Yandex Monitoring metric reference

Written by

Updated at October 1, 2024

CPU metrics
Disk metrics
Disk operation metrics
RAM metrics
Network metrics
Service metrics
Other metrics

This section describes Managed Service for ClickHouse® metrics delivered to Monitoring.

The name of the metric is written in the name label.

Common labels for all Managed Service for ClickHouse® metrics:

Label	Value
service	Service ID: `managed-clickhouse`
resource_type	Resource type: `cluster`
resource_id	Cluster ID
host	Host FQDN
node	Host type: `replica`, `follower`, or `leader`
subcluster_name	Subcluster type: `clickhouse_subcluster`, `zookeeper_subcluster`
shard	Shard ID

CPU metrics

Processor core workload.

Name Type, units	Description
`cpu.fraction` `DGAUGE`, %	Guaranteed vCPU share
`cpu.guarantee` `DGAUGE`, number	Guaranteed number of cores
`cpu.limit` `DGAUGE`, number	Limit on CPU cores in use
`cpu.guest` `DGAUGE`, %	CPU core usage, `guest` usage type
`cpu.idle` `DGAUGE`, %	CPU core usage, `idle` usage type
`cpu.iowait` `DGAUGE`, %	CPU core usage, `iowait` usage type
`cpu.irq` `DGAUGE`, %	CPU core usage, `irq` usage type
`cpu.nice` `DGAUGE`, %	CPU core usage, `nice` usage type
`cpu.softirq` `DGAUGE`, %	CPU core usage, `softirq` usage type
`cpu.steal` `DGAUGE`, %	CPU core usage, `steal` usage type
`cpu.system` `DGAUGE`, %	CPU core usage, `system` usage type
`cpu.user` `DGAUGE`, %	CPU core usage, `user` usage type
`load.avg_15min` `DGAUGE`, %	Average load over 15 minutes
`load.avg_1min` `DGAUGE`, %	Average load over 1 minute
`load.avg_5min` `DGAUGE`, %	Average load over 5 minutes

Disk metrics

Name Type, unit	Description
`ch_s3_disk_parts_size` `DGAUGE`, bytes	Space used by MergeTree table parts in Yandex Object Storage when Managed Service for ClickHouse® hybrid storage is configured.
`disk.free_bytes` `DGAUGE`, bytes	Free space
`disk.free_inodes` `DGAUGE`, number	Number of free inodes
`disk.total_bytes` `DGAUGE`, bytes	Available space
`disk.total_inodes` `DGAUGE`, number	Available inodes
`disk.used_bytes` `DGAUGE`, bytes	Used space
`disk.used_inodes` `DGAUGE`, number	Used inodes

Disk operation metrics

Name Type, units	Description
`io.avg_read_time` `DGAUGE`, ms	Average disk read time
`io.avg_write_time` `DGAUGE`, ms	Average disk write time
`io.disk*.avg_read_time` `DGAUGE`, ms	Average read time for a specific disk
`io.disk*.avg_write_time` `DGAUGE`, ms	Average write time for a specific disk
`io.disk*.read_bytes` `DGAUGE`, bytes per second	Read speed for a specific disk
`io.disk*.read_count` `DGAUGE`, operations per second	Read operations per second for a specific disk
`io.disk*.read_merged_count` `DGAUGE`, operations per second	Merged read operations per second for a specific disk
`io.disk*.utilization` `DGAUGE`, %	Utilization of a specific disk; disabled for network drives
`io.disk*.write_bytes` `DGAUGE`, bytes per second	Write speed for a specific disk
`io.disk*.write_count` `DGAUGE`, operations per second	Number of write operations per second for a specific disk
`io.disk*.write_merged_count` `DGAUGE`, operations per second	Number of merged write operations per second for a specific disk
`io.read_bytes` `DGAUGE`, bytes/s	Disk read speed
`io.read_count` `DGAUGE`, operations per second	Number of read operations per second
`io.read_merged_count` `DGAUGE`, operations per second	Number of merged read operations per second
`io.utilization` `DGAUGE`, %	Disk utilization
`io.write_bytes` `DGAUGE`, bytes/s	Disk write speed
`io.write_count` `DGAUGE`, operations per second	Number of write operations per second
`io.write_merged_count` `DGAUGE`, operations per second	Number of merged write operations per second

RAM metrics

Name Type, units	Description
`mem.guarantee_bytes` `DGAUGE`, bytes	Guaranteed memory
`mem.limit_bytes` `DGAUGE`, bytes	Memory limit
`mem.active_bytes` `DGAUGE`, bytes	Amount of RAM used most often and only freed up when absolutely necessary
`mem.available_bytes` `DGAUGE`, bytes	RAM usage, `available` usage type
`mem.buffers_bytes` `DGAUGE`, bytes	RAM usage, `buffers` usage type
`mem.cached_bytes` `DGAUGE`, bytes	RAM usage, `cached` usage type
`mem.free_bytes` `DGAUGE`, bytes	Amount of free RAM available, excluding `mem.buffers_bytes` and `mem.cached_bytes`
`mem.shared_bytes` `DGAUGE`, bytes	RAM usage, `shared` usage type
`mem.total_bytes` `DGAUGE`, bytes	RAM usage, `total` usage type
`mem.used_bytes` `DGAUGE`, bytes	Amount of RAM currently used by the running processes

Network metrics

Name Type, units	Description
`net.bytes_recv` `DGAUGE`, bytes/s	Rate of receiving data over the network
`net.bytes_sent` `DGAUGE`, bytes/s	Rate of sending data over the network
`net.dropin` `DGAUGE`, number	Packets dropped upon receipt
`net.dropout` `DGAUGE`, number	Packets dropped when being sent
`net.errin` `DGAUGE`, number	Number of errors upon receipt
`net.errout` `DGAUGE`, number	Number of errors at sending
`net.packets_recv` `DGAUGE`, packets per second	Rate of receiving packets over the network
`net.packets_sent` `DGAUGE`, packets per second	Rate of sending packets over the network

Service metrics

System event metrics

ClickHouse® native metrics from the system.events table.
For each metric, the increment (inc) and change rate per unit of time are calculated.

Name Type
`ch_system_events_ArenaAllocBytes_inc` `DGAUGE`
`ch_system_events_ArenaAllocBytes_rate` `DGAUGE`
`ch_system_events_ArenaAllocChunks_inc` `DGAUGE`
`ch_system_events_ArenaAllocChunks_rate` `DGAUGE`
`ch_system_events_BackgroundLoadingMarksTasks_inc` `DGAUGE`
`ch_system_events_BackgroundLoadingMarksTasks_rate` `DGAUGE`
`ch_system_events_CreatedHTTPConnections_inc` `DGAUGE`
`ch_system_events_CreatedHTTPConnections_rate` `DGAUGE`
`ch_system_events_CompileExpressionsBytes_inc` `DGAUGE`
`ch_system_events_CompileExpressionsBytes_rate` `DGAUGE`
`ch_system_events_CompileExpressionsMicroseconds_inc` `DGAUGE`
`ch_system_events_CompileExpressionsMicroseconds_rate` `DGAUGE`
`ch_system_events_CompileFunction_inc` `DGAUGE`
`ch_system_events_CompileFunction_rate` `DGAUGE`
`ch_system_events_CompressedReadBufferBlocks_inc` `DGAUGE`
`ch_system_events_CompressedReadBufferBlocks_rate` `DGAUGE`
`ch_system_events_CompressedReadBufferBytes_inc` `DGAUGE`
`ch_system_events_CompressedReadBufferBytes_rate` `DGAUGE`
`ch_system_events_ContextLock_inc` `DGAUGE`
`ch_system_events_ContextLock_rate` `DGAUGE`
`ch_system_events_ContextLockWaitMicroseconds_inc` `DGAUGE`
`ch_system_events_ContextLockWaitMicroseconds_rate` `DGAUGE`
`ch_system_events_CreatedReadBufferOrdinary_inc` `DGAUGE`
`ch_system_events_CreatedReadBufferOrdinary_rate` `DGAUGE`
`ch_system_events_DiskReadElapsedMicroseconds_inc` `DGAUGE`
`ch_system_events_DiskReadElapsedMicroseconds_rate` `DGAUGE`
`ch_system_events_DiskS3DeleteObjects_inc` `DGAUGE`
`ch_system_events_DiskS3DeleteObjects_rate` `DGAUGE`
`ch_system_events_DiskS3GetObject_inc` `DGAUGE`
`ch_system_events_DiskS3GetObject_rate` `DGAUGE`
`ch_system_events_DiskS3PutObject_inc` `DGAUGE`
`ch_system_events_DiskS3PutObject_rate` `DGAUGE`
`ch_system_events_DiskS3ReadMicroseconds_inc` `DGAUGE`
`ch_system_events_DiskS3ReadMicroseconds_rate` `DGAUGE`
`ch_system_events_DiskS3ReadRequestsCount_inc` `DGAUGE`
`ch_system_events_DiskS3ReadRequestsCount_rate` `DGAUGE`
`ch_system_events_DiskS3WriteMicroseconds_inc` `DGAUGE`
`ch_system_events_DiskS3WriteMicroseconds_rate` `DGAUGE`
`ch_system_events_DiskS3WriteRequestsCount_inc` `DGAUGE`
`ch_system_events_DiskS3WriteRequestsCount_rate` `DGAUGE`
`ch_system_events_DiskWriteElapsedMicroseconds_inc` `DGAUGE`
`ch_system_events_DiskWriteElapsedMicroseconds_rate` `DGAUGE`
`ch_system_events_FailedInsertQuery_inc` `DGAUGE`
`ch_system_events_FailedInsertQuery_rate` `DGAUGE`
`ch_system_events_FailedQuery_inc` `DGAUGE`
`ch_system_events_FailedQuery_rate` `DGAUGE`
`ch_system_events_FailedSelectQuery_inc` `DGAUGE`
`ch_system_events_FailedSelectQuery_rate` `DGAUGE`
`ch_system_events_FileOpen_inc` `DGAUGE`
`ch_system_events_FileOpen_rate` `DGAUGE`
`ch_system_events_FileSync_inc` `DGAUGE`
`ch_system_events_FileSync_rate` `DGAUGE`
`ch_system_events_FileSyncElapsedMicroseconds_inc` `DGAUGE`
`ch_system_events_FileSyncElapsedMicroseconds_rate` `DGAUGE`
`ch_system_events_FunctionExecute_inc` `DGAUGE`
`ch_system_events_FunctionExecute_rate` `DGAUGE`
`ch_system_events_HardPageFaults_inc` `DGAUGE`
`ch_system_events_HardPageFaults_rate` `DGAUGE`
`ch_system_events_IOBufferAllocBytes_inc` `DGAUGE`
`ch_system_events_IOBufferAllocBytes_rate` `DGAUGE`
`ch_system_events_IOBufferAllocs_inc` `DGAUGE`
`ch_system_events_IOBufferAllocs_rate` `DGAUGE`
`ch_system_events_LoadedMarksCount_inc` `DGAUGE`
`ch_system_events_LoadedMarksCount_rate` `DGAUGE`
`ch_system_events_LoadedMarksMemoryBytes_inc` `DGAUGE`
`ch_system_events_LoadedMarksMemoryBytes_rate` `DGAUGE`
`ch_system_events_LogDebug_inc` `DGAUGE`
`ch_system_events_LogDebug_rate` `DGAUGE`
`ch_system_events_LogError_inc` `DGAUGE`
`ch_system_events_LogError_rate` `DGAUGE`
`ch_system_events_LogInfo_inc` `DGAUGE`
`ch_system_events_LogInfo_rate` `DGAUGE`
`ch_system_events_LogWarning_inc` `DGAUGE`
`ch_system_events_LogWarning_rate` `DGAUGE`
`ch_system_events_InsertQueryTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_InsertQueryTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_InsertQuery_inc` `DGAUGE`
`ch_system_events_InsertQuery_rate` `DGAUGE`
`ch_system_events_InsertedBytes_inc` `DGAUGE`
`ch_system_events_InsertedCompactParts_inc` `DGAUGE`
`ch_system_events_InsertedCompactParts_rate` `DGAUGE`
`ch_system_events_InsertedBytes_rate` `DGAUGE`
`ch_system_events_InsertedRows_inc` `DGAUGE`
`ch_system_events_InsertedRows_rate` `DGAUGE`
`ch_system_events_MainConfigLoads_inc` `DGAUGE`
`ch_system_events_MainConfigLoads_rate` `DGAUGE`
`ch_system_events_MergeTreeDataWriterBlocksAlreadySorted_inc` `DGAUGE`
`ch_system_events_MergeTreeDataWriterBlocksAlreadySorted_rate` `DGAUGE`
`ch_system_events_MergeTreeDataWriterBlocks_inc` `DGAUGE`
`ch_system_events_MergeTreeDataWriterBlocks_rate` `DGAUGE`
`ch_system_events_MergeTreeDataWriterCompressedBytes_inc` `DGAUGE`
`ch_system_events_MergeTreeDataWriterCompressedBytes_rate` `DGAUGE`
`ch_system_events_MergeTreeDataWriterRows_inc` `DGAUGE`
`ch_system_events_MergeTreeDataWriterRows_rate` `DGAUGE`
`ch_system_events_MergeTreeDataWriterUncompressedBytes_inc` `DGAUGE`
`ch_system_events_MergeTreeDataWriterUncompressedBytes_rate` `DGAUGE`
`ch_system_events_Merge_inc` `DGAUGE`
`ch_system_events_Merge_rate` `DGAUGE`
`ch_system_events_MergedIntoCompactParts_inc` `DGAUGE`
`ch_system_events_MergedIntoCompactParts_rate` `DGAUGE`
`ch_system_events_MergedRows_inc` `DGAUGE`
`ch_system_events_MergedRows_rate` `DGAUGE`
`ch_system_events_MergedUncompressedBytes_inc` `DGAUGE`
`ch_system_events_MergedUncompressedBytes_rate` `DGAUGE`
`ch_system_events_MergesTimeMilliseconds_inc` `DGAUGE`
`ch_system_events_MergesTimeMilliseconds_rate` `DGAUGE`
`ch_system_events_NetworkReceiveBytes_inc` `DGAUGE`
`ch_system_events_NetworkReceiveBytes_rate` `DGAUGE`
`ch_system_events_NetworkReceiveElapsedMicroseconds_inc` `DGAUGE`
`ch_system_events_NetworkReceiveElapsedMicroseconds_rate` `DGAUGE`
`ch_system_events_NetworkSendBytes_inc` `DGAUGE`
`ch_system_events_NetworkSendBytes_rate` `DGAUGE`
`ch_system_events_NetworkSendElapsedMicroseconds_inc` `DGAUGE`
`ch_system_events_NetworkSendElapsedMicroseconds_rate` `DGAUGE`
`ch_system_events_OSCPUVirtualTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_OSCPUVirtualTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_OSCPUWaitMicroseconds_inc` `DGAUGE`
`ch_system_events_OSCPUWaitMicroseconds_rate` `DGAUGE`
`ch_system_events_OSIOWaitMicroseconds_inc` `DGAUGE`
`ch_system_events_OSIOWaitMicroseconds_rate` `DGAUGE`
`ch_system_events_OSReadBytes_inc` `DGAUGE`
`ch_system_events_OSReadBytes_rate` `DGAUGE`
`ch_system_events_OSReadChars_inc` `DGAUGE`
`ch_system_events_OSReadChars_rate` `DGAUGE`
`ch_system_events_OSWriteBytes_inc` `DGAUGE`
`ch_system_events_OSWriteBytes_rate` `DGAUGE`
`ch_system_events_OSWriteChars_inc` `DGAUGE`
`ch_system_events_OSWriteChars_rate` `DGAUGE`
`ch_system_events_OtherQueryTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_OtherQueryTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_PartsLockHoldMicroseconds_inc` `DGAUGE`
`ch_system_events_PartsLockHoldMicroseconds_rate` `DGAUGE`
`ch_system_events_PartsLockWaitMicroseconds_inc` `DGAUGE`
`ch_system_events_PartsLockWaitMicroseconds_rate` `DGAUGE`
`ch_system_events_QueriesWithSubqueries_inc` `DGAUGE`
`ch_system_events_QueriesWithSubqueries_rate` `DGAUGE`
`ch_system_events_OpenedFileCacheHits_inc` `DGAUGE`
`ch_system_events_OpenedFileCacheHits_rate` `DGAUGE`
`ch_system_events_OpenedFileCacheMisses_inc` `DGAUGE`
`ch_system_events_OpenedFileCacheMisses_rate` `DGAUGE`
`ch_system_events_QueryProfilerRuns_inc` `DGAUGE`
`ch_system_events_QueryProfilerRuns_rate` `DGAUGE`
`ch_system_events_QueryTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_QueryTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_Query_inc` `DGAUGE`
`ch_system_events_Query_rate` `DGAUGE`
`ch_system_events_RWLockAcquiredReadLocks_inc` `DGAUGE`
`ch_system_events_RWLockAcquiredReadLocks_rate` `DGAUGE`
`ch_system_events_RWLockReadersWaitMilliseconds_inc` `DGAUGE`
`ch_system_events_RWLockReadersWaitMilliseconds_rate` `DGAUGE`
`ch_system_events_S3DeleteObjects_inc` `DGAUGE`
`ch_system_events_S3DeleteObjects_rate` `DGAUGE`
`ch_system_events_S3GetObject_inc` `DGAUGE`
`ch_system_events_S3GetObject_rate` `DGAUGE`
`ch_system_events_S3PutObject_inc` `DGAUGE`
`ch_system_events_S3PutObject_rate` `DGAUGE`
`ch_system_events_S3ReadMicroseconds_inc` `DGAUGE`
`ch_system_events_S3ReadMicroseconds_rate` `DGAUGE`
`ch_system_events_S3ReadRequestsCount_inc` `DGAUGE`
`ch_system_events_S3ReadRequestsCount_rate` `DGAUGE`
`ch_system_events_S3WriteMicroseconds_inc` `DGAUGE`
`ch_system_events_S3WriteMicroseconds_rate` `DGAUGE`
`ch_system_events_S3WriteRequestsCount_inc` `DGAUGE`
`ch_system_events_S3WriteRequestsCount_rate` `DGAUGE`
`ch_system_events_ReadBufferFromFileDescriptorReadBytes_inc` `DGAUGE`
`ch_system_events_ReadBufferFromFileDescriptorReadBytes_rate` `DGAUGE`
`ch_system_events_ReadBufferFromS3Bytes_inc` `DGAUGE`
`ch_system_events_ReadBufferFromS3Bytes_rate` `DGAUGE`
`ch_system_events_ReadBufferFromS3InitMicroseconds_inc` `DGAUGE`
`ch_system_events_ReadBufferFromS3InitMicroseconds_rate` `DGAUGE`
`ch_system_events_ReadBufferFromS3Microseconds_inc` `DGAUGE`
`ch_system_events_ReadBufferFromS3Microseconds_rate` `DGAUGE`
`ch_system_events_ReadBufferFromS3PreservedSessions_inc` `DGAUGE`
`ch_system_events_ReadBufferFromS3PreservedSessions_rate` `DGAUGE`
`ch_system_events_ReadBufferFromFileDescriptorRead_inc` `DGAUGE`
`ch_system_events_ReadBufferFromFileDescriptorRead_rate` `DGAUGE`
`ch_system_events_ReadCompressedBytes_inc` `DGAUGE`
`ch_system_events_ReadCompressedBytes_rate` `DGAUGE`
`ch_system_events_RealTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_RealTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_RegexpCreated_inc` `DGAUGE`
`ch_system_events_RegexpCreated_rate` `DGAUGE`
`ch_system_events_RemoteFSBuffers_inc` `DGAUGE`
`ch_system_events_RemoteFSBuffers_rate` `DGAUGE`
`ch_system_events_RemoteFSSeeks_inc` `DGAUGE`
`ch_system_events_RemoteFSSeeks_rate` `DGAUGE`
`ch_system_events_RemoteFSSeeksWithReset_inc` `DGAUGE`
`ch_system_events_RemoteFSSeeksWithReset_rate` `DGAUGE`
`ch_system_events_RemoteFSUnprefetchedBytes_inc` `DGAUGE`
`ch_system_events_RemoteFSUnprefetchedBytes_rate` `DGAUGE`
`ch_system_events_RemoteFSUnprefetchedReads_inc` `DGAUGE`
`ch_system_events_RemoteFSUnprefetchedReads_rate` `DGAUGE`
`ch_system_events_Seek_inc` `DGAUGE`
`ch_system_events_Seek_rate` `DGAUGE`
`ch_system_events_SelectQueryTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_SelectQueryTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_ServerStartupMilliseconds_inc` `DGAUGE`
`ch_system_events_ServerStartupMilliseconds_rate` `DGAUGE`
`ch_system_events_SelectQuery_inc` `DGAUGE`
`ch_system_events_SelectQuery_rate` `DGAUGE`
`ch_system_events_SelectedBytes_inc` `DGAUGE`
`ch_system_events_SelectedBytes_rate` `DGAUGE`
`ch_system_events_SelectedRows_inc` `DGAUGE`
`ch_system_events_SelectedRows_rate` `DGAUGE`
`ch_system_events_SelectQueriesWithSubqueries_inc` `DGAUGE`
`ch_system_events_SelectQueriesWithSubqueries_rate` `DGAUGE`
`ch_system_events_SoftPageFaults_inc` `DGAUGE`
`ch_system_events_SoftPageFaults_rate` `DGAUGE`
`ch_system_events_SynchronousRemoteReadWaitMicroseconds_inc` `DGAUGE`
`ch_system_events_SynchronousRemoteReadWaitMicroseconds_rate` `DGAUGE`
`ch_system_events_SystemTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_SystemTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_UserTimeMicroseconds_inc` `DGAUGE`
`ch_system_events_UserTimeMicroseconds_rate` `DGAUGE`
`ch_system_events_WaitMarksLoadMicroseconds_inc` `DGAUGE`
`ch_system_events_WaitMarksLoadMicroseconds_rate` `DGAUGE`
`ch_system_events_WriteBufferFromFileDescriptorWrite_inc` `DGAUGE`
`ch_system_events_WriteBufferFromFileDescriptorWrite_rate` `DGAUGE`
`ch_system_events_WriteBufferFromFileDescriptorWriteBytes_inc` `DGAUGE`
`ch_system_events_WriteBufferFromFileDescriptorWriteBytes_rate` `DGAUGE`
`ch_system_events_WriteBufferFromS3Bytes_inc` `DGAUGE`
`ch_system_events_WriteBufferFromS3Bytes_rate` `DGAUGE`
`ch_system_events_WriteBufferFromS3Microseconds_inc` `DGAUGE`
`ch_system_events_WriteBufferFromS3Microseconds_rate` `DGAUGE`

Current event metrics

ClickHouse® native metrics from the system.metrics table.

Name Type
`ch_system_metrics_ActiveTimersInQueryProfiler` `DGAUGE`
`ch_system_metrics_AggregatorThreads` `DGAUGE`
`ch_system_metrics_AggregatorThreadsActive` `DGAUGE`
`ch_system_metrics_AsynchronousInsertThreads` `DGAUGE`
`ch_system_metrics_AsynchronousInsertThreadsActive` `DGAUGE`
`ch_system_metrics_AsynchronousReadWait` `DGAUGE`
`ch_system_metrics_AsyncInsertCacheSize` `DGAUGE`
`ch_system_metrics_BackgroundBufferFlushSchedulePoolSize` `DGAUGE`
`ch_system_metrics_BackgroundBufferFlushSchedulePoolTask` `DGAUGE`
`ch_system_metrics_BackgroundCommonPoolSize` `DGAUGE`
`ch_system_metrics_BackgroundCommonPoolTask` `DGAUGE`
`ch_system_metrics_BackgroundDistributedSchedulePoolSize` `DGAUGE`
`ch_system_metrics_BackgroundDistributedSchedulePoolTask` `DGAUGE`
`ch_system_metrics_BackgroundFetchesPoolSize` `DGAUGE`
`ch_system_metrics_BackgroundFetchesPoolTask` `DGAUGE`
`ch_system_metrics_BackgroundMergesAndMutationsPoolSize` `DGAUGE`
`ch_system_metrics_BackgroundMergesAndMutationsPoolTask` `DGAUGE`
`ch_system_metrics_BackgroundMessageBrokerSchedulePoolSize` `DGAUGE`
`ch_system_metrics_BackgroundMessageBrokerSchedulePoolTask` `DGAUGE`
`ch_system_metrics_BackgroundMovePoolSize` `DGAUGE`
`ch_system_metrics_BackgroundMovePoolTask` `DGAUGE`
`ch_system_metrics_BackgroundSchedulePoolSize` `DGAUGE`
`ch_system_metrics_BackgroundSchedulePoolTask` `DGAUGE`
`ch_system_metrics_BackgroundSchedulePoolTask` `DGAUGE`
`ch_system_metrics_BackupsIOThreads` `DGAUGE`
`ch_system_metrics_BackupsIOThreadsActive` `DGAUGE`
`ch_system_metrics_BackupsThreads` `DGAUGE`
`ch_system_metrics_BackupsThreadsActive` `DGAUGE`
`ch_system_metrics_BrokenDistributedFilesToInsert` `DGAUGE`
`ch_system_metrics_BrokenDistributedFilesToInsert` `DGAUGE`
`ch_system_metrics_CacheDetachedFileSegments` `DGAUGE`
`ch_system_metrics_CacheDictionaryThreads` `DGAUGE`
`ch_system_metrics_CacheDictionaryThreadsActive` `DGAUGE`
`ch_system_metrics_CacheDictionaryUpdateQueueBatches` `DGAUGE`
`ch_system_metrics_CacheDictionaryUpdateQueueKeys` `DGAUGE`
`ch_system_metrics_CacheFileSegments` `DGAUGE`
`ch_system_metrics_Connection` `DGAUGE`
`ch_system_metrics_ContextLockWait` `DGAUGE`
`ch_system_metrics_CreatedTimersInQueryProfiler` `DGAUGE`
`ch_system_metrics_DatabaseCatalogThreads` `DGAUGE`
`ch_system_metrics_DatabaseCatalogThreadsActive` `DGAUGE`
`ch_system_metrics_DatabaseOnDiskThreads` `DGAUGE`
`ch_system_metrics_DatabaseOnDiskThreadsActive` `DGAUGE`
`ch_system_metrics_DatabaseOrdinaryThreads` `DGAUGE`
`ch_system_metrics_DatabaseOrdinaryThreadsActive` `DGAUGE`
`ch_system_metrics_DDLWorkerThreads` `DGAUGE`
`ch_system_metrics_DDLWorkerThreadsActive` `DGAUGE`
`ch_system_metrics_DelayedInserts` `DGAUGE`
`ch_system_metrics_DestroyAggregatesThreads` `DGAUGE`
`ch_system_metrics_DestroyAggregatesThreadsActive` `DGAUGE`
`ch_system_metrics_DictCacheRequests` `DGAUGE`
`ch_system_metrics_DiskObjectStorageAsyncThreads` `DGAUGE`
`ch_system_metrics_DiskObjectStorageAsyncThreadsActive` `DGAUGE`
`ch_system_metrics_DiskSpaceReservedForMerge` `DGAUGE`
`ch_system_metrics_DistributedBytesToInsert` `DGAUGE`
`ch_system_metrics_DistributedFilesToInsert` `DGAUGE`
`ch_system_metrics_DistributedInsertThreads` `DGAUGE`
`ch_system_metrics_DistributedInsertThreadsActive` `DGAUGE`
`ch_system_metrics_DistributedSend` `DGAUGE`
`ch_system_metrics_EphemeralNode` `DGAUGE`
`ch_system_metrics_FilesystemCacheDelayedCleanupElements` `DGAUGE`
`ch_system_metrics_FilesystemCacheDownloadQueueElements` `DGAUGE`
`ch_system_metrics_FilesystemCacheElements` `DGAUGE`
`ch_system_metrics_FilesystemCacheReadBuffers` `DGAUGE`
`ch_system_metrics_FilesystemCacheSize` `DGAUGE`
`ch_system_metrics_FilesystemCacheSizeLimit` `DGAUGE`
`ch_system_metrics_GlobalThread` `DGAUGE`
`ch_system_metrics_GlobalThreadActive` `DGAUGE`
`ch_system_metrics_HashedDictionaryThreads` `DGAUGE`
`ch_system_metrics_HashedDictionaryThreadsActive` `DGAUGE`
`ch_system_metrics_HTTPConnection` `DGAUGE`
`ch_system_metrics_IDiskCopierThreads` `DGAUGE`
`ch_system_metrics_IDiskCopierThreadsActive` `DGAUGE`
`ch_system_metrics_InterserverConnection` `DGAUGE`
`ch_system_metrics_IOPrefetchThreads` `DGAUGE`
`ch_system_metrics_IOPrefetchThreadsActive` `DGAUGE`
`ch_system_metrics_IOThreads` `DGAUGE`
`ch_system_metrics_IOThreadsActive` `DGAUGE`
`ch_system_metrics_IOUringInFlightEvents` `DGAUGE`
`ch_system_metrics_IOUringPendingEvents` `DGAUGE`
`ch_system_metrics_IOWriterThreads` `DGAUGE`
`ch_system_metrics_IOWriterThreadsActive` `DGAUGE`
`ch_system_metrics_KafkaAssignedPartitions` `DGAUGE`
`ch_system_metrics_KafkaBackgroundReads` `DGAUGE`
`ch_system_metrics_KafkaConsumers` `DGAUGE`
`ch_system_metrics_KafkaConsumersInUse` `DGAUGE`
`ch_system_metrics_KafkaConsumersWithAssignment` `DGAUGE`
`ch_system_metrics_KafkaLibrdkafkaThreads` `DGAUGE`
`ch_system_metrics_KafkaProducers` `DGAUGE`
`ch_system_metrics_KafkaWrites` `DGAUGE`
`ch_system_metrics_KeeperAliveConnections` `DGAUGE`
`ch_system_metrics_KeeperOutstandingRequets` `DGAUGE`
`ch_system_metrics_LocalThread` `DGAUGE`
`ch_system_metrics_LocalThreadActive` `DGAUGE`
`ch_system_metrics_MarksLoaderThreads` `DGAUGE`
`ch_system_metrics_MarksLoaderThreadsActive` `DGAUGE`
`ch_system_metrics_MaxDDLEntryID` `DGAUGE`
`ch_system_metrics_MaxPushedDDLEntryID` `DGAUGE`
`ch_system_metrics_MemoryTracking` `DGAUGE`
`ch_system_metrics_Merge` `DGAUGE`
`ch_system_metrics_MergesMutationsMemoryTracking` `DGAUGE`
`ch_system_metrics_MergeTreeAllRangesAnnouncementsSent` `DGAUGE`
`ch_system_metrics_MergeTreeBackgroundExecutorThreads` `DGAUGE`
`ch_system_metrics_MergeTreeBackgroundExecutorThreadsActive` `DGAUGE`
`ch_system_metrics_MergeTreeDataSelectExecutorThreads` `DGAUGE`
`ch_system_metrics_MergeTreeDataSelectExecutorThreadsActive` `DGAUGE`
`ch_system_metrics_MergeTreeOutdatedPartsLoaderThreads` `DGAUGE`
`ch_system_metrics_MergeTreeOutdatedPartsLoaderThreadsActive` `DGAUGE`
`ch_system_metrics_MergeTreePartsCleanerThreads` `DGAUGE`
`ch_system_metrics_MergeTreePartsCleanerThreadsActive` `DGAUGE`
`ch_system_metrics_MergeTreePartsLoaderThreads` `DGAUGE`
`ch_system_metrics_MergeTreePartsLoaderThreadsActive` `DGAUGE`
`ch_system_metrics_MergeTreeReadTaskRequestsSent` `DGAUGE`
`ch_system_metrics_MMappedAllocBytes` `DGAUGE`
`ch_system_metrics_MMappedAllocs` `DGAUGE`
`ch_system_metrics_MMappedFileBytes` `DGAUGE`
`ch_system_metrics_MMappedFiles` `DGAUGE`
`ch_system_metrics_Move` `DGAUGE`
`ch_system_metrics_MySQLConnection` `DGAUGE`
`ch_system_metrics_NetworkReceive` `DGAUGE`
`ch_system_metrics_NetworkSend` `DGAUGE`
`ch_system_metrics_ObjectStorageAzureThreads` `DGAUGE`
`ch_system_metrics_ObjectStorageAzureThreadsActive` `DGAUGE`
`ch_system_metrics_ObjectStorageS3Threads` `DGAUGE`
`ch_system_metrics_ObjectStorageS3ThreadsActive` `DGAUGE`
`ch_system_metrics_OpenFileForRead` `DGAUGE`
`ch_system_metrics_OpenFileForWrite` `DGAUGE`
`ch_system_metrics_OutdatedPartsLoadingThreads` `DGAUGE`
`ch_system_metrics_OutdatedPartsLoadingThreadsActive` `DGAUGE`
`ch_system_metrics_ParallelFormattingOutputFormatThreads` `DGAUGE`
`ch_system_metrics_ParallelFormattingOutputFormatThreadsActive` `DGAUGE`
`ch_system_metrics_ParallelParsingInputFormatThreads` `DGAUGE`
`ch_system_metrics_ParallelParsingInputFormatThreadsActive` `DGAUGE`
`ch_system_metrics_ParquetDecoderThreads` `DGAUGE`
`ch_system_metrics_ParquetDecoderThreadsActive` `DGAUGE`
`ch_system_metrics_ParquetEncoderThreads` `DGAUGE`
`ch_system_metrics_ParquetEncoderThreadsActive` `DGAUGE`
`ch_system_metrics_PartMutation` `DGAUGE`
`ch_system_metrics_PartsActive` `DGAUGE`
`ch_system_metrics_PartsCommitted` `DGAUGE`
`ch_system_metrics_PartsCompact` `DGAUGE`
`ch_system_metrics_PartsDeleteOnDestroy` `DGAUGE`
`ch_system_metrics_PartsDeleting` `DGAUGE`
`ch_system_metrics_PartsInMemory` `DGAUGE`
`ch_system_metrics_PartsOutdated` `DGAUGE`
`ch_system_metrics_PartsPreActive` `DGAUGE`
`ch_system_metrics_PartsPreCommitted` `DGAUGE`
`ch_system_metrics_PartsTemporary` `DGAUGE`
`ch_system_metrics_PartsWide` `DGAUGE`
`ch_system_metrics_PendingAsyncInsert` `DGAUGE`
`ch_system_metrics_PostgreSQLConnection` `DGAUGE`
`ch_system_metrics_Query` `DGAUGE`
`ch_system_metrics_QueryPipelineExecutorThreads` `DGAUGE`
`ch_system_metrics_QueryPipelineExecutorThreadsActive` `DGAUGE`
`ch_system_metrics_QueryPreempted` `DGAUGE`
`ch_system_metrics_QueryThread` `DGAUGE`
`ch_system_metrics_Read` `DGAUGE`
`ch_system_metrics_ReadonlyReplica` `DGAUGE`
`ch_system_metrics_ReadTaskRequestsSent` `DGAUGE`
`ch_system_metrics_RemoteRead` `DGAUGE`
`ch_system_metrics_ReplicatedChecks` `DGAUGE`
`ch_system_metrics_ReplicatedFetch` `DGAUGE`
`ch_system_metrics_ReplicatedSend` `DGAUGE`
`ch_system_metrics_RestartReplicaThreads` `DGAUGE`
`ch_system_metrics_RestartReplicaThreadsActive` `DGAUGE`
`ch_system_metrics_RestoreThreads` `DGAUGE`
`ch_system_metrics_RestoreThreadsActive` `DGAUGE`
`ch_system_metrics_Revision` `DGAUGE`
`ch_system_metrics_RWLockActiveReaders` `DGAUGE`
`ch_system_metrics_RWLockActiveTotal` `DGAUGE`
`ch_system_metrics_RWLockActiveWriters` `DGAUGE`
`ch_system_metrics_RWLockWaitingReaders` `DGAUGE`
`ch_system_metrics_RWLockWaitingTotal` `DGAUGE`
`ch_system_metrics_RWLockWaitingWriters` `DGAUGE`
`ch_system_metrics_S3Requests` `DGAUGE`
`ch_system_metrics_SendExternalTables` `DGAUGE`
`ch_system_metrics_SendScalars` `DGAUGE`
`ch_system_metrics_StartupSystemTablesThreads` `DGAUGE`
`ch_system_metrics_StartupSystemTablesThreadsActive` `DGAUGE`
`ch_system_metrics_StorageBufferBytes` `DGAUGE`
`ch_system_metrics_StorageBufferRows` `DGAUGE`
`ch_system_metrics_StorageDistributedThreads` `DGAUGE`
`ch_system_metrics_StorageDistributedThreadsActive` `DGAUGE`
`ch_system_metrics_StorageHiveThreads` `DGAUGE`
`ch_system_metrics_StorageHiveThreadsActive` `DGAUGE`
`ch_system_metrics_StorageS3Threads` `DGAUGE`
`ch_system_metrics_StorageS3ThreadsActive` `DGAUGE`
`ch_system_metrics_SystemReplicasThreads` `DGAUGE`
`ch_system_metrics_SystemReplicasThreadsActive` `DGAUGE`
`ch_system_metrics_TablesLoaderThreads` `DGAUGE`
`ch_system_metrics_TablesLoaderThreadsActive` `DGAUGE`
`ch_system_metrics_TablesToDropQueueSize` `DGAUGE`
`ch_system_metrics_TCPConnection` `DGAUGE`
`ch_system_metrics_TemporaryFilesForAggregation` `DGAUGE`
`ch_system_metrics_TemporaryFilesForJoin` `DGAUGE`
`ch_system_metrics_TemporaryFilesForSort` `DGAUGE`
`ch_system_metrics_TemporaryFilesUnknown` `DGAUGE`
`ch_system_metrics_ThreadPoolFSReaderThreads` `DGAUGE`
`ch_system_metrics_ThreadPoolFSReaderThreadsActive` `DGAUGE`
`ch_system_metrics_ThreadPoolRemoteFSReaderThreads` `DGAUGE`
`ch_system_metrics_ThreadPoolRemoteFSReaderThreadsActive` `DGAUGE`
`ch_system_metrics_ThreadsInOvercommitTracker` `DGAUGE`
`ch_system_metrics_TotalTemporaryFiles` `DGAUGE`
`ch_system_metrics_VersionInteger` `DGAUGE`
`ch_system_metrics_Write` `DGAUGE`
`ch_system_metrics_ZooKeeperRequest` `DGAUGE`
`ch_system_metrics_ZooKeeperSession` `DGAUGE`
`ch_system_metrics_ZooKeeperWatch` `DGAUGE`

Query queue metrics

ClickHouse® native metrics from the system.query_log table.
For each metric, the increment per unit of time (second) is calculated.

Name Type
`ch_system_query_log_insert_requests_inc` `DGAUGE`
`ch_system_query_log_read_bytes_inc` `DGAUGE`
`ch_system_query_log_read_rows_inc` `DGAUGE`
`ch_system_query_log_requests_inc` `DGAUGE`
`ch_system_query_log_result_bytes_inc` `DGAUGE`
`ch_system_query_log_result_rows_inc` `DGAUGE`
`ch_system_query_log_select_requests_inc` `DGAUGE`
`ch_system_query_log_written_bytes_inc` `DGAUGE`
`ch_system_query_log_written_rows_inc` `DGAUGE`

Replication metrics

Name Type, units	Description
`ch_replication-future_parts` `DGAUGE`, number	Number of data parts after MERGE and INSERT operations are completed
`ch_replication-inserts_in_queue` `DGAUGE`, number	Number of enqueued data parts to be inserted
`ch_replication-is_alive` `DGAUGE`, 0/1	Replication performance indicator. `1` if DB replication is alive, `0` if it is not.
`ch_replication-max_absolute_delay` `DGAUGE`, seconds	Maximum replication delay
`ch_replication-merges_in_queue` `DGAUGE`, number	Merges enqueued
`ch_replication-parts_to_check` `DGAUGE`, number	Number of data parts to be checked
`ch_replication-queue_size` `DGAUGE`, number	Merge and insert queue size
`ch_replication-tables` `DGAUGE`, number	Number of replicated tables

System metrics

Name Type, units	Description
`ch_config_merge_tree_parts_to_throw_insert` `DGAUGE`, number	Threshold value of active table data parts for ClickHouse® to throw a `Too many parts ...` exception if exceeded. Set in the settings. It pays to analyze it along with the `ch_system_async_metrics_MaxPartCountForPartition` metric.
`ch_local_disk_parts_size` `DGAUGE`, bytes	Local disk partition size
`ch_system_async_metrics_MaxPartCountForPartition` `DGAUGE`, number	Maximum number of data parts per partition
`ch_system_async_metrics_NumberOfDatabases` `DGAUGE`, number	Total number of databases on the server
`ch_system_async_metrics_NumberOfTables` `DGAUGE`, number	Total number of tables across all databases on the server, excluding those databases that cannot contain MergeTree tables. Excluded database engines are those that generate a set of tables on the fly, such as Lazy, MySQL®, PostgreSQL, and SQLite.
`ch_system_async_metrics_NumberOfTablesSystem` `DGAUGE`, number	Total number of system database tables stored as MergeTree tables on the server
`ch_system_async_metrics_ReplicasMaxAbsoluteDelay` `DGAUGE`, seconds	Maximum replication delay
`ch_system_async_metrics_ReplicasMaxInsertsInQueue` `DGAUGE`, number	Maximum number of queued (still subject to replication) insert operations in the replicated tables
`ch_system_async_metrics_ReplicasMaxMergesInQueue` `DGAUGE`, number	Maximum number of queued merge operations (to be applied yet) for the replicated tables
`ch_system_async_metrics_ReplicasMaxQueueSize` `DGAUGE`, number	Maximum replication queue size
`ch_system_async_metrics_ReplicasMaxRelativeDelay` `DGAUGE`, seconds	Maximum difference between the replica delay and the delay of the most recent replica of the same table in different replicated tables
`ch_system_async_metrics_ReplicasSumInsertsInQueue` `DGAUGE`, number	Total number of queued (still subject to replication) insert operations for the replicated tables
`ch_system_async_metrics_ReplicasSumMergesInQueue` `DGAUGE`, number	Total number of queued merge operations (to be applied yet) across the replicated tables
`ch_system_async_metrics_ReplicasSumQueueSize` `DGAUGE`, bytes	Total number of queued operations (e.g., fetch, merge) across the replicated tables
`ch_system_async_metrics_TotalBytesOfMergeTreeTables` `DGAUGE`, bytes	Total number of compressed bytes (including data and indexes) across all MergeTree tables
`ch_system_async_metrics_TotalBytesOfMergeTreeTablesSystem` `DGAUGE`, bytes	Total number of compressed bytes (including data and indexes) in MergeTree tables within the system database
`ch_system_async_metrics_TotalPartsOfMergeTreeTables` `DGAUGE`, number	Total number of data parts across all MergeTree tables. Values greater than 10,000 will impact the server startup time and may indicate a bad choice of partition key.
`ch_system_async_metrics_TotalPartsOfMergeTreeTablesSystem` `DGAUGE`, number	Total number of data parts in MergeTree tables within the system database
`ch_system_async_metrics_TotalRowsOfMergeTreeTables` `DGAUGE`, number	Total number of strings (records) across all MergeTree tables
`ch_system_async_metrics_TotalRowsOfMergeTreeTablesSystem` `DGAUGE`, number	Total number of strings (records) in MergeTree tables within the system database
`ch_system_async_metrics_Uptime` `DGAUGE`, seconds	Total server uptime in seconds. Includes the server initialization time before it starts accepting connections.

Other metrics

Name Type, units	Description
`can_read` `DGAUGE`, 0/1	Read access indicator. `1` if a cluster is available for reads, `0` if it is not.
`can_write` `DGAUGE`, 0/1	Write access indicator. `1` if a cluster is available for writes, `0` if it is not.
`is_alive` `DGAUGE`, 0/1	Host health indicator. `1` if a DB host is alive, `0` if it is not.

For more information, see Monitoring the state of ClickHouse® clusters and hosts.

ClickHouse® is a registered trademark of ClickHouse, Inc.

Yandex Monitoring metric reference

CPU metricsCPU metrics

Disk metricsDisk metrics

Disk operation metricsDisk operation metrics

RAM metricsRAM metrics

Network metricsNetwork metrics

Service metricsService metrics

System event metricsSystem event metrics

Current event metricsCurrent event metrics

Query queue metricsQuery queue metrics

Replication metricsReplication metrics

System metricsSystem metrics

Other metricsOther metrics

Was the article helpful?