Managed Service for ClickHouse API, REST: Cluster.UpdateShard
- HTTP request
- Path parameters
- Body parameters
- ShardConfigSpec
- Clickhouse
- ClickhouseConfig
- AccessControlImprovements
- MergeTree
- Compression
- ExternalDictionary
- Structure
- Id
- Key
- Attribute
- Layout
- Range
- HttpSource
- Header
- MysqlSource
- Replica
- ClickhouseSource
- MongodbSource
- PostgresqlSource
- GraphiteRollup
- Pattern
- Retention
- Kafka
- KafkaTopic
- Rabbitmq
- QueryMaskingRule
- QueryCache
- JdbcBridge
- Macro
- Resources
- DiskSizeAutoscaling
- Response
- UpdateClusterShardMetadata
- Status
- Shard
- ShardConfig
- Clickhouse
- ClickhouseConfigSet
- ClickhouseConfig
- AccessControlImprovements
- MergeTree
- Compression
- ExternalDictionary
- Structure
- Id
- Key
- Attribute
- Layout
- Range
- HttpSource
- Header
- MysqlSource
- Replica
- ClickhouseSource
- MongodbSource
- PostgresqlSource
- GraphiteRollup
- Pattern
- Retention
- Kafka
- KafkaTopic
- Rabbitmq
- QueryMaskingRule
- QueryCache
- JdbcBridge
- Macro
- Resources
- DiskSizeAutoscaling
Modifies the specified shard.
HTTP request
PATCH https://mdb.api.yandexcloud.kz/managed-clickhouse/v1/clusters/{clusterId}/shards/{shardName}
Path parameters
|
Field |
Description |
|
clusterId |
string Required field. ID of the ClickHouse cluster the shard belongs to. |
|
shardName |
string Required field. Name of the shard to be updated. |
Body parameters
{
"updateMask": "string",
"configSpec": {
"clickhouse": {
"config": {
"backgroundPoolSize": "string",
"backgroundMergesMutationsConcurrencyRatio": "string",
"backgroundSchedulePoolSize": "string",
"backgroundFetchesPoolSize": "string",
"backgroundMovePoolSize": "string",
"backgroundDistributedSchedulePoolSize": "string",
"backgroundBufferFlushSchedulePoolSize": "string",
"backgroundMessageBrokerSchedulePoolSize": "string",
"backgroundCommonPoolSize": "string",
"dictionariesLazyLoad": "boolean",
"logLevel": "string",
"queryLogRetentionSize": "string",
"queryLogRetentionTime": "string",
"queryThreadLogEnabled": "boolean",
"queryThreadLogRetentionSize": "string",
"queryThreadLogRetentionTime": "string",
"partLogRetentionSize": "string",
"partLogRetentionTime": "string",
"metricLogEnabled": "boolean",
"metricLogRetentionSize": "string",
"metricLogRetentionTime": "string",
"traceLogEnabled": "boolean",
"traceLogRetentionSize": "string",
"traceLogRetentionTime": "string",
"textLogEnabled": "boolean",
"textLogRetentionSize": "string",
"textLogRetentionTime": "string",
"textLogLevel": "string",
"opentelemetrySpanLogEnabled": "boolean",
"opentelemetrySpanLogRetentionSize": "string",
"opentelemetrySpanLogRetentionTime": "string",
"queryViewsLogEnabled": "boolean",
"queryViewsLogRetentionSize": "string",
"queryViewsLogRetentionTime": "string",
"asynchronousMetricLogEnabled": "boolean",
"asynchronousMetricLogRetentionSize": "string",
"asynchronousMetricLogRetentionTime": "string",
"sessionLogEnabled": "boolean",
"sessionLogRetentionSize": "string",
"sessionLogRetentionTime": "string",
"zookeeperLogEnabled": "boolean",
"zookeeperLogRetentionSize": "string",
"zookeeperLogRetentionTime": "string",
"asynchronousInsertLogEnabled": "boolean",
"asynchronousInsertLogRetentionSize": "string",
"asynchronousInsertLogRetentionTime": "string",
"processorsProfileLogEnabled": "boolean",
"processorsProfileLogRetentionSize": "string",
"processorsProfileLogRetentionTime": "string",
"errorLogEnabled": "boolean",
"errorLogRetentionSize": "string",
"errorLogRetentionTime": "string",
"accessControlImprovements": {
"selectFromSystemDbRequiresGrant": "boolean",
"selectFromInformationSchemaRequiresGrant": "boolean"
},
"maxConnections": "string",
"maxConcurrentQueries": "string",
"maxTableSizeToDrop": "string",
"maxPartitionSizeToDrop": "string",
"keepAliveTimeout": "string",
"uncompressedCacheSize": "string",
"markCacheSize": "string",
"timezone": "string",
"geobaseEnabled": "boolean",
"geobaseUri": "string",
"defaultDatabase": "string",
"totalMemoryProfilerStep": "string",
"totalMemoryTrackerSampleProbability": "number",
"asyncInsertThreads": "string",
"backupThreads": "string",
"restoreThreads": "string",
"mergeTree": {
"partsToDelayInsert": "string",
"partsToThrowInsert": "string",
"inactivePartsToDelayInsert": "string",
"inactivePartsToThrowInsert": "string",
"maxAvgPartSizeForTooManyParts": "string",
"maxPartsInTotal": "string",
"maxReplicatedMergesInQueue": "string",
"numberOfFreeEntriesInPoolToLowerMaxSizeOfMerge": "string",
"numberOfFreeEntriesInPoolToExecuteMutation": "string",
"maxBytesToMergeAtMinSpaceInPool": "string",
"maxBytesToMergeAtMaxSpaceInPool": "string",
"minBytesForWidePart": "string",
"minRowsForWidePart": "string",
"cleanupDelayPeriod": "string",
"maxCleanupDelayPeriod": "string",
"mergeSelectingSleepMs": "string",
"maxMergeSelectingSleepMs": "string",
"minAgeToForceMergeSeconds": "string",
"minAgeToForceMergeOnPartitionOnly": "boolean",
"mergeMaxBlockSize": "string",
"deduplicateMergeProjectionMode": "string",
"lightweightMutationProjectionMode": "string",
"replicatedDeduplicationWindow": "string",
"replicatedDeduplicationWindowSeconds": "string",
"fsyncAfterInsert": "boolean",
"fsyncPartDirectory": "boolean",
"minCompressedBytesToFsyncAfterFetch": "string",
"minCompressedBytesToFsyncAfterMerge": "string",
"minRowsToFsyncAfterMerge": "string",
"ttlOnlyDropParts": "boolean",
"mergeWithTtlTimeout": "string",
"mergeWithRecompressionTtlTimeout": "string",
"maxNumberOfMergesWithTtlInPool": "string",
"materializeTtlRecalculateOnly": "boolean",
"checkSampleColumnIsCorrect": "boolean",
"allowRemoteFsZeroCopyReplication": "boolean"
},
"compression": [
{
"method": "string",
"minPartSize": "string",
"minPartSizeRatio": "string",
"level": "string"
}
],
"dictionaries": [
{
"name": "string",
"structure": {
"id": {
"name": "string"
},
"key": {
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"rangeMin": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"rangeMax": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"layout": {
"type": "string",
"sizeInCells": "string",
"allowReadExpiredKeys": "boolean",
"maxUpdateQueueSize": "string",
"updateQueuePushTimeoutMilliseconds": "string",
"queryWaitTimeoutMilliseconds": "string",
"maxThreadsForUpdates": "string",
"initialArraySize": "string",
"maxArraySize": "string",
"accessToKeyFromAttributes": "boolean"
},
// Includes only one of the fields `fixedLifetime`, `lifetimeRange`
"fixedLifetime": "string",
"lifetimeRange": {
"min": "string",
"max": "string"
},
// end of the list of possible fields
// Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`
"httpSource": {
"url": "string",
"format": "string",
"headers": [
{
"name": "string",
"value": "string"
}
]
},
"mysqlSource": {
"db": "string",
"table": "string",
"port": "string",
"user": "string",
"password": "string",
"replicas": [
{
"host": "string",
"priority": "string",
"port": "string",
"user": "string",
"password": "string"
}
],
"where": "string",
"invalidateQuery": "string",
"closeConnection": "boolean",
"shareConnection": "boolean"
},
"clickhouseSource": {
"db": "string",
"table": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"where": "string",
"secure": "boolean"
},
"mongodbSource": {
"db": "string",
"collection": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"options": "string"
},
"postgresqlSource": {
"db": "string",
"table": "string",
"hosts": [
"string"
],
"port": "string",
"user": "string",
"password": "string",
"invalidateQuery": "string",
"sslMode": "string"
}
// end of the list of possible fields
}
],
"graphiteRollup": [
{
"name": "string",
"patterns": [
{
"regexp": "string",
"function": "string",
"retention": [
{
"age": "string",
"precision": "string"
}
]
}
],
"pathColumnName": "string",
"timeColumnName": "string",
"valueColumnName": "string",
"versionColumnName": "string"
}
],
"kafka": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
},
"kafkaTopics": [
{
"name": "string",
"settings": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
}
}
],
"rabbitmq": {
"username": "string",
"password": "string",
"vhost": "string"
},
"queryMaskingRules": [
{
"name": "string",
"regexp": "string",
"replace": "string"
}
],
"queryCache": {
"maxSizeInBytes": "string",
"maxEntries": "string",
"maxEntrySizeInBytes": "string",
"maxEntrySizeInRows": "string"
},
"jdbcBridge": {
"host": "string",
"port": "string"
},
"mysqlProtocol": "boolean",
"customMacros": [
{
"name": "string",
"value": "string"
}
],
"builtinDictionariesReloadInterval": "string"
},
"resources": {
"resourcePresetId": "string",
"diskSize": "string",
"diskTypeId": "string"
},
"weight": "string",
"diskSizeAutoscaling": {
"plannedUsageThreshold": "string",
"emergencyUsageThreshold": "string",
"diskSizeLimit": "string"
}
}
}
}
|
Field |
Description |
|
updateMask |
string (field-mask) A comma-separated names off ALL fields to be updated. If |
|
configSpec |
New configuration for the specified shard. |
ShardConfigSpec
|
Field |
Description |
|
clickhouse |
ClickHouse configuration for a shard. |
Clickhouse
|
Field |
Description |
|
config |
ClickHouse settings for the shard. |
|
resources |
Computational resources for the shard. |
|
weight |
string (int64) Relative weight of the shard considered when writing data to the cluster. |
|
diskSizeAutoscaling |
Disk size autoscaling settings. |
ClickhouseConfig
ClickHouse configuration settings. Supported settings are a subset of settings described
in ClickHouse documentation
|
Field |
Description |
|
backgroundPoolSize |
string (int64) Sets the number of threads performing background merges and mutations for MergeTree-engine tables. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundMergesMutationsConcurrencyRatio |
string (int64) Sets a ratio between the number of threads and the number of background merges and mutations that can be executed concurrently. For example, if the ratio equals to 2 and background_pool_size is set to 16 then ClickHouse can execute 32 background merges concurrently. Default value: 2. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundSchedulePoolSize |
string (int64) The maximum number of threads that will be used for constantly executing some lightweight periodic operations Default value: 512. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundFetchesPoolSize |
string (int64) The maximum number of threads that will be used for fetching data parts from another replica for MergeTree-engine tables in a background. Default value: 32 for versions 25.1 and higher, 16 for versions 24.12 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
backgroundMovePoolSize |
string (int64) The maximum number of threads that will be used for moving data parts to another disk or volume for MergeTree-engine tables in a background. Default value: 8. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundDistributedSchedulePoolSize |
string (int64) The maximum number of threads that will be used for executing distributed sends. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundBufferFlushSchedulePoolSize |
string (int64) The maximum number of threads that will be used for performing flush operations for Buffer-engine tables in the background. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundMessageBrokerSchedulePoolSize |
string (int64) The maximum number of threads that will be used for executing background operations for message streaming. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundCommonPoolSize |
string (int64) The maximum number of threads that will be used for performing a variety of operations (mostly garbage collection) for MergeTree-engine tables in a background. Default value: 8. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
dictionariesLazyLoad |
boolean Lazy loading of dictionaries. If enabled, then each dictionary is loaded on the first use. Otherwise, the server loads all dictionaries at startup. Default value: true for versions 25.1 and higher, false for versions 24.12 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
logLevel |
enum (LogLevel) Logging level.
|
|
queryLogRetentionSize |
string (int64) The maximum size that query_log can grow to before old data will be removed. If set to 0, Default value: 1073741824 (1 GiB). |
|
queryLogRetentionTime |
string (int64) The maximum time that query_log records will be retained before removal. If set to 0, automatic removal of query_log data based on time is disabled. Default value: 2592000000 (30 days). |
|
queryThreadLogEnabled |
boolean Enables or disables query_thread_log system table. Default value: true. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
queryThreadLogRetentionSize |
string (int64) The maximum size that query_thread_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
queryThreadLogRetentionTime |
string (int64) The maximum time that query_thread_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
partLogRetentionSize |
string (int64) The maximum size that part_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
partLogRetentionTime |
string (int64) The maximum time that part_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
metricLogEnabled |
boolean Enables or disables metric_log system table. Default value: false for versions 25.1 and higher, true for versions 24.12 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
metricLogRetentionSize |
string (int64) The maximum size that metric_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
metricLogRetentionTime |
string (int64) The maximum time that metric_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
traceLogEnabled |
boolean Enables or disables trace_log system table. Default value: true for versions 25.2 and higher, false for versions 25.1 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
traceLogRetentionSize |
string (int64) The maximum size that trace_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
traceLogRetentionTime |
string (int64) The maximum time that trace_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
textLogEnabled |
boolean Enables or disables text_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
textLogRetentionSize |
string (int64) The maximum size that text_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
textLogRetentionTime |
string (int64) The maximum time that text_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
textLogLevel |
enum (LogLevel) Logging level for text_log system table. Default value: TRACE. Change of the setting is applied with restart.
|
|
opentelemetrySpanLogEnabled |
boolean Enables or disables opentelemetry_span_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
opentelemetrySpanLogRetentionSize |
string (int64) The maximum size that opentelemetry_span_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
opentelemetrySpanLogRetentionTime |
string (int64) The maximum time that opentelemetry_span_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
queryViewsLogEnabled |
boolean Enables or disables query_views_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
queryViewsLogRetentionSize |
string (int64) The maximum size that query_views_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
queryViewsLogRetentionTime |
string (int64) The maximum time that query_views_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
asynchronousMetricLogEnabled |
boolean Enables or disables asynchronous_metric_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
asynchronousMetricLogRetentionSize |
string (int64) The maximum size that asynchronous_metric_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
asynchronousMetricLogRetentionTime |
string (int64) The maximum time that asynchronous_metric_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
sessionLogEnabled |
boolean Enables or disables session_log system table. Default value: true for versions 25.3 and higher, false for versions 25.2 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
sessionLogRetentionSize |
string (int64) The maximum size that session_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB) for versions 25.3 and higher, 0 for versions 25.2 and lower. |
|
sessionLogRetentionTime |
string (int64) The maximum time that session_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
zookeeperLogEnabled |
boolean Enables or disables zookeeper_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
zookeeperLogRetentionSize |
string (int64) The maximum size that zookeeper_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
zookeeperLogRetentionTime |
string (int64) The maximum time that zookeeper_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
asynchronousInsertLogEnabled |
boolean Enables or disables asynchronous_insert_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
asynchronousInsertLogRetentionSize |
string (int64) The maximum size that asynchronous_insert_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
asynchronousInsertLogRetentionTime |
string (int64) The maximum time that asynchronous_insert_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
processorsProfileLogEnabled |
boolean Enables or disables processors_profile_log system table. Default value: true for versions 25.2 and higher, false for versions 25.1 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
processorsProfileLogRetentionSize |
string (int64) The maximum size that processors_profile_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
processorsProfileLogRetentionTime |
string (int64) The maximum time that processors_profile_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
errorLogEnabled |
boolean Enables or disables error_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
errorLogRetentionSize |
string (int64) The maximum size that error_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
errorLogRetentionTime |
string (int64) The maximum time that error_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
accessControlImprovements |
Access control settings. |
|
maxConnections |
string (int64) Maximum number of inbound connections. Default value: 4096. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
maxConcurrentQueries |
string (int64) Maximum number of concurrently executed queries. Default value: 500. For details, see ClickHouse documentation |
|
maxTableSizeToDrop |
string (int64) Maximum size of the table that can be deleted using DROP or TRUNCATE query. Default value: 50000000000 (48828125 KiB). For details, see ClickHouse documentation |
|
maxPartitionSizeToDrop |
string (int64) Maximum size of the partition that can be deleted using DROP or TRUNCATE query. Default value: 50000000000 (48828125 KiB). For details, see ClickHouse documentation |
|
keepAliveTimeout |
string (int64) The number of seconds that ClickHouse waits for incoming requests for HTTP protocol before closing the connection. Default value: 30. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
uncompressedCacheSize |
string (int64) Cache size (in bytes) for uncompressed data used by table engines from the MergeTree family. 0 means disabled. For details, see ClickHouse documentation |
|
markCacheSize |
string (int64) Maximum size (in bytes) of the cache of "marks" used by MergeTree tables. For details, see ClickHouse documentation |
|
timezone |
string The server's time zone to be used in DateTime fields conversions. Specified as an IANA identifier. Default value: Europe/Moscow. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
geobaseEnabled |
boolean Enables or disables geobase. Default value: false for versions 25.8 and higher, true for versions 25.7 and lower. Change of the setting is applied with restart. |
|
geobaseUri |
string Address of the archive with the user geobase in Object Storage. Change of the setting is applied with restart. |
|
defaultDatabase |
string The default database. Default value: default. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
totalMemoryProfilerStep |
string (int64) Whenever server memory usage becomes larger than every next step in number of bytes the memory profiler will collect Default value: 0. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
totalMemoryTrackerSampleProbability |
number (double) Allows to collect random allocations and de-allocations and writes them in the system.trace_log system table Default value: 0. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
asyncInsertThreads |
string (int64) Maximum number of threads to parse and insert data in background. If set to 0, asynchronous mode is disabled. Default value: 16. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
backupThreads |
string (int64) The maximum number of threads to execute BACKUP requests. Default value: 16. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
restoreThreads |
string (int64) The maximum number of threads to execute RESTORE requests. Default value: 16. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
mergeTree |
Settings for the MergeTree table engine family. Change of the settings of merge_tree is applied with restart. |
|
compression[] |
Data compression settings for MergeTree engine tables. Change of the settings of compression is applied with restart. For details, see ClickHouse documentation |
|
dictionaries[] |
Configuration of external dictionaries. Change of the settings of dictionaries is applied with restart. For details, see ClickHouse documentation |
|
graphiteRollup[] |
Rollup settings for the GraphiteMergeTree engine tables. Change of the settings of graphite_rollup is applied with restart. For details, see ClickHouse documentation |
|
kafka |
Kafka integration settings. Change of the settings of kafka is applied with restart. |
|
kafkaTopics[] |
Per-topic Kafka integration settings. Change of the settings of kafka_topics is applied with restart. |
|
rabbitmq |
RabbitMQ integration settings. Change of the settings of rabbitmq is applied with restart. |
|
queryMaskingRules[] |
Regexp-based rules, which will be applied to queries as well as all log messages before storing them in server logs, Change of the settings of query_masking_rules is applied with restart. For details, see ClickHouse documentation |
|
queryCache |
Query cache Change of the settings of query_cache is applied with restart. |
|
jdbcBridge |
JDBC bridge configuration for queries to external databases. Change of the settings of jdbc_bridge is applied with restart. For details, see ClickHouse documentation |
|
mysqlProtocol |
boolean Enables or disables MySQL interface on ClickHouse server Default value: false. For details, see ClickHouse documentation |
|
customMacros[] |
Custom ClickHouse macros. |
|
builtinDictionariesReloadInterval |
string (int64) The interval in seconds before reloading built-in dictionaries. Default value: 3600. For details, see ClickHouse documentation |
AccessControlImprovements
Access control settings.
For details, see ClickHouse documentation
|
Field |
Description |
|
selectFromSystemDbRequiresGrant |
boolean Sets whether SELECT * FROM system.<table> requires any grants and can be executed by any user. Default value: false. |
|
selectFromInformationSchemaRequiresGrant |
boolean Sets whether SELECT * FROM information_schema.<table> requires any grants and can be executed by any user. Default value: false. |
MergeTree
Settings for the MergeTree table engine family.
|
Field |
Description |
|
partsToDelayInsert |
string (int64) If the number of active parts in a single partition exceeds the parts_to_delay_insert value, an INSERT artificially slows down. Default value: 1000 for versions 25.1 and higher, 150 for versions 24.12 and lower. For details, see ClickHouse documentation |
|
partsToThrowInsert |
string (int64) If the number of active parts in a single partition exceeds the parts_to_throw_insert value, an INSERT Default value: 3000 for versions 25.1 and higher, 300 for versions 24.12 and lower. For details, see ClickHouse documentation |
|
inactivePartsToDelayInsert |
string (int64) If the number of inactive parts in a single partition in the table exceeds the inactive_parts_to_delay_insert value, Default value: 0. For details, see ClickHouse documentation |
|
inactivePartsToThrowInsert |
string (int64) If the number of inactive parts in a single partition more than the inactive_parts_to_throw_insert value, Default value: 0. For details, see ClickHouse documentation |
|
maxAvgPartSizeForTooManyParts |
string (int64) The "Too many parts" check according to parts_to_delay_insert and parts_to_throw_insert will be active only if the average Default value: 1073741824 (1 GiB). For details, see ClickHouse documentation |
|
maxPartsInTotal |
string (int64) If the total number of active parts in all partitions of a table exceeds the max_parts_in_total value, Default value: 20000 for versions 25.2 and higher, 100000 for versions 25.1 and lower. For details, see ClickHouse documentation |
|
maxReplicatedMergesInQueue |
string (int64) How many tasks of merging and mutating parts are allowed simultaneously in ReplicatedMergeTree queue. Default value: 32 for versions 25.8 and higher, 16 for versions 25.7 and lower. For details, see ClickHouse documentation |
|
numberOfFreeEntriesInPoolToLowerMaxSizeOfMerge |
string (int64) When there is less than the specified number of free entries in pool (or replicated queue), start to lower maximum size of Default value: 8. For details, see ClickHouse documentation |
|
numberOfFreeEntriesInPoolToExecuteMutation |
string (int64) When there is less than specified number of free entries in pool, do not execute part mutations. Default value: 20. For details, see ClickHouse documentation |
|
maxBytesToMergeAtMinSpaceInPool |
string (int64) The maximum total part size (in bytes) to be merged into one part, with the minimum available resources in the background pool. Default value: 1048576 (1 MiB). For details, see ClickHouse documentation |
|
maxBytesToMergeAtMaxSpaceInPool |
string (int64) The maximum total parts size (in bytes) to be merged into one part, if there are enough resources available. Default value: 161061273600 (150 GiB). For details, see ClickHouse documentation |
|
minBytesForWidePart |
string (int64) Minimum number of bytes in a data part that can be stored in Wide format. Default value: 10485760 (10 MiB). For details, see ClickHouse documentation |
|
minRowsForWidePart |
string (int64) Minimum number of rows in a data part that can be stored in Wide format. Default value: 0. For details, see ClickHouse documentation |
|
cleanupDelayPeriod |
string (int64) Minimum period to clean old queue logs, blocks hashes and parts. Default value: 30. For details, see ClickHouse documentation |
|
maxCleanupDelayPeriod |
string (int64) Maximum period to clean old queue logs, blocks hashes and parts. Default value: 300 (5 minutes). For details, see ClickHouse documentation |
|
mergeSelectingSleepMs |
string (int64) Minimum time to wait before trying to select parts to merge again after no parts were selected. A lower setting value will trigger Default value: 5000 (5 seconds). For details, see ClickHouse documentation |
|
maxMergeSelectingSleepMs |
string (int64) Maximum time to wait before trying to select parts to merge again after no parts were selected. A lower setting value will trigger Default value: 60000 (1 minute). For details, see ClickHouse documentation |
|
minAgeToForceMergeSeconds |
string (int64) Merge parts if every part in the range is older than the specified value. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
minAgeToForceMergeOnPartitionOnly |
boolean Whether min_age_to_force_merge_seconds should be applied only on the entire partition and not on subset. Default value: false. For details, see ClickHouse documentation |
|
mergeMaxBlockSize |
string (int64) The number of rows that are read from the merged parts into memory. Default value: 8192. For details, see ClickHouse documentation |
|
deduplicateMergeProjectionMode |
enum (DeduplicateMergeProjectionMode) Determines the behavior of background merges for MergeTree tables with projections. Default value: DEDUPLICATE_MERGE_PROJECTION_MODE_THROW. For details, see ClickHouse documentation
|
|
lightweightMutationProjectionMode |
enum (LightweightMutationProjectionMode) Determines the behavior of lightweight deletes for MergeTree tables with projections. Default value: LIGHTWEIGHT_MUTATION_PROJECTION_MODE_THROW. For details, see ClickHouse documentation
|
|
replicatedDeduplicationWindow |
string (int64) The number of most recently inserted blocks for which ClickHouse Keeper stores hash sums to check for duplicates. Default value: 10000 for versions 25.9 and higher, 1000 for versions from 23.11 to 25.8, 100 for versions 23.10 and lower. For details, see ClickHouse documentation |
|
replicatedDeduplicationWindowSeconds |
string (int64) The number of seconds after which the hash sums of the inserted blocks are removed from ClickHouse Keeper. Default value: 604800 (7 days). For details, see ClickHouse documentation |
|
fsyncAfterInsert |
boolean Do fsync for every inserted part. Significantly decreases performance of inserts, not recommended to use with wide parts. Default value: false. For details, see ClickHouse documentation |
|
fsyncPartDirectory |
boolean Do fsync for part directory after all part operations (writes, renames, etc.). Default value: false. For details, see ClickHouse documentation |
|
minCompressedBytesToFsyncAfterFetch |
string (int64) Minimal number of compressed bytes to do fsync for part after fetch. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
minCompressedBytesToFsyncAfterMerge |
string (int64) Minimal number of compressed bytes to do fsync for part after merge. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
minRowsToFsyncAfterMerge |
string (int64) Minimal number of rows to do fsync for part after merge. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
ttlOnlyDropParts |
boolean Controls whether data parts are fully dropped in MergeTree tables when all rows in that part have expired according to their TTL settings.
Default value: false. For details, see ClickHouse documentation |
|
mergeWithTtlTimeout |
string (int64) Minimum delay in seconds before repeating a merge with delete TTL. Default value: 14400 (4 hours). For details, see ClickHouse documentation |
|
mergeWithRecompressionTtlTimeout |
string (int64) Minimum delay in seconds before repeating a merge with recompression TTL. Default value: 14400 (4 hours). For details, see ClickHouse documentation |
|
maxNumberOfMergesWithTtlInPool |
string (int64) When there is more than specified number of merges with TTL entries in pool, do not assign new merge with TTL. Default value: 2. For details, see ClickHouse documentation |
|
materializeTtlRecalculateOnly |
boolean Only recalculate ttl info when MATERIALIZE TTL. Default value: true for versions 25.2 and higher, false for versions 25.1 and lower. For details, see ClickHouse documentation |
|
checkSampleColumnIsCorrect |
boolean Enables the check at table creation, that the data type of a column for sampling or sampling expression is correct. Default value: true. For details, see ClickHouse documentation |
|
allowRemoteFsZeroCopyReplication |
boolean Setting is automatically enabled if cloud storage is enabled, disabled otherwise. Default value: true. |
Compression
Compression settings.
For details, see ClickHouse documentation
|
Field |
Description |
|
method |
enum (Method) Required field. Compression method to use for the specified combination of min_part_size and min_part_size_ratio.
|
|
minPartSize |
string (int64) The minimum size of a data part. |
|
minPartSizeRatio |
string The ratio of the data part size to the table size. |
|
level |
string (int64) Compression level. |
ExternalDictionary
External dictionary configuration.
|
Field |
Description |
|
name |
string Required field. Name of the external dictionary. |
|
structure |
Required field. Structure of the external dictionary. |
|
layout |
Required field. Layout determining how to store the dictionary in memory. For details, see https://clickhouse.com/docs/sql-reference/dictionaries#ways-to-store-dictionaries-in-memory. |
|
fixedLifetime |
string (int64) Fixed interval between dictionary updates. Includes only one of the fields |
|
lifetimeRange |
Range of intervals between dictionary updates for ClickHouse to choose from. Includes only one of the fields |
|
httpSource |
HTTP source for the dictionary. Includes only one of the fields |
|
mysqlSource |
MySQL source for the dictionary. Includes only one of the fields |
|
clickhouseSource |
ClickHouse source for the dictionary. Includes only one of the fields |
|
mongodbSource |
MongoDB source for the dictionary. Includes only one of the fields |
|
postgresqlSource |
PostgreSQL source for the dictionary. Includes only one of the fields |
Structure
Configuration of external dictionary structure.
|
Field |
Description |
|
id |
Single numeric key column for the dictionary. |
|
key |
Composite key for the dictionary, containing of one or more key columns. For details, see ClickHouse documentation |
|
rangeMin |
Field holding the beginning of the range for dictionaries with RANGE_HASHED layout. For details, see ClickHouse documentation |
|
rangeMax |
Field holding the end of the range for dictionaries with RANGE_HASHED layout. For details, see ClickHouse documentation |
|
attributes[] |
Description of the fields available for database queries. For details, see ClickHouse documentation |
Id
Numeric key.
|
Field |
Description |
|
name |
string Required field. Name of the numeric key. |
Key
Complex key.
|
Field |
Description |
|
attributes[] |
Attributes of a complex key. |
Attribute
|
Field |
Description |
|
name |
string Required field. Name of the column. |
|
type |
string Required field. Type of the column. |
|
nullValue |
string Default value for an element without data (for example, an empty string). |
|
expression |
string Expression, describing the attribute, if applicable. |
|
hierarchical |
boolean Indication of hierarchy support. Default value: false. |
|
injective |
boolean Indication of injective mapping "id -> attribute". Default value: false. |
Layout
|
Field |
Description |
|
type |
enum (Type) Required field. Layout type. For details, see ClickHouse documentation
|
|
sizeInCells |
string (int64) Number of cells in the cache. Rounded up to a power of two. Default value: 1000000000. For details, see ClickHouse documentation |
|
allowReadExpiredKeys |
boolean Allows to read expired keys. Default value: false. For details, see ClickHouse documentation |
|
maxUpdateQueueSize |
string (int64) Max size of update queue. Default value: 100000. For details, see ClickHouse documentation |
|
updateQueuePushTimeoutMilliseconds |
string (int64) Max timeout in milliseconds for push update task into queue. Default value: 10. For details, see ClickHouse documentation |
|
queryWaitTimeoutMilliseconds |
string (int64) Max wait timeout in milliseconds for update task to complete. Default value: 60000 (1 minute). For details, see ClickHouse documentation |
|
maxThreadsForUpdates |
string (int64) Max threads for cache dictionary update. Default value: 4. For details, see ClickHouse documentation |
|
initialArraySize |
string (int64) Initial dictionary key size. Default value: 1024. For details, see ClickHouse documentation |
|
maxArraySize |
string (int64) Maximum dictionary key size. Default value: 500000. For details, see ClickHouse documentation |
|
accessToKeyFromAttributes |
boolean Allows to retrieve key attribute using dictGetString function. For details, see ClickHouse documentation |
Range
|
Field |
Description |
|
min |
string (int64) Minimum dictionary lifetime. |
|
max |
string (int64) Maximum dictionary lifetime. |
HttpSource
|
Field |
Description |
|
url |
string Required field. URL of the source dictionary available over HTTP. |
|
format |
string Required field. The data format. Valid values are all formats supported by ClickHouse SQL dialect |
|
headers[] |
HTTP headers. |
Header
|
Field |
Description |
|
name |
string Required field. Header name. |
|
value |
string Required field. Header value. |
MysqlSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
table |
string Required field. Table name. |
|
port |
string (int64) Port to use when connecting to a replica of the dictionary source. |
|
user |
string Required field. Name of the user for replicas of the dictionary source. |
|
password |
string Password of the user for replicas of the dictionary source. |
|
replicas[] |
List of MySQL replicas of the database used as dictionary source. |
|
where |
string Selection criteria for the data in the specified MySQL table. |
|
invalidateQuery |
string Query for checking the dictionary status, to pull only updated data. |
|
closeConnection |
boolean Should a connection be closed after each request. |
|
shareConnection |
boolean Should a connection be shared for some requests. |
Replica
|
Field |
Description |
|
host |
string Required field. MySQL host of the replica. |
|
priority |
string (int64) The priority of the replica that ClickHouse takes into account when connecting. |
|
port |
string (int64) Port to use when connecting to the replica. |
|
user |
string Name of the MySQL database user. |
|
password |
string Password of the MySQL database user. |
ClickhouseSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
table |
string Required field. Table name. |
|
host |
string ClickHouse host. |
|
port |
string (int64) Port to use when connecting to the host. |
|
user |
string Required field. Name of the ClickHouse database user. |
|
password |
string Password of the ClickHouse database user. |
|
where |
string Selection criteria for the data in the specified ClickHouse table. |
|
secure |
boolean Determines whether to use TLS for connection. |
MongodbSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
collection |
string Required field. Collection name. |
|
host |
string Required field. MongoDB host. |
|
port |
string (int64) Port to use when connecting to the host. |
|
user |
string Required field. Name of the MongoDB database user. |
|
password |
string Password of the MongoDB database user. |
|
options |
string Dictionary source options. |
PostgresqlSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
table |
string Required field. Table name. |
|
hosts[] |
string PostgreSQL hosts. |
|
port |
string (int64) Port to use when connecting to the PostgreSQL hosts. |
|
user |
string Required field. Name of the PostrgreSQL database user. |
|
password |
string Password of the PostrgreSQL database user. |
|
invalidateQuery |
string Query for checking the dictionary status, to pull only updated data. |
|
sslMode |
enum (SslMode) Mode of SSL TCP/IP connection to the PostgreSQL host.
|
GraphiteRollup
Rollup settings for the GraphiteMergeTree table engine.
For details, see ClickHouse documentation
|
Field |
Description |
|
name |
string Required field. Name for the specified combination of settings for Graphite rollup. |
|
patterns[] |
Pattern to use for the rollup. |
|
pathColumnName |
string The name of the column storing the metric name (Graphite sensor). Default value: Path. |
|
timeColumnName |
string The name of the column storing the time of measuring the metric. Default value: Time. |
|
valueColumnName |
string The name of the column storing the value of the metric at the time set in time_column_name. Default value: Value. |
|
versionColumnName |
string The name of the column storing the version of the metric. Default value: Timestamp. |
Pattern
|
Field |
Description |
|
regexp |
string A pattern for the metric name (a regular or DSL). |
|
function |
string The name of the aggregating function to apply to data whose age falls within the range [age, age + precision]. |
|
retention[] |
Retention rules. |
Retention
|
Field |
Description |
|
age |
string (int64) The minimum age of the data in seconds. |
|
precision |
string (int64) Precision of determining the age of the data, in seconds. Should be a divisor for 86400 (seconds in a day). |
Kafka
Kafka configuration settings.
For details, see librdkafka documentation
|
Field |
Description |
|
securityProtocol |
enum (SecurityProtocol) Protocol used to communicate with brokers. Default value: SECURITY_PROTOCOL_PLAINTEXT.
|
|
saslMechanism |
enum (SaslMechanism) SASL mechanism to use for authentication. Default value: SASL_MECHANISM_GSSAPI.
|
|
saslUsername |
string SASL username for use with the PLAIN and SASL-SCRAM mechanisms. |
|
saslPassword |
string SASL password for use with the PLAIN and SASL-SCRAM mechanisms. |
|
enableSslCertificateVerification |
boolean Enable OpenSSL's builtin broker (server) certificate verification. Default value: true. |
|
maxPollIntervalMs |
string (int64) Maximum allowed time between calls to consume messages for high-level consumers. Default value: 300000 (5 minutes). |
|
sessionTimeoutMs |
string (int64) Client group session and failure detection timeout. The consumer sends periodic heartbeats (heartbeat.interval.ms) Default value: 45000 (45 seconds). |
|
debug |
enum (Debug) Debug context to enable.
|
|
autoOffsetReset |
enum (AutoOffsetReset) Action to take when there is no initial offset in offset store or the desired offset is out of range. Default value: AUTO_OFFSET_RESET_LARGEST.
|
KafkaTopic
|
Field |
Description |
|
name |
string Required field. Kafka topic name. |
|
settings |
Required field. Kafka topic settings. |
Rabbitmq
RabbitMQ integration settings.
For details, see ClickHouse documentation
|
Field |
Description |
|
username |
string RabbitMQ username. |
|
password |
string RabbitMQ password. |
|
vhost |
string RabbitMQ virtual host. |
QueryMaskingRule
|
Field |
Description |
|
name |
string Name for the rule. |
|
regexp |
string Required field. RE2 compatible regular expression. |
|
replace |
string Substitution string for sensitive data. Default value: six asterisks. |
QueryCache
Query cache configuration.
|
Field |
Description |
|
maxSizeInBytes |
string (int64) The maximum cache size in bytes. Default value: 1073741824 (1 GiB). |
|
maxEntries |
string (int64) The maximum number of SELECT query results stored in the cache. Default value: 1024. |
|
maxEntrySizeInBytes |
string (int64) The maximum size in bytes SELECT query results may have to be saved in the cache. Default value: 1048576 (1 MiB). |
|
maxEntrySizeInRows |
string (int64) The maximum number of rows SELECT query results may have to be saved in the cache. Default value: 30000000. |
JdbcBridge
JDBC bridge configuration for queries to external databases.
|
Field |
Description |
|
host |
string Host of jdbc bridge. |
|
port |
string (int64) Port of jdbc bridge. Default value: 9019. |
Macro
ClickHouse macro.
|
Field |
Description |
|
name |
string Required field. Name of the macro. |
|
value |
string Required field. Value of the macro. |
Resources
|
Field |
Description |
|
resourcePresetId |
string ID of the preset for computational resources available to a host (CPU, memory etc.). |
|
diskSize |
string (int64) Volume of the storage available to a host, in bytes. |
|
diskTypeId |
string Type of the storage environment for the host.
|
DiskSizeAutoscaling
|
Field |
Description |
|
plannedUsageThreshold |
string (int64) Amount of used storage for automatic disk scaling in the maintenance window, 0 means disabled, in percent. |
|
emergencyUsageThreshold |
string (int64) Amount of used storage for immediately automatic disk scaling, 0 means disabled, in percent. |
|
diskSizeLimit |
string (int64) Limit on how large the storage for database instances can automatically grow, in bytes. |
Response
HTTP Code: 200 - OK
{
"id": "string",
"description": "string",
"createdAt": "string",
"createdBy": "string",
"modifiedAt": "string",
"done": "boolean",
"metadata": {
"clusterId": "string",
"shardName": "string"
},
// Includes only one of the fields `error`, `response`
"error": {
"code": "integer",
"message": "string",
"details": [
"object"
]
},
"response": {
"name": "string",
"clusterId": "string",
"config": {
"clickhouse": {
"config": {
"effectiveConfig": {
"backgroundPoolSize": "string",
"backgroundMergesMutationsConcurrencyRatio": "string",
"backgroundSchedulePoolSize": "string",
"backgroundFetchesPoolSize": "string",
"backgroundMovePoolSize": "string",
"backgroundDistributedSchedulePoolSize": "string",
"backgroundBufferFlushSchedulePoolSize": "string",
"backgroundMessageBrokerSchedulePoolSize": "string",
"backgroundCommonPoolSize": "string",
"dictionariesLazyLoad": "boolean",
"logLevel": "string",
"queryLogRetentionSize": "string",
"queryLogRetentionTime": "string",
"queryThreadLogEnabled": "boolean",
"queryThreadLogRetentionSize": "string",
"queryThreadLogRetentionTime": "string",
"partLogRetentionSize": "string",
"partLogRetentionTime": "string",
"metricLogEnabled": "boolean",
"metricLogRetentionSize": "string",
"metricLogRetentionTime": "string",
"traceLogEnabled": "boolean",
"traceLogRetentionSize": "string",
"traceLogRetentionTime": "string",
"textLogEnabled": "boolean",
"textLogRetentionSize": "string",
"textLogRetentionTime": "string",
"textLogLevel": "string",
"opentelemetrySpanLogEnabled": "boolean",
"opentelemetrySpanLogRetentionSize": "string",
"opentelemetrySpanLogRetentionTime": "string",
"queryViewsLogEnabled": "boolean",
"queryViewsLogRetentionSize": "string",
"queryViewsLogRetentionTime": "string",
"asynchronousMetricLogEnabled": "boolean",
"asynchronousMetricLogRetentionSize": "string",
"asynchronousMetricLogRetentionTime": "string",
"sessionLogEnabled": "boolean",
"sessionLogRetentionSize": "string",
"sessionLogRetentionTime": "string",
"zookeeperLogEnabled": "boolean",
"zookeeperLogRetentionSize": "string",
"zookeeperLogRetentionTime": "string",
"asynchronousInsertLogEnabled": "boolean",
"asynchronousInsertLogRetentionSize": "string",
"asynchronousInsertLogRetentionTime": "string",
"processorsProfileLogEnabled": "boolean",
"processorsProfileLogRetentionSize": "string",
"processorsProfileLogRetentionTime": "string",
"errorLogEnabled": "boolean",
"errorLogRetentionSize": "string",
"errorLogRetentionTime": "string",
"accessControlImprovements": {
"selectFromSystemDbRequiresGrant": "boolean",
"selectFromInformationSchemaRequiresGrant": "boolean"
},
"maxConnections": "string",
"maxConcurrentQueries": "string",
"maxTableSizeToDrop": "string",
"maxPartitionSizeToDrop": "string",
"keepAliveTimeout": "string",
"uncompressedCacheSize": "string",
"markCacheSize": "string",
"timezone": "string",
"geobaseEnabled": "boolean",
"geobaseUri": "string",
"defaultDatabase": "string",
"totalMemoryProfilerStep": "string",
"totalMemoryTrackerSampleProbability": "number",
"asyncInsertThreads": "string",
"backupThreads": "string",
"restoreThreads": "string",
"mergeTree": {
"partsToDelayInsert": "string",
"partsToThrowInsert": "string",
"inactivePartsToDelayInsert": "string",
"inactivePartsToThrowInsert": "string",
"maxAvgPartSizeForTooManyParts": "string",
"maxPartsInTotal": "string",
"maxReplicatedMergesInQueue": "string",
"numberOfFreeEntriesInPoolToLowerMaxSizeOfMerge": "string",
"numberOfFreeEntriesInPoolToExecuteMutation": "string",
"maxBytesToMergeAtMinSpaceInPool": "string",
"maxBytesToMergeAtMaxSpaceInPool": "string",
"minBytesForWidePart": "string",
"minRowsForWidePart": "string",
"cleanupDelayPeriod": "string",
"maxCleanupDelayPeriod": "string",
"mergeSelectingSleepMs": "string",
"maxMergeSelectingSleepMs": "string",
"minAgeToForceMergeSeconds": "string",
"minAgeToForceMergeOnPartitionOnly": "boolean",
"mergeMaxBlockSize": "string",
"deduplicateMergeProjectionMode": "string",
"lightweightMutationProjectionMode": "string",
"replicatedDeduplicationWindow": "string",
"replicatedDeduplicationWindowSeconds": "string",
"fsyncAfterInsert": "boolean",
"fsyncPartDirectory": "boolean",
"minCompressedBytesToFsyncAfterFetch": "string",
"minCompressedBytesToFsyncAfterMerge": "string",
"minRowsToFsyncAfterMerge": "string",
"ttlOnlyDropParts": "boolean",
"mergeWithTtlTimeout": "string",
"mergeWithRecompressionTtlTimeout": "string",
"maxNumberOfMergesWithTtlInPool": "string",
"materializeTtlRecalculateOnly": "boolean",
"checkSampleColumnIsCorrect": "boolean",
"allowRemoteFsZeroCopyReplication": "boolean"
},
"compression": [
{
"method": "string",
"minPartSize": "string",
"minPartSizeRatio": "string",
"level": "string"
}
],
"dictionaries": [
{
"name": "string",
"structure": {
"id": {
"name": "string"
},
"key": {
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"rangeMin": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"rangeMax": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"layout": {
"type": "string",
"sizeInCells": "string",
"allowReadExpiredKeys": "boolean",
"maxUpdateQueueSize": "string",
"updateQueuePushTimeoutMilliseconds": "string",
"queryWaitTimeoutMilliseconds": "string",
"maxThreadsForUpdates": "string",
"initialArraySize": "string",
"maxArraySize": "string",
"accessToKeyFromAttributes": "boolean"
},
// Includes only one of the fields `fixedLifetime`, `lifetimeRange`
"fixedLifetime": "string",
"lifetimeRange": {
"min": "string",
"max": "string"
},
// end of the list of possible fields
// Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`
"httpSource": {
"url": "string",
"format": "string",
"headers": [
{
"name": "string",
"value": "string"
}
]
},
"mysqlSource": {
"db": "string",
"table": "string",
"port": "string",
"user": "string",
"password": "string",
"replicas": [
{
"host": "string",
"priority": "string",
"port": "string",
"user": "string",
"password": "string"
}
],
"where": "string",
"invalidateQuery": "string",
"closeConnection": "boolean",
"shareConnection": "boolean"
},
"clickhouseSource": {
"db": "string",
"table": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"where": "string",
"secure": "boolean"
},
"mongodbSource": {
"db": "string",
"collection": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"options": "string"
},
"postgresqlSource": {
"db": "string",
"table": "string",
"hosts": [
"string"
],
"port": "string",
"user": "string",
"password": "string",
"invalidateQuery": "string",
"sslMode": "string"
}
// end of the list of possible fields
}
],
"graphiteRollup": [
{
"name": "string",
"patterns": [
{
"regexp": "string",
"function": "string",
"retention": [
{
"age": "string",
"precision": "string"
}
]
}
],
"pathColumnName": "string",
"timeColumnName": "string",
"valueColumnName": "string",
"versionColumnName": "string"
}
],
"kafka": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
},
"kafkaTopics": [
{
"name": "string",
"settings": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
}
}
],
"rabbitmq": {
"username": "string",
"password": "string",
"vhost": "string"
},
"queryMaskingRules": [
{
"name": "string",
"regexp": "string",
"replace": "string"
}
],
"queryCache": {
"maxSizeInBytes": "string",
"maxEntries": "string",
"maxEntrySizeInBytes": "string",
"maxEntrySizeInRows": "string"
},
"jdbcBridge": {
"host": "string",
"port": "string"
},
"mysqlProtocol": "boolean",
"customMacros": [
{
"name": "string",
"value": "string"
}
],
"builtinDictionariesReloadInterval": "string"
},
"userConfig": {
"backgroundPoolSize": "string",
"backgroundMergesMutationsConcurrencyRatio": "string",
"backgroundSchedulePoolSize": "string",
"backgroundFetchesPoolSize": "string",
"backgroundMovePoolSize": "string",
"backgroundDistributedSchedulePoolSize": "string",
"backgroundBufferFlushSchedulePoolSize": "string",
"backgroundMessageBrokerSchedulePoolSize": "string",
"backgroundCommonPoolSize": "string",
"dictionariesLazyLoad": "boolean",
"logLevel": "string",
"queryLogRetentionSize": "string",
"queryLogRetentionTime": "string",
"queryThreadLogEnabled": "boolean",
"queryThreadLogRetentionSize": "string",
"queryThreadLogRetentionTime": "string",
"partLogRetentionSize": "string",
"partLogRetentionTime": "string",
"metricLogEnabled": "boolean",
"metricLogRetentionSize": "string",
"metricLogRetentionTime": "string",
"traceLogEnabled": "boolean",
"traceLogRetentionSize": "string",
"traceLogRetentionTime": "string",
"textLogEnabled": "boolean",
"textLogRetentionSize": "string",
"textLogRetentionTime": "string",
"textLogLevel": "string",
"opentelemetrySpanLogEnabled": "boolean",
"opentelemetrySpanLogRetentionSize": "string",
"opentelemetrySpanLogRetentionTime": "string",
"queryViewsLogEnabled": "boolean",
"queryViewsLogRetentionSize": "string",
"queryViewsLogRetentionTime": "string",
"asynchronousMetricLogEnabled": "boolean",
"asynchronousMetricLogRetentionSize": "string",
"asynchronousMetricLogRetentionTime": "string",
"sessionLogEnabled": "boolean",
"sessionLogRetentionSize": "string",
"sessionLogRetentionTime": "string",
"zookeeperLogEnabled": "boolean",
"zookeeperLogRetentionSize": "string",
"zookeeperLogRetentionTime": "string",
"asynchronousInsertLogEnabled": "boolean",
"asynchronousInsertLogRetentionSize": "string",
"asynchronousInsertLogRetentionTime": "string",
"processorsProfileLogEnabled": "boolean",
"processorsProfileLogRetentionSize": "string",
"processorsProfileLogRetentionTime": "string",
"errorLogEnabled": "boolean",
"errorLogRetentionSize": "string",
"errorLogRetentionTime": "string",
"accessControlImprovements": {
"selectFromSystemDbRequiresGrant": "boolean",
"selectFromInformationSchemaRequiresGrant": "boolean"
},
"maxConnections": "string",
"maxConcurrentQueries": "string",
"maxTableSizeToDrop": "string",
"maxPartitionSizeToDrop": "string",
"keepAliveTimeout": "string",
"uncompressedCacheSize": "string",
"markCacheSize": "string",
"timezone": "string",
"geobaseEnabled": "boolean",
"geobaseUri": "string",
"defaultDatabase": "string",
"totalMemoryProfilerStep": "string",
"totalMemoryTrackerSampleProbability": "number",
"asyncInsertThreads": "string",
"backupThreads": "string",
"restoreThreads": "string",
"mergeTree": {
"partsToDelayInsert": "string",
"partsToThrowInsert": "string",
"inactivePartsToDelayInsert": "string",
"inactivePartsToThrowInsert": "string",
"maxAvgPartSizeForTooManyParts": "string",
"maxPartsInTotal": "string",
"maxReplicatedMergesInQueue": "string",
"numberOfFreeEntriesInPoolToLowerMaxSizeOfMerge": "string",
"numberOfFreeEntriesInPoolToExecuteMutation": "string",
"maxBytesToMergeAtMinSpaceInPool": "string",
"maxBytesToMergeAtMaxSpaceInPool": "string",
"minBytesForWidePart": "string",
"minRowsForWidePart": "string",
"cleanupDelayPeriod": "string",
"maxCleanupDelayPeriod": "string",
"mergeSelectingSleepMs": "string",
"maxMergeSelectingSleepMs": "string",
"minAgeToForceMergeSeconds": "string",
"minAgeToForceMergeOnPartitionOnly": "boolean",
"mergeMaxBlockSize": "string",
"deduplicateMergeProjectionMode": "string",
"lightweightMutationProjectionMode": "string",
"replicatedDeduplicationWindow": "string",
"replicatedDeduplicationWindowSeconds": "string",
"fsyncAfterInsert": "boolean",
"fsyncPartDirectory": "boolean",
"minCompressedBytesToFsyncAfterFetch": "string",
"minCompressedBytesToFsyncAfterMerge": "string",
"minRowsToFsyncAfterMerge": "string",
"ttlOnlyDropParts": "boolean",
"mergeWithTtlTimeout": "string",
"mergeWithRecompressionTtlTimeout": "string",
"maxNumberOfMergesWithTtlInPool": "string",
"materializeTtlRecalculateOnly": "boolean",
"checkSampleColumnIsCorrect": "boolean",
"allowRemoteFsZeroCopyReplication": "boolean"
},
"compression": [
{
"method": "string",
"minPartSize": "string",
"minPartSizeRatio": "string",
"level": "string"
}
],
"dictionaries": [
{
"name": "string",
"structure": {
"id": {
"name": "string"
},
"key": {
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"rangeMin": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"rangeMax": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"layout": {
"type": "string",
"sizeInCells": "string",
"allowReadExpiredKeys": "boolean",
"maxUpdateQueueSize": "string",
"updateQueuePushTimeoutMilliseconds": "string",
"queryWaitTimeoutMilliseconds": "string",
"maxThreadsForUpdates": "string",
"initialArraySize": "string",
"maxArraySize": "string",
"accessToKeyFromAttributes": "boolean"
},
// Includes only one of the fields `fixedLifetime`, `lifetimeRange`
"fixedLifetime": "string",
"lifetimeRange": {
"min": "string",
"max": "string"
},
// end of the list of possible fields
// Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`
"httpSource": {
"url": "string",
"format": "string",
"headers": [
{
"name": "string",
"value": "string"
}
]
},
"mysqlSource": {
"db": "string",
"table": "string",
"port": "string",
"user": "string",
"password": "string",
"replicas": [
{
"host": "string",
"priority": "string",
"port": "string",
"user": "string",
"password": "string"
}
],
"where": "string",
"invalidateQuery": "string",
"closeConnection": "boolean",
"shareConnection": "boolean"
},
"clickhouseSource": {
"db": "string",
"table": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"where": "string",
"secure": "boolean"
},
"mongodbSource": {
"db": "string",
"collection": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"options": "string"
},
"postgresqlSource": {
"db": "string",
"table": "string",
"hosts": [
"string"
],
"port": "string",
"user": "string",
"password": "string",
"invalidateQuery": "string",
"sslMode": "string"
}
// end of the list of possible fields
}
],
"graphiteRollup": [
{
"name": "string",
"patterns": [
{
"regexp": "string",
"function": "string",
"retention": [
{
"age": "string",
"precision": "string"
}
]
}
],
"pathColumnName": "string",
"timeColumnName": "string",
"valueColumnName": "string",
"versionColumnName": "string"
}
],
"kafka": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
},
"kafkaTopics": [
{
"name": "string",
"settings": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
}
}
],
"rabbitmq": {
"username": "string",
"password": "string",
"vhost": "string"
},
"queryMaskingRules": [
{
"name": "string",
"regexp": "string",
"replace": "string"
}
],
"queryCache": {
"maxSizeInBytes": "string",
"maxEntries": "string",
"maxEntrySizeInBytes": "string",
"maxEntrySizeInRows": "string"
},
"jdbcBridge": {
"host": "string",
"port": "string"
},
"mysqlProtocol": "boolean",
"customMacros": [
{
"name": "string",
"value": "string"
}
],
"builtinDictionariesReloadInterval": "string"
},
"defaultConfig": {
"backgroundPoolSize": "string",
"backgroundMergesMutationsConcurrencyRatio": "string",
"backgroundSchedulePoolSize": "string",
"backgroundFetchesPoolSize": "string",
"backgroundMovePoolSize": "string",
"backgroundDistributedSchedulePoolSize": "string",
"backgroundBufferFlushSchedulePoolSize": "string",
"backgroundMessageBrokerSchedulePoolSize": "string",
"backgroundCommonPoolSize": "string",
"dictionariesLazyLoad": "boolean",
"logLevel": "string",
"queryLogRetentionSize": "string",
"queryLogRetentionTime": "string",
"queryThreadLogEnabled": "boolean",
"queryThreadLogRetentionSize": "string",
"queryThreadLogRetentionTime": "string",
"partLogRetentionSize": "string",
"partLogRetentionTime": "string",
"metricLogEnabled": "boolean",
"metricLogRetentionSize": "string",
"metricLogRetentionTime": "string",
"traceLogEnabled": "boolean",
"traceLogRetentionSize": "string",
"traceLogRetentionTime": "string",
"textLogEnabled": "boolean",
"textLogRetentionSize": "string",
"textLogRetentionTime": "string",
"textLogLevel": "string",
"opentelemetrySpanLogEnabled": "boolean",
"opentelemetrySpanLogRetentionSize": "string",
"opentelemetrySpanLogRetentionTime": "string",
"queryViewsLogEnabled": "boolean",
"queryViewsLogRetentionSize": "string",
"queryViewsLogRetentionTime": "string",
"asynchronousMetricLogEnabled": "boolean",
"asynchronousMetricLogRetentionSize": "string",
"asynchronousMetricLogRetentionTime": "string",
"sessionLogEnabled": "boolean",
"sessionLogRetentionSize": "string",
"sessionLogRetentionTime": "string",
"zookeeperLogEnabled": "boolean",
"zookeeperLogRetentionSize": "string",
"zookeeperLogRetentionTime": "string",
"asynchronousInsertLogEnabled": "boolean",
"asynchronousInsertLogRetentionSize": "string",
"asynchronousInsertLogRetentionTime": "string",
"processorsProfileLogEnabled": "boolean",
"processorsProfileLogRetentionSize": "string",
"processorsProfileLogRetentionTime": "string",
"errorLogEnabled": "boolean",
"errorLogRetentionSize": "string",
"errorLogRetentionTime": "string",
"accessControlImprovements": {
"selectFromSystemDbRequiresGrant": "boolean",
"selectFromInformationSchemaRequiresGrant": "boolean"
},
"maxConnections": "string",
"maxConcurrentQueries": "string",
"maxTableSizeToDrop": "string",
"maxPartitionSizeToDrop": "string",
"keepAliveTimeout": "string",
"uncompressedCacheSize": "string",
"markCacheSize": "string",
"timezone": "string",
"geobaseEnabled": "boolean",
"geobaseUri": "string",
"defaultDatabase": "string",
"totalMemoryProfilerStep": "string",
"totalMemoryTrackerSampleProbability": "number",
"asyncInsertThreads": "string",
"backupThreads": "string",
"restoreThreads": "string",
"mergeTree": {
"partsToDelayInsert": "string",
"partsToThrowInsert": "string",
"inactivePartsToDelayInsert": "string",
"inactivePartsToThrowInsert": "string",
"maxAvgPartSizeForTooManyParts": "string",
"maxPartsInTotal": "string",
"maxReplicatedMergesInQueue": "string",
"numberOfFreeEntriesInPoolToLowerMaxSizeOfMerge": "string",
"numberOfFreeEntriesInPoolToExecuteMutation": "string",
"maxBytesToMergeAtMinSpaceInPool": "string",
"maxBytesToMergeAtMaxSpaceInPool": "string",
"minBytesForWidePart": "string",
"minRowsForWidePart": "string",
"cleanupDelayPeriod": "string",
"maxCleanupDelayPeriod": "string",
"mergeSelectingSleepMs": "string",
"maxMergeSelectingSleepMs": "string",
"minAgeToForceMergeSeconds": "string",
"minAgeToForceMergeOnPartitionOnly": "boolean",
"mergeMaxBlockSize": "string",
"deduplicateMergeProjectionMode": "string",
"lightweightMutationProjectionMode": "string",
"replicatedDeduplicationWindow": "string",
"replicatedDeduplicationWindowSeconds": "string",
"fsyncAfterInsert": "boolean",
"fsyncPartDirectory": "boolean",
"minCompressedBytesToFsyncAfterFetch": "string",
"minCompressedBytesToFsyncAfterMerge": "string",
"minRowsToFsyncAfterMerge": "string",
"ttlOnlyDropParts": "boolean",
"mergeWithTtlTimeout": "string",
"mergeWithRecompressionTtlTimeout": "string",
"maxNumberOfMergesWithTtlInPool": "string",
"materializeTtlRecalculateOnly": "boolean",
"checkSampleColumnIsCorrect": "boolean",
"allowRemoteFsZeroCopyReplication": "boolean"
},
"compression": [
{
"method": "string",
"minPartSize": "string",
"minPartSizeRatio": "string",
"level": "string"
}
],
"dictionaries": [
{
"name": "string",
"structure": {
"id": {
"name": "string"
},
"key": {
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"rangeMin": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"rangeMax": {
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
},
"attributes": [
{
"name": "string",
"type": "string",
"nullValue": "string",
"expression": "string",
"hierarchical": "boolean",
"injective": "boolean"
}
]
},
"layout": {
"type": "string",
"sizeInCells": "string",
"allowReadExpiredKeys": "boolean",
"maxUpdateQueueSize": "string",
"updateQueuePushTimeoutMilliseconds": "string",
"queryWaitTimeoutMilliseconds": "string",
"maxThreadsForUpdates": "string",
"initialArraySize": "string",
"maxArraySize": "string",
"accessToKeyFromAttributes": "boolean"
},
// Includes only one of the fields `fixedLifetime`, `lifetimeRange`
"fixedLifetime": "string",
"lifetimeRange": {
"min": "string",
"max": "string"
},
// end of the list of possible fields
// Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`
"httpSource": {
"url": "string",
"format": "string",
"headers": [
{
"name": "string",
"value": "string"
}
]
},
"mysqlSource": {
"db": "string",
"table": "string",
"port": "string",
"user": "string",
"password": "string",
"replicas": [
{
"host": "string",
"priority": "string",
"port": "string",
"user": "string",
"password": "string"
}
],
"where": "string",
"invalidateQuery": "string",
"closeConnection": "boolean",
"shareConnection": "boolean"
},
"clickhouseSource": {
"db": "string",
"table": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"where": "string",
"secure": "boolean"
},
"mongodbSource": {
"db": "string",
"collection": "string",
"host": "string",
"port": "string",
"user": "string",
"password": "string",
"options": "string"
},
"postgresqlSource": {
"db": "string",
"table": "string",
"hosts": [
"string"
],
"port": "string",
"user": "string",
"password": "string",
"invalidateQuery": "string",
"sslMode": "string"
}
// end of the list of possible fields
}
],
"graphiteRollup": [
{
"name": "string",
"patterns": [
{
"regexp": "string",
"function": "string",
"retention": [
{
"age": "string",
"precision": "string"
}
]
}
],
"pathColumnName": "string",
"timeColumnName": "string",
"valueColumnName": "string",
"versionColumnName": "string"
}
],
"kafka": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
},
"kafkaTopics": [
{
"name": "string",
"settings": {
"securityProtocol": "string",
"saslMechanism": "string",
"saslUsername": "string",
"saslPassword": "string",
"enableSslCertificateVerification": "boolean",
"maxPollIntervalMs": "string",
"sessionTimeoutMs": "string",
"debug": "string",
"autoOffsetReset": "string"
}
}
],
"rabbitmq": {
"username": "string",
"password": "string",
"vhost": "string"
},
"queryMaskingRules": [
{
"name": "string",
"regexp": "string",
"replace": "string"
}
],
"queryCache": {
"maxSizeInBytes": "string",
"maxEntries": "string",
"maxEntrySizeInBytes": "string",
"maxEntrySizeInRows": "string"
},
"jdbcBridge": {
"host": "string",
"port": "string"
},
"mysqlProtocol": "boolean",
"customMacros": [
{
"name": "string",
"value": "string"
}
],
"builtinDictionariesReloadInterval": "string"
}
},
"resources": {
"resourcePresetId": "string",
"diskSize": "string",
"diskTypeId": "string"
},
"weight": "string",
"diskSizeAutoscaling": {
"plannedUsageThreshold": "string",
"emergencyUsageThreshold": "string",
"diskSizeLimit": "string"
}
}
}
}
// end of the list of possible fields
}
An Operation resource. For more information, see Operation.
|
Field |
Description |
|
id |
string ID of the operation. |
|
description |
string Description of the operation. 0-256 characters long. |
|
createdAt |
string (date-time) Creation timestamp. String in RFC3339 To work with values in this field, use the APIs described in the |
|
createdBy |
string ID of the user or service account who initiated the operation. |
|
modifiedAt |
string (date-time) The time when the Operation resource was last modified. String in RFC3339 To work with values in this field, use the APIs described in the |
|
done |
boolean If the value is |
|
metadata |
Service-specific metadata associated with the operation. |
|
error |
The error result of the operation in case of failure or cancellation. Includes only one of the fields The operation result. |
|
response |
The normal response of the operation in case of success. Includes only one of the fields The operation result. |
UpdateClusterShardMetadata
|
Field |
Description |
|
clusterId |
string ID of the cluster that contains the shard being updated. |
|
shardName |
string Name of the shard being updated. |
Status
The error result of the operation in case of failure or cancellation.
|
Field |
Description |
|
code |
integer (int32) Error code. An enum value of google.rpc.Code |
|
message |
string An error message. |
|
details[] |
object A list of messages that carry the error details. |
Shard
|
Field |
Description |
|
name |
string Name of the shard. |
|
clusterId |
string ID of the cluster that the shard belongs to. |
|
config |
Configuration of the shard. |
ShardConfig
|
Field |
Description |
|
clickhouse |
ClickHouse configuration for a shard. |
Clickhouse
|
Field |
Description |
|
config |
ClickHouse settings for a shard. |
|
resources |
Computational resources for a shard. |
|
weight |
string (int64) Relative weight of a shard considered when writing data to the cluster. |
|
diskSizeAutoscaling |
Disk size autoscaling settings. |
ClickhouseConfigSet
|
Field |
Description |
|
effectiveConfig |
Required field. Effective configuration (a combination of user-defined configuration and default configuration). |
|
userConfig |
Required field. User-defined configuration. |
|
defaultConfig |
Required field. Default configuration. |
ClickhouseConfig
ClickHouse configuration settings. Supported settings are a subset of settings described
in ClickHouse documentation
|
Field |
Description |
|
backgroundPoolSize |
string (int64) Sets the number of threads performing background merges and mutations for MergeTree-engine tables. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundMergesMutationsConcurrencyRatio |
string (int64) Sets a ratio between the number of threads and the number of background merges and mutations that can be executed concurrently. For example, if the ratio equals to 2 and background_pool_size is set to 16 then ClickHouse can execute 32 background merges concurrently. Default value: 2. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundSchedulePoolSize |
string (int64) The maximum number of threads that will be used for constantly executing some lightweight periodic operations Default value: 512. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundFetchesPoolSize |
string (int64) The maximum number of threads that will be used for fetching data parts from another replica for MergeTree-engine tables in a background. Default value: 32 for versions 25.1 and higher, 16 for versions 24.12 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
backgroundMovePoolSize |
string (int64) The maximum number of threads that will be used for moving data parts to another disk or volume for MergeTree-engine tables in a background. Default value: 8. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundDistributedSchedulePoolSize |
string (int64) The maximum number of threads that will be used for executing distributed sends. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundBufferFlushSchedulePoolSize |
string (int64) The maximum number of threads that will be used for performing flush operations for Buffer-engine tables in the background. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundMessageBrokerSchedulePoolSize |
string (int64) The maximum number of threads that will be used for executing background operations for message streaming. Default value: 16. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
backgroundCommonPoolSize |
string (int64) The maximum number of threads that will be used for performing a variety of operations (mostly garbage collection) for MergeTree-engine tables in a background. Default value: 8. Change of the setting is applied with restart on value decrease and without restart on value increase. For details, see ClickHouse documentation |
|
dictionariesLazyLoad |
boolean Lazy loading of dictionaries. If enabled, then each dictionary is loaded on the first use. Otherwise, the server loads all dictionaries at startup. Default value: true for versions 25.1 and higher, false for versions 24.12 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
logLevel |
enum (LogLevel) Logging level.
|
|
queryLogRetentionSize |
string (int64) The maximum size that query_log can grow to before old data will be removed. If set to 0, Default value: 1073741824 (1 GiB). |
|
queryLogRetentionTime |
string (int64) The maximum time that query_log records will be retained before removal. If set to 0, automatic removal of query_log data based on time is disabled. Default value: 2592000000 (30 days). |
|
queryThreadLogEnabled |
boolean Enables or disables query_thread_log system table. Default value: true. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
queryThreadLogRetentionSize |
string (int64) The maximum size that query_thread_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
queryThreadLogRetentionTime |
string (int64) The maximum time that query_thread_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
partLogRetentionSize |
string (int64) The maximum size that part_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
partLogRetentionTime |
string (int64) The maximum time that part_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
metricLogEnabled |
boolean Enables or disables metric_log system table. Default value: false for versions 25.1 and higher, true for versions 24.12 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
metricLogRetentionSize |
string (int64) The maximum size that metric_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
metricLogRetentionTime |
string (int64) The maximum time that metric_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
traceLogEnabled |
boolean Enables or disables trace_log system table. Default value: true for versions 25.2 and higher, false for versions 25.1 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
traceLogRetentionSize |
string (int64) The maximum size that trace_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
traceLogRetentionTime |
string (int64) The maximum time that trace_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
textLogEnabled |
boolean Enables or disables text_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
textLogRetentionSize |
string (int64) The maximum size that text_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB). |
|
textLogRetentionTime |
string (int64) The maximum time that text_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
textLogLevel |
enum (LogLevel) Logging level for text_log system table. Default value: TRACE. Change of the setting is applied with restart.
|
|
opentelemetrySpanLogEnabled |
boolean Enables or disables opentelemetry_span_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
opentelemetrySpanLogRetentionSize |
string (int64) The maximum size that opentelemetry_span_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
opentelemetrySpanLogRetentionTime |
string (int64) The maximum time that opentelemetry_span_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
queryViewsLogEnabled |
boolean Enables or disables query_views_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
queryViewsLogRetentionSize |
string (int64) The maximum size that query_views_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
queryViewsLogRetentionTime |
string (int64) The maximum time that query_views_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
asynchronousMetricLogEnabled |
boolean Enables or disables asynchronous_metric_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
asynchronousMetricLogRetentionSize |
string (int64) The maximum size that asynchronous_metric_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
asynchronousMetricLogRetentionTime |
string (int64) The maximum time that asynchronous_metric_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
sessionLogEnabled |
boolean Enables or disables session_log system table. Default value: true for versions 25.3 and higher, false for versions 25.2 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
sessionLogRetentionSize |
string (int64) The maximum size that session_log can grow to before old data will be removed. If set to 0, Default value: 536870912 (512 MiB) for versions 25.3 and higher, 0 for versions 25.2 and lower. |
|
sessionLogRetentionTime |
string (int64) The maximum time that session_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
zookeeperLogEnabled |
boolean Enables or disables zookeeper_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
zookeeperLogRetentionSize |
string (int64) The maximum size that zookeeper_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
zookeeperLogRetentionTime |
string (int64) The maximum time that zookeeper_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
asynchronousInsertLogEnabled |
boolean Enables or disables asynchronous_insert_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
asynchronousInsertLogRetentionSize |
string (int64) The maximum size that asynchronous_insert_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
asynchronousInsertLogRetentionTime |
string (int64) The maximum time that asynchronous_insert_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
processorsProfileLogEnabled |
boolean Enables or disables processors_profile_log system table. Default value: true for versions 25.2 and higher, false for versions 25.1 and lower. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
processorsProfileLogRetentionSize |
string (int64) The maximum size that processors_profile_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
processorsProfileLogRetentionTime |
string (int64) The maximum time that processors_profile_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
errorLogEnabled |
boolean Enables or disables error_log system table. Default value: false. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
errorLogRetentionSize |
string (int64) The maximum size that error_log can grow to before old data will be removed. If set to 0, Default value: 0. |
|
errorLogRetentionTime |
string (int64) The maximum time that error_log records will be retained before removal. If set to 0, Default value: 2592000000 (30 days). |
|
accessControlImprovements |
Access control settings. |
|
maxConnections |
string (int64) Maximum number of inbound connections. Default value: 4096. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
maxConcurrentQueries |
string (int64) Maximum number of concurrently executed queries. Default value: 500. For details, see ClickHouse documentation |
|
maxTableSizeToDrop |
string (int64) Maximum size of the table that can be deleted using DROP or TRUNCATE query. Default value: 50000000000 (48828125 KiB). For details, see ClickHouse documentation |
|
maxPartitionSizeToDrop |
string (int64) Maximum size of the partition that can be deleted using DROP or TRUNCATE query. Default value: 50000000000 (48828125 KiB). For details, see ClickHouse documentation |
|
keepAliveTimeout |
string (int64) The number of seconds that ClickHouse waits for incoming requests for HTTP protocol before closing the connection. Default value: 30. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
uncompressedCacheSize |
string (int64) Cache size (in bytes) for uncompressed data used by table engines from the MergeTree family. 0 means disabled. For details, see ClickHouse documentation |
|
markCacheSize |
string (int64) Maximum size (in bytes) of the cache of "marks" used by MergeTree tables. For details, see ClickHouse documentation |
|
timezone |
string The server's time zone to be used in DateTime fields conversions. Specified as an IANA identifier. Default value: Europe/Moscow. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
geobaseEnabled |
boolean Enables or disables geobase. Default value: false for versions 25.8 and higher, true for versions 25.7 and lower. Change of the setting is applied with restart. |
|
geobaseUri |
string Address of the archive with the user geobase in Object Storage. Change of the setting is applied with restart. |
|
defaultDatabase |
string The default database. Default value: default. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
totalMemoryProfilerStep |
string (int64) Whenever server memory usage becomes larger than every next step in number of bytes the memory profiler will collect Default value: 0. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
totalMemoryTrackerSampleProbability |
number (double) Allows to collect random allocations and de-allocations and writes them in the system.trace_log system table Default value: 0. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
asyncInsertThreads |
string (int64) Maximum number of threads to parse and insert data in background. If set to 0, asynchronous mode is disabled. Default value: 16. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
backupThreads |
string (int64) The maximum number of threads to execute BACKUP requests. Default value: 16. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
restoreThreads |
string (int64) The maximum number of threads to execute RESTORE requests. Default value: 16. Change of the setting is applied with restart. For details, see ClickHouse documentation |
|
mergeTree |
Settings for the MergeTree table engine family. Change of the settings of merge_tree is applied with restart. |
|
compression[] |
Data compression settings for MergeTree engine tables. Change of the settings of compression is applied with restart. For details, see ClickHouse documentation |
|
dictionaries[] |
Configuration of external dictionaries. Change of the settings of dictionaries is applied with restart. For details, see ClickHouse documentation |
|
graphiteRollup[] |
Rollup settings for the GraphiteMergeTree engine tables. Change of the settings of graphite_rollup is applied with restart. For details, see ClickHouse documentation |
|
kafka |
Kafka integration settings. Change of the settings of kafka is applied with restart. |
|
kafkaTopics[] |
Per-topic Kafka integration settings. Change of the settings of kafka_topics is applied with restart. |
|
rabbitmq |
RabbitMQ integration settings. Change of the settings of rabbitmq is applied with restart. |
|
queryMaskingRules[] |
Regexp-based rules, which will be applied to queries as well as all log messages before storing them in server logs, Change of the settings of query_masking_rules is applied with restart. For details, see ClickHouse documentation |
|
queryCache |
Query cache Change of the settings of query_cache is applied with restart. |
|
jdbcBridge |
JDBC bridge configuration for queries to external databases. Change of the settings of jdbc_bridge is applied with restart. For details, see ClickHouse documentation |
|
mysqlProtocol |
boolean Enables or disables MySQL interface on ClickHouse server Default value: false. For details, see ClickHouse documentation |
|
customMacros[] |
Custom ClickHouse macros. |
|
builtinDictionariesReloadInterval |
string (int64) The interval in seconds before reloading built-in dictionaries. Default value: 3600. For details, see ClickHouse documentation |
AccessControlImprovements
Access control settings.
For details, see ClickHouse documentation
|
Field |
Description |
|
selectFromSystemDbRequiresGrant |
boolean Sets whether SELECT * FROM system.<table> requires any grants and can be executed by any user. Default value: false. |
|
selectFromInformationSchemaRequiresGrant |
boolean Sets whether SELECT * FROM information_schema.<table> requires any grants and can be executed by any user. Default value: false. |
MergeTree
Settings for the MergeTree table engine family.
|
Field |
Description |
|
partsToDelayInsert |
string (int64) If the number of active parts in a single partition exceeds the parts_to_delay_insert value, an INSERT artificially slows down. Default value: 1000 for versions 25.1 and higher, 150 for versions 24.12 and lower. For details, see ClickHouse documentation |
|
partsToThrowInsert |
string (int64) If the number of active parts in a single partition exceeds the parts_to_throw_insert value, an INSERT Default value: 3000 for versions 25.1 and higher, 300 for versions 24.12 and lower. For details, see ClickHouse documentation |
|
inactivePartsToDelayInsert |
string (int64) If the number of inactive parts in a single partition in the table exceeds the inactive_parts_to_delay_insert value, Default value: 0. For details, see ClickHouse documentation |
|
inactivePartsToThrowInsert |
string (int64) If the number of inactive parts in a single partition more than the inactive_parts_to_throw_insert value, Default value: 0. For details, see ClickHouse documentation |
|
maxAvgPartSizeForTooManyParts |
string (int64) The "Too many parts" check according to parts_to_delay_insert and parts_to_throw_insert will be active only if the average Default value: 1073741824 (1 GiB). For details, see ClickHouse documentation |
|
maxPartsInTotal |
string (int64) If the total number of active parts in all partitions of a table exceeds the max_parts_in_total value, Default value: 20000 for versions 25.2 and higher, 100000 for versions 25.1 and lower. For details, see ClickHouse documentation |
|
maxReplicatedMergesInQueue |
string (int64) How many tasks of merging and mutating parts are allowed simultaneously in ReplicatedMergeTree queue. Default value: 32 for versions 25.8 and higher, 16 for versions 25.7 and lower. For details, see ClickHouse documentation |
|
numberOfFreeEntriesInPoolToLowerMaxSizeOfMerge |
string (int64) When there is less than the specified number of free entries in pool (or replicated queue), start to lower maximum size of Default value: 8. For details, see ClickHouse documentation |
|
numberOfFreeEntriesInPoolToExecuteMutation |
string (int64) When there is less than specified number of free entries in pool, do not execute part mutations. Default value: 20. For details, see ClickHouse documentation |
|
maxBytesToMergeAtMinSpaceInPool |
string (int64) The maximum total part size (in bytes) to be merged into one part, with the minimum available resources in the background pool. Default value: 1048576 (1 MiB). For details, see ClickHouse documentation |
|
maxBytesToMergeAtMaxSpaceInPool |
string (int64) The maximum total parts size (in bytes) to be merged into one part, if there are enough resources available. Default value: 161061273600 (150 GiB). For details, see ClickHouse documentation |
|
minBytesForWidePart |
string (int64) Minimum number of bytes in a data part that can be stored in Wide format. Default value: 10485760 (10 MiB). For details, see ClickHouse documentation |
|
minRowsForWidePart |
string (int64) Minimum number of rows in a data part that can be stored in Wide format. Default value: 0. For details, see ClickHouse documentation |
|
cleanupDelayPeriod |
string (int64) Minimum period to clean old queue logs, blocks hashes and parts. Default value: 30. For details, see ClickHouse documentation |
|
maxCleanupDelayPeriod |
string (int64) Maximum period to clean old queue logs, blocks hashes and parts. Default value: 300 (5 minutes). For details, see ClickHouse documentation |
|
mergeSelectingSleepMs |
string (int64) Minimum time to wait before trying to select parts to merge again after no parts were selected. A lower setting value will trigger Default value: 5000 (5 seconds). For details, see ClickHouse documentation |
|
maxMergeSelectingSleepMs |
string (int64) Maximum time to wait before trying to select parts to merge again after no parts were selected. A lower setting value will trigger Default value: 60000 (1 minute). For details, see ClickHouse documentation |
|
minAgeToForceMergeSeconds |
string (int64) Merge parts if every part in the range is older than the specified value. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
minAgeToForceMergeOnPartitionOnly |
boolean Whether min_age_to_force_merge_seconds should be applied only on the entire partition and not on subset. Default value: false. For details, see ClickHouse documentation |
|
mergeMaxBlockSize |
string (int64) The number of rows that are read from the merged parts into memory. Default value: 8192. For details, see ClickHouse documentation |
|
deduplicateMergeProjectionMode |
enum (DeduplicateMergeProjectionMode) Determines the behavior of background merges for MergeTree tables with projections. Default value: DEDUPLICATE_MERGE_PROJECTION_MODE_THROW. For details, see ClickHouse documentation
|
|
lightweightMutationProjectionMode |
enum (LightweightMutationProjectionMode) Determines the behavior of lightweight deletes for MergeTree tables with projections. Default value: LIGHTWEIGHT_MUTATION_PROJECTION_MODE_THROW. For details, see ClickHouse documentation
|
|
replicatedDeduplicationWindow |
string (int64) The number of most recently inserted blocks for which ClickHouse Keeper stores hash sums to check for duplicates. Default value: 10000 for versions 25.9 and higher, 1000 for versions from 23.11 to 25.8, 100 for versions 23.10 and lower. For details, see ClickHouse documentation |
|
replicatedDeduplicationWindowSeconds |
string (int64) The number of seconds after which the hash sums of the inserted blocks are removed from ClickHouse Keeper. Default value: 604800 (7 days). For details, see ClickHouse documentation |
|
fsyncAfterInsert |
boolean Do fsync for every inserted part. Significantly decreases performance of inserts, not recommended to use with wide parts. Default value: false. For details, see ClickHouse documentation |
|
fsyncPartDirectory |
boolean Do fsync for part directory after all part operations (writes, renames, etc.). Default value: false. For details, see ClickHouse documentation |
|
minCompressedBytesToFsyncAfterFetch |
string (int64) Minimal number of compressed bytes to do fsync for part after fetch. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
minCompressedBytesToFsyncAfterMerge |
string (int64) Minimal number of compressed bytes to do fsync for part after merge. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
minRowsToFsyncAfterMerge |
string (int64) Minimal number of rows to do fsync for part after merge. 0 means disabled. Default value: 0. For details, see ClickHouse documentation |
|
ttlOnlyDropParts |
boolean Controls whether data parts are fully dropped in MergeTree tables when all rows in that part have expired according to their TTL settings.
Default value: false. For details, see ClickHouse documentation |
|
mergeWithTtlTimeout |
string (int64) Minimum delay in seconds before repeating a merge with delete TTL. Default value: 14400 (4 hours). For details, see ClickHouse documentation |
|
mergeWithRecompressionTtlTimeout |
string (int64) Minimum delay in seconds before repeating a merge with recompression TTL. Default value: 14400 (4 hours). For details, see ClickHouse documentation |
|
maxNumberOfMergesWithTtlInPool |
string (int64) When there is more than specified number of merges with TTL entries in pool, do not assign new merge with TTL. Default value: 2. For details, see ClickHouse documentation |
|
materializeTtlRecalculateOnly |
boolean Only recalculate ttl info when MATERIALIZE TTL. Default value: true for versions 25.2 and higher, false for versions 25.1 and lower. For details, see ClickHouse documentation |
|
checkSampleColumnIsCorrect |
boolean Enables the check at table creation, that the data type of a column for sampling or sampling expression is correct. Default value: true. For details, see ClickHouse documentation |
|
allowRemoteFsZeroCopyReplication |
boolean Setting is automatically enabled if cloud storage is enabled, disabled otherwise. Default value: true. |
Compression
Compression settings.
For details, see ClickHouse documentation
|
Field |
Description |
|
method |
enum (Method) Required field. Compression method to use for the specified combination of min_part_size and min_part_size_ratio.
|
|
minPartSize |
string (int64) The minimum size of a data part. |
|
minPartSizeRatio |
string The ratio of the data part size to the table size. |
|
level |
string (int64) Compression level. |
ExternalDictionary
External dictionary configuration.
|
Field |
Description |
|
name |
string Required field. Name of the external dictionary. |
|
structure |
Required field. Structure of the external dictionary. |
|
layout |
Required field. Layout determining how to store the dictionary in memory. For details, see https://clickhouse.com/docs/sql-reference/dictionaries#ways-to-store-dictionaries-in-memory. |
|
fixedLifetime |
string (int64) Fixed interval between dictionary updates. Includes only one of the fields |
|
lifetimeRange |
Range of intervals between dictionary updates for ClickHouse to choose from. Includes only one of the fields |
|
httpSource |
HTTP source for the dictionary. Includes only one of the fields |
|
mysqlSource |
MySQL source for the dictionary. Includes only one of the fields |
|
clickhouseSource |
ClickHouse source for the dictionary. Includes only one of the fields |
|
mongodbSource |
MongoDB source for the dictionary. Includes only one of the fields |
|
postgresqlSource |
PostgreSQL source for the dictionary. Includes only one of the fields |
Structure
Configuration of external dictionary structure.
|
Field |
Description |
|
id |
Single numeric key column for the dictionary. |
|
key |
Composite key for the dictionary, containing of one or more key columns. For details, see ClickHouse documentation |
|
rangeMin |
Field holding the beginning of the range for dictionaries with RANGE_HASHED layout. For details, see ClickHouse documentation |
|
rangeMax |
Field holding the end of the range for dictionaries with RANGE_HASHED layout. For details, see ClickHouse documentation |
|
attributes[] |
Description of the fields available for database queries. For details, see ClickHouse documentation |
Id
Numeric key.
|
Field |
Description |
|
name |
string Required field. Name of the numeric key. |
Key
Complex key.
|
Field |
Description |
|
attributes[] |
Attributes of a complex key. |
Attribute
|
Field |
Description |
|
name |
string Required field. Name of the column. |
|
type |
string Required field. Type of the column. |
|
nullValue |
string Default value for an element without data (for example, an empty string). |
|
expression |
string Expression, describing the attribute, if applicable. |
|
hierarchical |
boolean Indication of hierarchy support. Default value: false. |
|
injective |
boolean Indication of injective mapping "id -> attribute". Default value: false. |
Layout
|
Field |
Description |
|
type |
enum (Type) Required field. Layout type. For details, see ClickHouse documentation
|
|
sizeInCells |
string (int64) Number of cells in the cache. Rounded up to a power of two. Default value: 1000000000. For details, see ClickHouse documentation |
|
allowReadExpiredKeys |
boolean Allows to read expired keys. Default value: false. For details, see ClickHouse documentation |
|
maxUpdateQueueSize |
string (int64) Max size of update queue. Default value: 100000. For details, see ClickHouse documentation |
|
updateQueuePushTimeoutMilliseconds |
string (int64) Max timeout in milliseconds for push update task into queue. Default value: 10. For details, see ClickHouse documentation |
|
queryWaitTimeoutMilliseconds |
string (int64) Max wait timeout in milliseconds for update task to complete. Default value: 60000 (1 minute). For details, see ClickHouse documentation |
|
maxThreadsForUpdates |
string (int64) Max threads for cache dictionary update. Default value: 4. For details, see ClickHouse documentation |
|
initialArraySize |
string (int64) Initial dictionary key size. Default value: 1024. For details, see ClickHouse documentation |
|
maxArraySize |
string (int64) Maximum dictionary key size. Default value: 500000. For details, see ClickHouse documentation |
|
accessToKeyFromAttributes |
boolean Allows to retrieve key attribute using dictGetString function. For details, see ClickHouse documentation |
Range
|
Field |
Description |
|
min |
string (int64) Minimum dictionary lifetime. |
|
max |
string (int64) Maximum dictionary lifetime. |
HttpSource
|
Field |
Description |
|
url |
string Required field. URL of the source dictionary available over HTTP. |
|
format |
string Required field. The data format. Valid values are all formats supported by ClickHouse SQL dialect |
|
headers[] |
HTTP headers. |
Header
|
Field |
Description |
|
name |
string Required field. Header name. |
|
value |
string Required field. Header value. |
MysqlSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
table |
string Required field. Table name. |
|
port |
string (int64) Port to use when connecting to a replica of the dictionary source. |
|
user |
string Required field. Name of the user for replicas of the dictionary source. |
|
password |
string Password of the user for replicas of the dictionary source. |
|
replicas[] |
List of MySQL replicas of the database used as dictionary source. |
|
where |
string Selection criteria for the data in the specified MySQL table. |
|
invalidateQuery |
string Query for checking the dictionary status, to pull only updated data. |
|
closeConnection |
boolean Should a connection be closed after each request. |
|
shareConnection |
boolean Should a connection be shared for some requests. |
Replica
|
Field |
Description |
|
host |
string Required field. MySQL host of the replica. |
|
priority |
string (int64) The priority of the replica that ClickHouse takes into account when connecting. |
|
port |
string (int64) Port to use when connecting to the replica. |
|
user |
string Name of the MySQL database user. |
|
password |
string Password of the MySQL database user. |
ClickhouseSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
table |
string Required field. Table name. |
|
host |
string ClickHouse host. |
|
port |
string (int64) Port to use when connecting to the host. |
|
user |
string Required field. Name of the ClickHouse database user. |
|
password |
string Password of the ClickHouse database user. |
|
where |
string Selection criteria for the data in the specified ClickHouse table. |
|
secure |
boolean Determines whether to use TLS for connection. |
MongodbSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
collection |
string Required field. Collection name. |
|
host |
string Required field. MongoDB host. |
|
port |
string (int64) Port to use when connecting to the host. |
|
user |
string Required field. Name of the MongoDB database user. |
|
password |
string Password of the MongoDB database user. |
|
options |
string Dictionary source options. |
PostgresqlSource
|
Field |
Description |
|
db |
string Required field. Database name. |
|
table |
string Required field. Table name. |
|
hosts[] |
string PostgreSQL hosts. |
|
port |
string (int64) Port to use when connecting to the PostgreSQL hosts. |
|
user |
string Required field. Name of the PostrgreSQL database user. |
|
password |
string Password of the PostrgreSQL database user. |
|
invalidateQuery |
string Query for checking the dictionary status, to pull only updated data. |
|
sslMode |
enum (SslMode) Mode of SSL TCP/IP connection to the PostgreSQL host.
|
GraphiteRollup
Rollup settings for the GraphiteMergeTree table engine.
For details, see ClickHouse documentation
|
Field |
Description |
|
name |
string Required field. Name for the specified combination of settings for Graphite rollup. |
|
patterns[] |
Pattern to use for the rollup. |
|
pathColumnName |
string The name of the column storing the metric name (Graphite sensor). Default value: Path. |
|
timeColumnName |
string The name of the column storing the time of measuring the metric. Default value: Time. |
|
valueColumnName |
string The name of the column storing the value of the metric at the time set in time_column_name. Default value: Value. |
|
versionColumnName |
string The name of the column storing the version of the metric. Default value: Timestamp. |
Pattern
|
Field |
Description |
|
regexp |
string A pattern for the metric name (a regular or DSL). |
|
function |
string The name of the aggregating function to apply to data whose age falls within the range [age, age + precision]. |
|
retention[] |
Retention rules. |
Retention
|
Field |
Description |
|
age |
string (int64) The minimum age of the data in seconds. |
|
precision |
string (int64) Precision of determining the age of the data, in seconds. Should be a divisor for 86400 (seconds in a day). |
Kafka
Kafka configuration settings.
For details, see librdkafka documentation
|
Field |
Description |
|
securityProtocol |
enum (SecurityProtocol) Protocol used to communicate with brokers. Default value: SECURITY_PROTOCOL_PLAINTEXT.
|
|
saslMechanism |
enum (SaslMechanism) SASL mechanism to use for authentication. Default value: SASL_MECHANISM_GSSAPI.
|
|
saslUsername |
string SASL username for use with the PLAIN and SASL-SCRAM mechanisms. |
|
saslPassword |
string SASL password for use with the PLAIN and SASL-SCRAM mechanisms. |
|
enableSslCertificateVerification |
boolean Enable OpenSSL's builtin broker (server) certificate verification. Default value: true. |
|
maxPollIntervalMs |
string (int64) Maximum allowed time between calls to consume messages for high-level consumers. Default value: 300000 (5 minutes). |
|
sessionTimeoutMs |
string (int64) Client group session and failure detection timeout. The consumer sends periodic heartbeats (heartbeat.interval.ms) Default value: 45000 (45 seconds). |
|
debug |
enum (Debug) Debug context to enable.
|
|
autoOffsetReset |
enum (AutoOffsetReset) Action to take when there is no initial offset in offset store or the desired offset is out of range. Default value: AUTO_OFFSET_RESET_LARGEST.
|
KafkaTopic
|
Field |
Description |
|
name |
string Required field. Kafka topic name. |
|
settings |
Required field. Kafka topic settings. |
Rabbitmq
RabbitMQ integration settings.
For details, see ClickHouse documentation
|
Field |
Description |
|
username |
string RabbitMQ username. |
|
password |
string RabbitMQ password. |
|
vhost |
string RabbitMQ virtual host. |
QueryMaskingRule
|
Field |
Description |
|
name |
string Name for the rule. |
|
regexp |
string Required field. RE2 compatible regular expression. |
|
replace |
string Substitution string for sensitive data. Default value: six asterisks. |
QueryCache
Query cache configuration.
|
Field |
Description |
|
maxSizeInBytes |
string (int64) The maximum cache size in bytes. Default value: 1073741824 (1 GiB). |
|
maxEntries |
string (int64) The maximum number of SELECT query results stored in the cache. Default value: 1024. |
|
maxEntrySizeInBytes |
string (int64) The maximum size in bytes SELECT query results may have to be saved in the cache. Default value: 1048576 (1 MiB). |
|
maxEntrySizeInRows |
string (int64) The maximum number of rows SELECT query results may have to be saved in the cache. Default value: 30000000. |
JdbcBridge
JDBC bridge configuration for queries to external databases.
|
Field |
Description |
|
host |
string Host of jdbc bridge. |
|
port |
string (int64) Port of jdbc bridge. Default value: 9019. |
Macro
ClickHouse macro.
|
Field |
Description |
|
name |
string Required field. Name of the macro. |
|
value |
string Required field. Value of the macro. |
Resources
|
Field |
Description |
|
resourcePresetId |
string ID of the preset for computational resources available to a host (CPU, memory etc.). |
|
diskSize |
string (int64) Volume of the storage available to a host, in bytes. |
|
diskTypeId |
string Type of the storage environment for the host.
|
DiskSizeAutoscaling
|
Field |
Description |
|
plannedUsageThreshold |
string (int64) Amount of used storage for automatic disk scaling in the maintenance window, 0 means disabled, in percent. |
|
emergencyUsageThreshold |
string (int64) Amount of used storage for immediately automatic disk scaling, 0 means disabled, in percent. |
|
diskSizeLimit |
string (int64) Limit on how large the storage for database instances can automatically grow, in bytes. |