Managed Service for Apache Kafka® API, gRPC: ClusterService.Update

Статья создана

Yandex Cloud

Обновлена 17 декабря 2024 г.

gRPC request
UpdateClusterRequest
ConfigSpec
Kafka
Resources
KafkaConfig2_8
KafkaConfig3
Zookeeper
Access
RestAPIConfig
DiskSizeAutoscaling
KRaft
MaintenanceWindow
AnytimeMaintenanceWindow
WeeklyMaintenanceWindow
operation.Operation
UpdateClusterMetadata
Cluster
Monitoring
ConfigSpec
Kafka
Resources
KafkaConfig2_8
KafkaConfig3
Zookeeper
Access
RestAPIConfig
DiskSizeAutoscaling
KRaft
MaintenanceWindow
AnytimeMaintenanceWindow
WeeklyMaintenanceWindow
MaintenanceOperation

Updates the specified Apache Kafka® cluster.

gRPC request

rpc Update (UpdateClusterRequest) returns (operation.Operation)

UpdateClusterRequest

{
  "cluster_id": "string",
  "update_mask": "google.protobuf.FieldMask",
  "description": "string",
  "labels": "map<string, string>",
  "config_spec": {
    "version": "string",
    "kafka": {
      "resources": {
        "resource_preset_id": "string",
        "disk_size": "int64",
        "disk_type_id": "string"
      },
      // Includes only one of the fields `kafka_config_2_8`, `kafka_config_3`
      "kafka_config_2_8": {
        "compression_type": "CompressionType",
        "log_flush_interval_messages": "google.protobuf.Int64Value",
        "log_flush_interval_ms": "google.protobuf.Int64Value",
        "log_flush_scheduler_interval_ms": "google.protobuf.Int64Value",
        "log_retention_bytes": "google.protobuf.Int64Value",
        "log_retention_hours": "google.protobuf.Int64Value",
        "log_retention_minutes": "google.protobuf.Int64Value",
        "log_retention_ms": "google.protobuf.Int64Value",
        "log_segment_bytes": "google.protobuf.Int64Value",
        "log_preallocate": "google.protobuf.BoolValue",
        "socket_send_buffer_bytes": "google.protobuf.Int64Value",
        "socket_receive_buffer_bytes": "google.protobuf.Int64Value",
        "auto_create_topics_enable": "google.protobuf.BoolValue",
        "num_partitions": "google.protobuf.Int64Value",
        "default_replication_factor": "google.protobuf.Int64Value",
        "message_max_bytes": "google.protobuf.Int64Value",
        "replica_fetch_max_bytes": "google.protobuf.Int64Value",
        "ssl_cipher_suites": [
          "string"
        ],
        "offsets_retention_minutes": "google.protobuf.Int64Value",
        "sasl_enabled_mechanisms": [
          "SaslMechanism"
        ]
      },
      "kafka_config_3": {
        "compression_type": "CompressionType",
        "log_flush_interval_messages": "google.protobuf.Int64Value",
        "log_flush_interval_ms": "google.protobuf.Int64Value",
        "log_flush_scheduler_interval_ms": "google.protobuf.Int64Value",
        "log_retention_bytes": "google.protobuf.Int64Value",
        "log_retention_hours": "google.protobuf.Int64Value",
        "log_retention_minutes": "google.protobuf.Int64Value",
        "log_retention_ms": "google.protobuf.Int64Value",
        "log_segment_bytes": "google.protobuf.Int64Value",
        "log_preallocate": "google.protobuf.BoolValue",
        "socket_send_buffer_bytes": "google.protobuf.Int64Value",
        "socket_receive_buffer_bytes": "google.protobuf.Int64Value",
        "auto_create_topics_enable": "google.protobuf.BoolValue",
        "num_partitions": "google.protobuf.Int64Value",
        "default_replication_factor": "google.protobuf.Int64Value",
        "message_max_bytes": "google.protobuf.Int64Value",
        "replica_fetch_max_bytes": "google.protobuf.Int64Value",
        "ssl_cipher_suites": [
          "string"
        ],
        "offsets_retention_minutes": "google.protobuf.Int64Value",
        "sasl_enabled_mechanisms": [
          "SaslMechanism"
        ]
      }
      // end of the list of possible fields
    },
    "zookeeper": {
      "resources": {
        "resource_preset_id": "string",
        "disk_size": "int64",
        "disk_type_id": "string"
      }
    },
    "zone_id": [
      "string"
    ],
    "brokers_count": "google.protobuf.Int64Value",
    "assign_public_ip": "bool",
    "unmanaged_topics": "bool",
    "schema_registry": "bool",
    "access": {
      "data_transfer": "bool"
    },
    "rest_api_config": {
      "enabled": "bool"
    },
    "disk_size_autoscaling": {
      "planned_usage_threshold": "int64",
      "emergency_usage_threshold": "int64",
      "disk_size_limit": "int64"
    },
    "kraft": {
      "resources": {
        "resource_preset_id": "string",
        "disk_size": "int64",
        "disk_type_id": "string"
      }
    }
  },
  "name": "string",
  "security_group_ids": [
    "string"
  ],
  "deletion_protection": "bool",
  "maintenance_window": {
    // Includes only one of the fields `anytime`, `weekly_maintenance_window`
    "anytime": "AnytimeMaintenanceWindow",
    "weekly_maintenance_window": {
      "day": "WeekDay",
      "hour": "int64"
    }
    // end of the list of possible fields
  },
  "network_id": "string",
  "subnet_ids": [
    "string"
  ]
}

Field	Description
cluster_id	string Required field. ID of the Apache Kafka® cluster to update. To get the Apache Kafka® cluster ID, make a ClusterService.List request.
update_mask	google.protobuf.FieldMask
description	string New description of the Apache Kafka® cluster.
labels	object (map<string, string>) Custom labels for the Apache Kafka® cluster as `key:value` pairs. For example, "project": "mvp" or "source": "dictionary". The new set of labels will completely replace the old ones. To add a label, request the current set with the ClusterService.Get method, then send an ClusterService.Update request with the new label added to the set.
config_spec	ConfigSpec New configuration and resources for hosts in the Apache Kafka® cluster. Use `update_mask` to prevent reverting all cluster settings that are not listed in `config_spec` to their default values.
name	string New name for the Apache Kafka® cluster.
security_group_ids[]	string User security groups
deletion_protection	bool Deletion Protection inhibits deletion of the cluster
maintenance_window	MaintenanceWindow New maintenance window settings for the cluster.
network_id	string ID of the network to move the cluster to.
subnet_ids[]	string IDs of subnets where the hosts are located or a new host is being created

ConfigSpec

Field	Description
version	string Version of Apache Kafka® used in the cluster. Possible values: `2.8`, `3.0`, `3.1`, `3.2`, `3.3`, `3.4`, `3.5`, `3.6`.
kafka	Kafka Configuration and resource allocation for Kafka brokers.
zookeeper	Zookeeper Configuration and resource allocation for ZooKeeper hosts.
zone_id[]	string IDs of availability zones where Kafka brokers reside.
brokers_count	google.protobuf.Int64Value The number of Kafka brokers deployed in each availability zone.
assign_public_ip	bool The flag that defines whether a public IP address is assigned to the cluster. If the value is `true`, then Apache Kafka® cluster is available on the Internet via it's public IP address.
unmanaged_topics	bool Allows to manage topics via AdminAPI Deprecated. Feature enabled permanently.
schema_registry	bool Enables managed schema registry on cluster
access	Access Access policy for external services.
rest_api_config	RestAPIConfig Configuration of REST API.
disk_size_autoscaling	DiskSizeAutoscaling DiskSizeAutoscaling settings
kraft	KRaft Configuration and resource allocation for KRaft-controller hosts.

Kafka

Field	Description
resources	Resources Resources allocated to Kafka brokers.
kafka_config_2_8	KafkaConfig2_8 Includes only one of the fields `kafka_config_2_8`, `kafka_config_3`. Kafka broker configuration.
kafka_config_3	KafkaConfig3 Includes only one of the fields `kafka_config_2_8`, `kafka_config_3`. Kafka broker configuration.

Resources

Field	Description
resource_preset_id	string ID of the preset for computational resources available to a host (CPU, memory, etc.). All available presets are listed in the documentation.
disk_size	int64 Volume of the storage available to a host, in bytes. Must be greater than 2 * partition segment size in bytes * partitions count, so each partition can have one active segment file and one closed segment file that can be deleted.
disk_type_id	string Type of the storage environment for the host.

KafkaConfig2_8

Kafka version 2.8 broker configuration.

Field	Description
compression_type	enum CompressionType Cluster topics compression type. `COMPRESSION_TYPE_UNSPECIFIED` `COMPRESSION_TYPE_UNCOMPRESSED`: no codec (uncompressed). `COMPRESSION_TYPE_ZSTD`: Zstandard codec. `COMPRESSION_TYPE_LZ4`: LZ4 codec. `COMPRESSION_TYPE_SNAPPY`: Snappy codec. `COMPRESSION_TYPE_GZIP`: GZip codec. `COMPRESSION_TYPE_PRODUCER`: the codec to use is set by a producer (can be any of `ZSTD`, `LZ4`, `GZIP` or `SNAPPY` codecs).
log_flush_interval_messages	google.protobuf.Int64Value The number of messages accumulated on a log partition before messages are flushed to disk. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.flush_messages setting.
log_flush_interval_ms	google.protobuf.Int64Value The maximum time (in milliseconds) that a message in any topic is kept in memory before flushed to disk. If not set, the value of `log_flush_scheduler_interval_ms` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.flush_ms setting.
log_flush_scheduler_interval_ms	google.protobuf.Int64Value The frequency of checks (in milliseconds) for any logs that need to be flushed to disk. This check is done by the log flusher.
log_retention_bytes	google.protobuf.Int64Value Partition size limit; Kafka will discard old log segments to free up space if `delete` TopicConfig2_8.cleanup_policy is in effect. This setting is helpful if you need to control the size of a log due to limited disk space. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.retention_bytes setting.
log_retention_hours	google.protobuf.Int64Value The number of hours to keep a log segment file before deleting it.
log_retention_minutes	google.protobuf.Int64Value The number of minutes to keep a log segment file before deleting it. If not set, the value of `log_retention_hours` is used.
log_retention_ms	google.protobuf.Int64Value The number of milliseconds to keep a log segment file before deleting it. If not set, the value of `log_retention_minutes` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.retention_ms setting.
log_segment_bytes	google.protobuf.Int64Value The maximum size of a single log file. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.segment_bytes setting.
log_preallocate	google.protobuf.BoolValue Should pre allocate file when create new segment? This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.preallocate setting.
socket_send_buffer_bytes	google.protobuf.Int64Value The SO_SNDBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
socket_receive_buffer_bytes	google.protobuf.Int64Value The SO_RCVBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
auto_create_topics_enable	google.protobuf.BoolValue Enable auto creation of topic on the server
num_partitions	google.protobuf.Int64Value Default number of partitions per topic on the whole cluster
default_replication_factor	google.protobuf.Int64Value Default replication factor of the topic on the whole cluster
message_max_bytes	google.protobuf.Int64Value The largest record batch size allowed by Kafka. Default value: 1048588.
replica_fetch_max_bytes	google.protobuf.Int64Value The number of bytes of messages to attempt to fetch for each partition. Default value: 1048576.
ssl_cipher_suites[]	string A list of cipher suites.
offsets_retention_minutes	google.protobuf.Int64Value Offset storage time after a consumer group loses all its consumers. Default: 10080.
sasl_enabled_mechanisms[]	enum SaslMechanism The list of SASL mechanisms enabled in the Kafka server. Default: [SCRAM_SHA_512]. `SASL_MECHANISM_UNSPECIFIED` `SASL_MECHANISM_SCRAM_SHA_256` `SASL_MECHANISM_SCRAM_SHA_512`

KafkaConfig3

Kafka version 3.x broker configuration.

Field	Description
compression_type	enum CompressionType Cluster topics compression type. `COMPRESSION_TYPE_UNSPECIFIED` `COMPRESSION_TYPE_UNCOMPRESSED`: no codec (uncompressed). `COMPRESSION_TYPE_ZSTD`: Zstandard codec. `COMPRESSION_TYPE_LZ4`: LZ4 codec. `COMPRESSION_TYPE_SNAPPY`: Snappy codec. `COMPRESSION_TYPE_GZIP`: GZip codec. `COMPRESSION_TYPE_PRODUCER`: the codec to use is set by a producer (can be any of `ZSTD`, `LZ4`, `GZIP` or `SNAPPY` codecs).
log_flush_interval_messages	google.protobuf.Int64Value The number of messages accumulated on a log partition before messages are flushed to disk. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.flush_messages setting.
log_flush_interval_ms	google.protobuf.Int64Value The maximum time (in milliseconds) that a message in any topic is kept in memory before flushed to disk. If not set, the value of `log_flush_scheduler_interval_ms` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.flush_ms setting.
log_flush_scheduler_interval_ms	google.protobuf.Int64Value The frequency of checks (in milliseconds) for any logs that need to be flushed to disk. This check is done by the log flusher.
log_retention_bytes	google.protobuf.Int64Value Partition size limit; Kafka will discard old log segments to free up space if `delete` TopicConfig3.cleanup_policy is in effect. This setting is helpful if you need to control the size of a log due to limited disk space. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.retention_bytes setting.
log_retention_hours	google.protobuf.Int64Value The number of hours to keep a log segment file before deleting it.
log_retention_minutes	google.protobuf.Int64Value The number of minutes to keep a log segment file before deleting it. If not set, the value of `log_retention_hours` is used.
log_retention_ms	google.protobuf.Int64Value The number of milliseconds to keep a log segment file before deleting it. If not set, the value of `log_retention_minutes` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.retention_ms setting.
log_segment_bytes	google.protobuf.Int64Value The maximum size of a single log file. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.segment_bytes setting.
log_preallocate	google.protobuf.BoolValue Should pre allocate file when create new segment? This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.preallocate setting.
socket_send_buffer_bytes	google.protobuf.Int64Value The SO_SNDBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
socket_receive_buffer_bytes	google.protobuf.Int64Value The SO_RCVBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
auto_create_topics_enable	google.protobuf.BoolValue Enable auto creation of topic on the server
num_partitions	google.protobuf.Int64Value Default number of partitions per topic on the whole cluster
default_replication_factor	google.protobuf.Int64Value Default replication factor of the topic on the whole cluster
message_max_bytes	google.protobuf.Int64Value The largest record batch size allowed by Kafka. Default value: 1048588.
replica_fetch_max_bytes	google.protobuf.Int64Value The number of bytes of messages to attempt to fetch for each partition. Default value: 1048576.
ssl_cipher_suites[]	string A list of cipher suites.
offsets_retention_minutes	google.protobuf.Int64Value Offset storage time after a consumer group loses all its consumers. Default: 10080.
sasl_enabled_mechanisms[]	enum SaslMechanism The list of SASL mechanisms enabled in the Kafka server. Default: [SCRAM_SHA_512]. `SASL_MECHANISM_UNSPECIFIED` `SASL_MECHANISM_SCRAM_SHA_256` `SASL_MECHANISM_SCRAM_SHA_512`

Zookeeper

Field

Description

resources

Resources

Resources allocated to ZooKeeper hosts.

Access

Field

Description

data_transfer

bool

Allow access for DataTransfer.

RestAPIConfig

Field

Description

enabled

bool

Is REST API enabled for this cluster.

DiskSizeAutoscaling

Field	Description
planned_usage_threshold	int64 Threshold of storage usage (in percent) that triggers automatic scaling of the storage during the maintenance window. Zero value means disabled threshold.
emergency_usage_threshold	int64 Threshold of storage usage (in percent) that triggers immediate automatic scaling of the storage. Zero value means disabled threshold.
disk_size_limit	int64 New storage size (in bytes) that is set when one of the thresholds is achieved.

KRaft

Field

Description

resources

Resources

Resources allocated to KRaft controller hosts.

MaintenanceWindow

Field

Description

anytime

AnytimeMaintenanceWindow

Includes only one of the fields anytime, weekly_maintenance_window.

weekly_maintenance_window

WeeklyMaintenanceWindow

Includes only one of the fields anytime, weekly_maintenance_window.

AnytimeMaintenanceWindow

Field	Description
Empty

WeeklyMaintenanceWindow

Field

Description

day

enum WeekDay

WEEK_DAY_UNSPECIFIED
MON
TUE
WED
THU
FRI
SAT
SUN

hour

int64

Hour of the day in UTC.

operation.Operation

{
  "id": "string",
  "description": "string",
  "created_at": "google.protobuf.Timestamp",
  "created_by": "string",
  "modified_at": "google.protobuf.Timestamp",
  "done": "bool",
  "metadata": {
    "cluster_id": "string"
  },
  // Includes only one of the fields `error`, `response`
  "error": "google.rpc.Status",
  "response": {
    "id": "string",
    "folder_id": "string",
    "created_at": "google.protobuf.Timestamp",
    "name": "string",
    "description": "string",
    "labels": "map<string, string>",
    "environment": "Environment",
    "monitoring": [
      {
        "name": "string",
        "description": "string",
        "link": "string"
      }
    ],
    "config": {
      "version": "string",
      "kafka": {
        "resources": {
          "resource_preset_id": "string",
          "disk_size": "int64",
          "disk_type_id": "string"
        },
        // Includes only one of the fields `kafka_config_2_8`, `kafka_config_3`
        "kafka_config_2_8": {
          "compression_type": "CompressionType",
          "log_flush_interval_messages": "google.protobuf.Int64Value",
          "log_flush_interval_ms": "google.protobuf.Int64Value",
          "log_flush_scheduler_interval_ms": "google.protobuf.Int64Value",
          "log_retention_bytes": "google.protobuf.Int64Value",
          "log_retention_hours": "google.protobuf.Int64Value",
          "log_retention_minutes": "google.protobuf.Int64Value",
          "log_retention_ms": "google.protobuf.Int64Value",
          "log_segment_bytes": "google.protobuf.Int64Value",
          "log_preallocate": "google.protobuf.BoolValue",
          "socket_send_buffer_bytes": "google.protobuf.Int64Value",
          "socket_receive_buffer_bytes": "google.protobuf.Int64Value",
          "auto_create_topics_enable": "google.protobuf.BoolValue",
          "num_partitions": "google.protobuf.Int64Value",
          "default_replication_factor": "google.protobuf.Int64Value",
          "message_max_bytes": "google.protobuf.Int64Value",
          "replica_fetch_max_bytes": "google.protobuf.Int64Value",
          "ssl_cipher_suites": [
            "string"
          ],
          "offsets_retention_minutes": "google.protobuf.Int64Value",
          "sasl_enabled_mechanisms": [
            "SaslMechanism"
          ]
        },
        "kafka_config_3": {
          "compression_type": "CompressionType",
          "log_flush_interval_messages": "google.protobuf.Int64Value",
          "log_flush_interval_ms": "google.protobuf.Int64Value",
          "log_flush_scheduler_interval_ms": "google.protobuf.Int64Value",
          "log_retention_bytes": "google.protobuf.Int64Value",
          "log_retention_hours": "google.protobuf.Int64Value",
          "log_retention_minutes": "google.protobuf.Int64Value",
          "log_retention_ms": "google.protobuf.Int64Value",
          "log_segment_bytes": "google.protobuf.Int64Value",
          "log_preallocate": "google.protobuf.BoolValue",
          "socket_send_buffer_bytes": "google.protobuf.Int64Value",
          "socket_receive_buffer_bytes": "google.protobuf.Int64Value",
          "auto_create_topics_enable": "google.protobuf.BoolValue",
          "num_partitions": "google.protobuf.Int64Value",
          "default_replication_factor": "google.protobuf.Int64Value",
          "message_max_bytes": "google.protobuf.Int64Value",
          "replica_fetch_max_bytes": "google.protobuf.Int64Value",
          "ssl_cipher_suites": [
            "string"
          ],
          "offsets_retention_minutes": "google.protobuf.Int64Value",
          "sasl_enabled_mechanisms": [
            "SaslMechanism"
          ]
        }
        // end of the list of possible fields
      },
      "zookeeper": {
        "resources": {
          "resource_preset_id": "string",
          "disk_size": "int64",
          "disk_type_id": "string"
        }
      },
      "zone_id": [
        "string"
      ],
      "brokers_count": "google.protobuf.Int64Value",
      "assign_public_ip": "bool",
      "unmanaged_topics": "bool",
      "schema_registry": "bool",
      "access": {
        "data_transfer": "bool"
      },
      "rest_api_config": {
        "enabled": "bool"
      },
      "disk_size_autoscaling": {
        "planned_usage_threshold": "int64",
        "emergency_usage_threshold": "int64",
        "disk_size_limit": "int64"
      },
      "kraft": {
        "resources": {
          "resource_preset_id": "string",
          "disk_size": "int64",
          "disk_type_id": "string"
        }
      }
    },
    "network_id": "string",
    "health": "Health",
    "status": "Status",
    "security_group_ids": [
      "string"
    ],
    "host_group_ids": [
      "string"
    ],
    "deletion_protection": "bool",
    "maintenance_window": {
      // Includes only one of the fields `anytime`, `weekly_maintenance_window`
      "anytime": "AnytimeMaintenanceWindow",
      "weekly_maintenance_window": {
        "day": "WeekDay",
        "hour": "int64"
      }
      // end of the list of possible fields
    },
    "planned_operation": {
      "info": "string",
      "delayed_until": "google.protobuf.Timestamp"
    }
  }
  // end of the list of possible fields
}

An Operation resource. For more information, see Operation.

Field	Description
id	string ID of the operation.
description	string Description of the operation. 0-256 characters long.
created_at	google.protobuf.Timestamp Creation timestamp.
created_by	string ID of the user or service account who initiated the operation.
modified_at	google.protobuf.Timestamp The time when the Operation resource was last modified.
done	bool If the value is `false`, it means the operation is still in progress. If `true`, the operation is completed, and either `error` or `response` is available.
metadata	UpdateClusterMetadata Service-specific metadata associated with the operation. It typically contains the ID of the target resource that the operation is performed on. Any method that returns a long-running operation should document the metadata type, if any.
error	google.rpc.Status The error result of the operation in case of failure or cancellation. Includes only one of the fields `error`, `response`. The operation result. If `done == false` and there was no failure detected, neither `error` nor `response` is set. If `done == false` and there was a failure detected, `error` is set. If `done == true`, exactly one of `error` or `response` is set.
response	Cluster The normal response of the operation in case of success. If the original method returns no data on success, such as Delete, the response is google.protobuf.Empty. If the original method is the standard Create/Update, the response should be the target resource of the operation. Any method that returns a long-running operation should document the response type, if any. Includes only one of the fields `error`, `response`. The operation result. If `done == false` and there was no failure detected, neither `error` nor `response` is set. If `done == false` and there was a failure detected, `error` is set. If `done == true`, exactly one of `error` or `response` is set.

UpdateClusterMetadata

Field

Description

cluster_id

string

ID of the Apache Kafka® cluster that is being updated.

Cluster

An Apache Kafka® cluster resource.
For more information, see the Concepts section of the documentation.

Field	Description
id	string ID of the Apache Kafka® cluster. This ID is assigned at creation time.
folder_id	string ID of the folder that the Apache Kafka® cluster belongs to.
created_at	google.protobuf.Timestamp Creation timestamp.
name	string Name of the Apache Kafka® cluster. The name must be unique within the folder. 1-63 characters long. Value must match the regular expression `[a-zA-Z0-9_-]*`.
description	string Description of the Apache Kafka® cluster. 0-256 characters long.
labels	object (map<string, string>) Custom labels for the Apache Kafka® cluster as `key:value` pairs. A maximum of 64 labels per resource is allowed.
environment	enum Environment Deployment environment of the Apache Kafka® cluster. `ENVIRONMENT_UNSPECIFIED` `PRODUCTION`: Stable environment with a conservative update policy when only hotfixes are applied during regular maintenance. `PRESTABLE`: Environment with a more aggressive update policy when new versions are rolled out irrespective of backward compatibility.
monitoring[]	Monitoring Description of monitoring systems relevant to the Apache Kafka® cluster. The field is ignored for response of List method.
config	ConfigSpec Configuration of the Apache Kafka® cluster. The field is ignored for response of List method.
network_id	string ID of the network that the cluster belongs to.
health	enum Health Aggregated cluster health. `HEALTH_UNKNOWN`: State of the cluster is unknown (Host.health of all hosts in the cluster is `UNKNOWN`). `ALIVE`: Cluster is alive and well (Host.health of all hosts in the cluster is `ALIVE`). `DEAD`: Cluster is inoperable (Host.health of all hosts in the cluster is `DEAD`). `DEGRADED`: Cluster is in degraded state (Host.health of at least one of the hosts in the cluster is not `ALIVE`).
status	enum Status Current state of the cluster. `STATUS_UNKNOWN`: Cluster state is unknown. `CREATING`: Cluster is being created. `RUNNING`: Cluster is running normally. `ERROR`: Cluster encountered a problem and cannot operate. `UPDATING`: Cluster is being updated. `STOPPING`: Cluster is stopping. `STOPPED`: Cluster stopped. `STARTING`: Cluster is starting.
security_group_ids[]	string User security groups
host_group_ids[]	string Host groups hosting VMs of the cluster.
deletion_protection	bool Deletion Protection inhibits deletion of the cluster
maintenance_window	MaintenanceWindow Window of maintenance operations.
planned_operation	MaintenanceOperation Scheduled maintenance operation.

Monitoring

Metadata of monitoring system.

Field	Description
name	string Name of the monitoring system.
description	string Description of the monitoring system.
link	string Link to the monitoring system charts for the Apache Kafka® cluster.

ConfigSpec

Field	Description
version	string Version of Apache Kafka® used in the cluster. Possible values: `2.8`, `3.0`, `3.1`, `3.2`, `3.3`, `3.4`, `3.5`, `3.6`.
kafka	Kafka Configuration and resource allocation for Kafka brokers.
zookeeper	Zookeeper Configuration and resource allocation for ZooKeeper hosts.
zone_id[]	string IDs of availability zones where Kafka brokers reside.
brokers_count	google.protobuf.Int64Value The number of Kafka brokers deployed in each availability zone.
assign_public_ip	bool The flag that defines whether a public IP address is assigned to the cluster. If the value is `true`, then Apache Kafka® cluster is available on the Internet via it's public IP address.
unmanaged_topics	bool Allows to manage topics via AdminAPI Deprecated. Feature enabled permanently.
schema_registry	bool Enables managed schema registry on cluster
access	Access Access policy for external services.
rest_api_config	RestAPIConfig Configuration of REST API.
disk_size_autoscaling	DiskSizeAutoscaling DiskSizeAutoscaling settings
kraft	KRaft Configuration and resource allocation for KRaft-controller hosts.

Kafka

Field	Description
resources	Resources Resources allocated to Kafka brokers.
kafka_config_2_8	KafkaConfig2_8 Includes only one of the fields `kafka_config_2_8`, `kafka_config_3`. Kafka broker configuration.
kafka_config_3	KafkaConfig3 Includes only one of the fields `kafka_config_2_8`, `kafka_config_3`. Kafka broker configuration.

Resources

Field	Description
resource_preset_id	string ID of the preset for computational resources available to a host (CPU, memory, etc.). All available presets are listed in the documentation.
disk_size	int64 Volume of the storage available to a host, in bytes. Must be greater than 2 * partition segment size in bytes * partitions count, so each partition can have one active segment file and one closed segment file that can be deleted.
disk_type_id	string Type of the storage environment for the host.

KafkaConfig2_8

Kafka version 2.8 broker configuration.

Field	Description
compression_type	enum CompressionType Cluster topics compression type. `COMPRESSION_TYPE_UNSPECIFIED` `COMPRESSION_TYPE_UNCOMPRESSED`: no codec (uncompressed). `COMPRESSION_TYPE_ZSTD`: Zstandard codec. `COMPRESSION_TYPE_LZ4`: LZ4 codec. `COMPRESSION_TYPE_SNAPPY`: Snappy codec. `COMPRESSION_TYPE_GZIP`: GZip codec. `COMPRESSION_TYPE_PRODUCER`: the codec to use is set by a producer (can be any of `ZSTD`, `LZ4`, `GZIP` or `SNAPPY` codecs).
log_flush_interval_messages	google.protobuf.Int64Value The number of messages accumulated on a log partition before messages are flushed to disk. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.flush_messages setting.
log_flush_interval_ms	google.protobuf.Int64Value The maximum time (in milliseconds) that a message in any topic is kept in memory before flushed to disk. If not set, the value of `log_flush_scheduler_interval_ms` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.flush_ms setting.
log_flush_scheduler_interval_ms	google.protobuf.Int64Value The frequency of checks (in milliseconds) for any logs that need to be flushed to disk. This check is done by the log flusher.
log_retention_bytes	google.protobuf.Int64Value Partition size limit; Kafka will discard old log segments to free up space if `delete` TopicConfig2_8.cleanup_policy is in effect. This setting is helpful if you need to control the size of a log due to limited disk space. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.retention_bytes setting.
log_retention_hours	google.protobuf.Int64Value The number of hours to keep a log segment file before deleting it.
log_retention_minutes	google.protobuf.Int64Value The number of minutes to keep a log segment file before deleting it. If not set, the value of `log_retention_hours` is used.
log_retention_ms	google.protobuf.Int64Value The number of milliseconds to keep a log segment file before deleting it. If not set, the value of `log_retention_minutes` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.retention_ms setting.
log_segment_bytes	google.protobuf.Int64Value The maximum size of a single log file. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.segment_bytes setting.
log_preallocate	google.protobuf.BoolValue Should pre allocate file when create new segment? This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig2_8.preallocate setting.
socket_send_buffer_bytes	google.protobuf.Int64Value The SO_SNDBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
socket_receive_buffer_bytes	google.protobuf.Int64Value The SO_RCVBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
auto_create_topics_enable	google.protobuf.BoolValue Enable auto creation of topic on the server
num_partitions	google.protobuf.Int64Value Default number of partitions per topic on the whole cluster
default_replication_factor	google.protobuf.Int64Value Default replication factor of the topic on the whole cluster
message_max_bytes	google.protobuf.Int64Value The largest record batch size allowed by Kafka. Default value: 1048588.
replica_fetch_max_bytes	google.protobuf.Int64Value The number of bytes of messages to attempt to fetch for each partition. Default value: 1048576.
ssl_cipher_suites[]	string A list of cipher suites.
offsets_retention_minutes	google.protobuf.Int64Value Offset storage time after a consumer group loses all its consumers. Default: 10080.
sasl_enabled_mechanisms[]	enum SaslMechanism The list of SASL mechanisms enabled in the Kafka server. Default: [SCRAM_SHA_512]. `SASL_MECHANISM_UNSPECIFIED` `SASL_MECHANISM_SCRAM_SHA_256` `SASL_MECHANISM_SCRAM_SHA_512`

KafkaConfig3

Kafka version 3.x broker configuration.

Field	Description
compression_type	enum CompressionType Cluster topics compression type. `COMPRESSION_TYPE_UNSPECIFIED` `COMPRESSION_TYPE_UNCOMPRESSED`: no codec (uncompressed). `COMPRESSION_TYPE_ZSTD`: Zstandard codec. `COMPRESSION_TYPE_LZ4`: LZ4 codec. `COMPRESSION_TYPE_SNAPPY`: Snappy codec. `COMPRESSION_TYPE_GZIP`: GZip codec. `COMPRESSION_TYPE_PRODUCER`: the codec to use is set by a producer (can be any of `ZSTD`, `LZ4`, `GZIP` or `SNAPPY` codecs).
log_flush_interval_messages	google.protobuf.Int64Value The number of messages accumulated on a log partition before messages are flushed to disk. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.flush_messages setting.
log_flush_interval_ms	google.protobuf.Int64Value The maximum time (in milliseconds) that a message in any topic is kept in memory before flushed to disk. If not set, the value of `log_flush_scheduler_interval_ms` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.flush_ms setting.
log_flush_scheduler_interval_ms	google.protobuf.Int64Value The frequency of checks (in milliseconds) for any logs that need to be flushed to disk. This check is done by the log flusher.
log_retention_bytes	google.protobuf.Int64Value Partition size limit; Kafka will discard old log segments to free up space if `delete` TopicConfig3.cleanup_policy is in effect. This setting is helpful if you need to control the size of a log due to limited disk space. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.retention_bytes setting.
log_retention_hours	google.protobuf.Int64Value The number of hours to keep a log segment file before deleting it.
log_retention_minutes	google.protobuf.Int64Value The number of minutes to keep a log segment file before deleting it. If not set, the value of `log_retention_hours` is used.
log_retention_ms	google.protobuf.Int64Value The number of milliseconds to keep a log segment file before deleting it. If not set, the value of `log_retention_minutes` is used. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.retention_ms setting.
log_segment_bytes	google.protobuf.Int64Value The maximum size of a single log file. This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.segment_bytes setting.
log_preallocate	google.protobuf.BoolValue Should pre allocate file when create new segment? This is the global cluster-level setting that can be overridden on a topic level by using the TopicConfig3.preallocate setting.
socket_send_buffer_bytes	google.protobuf.Int64Value The SO_SNDBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
socket_receive_buffer_bytes	google.protobuf.Int64Value The SO_RCVBUF buffer of the socket server sockets. If the value is -1, the OS default will be used.
auto_create_topics_enable	google.protobuf.BoolValue Enable auto creation of topic on the server
num_partitions	google.protobuf.Int64Value Default number of partitions per topic on the whole cluster
default_replication_factor	google.protobuf.Int64Value Default replication factor of the topic on the whole cluster
message_max_bytes	google.protobuf.Int64Value The largest record batch size allowed by Kafka. Default value: 1048588.
replica_fetch_max_bytes	google.protobuf.Int64Value The number of bytes of messages to attempt to fetch for each partition. Default value: 1048576.
ssl_cipher_suites[]	string A list of cipher suites.
offsets_retention_minutes	google.protobuf.Int64Value Offset storage time after a consumer group loses all its consumers. Default: 10080.
sasl_enabled_mechanisms[]	enum SaslMechanism The list of SASL mechanisms enabled in the Kafka server. Default: [SCRAM_SHA_512]. `SASL_MECHANISM_UNSPECIFIED` `SASL_MECHANISM_SCRAM_SHA_256` `SASL_MECHANISM_SCRAM_SHA_512`

Zookeeper

Field

Description

resources

Resources

Resources allocated to ZooKeeper hosts.

Access

Field

Description

data_transfer

bool

Allow access for DataTransfer.

RestAPIConfig

Field

Description

enabled

bool

Is REST API enabled for this cluster.

DiskSizeAutoscaling

Field	Description
planned_usage_threshold	int64 Threshold of storage usage (in percent) that triggers automatic scaling of the storage during the maintenance window. Zero value means disabled threshold.
emergency_usage_threshold	int64 Threshold of storage usage (in percent) that triggers immediate automatic scaling of the storage. Zero value means disabled threshold.
disk_size_limit	int64 New storage size (in bytes) that is set when one of the thresholds is achieved.

KRaft

Field

Description

resources

Resources

Resources allocated to KRaft controller hosts.

MaintenanceWindow

Field

Description

anytime

AnytimeMaintenanceWindow

Includes only one of the fields anytime, weekly_maintenance_window.

weekly_maintenance_window

WeeklyMaintenanceWindow

Includes only one of the fields anytime, weekly_maintenance_window.

AnytimeMaintenanceWindow

Field	Description
Empty

WeeklyMaintenanceWindow

Field

Description

day

enum WeekDay

WEEK_DAY_UNSPECIFIED
MON
TUE
WED
THU
FRI
SAT
SUN

hour

int64

Hour of the day in UTC.

MaintenanceOperation

Field	Description
info	string
delayed_until	google.protobuf.Timestamp

Managed Service for Apache Kafka® API, gRPC: ClusterService.Update

gRPC requestgRPC request

UpdateClusterRequestUpdateClusterRequest

ConfigSpecConfigSpec

KafkaKafka

ResourcesResources

KafkaConfig2_8KafkaConfig2_8

KafkaConfig3KafkaConfig3

ZookeeperZookeeper

AccessAccess

RestAPIConfigRestAPIConfig

DiskSizeAutoscalingDiskSizeAutoscaling

KRaftKRaft

MaintenanceWindowMaintenanceWindow

AnytimeMaintenanceWindowAnytimeMaintenanceWindow

WeeklyMaintenanceWindowWeeklyMaintenanceWindow

operation.Operationoperation.Operation

UpdateClusterMetadataUpdateClusterMetadata

ClusterCluster

MonitoringMonitoring

ConfigSpecConfigSpec

KafkaKafka

ResourcesResources

KafkaConfig2_8KafkaConfig2_8

KafkaConfig3KafkaConfig3

ZookeeperZookeeper

AccessAccess

RestAPIConfigRestAPIConfig

DiskSizeAutoscalingDiskSizeAutoscaling

KRaftKRaft

MaintenanceWindowMaintenanceWindow

AnytimeMaintenanceWindowAnytimeMaintenanceWindow

WeeklyMaintenanceWindowWeeklyMaintenanceWindow

MaintenanceOperationMaintenanceOperation

Была ли статья полезна?

gRPC request

UpdateClusterRequest

ConfigSpec

Kafka

Resources

KafkaConfig2_8

KafkaConfig3

Zookeeper

Access

RestAPIConfig

DiskSizeAutoscaling

KRaft

MaintenanceWindow

AnytimeMaintenanceWindow

WeeklyMaintenanceWindow

operation.Operation

UpdateClusterMetadata

Cluster

Monitoring

ConfigSpec

Kafka

Resources

KafkaConfig2_8

KafkaConfig3

Zookeeper

Access

RestAPIConfig

DiskSizeAutoscaling

KRaft

MaintenanceWindow

AnytimeMaintenanceWindow

WeeklyMaintenanceWindow

MaintenanceOperation