Managed Service for Apache Kafka® API, gRPC: ConnectorService.Update
- gRPC request
- UpdateConnectorRequest
- UpdateConnectorSpec
- ConnectorConfigMirrorMakerSpec
- ClusterConnectionSpec
- ThisClusterSpec
- ExternalClusterConnectionSpec
- UpdateConnectorConfigS3SinkSpec
- S3ConnectionSpec
- ExternalS3StorageSpec
- operation.Operation
- UpdateConnectorMetadata
- Connector
- ConnectorConfigMirrorMaker
- ClusterConnection
- ThisCluster
- ExternalClusterConnection
- ConnectorConfigS3Sink
- S3Connection
- ExternalS3Storage
Updates an Apache Kafka® connector.
gRPC request
rpc Update (UpdateConnectorRequest) returns (operation.Operation)
UpdateConnectorRequest
{
"cluster_id": "string",
"connector_name": "string",
"update_mask": "google.protobuf.FieldMask",
"connector_spec": {
"tasks_max": "google.protobuf.Int64Value",
"properties": "map<string, string>",
// Includes only one of the fields `connector_config_mirrormaker`, `connector_config_s3_sink`
"connector_config_mirrormaker": {
"source_cluster": {
"alias": "string",
// Includes only one of the fields `this_cluster`, `external_cluster`
"this_cluster": "ThisClusterSpec",
"external_cluster": {
"bootstrap_servers": "string",
"sasl_username": "string",
"sasl_password": "string",
"sasl_mechanism": "string",
"security_protocol": "string",
"ssl_truststore_certificates": "string"
}
// end of the list of possible fields
},
"target_cluster": {
"alias": "string",
// Includes only one of the fields `this_cluster`, `external_cluster`
"this_cluster": "ThisClusterSpec",
"external_cluster": {
"bootstrap_servers": "string",
"sasl_username": "string",
"sasl_password": "string",
"sasl_mechanism": "string",
"security_protocol": "string",
"ssl_truststore_certificates": "string"
}
// end of the list of possible fields
},
"topics": "string",
"replication_factor": "google.protobuf.Int64Value"
},
"connector_config_s3_sink": {
"topics": "string",
"file_max_records": "google.protobuf.Int64Value",
"s3_connection": {
"bucket_name": "string",
// Includes only one of the fields `external_s3`
"external_s3": {
"access_key_id": "string",
"secret_access_key": "string",
"endpoint": "string",
"region": "string"
}
// end of the list of possible fields
}
}
// end of the list of possible fields
}
}
|
Field |
Description |
|
cluster_id |
string Required field. ID of the Apache Kafka® cluster to update the connector in. To get this ID, make a ClusterService.List request. The maximum string length in characters is 50. |
|
connector_name |
string Required field. Name of the connector to update. To get this name, make a ConnectorService.List request. The maximum string length in characters is 256. Value must match the regular expression |
|
update_mask |
Field mask that specifies which settings of the connector should be updated. |
|
connector_spec |
Required field. Configuration of the connector to update. |
UpdateConnectorSpec
|
Field |
Description |
|
tasks_max |
Maximum number of connector tasks to update. |
|
properties |
object (map<string, string>) A set of new or changed properties to update for the connector. They are passed with the connector configuration to Managed Service for Apache Kafka®. |
|
connector_config_mirrormaker |
ConnectorConfigMirrorMakerSpec Configuration of the MirrorMaker connector. Includes only one of the fields Updated configuration for the connector. |
|
connector_config_s3_sink |
UpdateConnectorConfigS3SinkSpec Update specification for S3-Sink Connector. Includes only one of the fields Updated configuration for the connector. |
ConnectorConfigMirrorMakerSpec
|
Field |
Description |
|
source_cluster |
Source cluster configuration for the MirrorMaker connector. |
|
target_cluster |
Target cluster configuration for the MirrorMaker connector. |
|
topics |
string List of Kafka topics, separated by |
|
replication_factor |
Replication factor for automatically created topics. |
ClusterConnectionSpec
|
Field |
Description |
|
alias |
string Alias of cluster connection configuration. |
|
this_cluster |
Connection configuration of the cluster the connector belongs to. As all credentials are already known, leave this parameter empty. Includes only one of the fields Type of connection to Apache Kafka® cluster. |
|
external_cluster |
Configuration of connection to an external cluster with all the necessary credentials. Includes only one of the fields Type of connection to Apache Kafka® cluster. |
ThisClusterSpec
|
Field |
Description |
|
Empty |
|
ExternalClusterConnectionSpec
|
Field |
Description |
|
bootstrap_servers |
string List of bootstrap servers of the cluster, separated by |
|
sasl_username |
string SASL username to use for connection to the cluster. |
|
sasl_password |
string SASL password to use for connection to the cluster. |
|
sasl_mechanism |
string SASL mechanism to use for connection to the cluster. |
|
security_protocol |
string Security protocol to use for connection to the cluster. |
|
ssl_truststore_certificates |
string CA in PEM format to connect to external cluster. |
UpdateConnectorConfigS3SinkSpec
Specification for update Kafka S3-Sink Connector.
|
Field |
Description |
|
topics |
string List of Kafka topics, separated by ','. |
|
file_max_records |
Max records per file. |
|
s3_connection |
Credentials for connecting to S3 storage. |
S3ConnectionSpec
Specification for S3Connection -
settings of connection to AWS-compatible S3 storage, that
are source or target of Kafka S3-connectors.
YC Object Storage is AWS-compatible.
|
Field |
Description |
|
bucket_name |
string |
|
external_s3 |
Includes only one of the fields |
ExternalS3StorageSpec
|
Field |
Description |
|
access_key_id |
string |
|
secret_access_key |
string |
|
endpoint |
string |
|
region |
string Default is 'us-east-1'. |
operation.Operation
{
"id": "string",
"description": "string",
"created_at": "google.protobuf.Timestamp",
"created_by": "string",
"modified_at": "google.protobuf.Timestamp",
"done": "bool",
"metadata": {
"cluster_id": "string",
"connector_name": "string"
},
// Includes only one of the fields `error`, `response`
"error": "google.rpc.Status",
"response": {
"name": "string",
"tasks_max": "google.protobuf.Int64Value",
"properties": "map<string, string>",
"health": "Health",
"status": "Status",
"cluster_id": "string",
// Includes only one of the fields `connector_config_mirrormaker`, `connector_config_s3_sink`
"connector_config_mirrormaker": {
"source_cluster": {
"alias": "string",
// Includes only one of the fields `this_cluster`, `external_cluster`
"this_cluster": "ThisCluster",
"external_cluster": {
"bootstrap_servers": "string",
"sasl_username": "string",
"sasl_mechanism": "string",
"security_protocol": "string"
}
// end of the list of possible fields
},
"target_cluster": {
"alias": "string",
// Includes only one of the fields `this_cluster`, `external_cluster`
"this_cluster": "ThisCluster",
"external_cluster": {
"bootstrap_servers": "string",
"sasl_username": "string",
"sasl_mechanism": "string",
"security_protocol": "string"
}
// end of the list of possible fields
},
"topics": "string",
"replication_factor": "google.protobuf.Int64Value"
},
"connector_config_s3_sink": {
"topics": "string",
"file_compression_type": "string",
"file_max_records": "google.protobuf.Int64Value",
"s3_connection": {
"bucket_name": "string",
// Includes only one of the fields `external_s3`
"external_s3": {
"access_key_id": "string",
"endpoint": "string",
"region": "string"
}
// end of the list of possible fields
}
}
// end of the list of possible fields
}
// end of the list of possible fields
}
An Operation resource. For more information, see Operation.
|
Field |
Description |
|
id |
string ID of the operation. |
|
description |
string Description of the operation. 0-256 characters long. |
|
created_at |
Creation timestamp. |
|
created_by |
string ID of the user or service account who initiated the operation. |
|
modified_at |
The time when the Operation resource was last modified. |
|
done |
bool If the value is |
|
metadata |
Service-specific metadata associated with the operation. |
|
error |
The error result of the operation in case of failure or cancellation. Includes only one of the fields The operation result. |
|
response |
The normal response of the operation in case of success. Includes only one of the fields The operation result. |
UpdateConnectorMetadata
|
Field |
Description |
|
cluster_id |
string Required field. ID of the Apache Kafka® cluster the connector is being updated in. The maximum string length in characters is 50. |
|
connector_name |
string Required field. Name of the Apache Kafka® connector that is being updated. The maximum string length in characters is 256. Value must match the regular expression |
Connector
|
Field |
Description |
|
name |
string Name of the connector. |
|
tasks_max |
Maximum number of connector tasks. Default value is the number of brokers. |
|
properties |
object (map<string, string>) A set of properties passed to Managed Service for Apache Kafka® with the connector configuration. |
|
health |
enum Health Connector health.
|
|
status |
enum Status Current status of the connector.
|
|
cluster_id |
string ID of the Apache Kafka® cluster that the connector belongs to. |
|
connector_config_mirrormaker |
Configuration of the MirrorMaker connector. Includes only one of the fields Additional settings for the connector. |
|
connector_config_s3_sink |
Configuration of S3-Sink connector. Includes only one of the fields Additional settings for the connector. |
ConnectorConfigMirrorMaker
|
Field |
Description |
|
source_cluster |
Source cluster connection configuration. |
|
target_cluster |
Target cluster connection configuration. |
|
topics |
string List of Kafka topics, separated by |
|
replication_factor |
Replication factor for automatically created topics. |
ClusterConnection
|
Field |
Description |
|
alias |
string Alias of cluster connection configuration. |
|
this_cluster |
Connection configuration of the cluster the connector belongs to. As all credentials are already known, leave this parameter empty. Includes only one of the fields Type of connection to Apache Kafka® cluster. |
|
external_cluster |
Configuration of connection to an external cluster with all the necessary credentials. Includes only one of the fields Type of connection to Apache Kafka® cluster. |
ThisCluster
|
Field |
Description |
|
Empty |
|
ExternalClusterConnection
|
Field |
Description |
|
bootstrap_servers |
string List of bootstrap servers of the cluster, separated by |
|
sasl_username |
string SASL username to use for connection to the cluster. |
|
sasl_mechanism |
string SASL mechanism to use for connection to the cluster. |
|
security_protocol |
string Security protocol to use for connection to the cluster. |
ConnectorConfigS3Sink
An Apache Kafka® S3-Sink
connector resource.
|
Field |
Description |
|
topics |
string List of Kafka topics, separated by ','. |
|
file_compression_type |
string The compression type used for files put on GCS. |
|
file_max_records |
Max records per file. |
|
s3_connection |
Credentials for connecting to S3 storage. |
S3Connection
Resource for S3Connection -
settings of connection to AWS-compatible S3 storage, that
are source or target of Kafka S3-connectors.
YC Object Storage is AWS-compatible.
|
Field |
Description |
|
bucket_name |
string |
|
external_s3 |
Includes only one of the fields |
ExternalS3Storage
|
Field |
Description |
|
access_key_id |
string |
|
endpoint |
string |
|
region |
string Default is 'us-east-1' |