Data Proc API, gRPC: SubclusterService.Create
Creates a subcluster in the specified cluster.
gRPC request
rpc Create (CreateSubclusterRequest) returns (operation.Operation)
CreateSubclusterRequest
{
"clusterId": "string",
"name": "string",
"role": "Role",
"resources": {
"resourcePresetId": "string",
"diskTypeId": "string",
"diskSize": "int64"
},
"subnetId": "string",
"hostsCount": "int64",
"autoscalingConfig": {
"maxHostsCount": "int64",
"preemptible": "bool",
"measurementDuration": "google.protobuf.Duration",
"warmupDuration": "google.protobuf.Duration",
"stabilizationDuration": "google.protobuf.Duration",
"cpuUtilizationTarget": "double",
"decommissionTimeout": "int64"
}
}
Field |
Description |
clusterId |
string Required field. ID of the Data Proc cluster to create a subcluster in. To get a cluster ID, make a ClusterService.List request. |
name |
string Name of the subcluster. The name must be unique within the cluster. The name can't be |
role |
enum Role Required field. Role that is fulfilled by hosts of the subcluster.
|
resources |
Required field. Resources allocated for each host in the subcluster. |
subnetId |
string Required field. ID of the VPC subnet used for hosts in the subcluster. |
hostsCount |
int64 Required field. Number of hosts in the subcluster. |
autoscalingConfig |
Configuration for instance group based subclusters |
Resources
Field |
Description |
resourcePresetId |
string ID of the resource preset for computational resources available to a host (CPU, memory etc.). |
diskTypeId |
string Type of the storage environment for the host.
|
diskSize |
int64 Volume of the storage available to a host, in bytes. |
AutoscalingConfig
Field |
Description |
maxHostsCount |
int64 Upper limit for total instance subcluster count. |
preemptible |
bool Preemptible instances are stopped at least once every 24 hours, and can be stopped at any time |
measurementDuration |
Required field. Time in seconds allotted for averaging metrics. |
warmupDuration |
The warmup time of the instance in seconds. During this time, |
stabilizationDuration |
Minimum amount of time in seconds allotted for monitoring before |
cpuUtilizationTarget |
double Defines an autoscaling rule based on the average CPU utilization of the instance group. |
decommissionTimeout |
int64 Timeout to gracefully decommission nodes during downscaling. In seconds. Default value: 120 |
operation.Operation
{
"id": "string",
"description": "string",
"createdAt": "google.protobuf.Timestamp",
"createdBy": "string",
"modifiedAt": "google.protobuf.Timestamp",
"done": "bool",
"metadata": {
"clusterId": "string",
"subclusterId": "string"
},
// Includes only one of the fields `error`, `response`
"error": "google.rpc.Status",
"response": {
"id": "string",
"clusterId": "string",
"createdAt": "google.protobuf.Timestamp",
"name": "string",
"role": "Role",
"resources": {
"resourcePresetId": "string",
"diskTypeId": "string",
"diskSize": "int64"
},
"subnetId": "string",
"hostsCount": "int64",
"assignPublicIp": "bool",
"autoscalingConfig": {
"maxHostsCount": "int64",
"preemptible": "bool",
"measurementDuration": "google.protobuf.Duration",
"warmupDuration": "google.protobuf.Duration",
"stabilizationDuration": "google.protobuf.Duration",
"cpuUtilizationTarget": "double",
"decommissionTimeout": "int64"
},
"instanceGroupId": "string"
}
// end of the list of possible fields
}
An Operation resource. For more information, see Operation.
Field |
Description |
id |
string ID of the operation. |
description |
string Description of the operation. 0-256 characters long. |
createdAt |
Creation timestamp. |
createdBy |
string ID of the user or service account who initiated the operation. |
modifiedAt |
The time when the Operation resource was last modified. |
done |
bool If the value is |
metadata |
Service-specific metadata associated with the operation. |
error |
The error result of the operation in case of failure or cancellation. Includes only one of the fields The operation result. |
response |
The normal response of the operation in case of success. Includes only one of the fields The operation result. |
CreateSubclusterMetadata
Field |
Description |
clusterId |
string ID of the cluster that the subcluster is being added to. |
subclusterId |
string ID of the subcluster that is being created. |
Subcluster
A Data Proc subcluster. For details about the concept, see documentation.
Field |
Description |
id |
string ID of the subcluster. Generated at creation time. |
clusterId |
string ID of the Data Proc cluster that the subcluster belongs to. |
createdAt |
Creation timestamp. |
name |
string Name of the subcluster. The name is unique within the cluster. |
role |
enum Role Role that is fulfilled by hosts of the subcluster.
|
resources |
Resources allocated for each host in the subcluster. |
subnetId |
string ID of the VPC subnet used for hosts in the subcluster. |
hostsCount |
int64 Number of hosts in the subcluster. |
assignPublicIp |
bool Assign public ip addresses for all hosts in subcluter. |
autoscalingConfig |
Configuration for instance group based subclusters |
instanceGroupId |
string ID of Compute Instance Group for autoscaling subclusters |
Resources
Field |
Description |
resourcePresetId |
string ID of the resource preset for computational resources available to a host (CPU, memory etc.). |
diskTypeId |
string Type of the storage environment for the host.
|
diskSize |
int64 Volume of the storage available to a host, in bytes. |
AutoscalingConfig
Field |
Description |
maxHostsCount |
int64 Upper limit for total instance subcluster count. |
preemptible |
bool Preemptible instances are stopped at least once every 24 hours, and can be stopped at any time |
measurementDuration |
Required field. Time in seconds allotted for averaging metrics. |
warmupDuration |
The warmup time of the instance in seconds. During this time, |
stabilizationDuration |
Minimum amount of time in seconds allotted for monitoring before |
cpuUtilizationTarget |
double Defines an autoscaling rule based on the average CPU utilization of the instance group. |
decommissionTimeout |
int64 Timeout to gracefully decommission nodes during downscaling. In seconds. Default value: 120 |