yc managed-spark cluster create

Flag

Description

--name

string

Name of the Spark cluster.

--description

string

Description of the cluster.

--labels

key=value[,key=value...]

A list of Spark cluster labels as key-value pairs.

--service-account-id

string

A service account id used to access Cloud resources.

--subnet-ids

value[,value]

List of IDs of VPC network subnets where instances of the cluster are attached.

--security-group-ids

value[,value]

A list of security groups for the Spark cluster.

--driver-preset-id

string

ID of the preset for computational resources available to the Driver (CPU, memory etc.).

--driver-fixed-size

int

Specifies the number of instances for the fixed-size driver.

--driver-min-size

int

Specifies the minimum number of instances for the auto-scaling driver.

--driver-max-size

int

Specifies the maximum number of instances for the auto-scaling driver.

--executor-preset-id

string

ID of the preset for computational resources available to the Executor (CPU, memory etc.).

--executor-fixed-size

int

Specifies the number of instances for the fixed-size executor.

--executor-min-size

int

Specifies the minimum number of instances for the auto-scaling executor.

--executor-max-size

int

Specifies the maximum number of instances for the auto-scaling executor.

--history-server-enabled

Enables History Server instance creation.

--metastore-cluster-id

string

ID of the Metastore cluster to connect

--spark-version

string

Version of Apache Spark. Format: Major.Minor

--pip-packages

value[,value]

Additional pip dependencies to install

--deb-packages

value[,value]

Additional deb dependencies to install

--log-enabled

Whether logs generated by the Airflow components are delivered to Cloud Logging.

--log-folder-id

string

Logs will be written to default log group in specified folder.

--log-group-id

string

Logs will be written to log group resolved by ID.

--maintenance-window

PROPERTY=VALUE[,PROPERTY=VALUE...]

Maintenance window settings.

Possible property names:

• type: Type of maintenance window, it can be 'anytime' or 'weekly'. A day and hour of window need to be specified with weekly window.

• hour: Hour of day in UTC time zone (1-24) for maintenance window if window type is weekly.

• day: Day of week for maintenance window if window type is weekly. One of MON, TUE, WED, THU, FRI, SAT, SUN. Values: 'mon', 'tue', 'wed', 'thu', 'fri', 'sat', 'sun'

--deletion-protection

Deletion Protection inhibits deletion of the cluster.

--async

Display information about the operation in progress, without waiting for the operation to complete.

Flag

Description

--profile

string

Set the custom configuration file.

--debug

Debug logging.

--debug-grpc

Debug gRPC logging. Very verbose, used for debugging connection problems.

--no-user-output

Disable printing user intended output to stderr.

--retry

int

Enable gRPC retries. By default, retries are enabled with maximum 5 attempts.
Pass 0 to disable retries. Pass any negative value for infinite retries.
Even infinite retries are capped with 2 minutes timeout.

--cloud-id

string

Set the ID of the cloud to use.

--folder-id

string

Set the ID of the folder to use.

--folder-name

string

Set the name of the folder to use (will be resolved to id).

--endpoint

string

Set the Cloud API endpoint (host:port).

--token

string

Set the OAuth token to use.

--impersonate-service-account-id

string

Set the ID of the service account to impersonate.

--no-browser

Disable opening browser for authentication.

--format

string

Set the output format: text (default), yaml, json, json-rest.

--jq

string

Query to select values from the response using jq syntax

-h, --help

Display help for the command.