yc dataproc
Written by
Updated at December 2, 2024
Manage data processing clusters.
Command Usage
Syntax:
yc dataproc <group>
Command Tree
- yc dataproc cluster — Manage DataProc clusters.
- yc dataproc cluster add-labels — Assign labels to a cluster.
- yc dataproc cluster create — Create a cluster.
- yc dataproc cluster delete — Delete a cluster.
- yc dataproc cluster get — Get information about a cluster.
- yc dataproc cluster list — List clusters in a folder.
- yc dataproc cluster list-hosts — List hosts for a cluster.
- yc dataproc cluster list-operations — List operations for a cluster.
- yc dataproc cluster list-ui-links — Show URLs of proxied web user interfaces.
- yc dataproc cluster remove-labels — Remove labels from a cluster.
- yc dataproc cluster start — Start a cluster.
- yc dataproc cluster stop — Stop a cluster.
- yc dataproc cluster update — Modify attributes of a cluster.
- yc dataproc job — Manage DataProc jobs.
- yc dataproc job cancel — Cancel Dataproc job.
- yc dataproc job create-hive — Create a Dataproc Hive job.
- yc dataproc job create-mapreduce — Create a Dataproc MapReduce job.
- yc dataproc job create-pyspark — Create a Dataproc PySpark job.
- yc dataproc job create-spark — Create a Dataproc Spark job.
- yc dataproc job get — Get information about a Dataproc job.
- yc dataproc job list — List Dataproc jobs for a cluster.
- yc dataproc job log — List logs for Dataproc job.
- yc dataproc resource-preset — Learn about Data Proc resource presets.
- yc dataproc resource-preset get — Get information about a Data Proc resource preset.
- yc dataproc resource-preset list — List available resource presets for Data Proc.
- yc dataproc subcluster — Manage Dataproc subclusters.
- yc dataproc subcluster create — Create a subcluster.
- yc dataproc subcluster delete — Delete a subcluster.
- yc dataproc subcluster get — Get information about a subcluster.
- yc dataproc subcluster list — List subclusters in a cluster.
- yc dataproc subcluster update — Modify configuration or attributes of a subcluster.
Global Flags
| Flag | Description |
|---|---|
--profile |
stringSet the custom configuration file. |
--debug |
Debug logging. |
--debug-grpc |
Debug gRPC logging. Very verbose, used for debugging connection problems. |
--no-user-output |
Disable printing user intended output to stderr. |
--retry |
intEnable gRPC retries. By default, retries are enabled with maximum 5 attempts. Pass 0 to disable retries. Pass any negative value for infinite retries. Even infinite retries are capped with 2 minutes timeout. |
--cloud-id |
stringSet the ID of the cloud to use. |
--folder-id |
stringSet the ID of the folder to use. |
--folder-name |
stringSet the name of the folder to use (will be resolved to id). |
--endpoint |
stringSet the Cloud API endpoint (host:port). |
--token |
stringSet the OAuth token to use. |
--impersonate-service-account-id |
stringSet the ID of the service account to impersonate. |
--no-browser |
Disable opening browser for authentication. |
--format |
stringSet the output format: text (default), yaml, json, json-rest. |
--jq |
stringQuery to select values from the response using jq syntax |
-h,--help |
Display help for the command. |