Viewing Apache Spark™ cluster logs
Yandex Managed Service for Apache Spark™ allows you to get a cluster log snippet for the selected period.
Note
Cluster logs are stored for 45 days.
Getting a cluster log
- In the management console, select the folder.
- Navigate to Managed Service for Apache Spark™.
- Click the cluster name and navigate to Logs.
- Specify the logging Level and the log time window.
With YC CLI, you can get Apache Spark™ cluster logs from a Yandex Cloud Logging log group.
-
If you do not have the Yandex Cloud CLI yet, install and initialize it.
-
The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the
yc config set folder-id <folder_ID>command. You can also specify a different folder for any command using--folder-nameor--folder-id.If you access a resource by its name, the search will be limited to the default folder. If you access a resource by its ID, the search will be global, i.e., through all folders based on access permissions.
-
To view the log group entries, run this command:
yc logging read --group-name <log_group_name> --followYou can look up the log group name in the Overview section of your Apache Spark™ cluster.