Apache Spark™ properties

Apache Spark™ properties define the job configuration, e.g., run resources, dynamic allocation and parallelism parameters, SQL parameters, etc. To override a configuration, you can update Apache Spark™ properties at individual job level when creating the job.

Apache Spark™ properties are set and stored in "key-value" format. You can set any of the properties specified in the official Apache Spark™ documentation, except for the following:

• spark.kubernetes.*: You cannot override Kubernetes properties as this may cause the Yandex Managed Service for Apache Spark™ cluster to work incorrectly.
• spark.yarn.*: Yandex Managed Service for Apache Spark™ does not use YARN.