SparkOptionsArgs

Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.

Fully qualified name of the user-provided Spark connection object. Format: ``"projects/{project_id}/locations/{location_id}/connections/{connection_id}"`` @property containerImage Custom container image for the runtime environment. @property fileUris Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark. @property jarUris JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark. @property mainClass The fully qualified name of a class in jar_uris, for example, com.example.wordcount. Exactly one of main_class and main_jar_uri field should be set for Java/Scala language type. @property mainFileUri The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type. @property properties Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list. @property pyFileUris Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark. @property runtimeVersion Runtime version. If not specified, the default runtime version is used.