Job Spark Config Args
data class JobSparkConfigArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<JobSparkConfigLoggingConfigArgs>? = null, val mainClass: Output<String>? = null, val mainJarFileUri: Output<String>? = null, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<JobSparkConfigArgs>
Constructors
Link copied to clipboard
constructor(archiveUris: Output<List<String>>? = null, args: Output<List<String>>? = null, fileUris: Output<List<String>>? = null, jarFileUris: Output<List<String>>? = null, loggingConfig: Output<JobSparkConfigLoggingConfigArgs>? = null, mainClass: Output<String>? = null, mainJarFileUri: Output<String>? = null, properties: Output<Map<String, String>>? = null)
Properties
Link copied to clipboard
HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.
Link copied to clipboard
HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
Link copied to clipboard
Link copied to clipboard
The HCFS URI of jar file containing the driver jar. Conflicts with main_class
Link copied to clipboard
A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf
and classes in user code.