JobSparkConfigArgs

data class JobSparkConfigArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<JobSparkConfigLoggingConfigArgs>? = null, val mainClass: Output<String>? = null, val mainJarFileUri: Output<String>? = null, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<JobSparkConfigArgs>

Constructors

Link copied to clipboard
constructor(archiveUris: Output<List<String>>? = null, args: Output<List<String>>? = null, fileUris: Output<List<String>>? = null, jarFileUris: Output<List<String>>? = null, loggingConfig: Output<JobSparkConfigLoggingConfigArgs>? = null, mainClass: Output<String>? = null, mainJarFileUri: Output<String>? = null, properties: Output<Map<String, String>>? = null)

Properties

Link copied to clipboard
val archiveUris: Output<List<String>>? = null

HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.

Link copied to clipboard
val args: Output<List<String>>? = null

The arguments to pass to the driver.

Link copied to clipboard
val fileUris: Output<List<String>>? = null

HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks. Useful for naively parallel tasks.

Link copied to clipboard
val jarFileUris: Output<List<String>>? = null

HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.

Link copied to clipboard

The runtime logging config of the job

Link copied to clipboard
val mainClass: Output<String>? = null

The class containing the main method of the driver. Must be in a provided jar or jar that is already on the classpath. Conflicts with main_jar_file_uri

Link copied to clipboard
val mainJarFileUri: Output<String>? = null

The HCFS URI of jar file containing the driver jar. Conflicts with main_class

Link copied to clipboard
val properties: Output<Map<String, String>>? = null

A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

Functions

Link copied to clipboard
open override fun toJava(): JobSparkConfigArgs