Job Hadoop Config Args
data class JobHadoopConfigArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<JobHadoopConfigLoggingConfigArgs>? = null, val mainClass: Output<String>? = null, val mainJarFileUri: Output<String>? = null, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<JobHadoopConfigArgs>
Constructors
Link copied to clipboard
constructor(archiveUris: Output<List<String>>? = null, args: Output<List<String>>? = null, fileUris: Output<List<String>>? = null, jarFileUris: Output<List<String>>? = null, loggingConfig: Output<JobHadoopConfigLoggingConfigArgs>? = null, mainClass: Output<String>? = null, mainJarFileUri: Output<String>? = null, properties: Output<Map<String, String>>? = null)
Properties
Link copied to clipboard
HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.
Link copied to clipboard
HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
Link copied to clipboard
The runtime logging config of the job
Link copied to clipboard
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'. Conflicts with main_class
Link copied to clipboard
A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site
and classes in user code..