PigJobArgs

data class PigJobArgs(val continueOnFailure: Output<Boolean>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val properties: Output<Map<String, String>>? = null, val queryFileUri: Output<String>? = null, val queryList: Output<QueryListArgs>? = null, val scriptVariables: Output<Map<String, String>>? = null) : ConvertibleToJava<PigJobArgs>

A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

Constructors

Link copied to clipboard
fun PigJobArgs(continueOnFailure: Output<Boolean>? = null, jarFileUris: Output<List<String>>? = null, loggingConfig: Output<LoggingConfigArgs>? = null, properties: Output<Map<String, String>>? = null, queryFileUri: Output<String>? = null, queryList: Output<QueryListArgs>? = null, scriptVariables: Output<Map<String, String>>? = null)

Functions

Link copied to clipboard
open override fun toJava(): PigJobArgs

Properties

Link copied to clipboard
val continueOnFailure: Output<Boolean>? = null

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Link copied to clipboard
val jarFileUris: Output<List<String>>? = null

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Link copied to clipboard
val loggingConfig: Output<LoggingConfigArgs>? = null

Optional. The runtime log config for job execution.

Link copied to clipboard
val properties: Output<Map<String, String>>? = null

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Link copied to clipboard
val queryFileUri: Output<String>? = null

The HCFS URI of the script that contains the Pig queries.

Link copied to clipboard
val queryList: Output<QueryListArgs>? = null

A list of queries.

Link copied to clipboard
val scriptVariables: Output<Map<String, String>>? = null

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=value). */