SparkSqlJobArgs

data class SparkSqlJobArgs(val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val properties: Output<Map<String, String>>? = null, val queryFileUri: Output<String>? = null, val queryList: Output<QueryListArgs>? = null, val scriptVariables: Output<Map<String, String>>? = null) : ConvertibleToJava<SparkSqlJobArgs>

A Dataproc job for running Apache Spark SQL (https://spark.apache.org/sql/) queries.

Constructors

Link copied to clipboard
fun SparkSqlJobArgs(jarFileUris: Output<List<String>>? = null, loggingConfig: Output<LoggingConfigArgs>? = null, properties: Output<Map<String, String>>? = null, queryFileUri: Output<String>? = null, queryList: Output<QueryListArgs>? = null, scriptVariables: Output<Map<String, String>>? = null)

Functions

Link copied to clipboard
open override fun toJava(): SparkSqlJobArgs

Properties

Link copied to clipboard
val jarFileUris: Output<List<String>>? = null

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Link copied to clipboard
val loggingConfig: Output<LoggingConfigArgs>? = null

Optional. The runtime log config for job execution.

Link copied to clipboard
val properties: Output<Map<String, String>>? = null

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Link copied to clipboard
val queryFileUri: Output<String>? = null

The HCFS URI of the script that contains SQL queries.

Link copied to clipboard
val queryList: Output<QueryListArgs>? = null

A list of queries.

Link copied to clipboard
val scriptVariables: Output<Map<String, String>>? = null

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).