SparkSqlBatchArgs

data class SparkSqlBatchArgs(val jarFileUris: Output<List<String>>? = null, val queryFileUri: Output<String>, val queryVariables: Output<Map<String, String>>? = null) : ConvertibleToJava<SparkSqlBatchArgs>

A configuration for running Apache Spark SQL (https://spark.apache.org/sql/) queries as a batch workload.

Constructors

Link copied to clipboard
fun SparkSqlBatchArgs(jarFileUris: Output<List<String>>? = null, queryFileUri: Output<String>, queryVariables: Output<Map<String, String>>? = null)

Functions

Link copied to clipboard
open override fun toJava(): SparkSqlBatchArgs

Properties

Link copied to clipboard
val jarFileUris: Output<List<String>>? = null

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Link copied to clipboard
val queryFileUri: Output<String>

The HCFS URI of the script that contains Spark SQL queries to execute.

Link copied to clipboard
val queryVariables: Output<Map<String, String>>? = null

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).