SparkSqlJobResponse

data class SparkSqlJobResponse(val jarFileUris: List<String>, val loggingConfig: LoggingConfigResponse, val properties: Map<String, String>, val queryFileUri: String, val queryList: QueryListResponse, val scriptVariables: Map<String, String>)

A Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

Constructors

Link copied to clipboard
fun SparkSqlJobResponse(jarFileUris: List<String>, loggingConfig: LoggingConfigResponse, properties: Map<String, String>, queryFileUri: String, queryList: QueryListResponse, scriptVariables: Map<String, String>)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Link copied to clipboard

Optional. The runtime log config for job execution.

Link copied to clipboard

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Link copied to clipboard

The HCFS URI of the script that contains SQL queries.

Link copied to clipboard

A list of queries.

Link copied to clipboard

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).