pulumi-google-native-kotlin/com.pulumi.googlenative.dataplex.v1.kotlin.inputs/GoogleCloudDataplexV1TaskSparkTaskConfigArgs

GoogleCloudDataplexV1TaskSparkTaskConfigArgs

data class GoogleCloudDataplexV1TaskSparkTaskConfigArgs(val archiveUris: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val infrastructureSpec: Output<GoogleCloudDataplexV1TaskInfrastructureSpecArgs>? = null, val mainClass: Output<String>? = null, val mainJarFileUri: Output<String>? = null, val pythonScriptFile: Output<String>? = null, val sqlScript: Output<String>? = null, val sqlScriptFile: Output<String>? = null) : ConvertibleToJava<GoogleCloudDataplexV1TaskSparkTaskConfigArgs>

User-specified config for running a Spark task.

Constructors

fun GoogleCloudDataplexV1TaskSparkTaskConfigArgs(archiveUris: Output<List<String>>? = null, fileUris: Output<List<String>>? = null, infrastructureSpec: Output<GoogleCloudDataplexV1TaskInfrastructureSpecArgs>? = null, mainClass: Output<String>? = null, mainJarFileUri: Output<String>? = null, pythonScriptFile: Output<String>? = null, sqlScript: Output<String>? = null, sqlScriptFile: Output<String>? = null)

Functions

toJava

open override fun toJava(): GoogleCloudDataplexV1TaskSparkTaskConfigArgs

Properties

archiveUris

val archiveUris: Output<List<String>>? = null

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

fileUris

val fileUris: Output<List<String>>? = null

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

infrastructureSpec

val infrastructureSpec: Output<GoogleCloudDataplexV1TaskInfrastructureSpecArgs>? = null

Optional. Infrastructure specification for the execution.

mainClass

val mainClass: Output<String>? = null

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

mainJarFileUri

val mainJarFileUri: Output<String>? = null

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

pythonScriptFile

val pythonScriptFile: Output<String>? = null

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

sqlScript

val sqlScript: Output<String>? = null

The query text. The execution args are used to declare a set of script variables (set key="value";).

sqlScriptFile

val sqlScriptFile: Output<String>? = null

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).