pulumi-google-native-kotlin/com.pulumi.googlenative.dataplex.v1.kotlin.outputs/GoogleCloudDataplexV1TaskSparkTaskConfigResponse

GoogleCloudDataplexV1TaskSparkTaskConfigResponse

data class GoogleCloudDataplexV1TaskSparkTaskConfigResponse(val archiveUris: List<String>, val fileUris: List<String>, val infrastructureSpec: GoogleCloudDataplexV1TaskInfrastructureSpecResponse, val mainClass: String, val mainJarFileUri: String, val pythonScriptFile: String, val sqlScript: String, val sqlScriptFile: String)

User-specified config for running a Spark task.

Constructors

fun GoogleCloudDataplexV1TaskSparkTaskConfigResponse(archiveUris: List<String>, fileUris: List<String>, infrastructureSpec: GoogleCloudDataplexV1TaskInfrastructureSpecResponse, mainClass: String, mainJarFileUri: String, pythonScriptFile: String, sqlScript: String, sqlScriptFile: String)

Types

Companion

object Companion

Properties

archiveUris

val archiveUris: List<String>

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

fileUris

val fileUris: List<String>

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

infrastructureSpec

val infrastructureSpec: GoogleCloudDataplexV1TaskInfrastructureSpecResponse

Optional. Infrastructure specification for the execution.

mainClass

val mainClass: String

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

mainJarFileUri

val mainJarFileUri: String

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

pythonScriptFile

val pythonScriptFile: String

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

sqlScript

val sqlScript: String

The query text. The execution args are used to declare a set of script variables (set key="value";).

sqlScriptFile

val sqlScriptFile: String

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).