pulumi-azure-native-kotlin/com.pulumi.azurenative.datafactory.kotlin.outputs/SynapseSparkJobDefinitionActivityResponse

SynapseSparkJobDefinitionActivityResponse

data class SynapseSparkJobDefinitionActivityResponse(val arguments: List<Any>? = null, val className: Any? = null, val conf: Any? = null, val configurationType: String? = null, val dependsOn: List<ActivityDependencyResponse>? = null, val description: String? = null, val driverSize: Any? = null, val executorSize: Any? = null, val file: Any? = null, val files: List<Any>? = null, val filesV2: List<Any>? = null, val linkedServiceName: LinkedServiceReferenceResponse? = null, val name: String, val numExecutors: Any? = null, val policy: ActivityPolicyResponse? = null, val pythonCodeReference: List<Any>? = null, val scanFolder: Any? = null, val sparkConfig: Map<String, Any>? = null, val sparkJob: SynapseSparkJobReferenceResponse, val targetBigDataPool: BigDataPoolParametrizationReferenceResponse? = null, val targetSparkConfiguration: SparkConfigurationParametrizationReferenceResponse? = null, val type: String, val userProperties: List<UserPropertyResponse>? = null)

Execute spark job activity.

Constructors

fun SynapseSparkJobDefinitionActivityResponse(arguments: List<Any>? = null, className: Any? = null, conf: Any? = null, configurationType: String? = null, dependsOn: List<ActivityDependencyResponse>? = null, description: String? = null, driverSize: Any? = null, executorSize: Any? = null, file: Any? = null, files: List<Any>? = null, filesV2: List<Any>? = null, linkedServiceName: LinkedServiceReferenceResponse? = null, name: String, numExecutors: Any? = null, policy: ActivityPolicyResponse? = null, pythonCodeReference: List<Any>? = null, scanFolder: Any? = null, sparkConfig: Map<String, Any>? = null, sparkJob: SynapseSparkJobReferenceResponse, targetBigDataPool: BigDataPoolParametrizationReferenceResponse? = null, targetSparkConfiguration: SparkConfigurationParametrizationReferenceResponse? = null, type: String, userProperties: List<UserPropertyResponse>? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val arguments: List<Any>? = null

User specified arguments to SynapseSparkJobDefinitionActivity.

Link copied to clipboard
val className: Any? = null

The fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string).

Link copied to clipboard
val conf: Any? = null

Spark configuration properties, which will override the 'conf' of the spark job definition you provide.

Link copied to clipboard
val configurationType: String? = null

The type of the spark config.

Link copied to clipboard
val dependsOn: List<ActivityDependencyResponse>? = null

Activity depends on condition.

Link copied to clipboard
val description: String? = null

Activity description.

Link copied to clipboard
val driverSize: Any? = null

Number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).

Link copied to clipboard
val executorSize: Any? = null

Number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).

Link copied to clipboard
val file: Any? = null

The main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string).

Link copied to clipboard
val files: List<Any>? = null

(Deprecated. Please use pythonCodeReference and filesV2) Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.

Link copied to clipboard
val filesV2: List<Any>? = null

Additional files used for reference in the main definition file, which will override the 'jars' and 'files' of the spark job definition you provide.

Link copied to clipboard
val linkedServiceName: LinkedServiceReferenceResponse? = null

Linked service reference.

Link copied to clipboard
val name: String

Activity name.

Link copied to clipboard
val numExecutors: Any? = null

Number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide. Type: integer (or Expression with resultType integer).

Link copied to clipboard
val policy: ActivityPolicyResponse? = null

Activity policy.

Link copied to clipboard
val pythonCodeReference: List<Any>? = null

Additional python code files used for reference in the main definition file, which will override the 'pyFiles' of the spark job definition you provide.

Link copied to clipboard
val scanFolder: Any? = null

Scanning subfolders from the root folder of the main definition file, these files will be added as reference files. The folders named 'jars', 'pyFiles', 'files' or 'archives' will be scanned, and the folders name are case sensitive. Type: boolean (or Expression with resultType boolean).

Link copied to clipboard
val sparkConfig: Map<String, Any>? = null

Spark configuration property.

Link copied to clipboard
val sparkJob: SynapseSparkJobReferenceResponse

Synapse spark job reference.

Link copied to clipboard
val targetBigDataPool: BigDataPoolParametrizationReferenceResponse? = null

The name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.

Link copied to clipboard
val targetSparkConfiguration: SparkConfigurationParametrizationReferenceResponse? = null

The spark configuration of the spark job.

Link copied to clipboard
val type: String

Type of activity. Expected value is 'SparkJob'.

Link copied to clipboard
val userProperties: List<UserPropertyResponse>? = null

Activity user properties.