LinkedServiceAzureDatabricksNewClusterConfig

data class LinkedServiceAzureDatabricksNewClusterConfig(val clusterVersion: String, val customTags: Map<String, String>? = null, val driverNodeType: String? = null, val initScripts: List<String>? = null, val logDestination: String? = null, val maxNumberOfWorkers: Int? = null, val minNumberOfWorkers: Int? = null, val nodeType: String, val sparkConfig: Map<String, String>? = null, val sparkEnvironmentVariables: Map<String, String>? = null)

Constructors

constructor(clusterVersion: String, customTags: Map<String, String>? = null, driverNodeType: String? = null, initScripts: List<String>? = null, logDestination: String? = null, maxNumberOfWorkers: Int? = null, minNumberOfWorkers: Int? = null, nodeType: String, sparkConfig: Map<String, String>? = null, sparkEnvironmentVariables: Map<String, String>? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

Spark version of a the cluster.

Link copied to clipboard
val customTags: Map<String, String>? = null

Tags for the cluster resource.

Link copied to clipboard
val driverNodeType: String? = null

Driver node type for the cluster.

Link copied to clipboard
val initScripts: List<String>? = null

User defined initialization scripts for the cluster.

Link copied to clipboard
val logDestination: String? = null

Location to deliver Spark driver, worker, and event logs.

Link copied to clipboard
val maxNumberOfWorkers: Int? = null

Specifies the maximum number of worker nodes. It should be between 1 and 25000.

Link copied to clipboard
val minNumberOfWorkers: Int? = null

Specifies the minimum number of worker nodes. It should be between 1 and 25000. It defaults to 1.

Link copied to clipboard

Node type for the new cluster.

Link copied to clipboard
val sparkConfig: Map<String, String>? = null

User-specified Spark configuration variables key-value pairs.

Link copied to clipboard

User-specified Spark environment variables key-value pairs.