pulumi-gcp-kotlin/com.pulumi.gcp.dataproc.kotlin.outputs/ClusterClusterConfig

ClusterClusterConfig

data class ClusterClusterConfig(val autoscalingConfig: ClusterClusterConfigAutoscalingConfig? = null, val bucket: String? = null, val dataprocMetricConfig: ClusterClusterConfigDataprocMetricConfig? = null, val encryptionConfig: ClusterClusterConfigEncryptionConfig? = null, val endpointConfig: ClusterClusterConfigEndpointConfig? = null, val gceClusterConfig: ClusterClusterConfigGceClusterConfig? = null, val initializationActions: List<ClusterClusterConfigInitializationAction>? = null, val lifecycleConfig: ClusterClusterConfigLifecycleConfig? = null, val masterConfig: ClusterClusterConfigMasterConfig? = null, val metastoreConfig: ClusterClusterConfigMetastoreConfig? = null, val preemptibleWorkerConfig: ClusterClusterConfigPreemptibleWorkerConfig? = null, val securityConfig: ClusterClusterConfigSecurityConfig? = null, val softwareConfig: ClusterClusterConfigSoftwareConfig? = null, val stagingBucket: String? = null, val tempBucket: String? = null, val workerConfig: ClusterClusterConfigWorkerConfig? = null)

Constructors

Link copied to clipboard
fun ClusterClusterConfig(autoscalingConfig: ClusterClusterConfigAutoscalingConfig? = null, bucket: String? = null, dataprocMetricConfig: ClusterClusterConfigDataprocMetricConfig? = null, encryptionConfig: ClusterClusterConfigEncryptionConfig? = null, endpointConfig: ClusterClusterConfigEndpointConfig? = null, gceClusterConfig: ClusterClusterConfigGceClusterConfig? = null, initializationActions: List<ClusterClusterConfigInitializationAction>? = null, lifecycleConfig: ClusterClusterConfigLifecycleConfig? = null, masterConfig: ClusterClusterConfigMasterConfig? = null, metastoreConfig: ClusterClusterConfigMetastoreConfig? = null, preemptibleWorkerConfig: ClusterClusterConfigPreemptibleWorkerConfig? = null, securityConfig: ClusterClusterConfigSecurityConfig? = null, softwareConfig: ClusterClusterConfigSoftwareConfig? = null, stagingBucket: String? = null, tempBucket: String? = null, workerConfig: ClusterClusterConfigWorkerConfig? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val autoscalingConfig: ClusterClusterConfigAutoscalingConfig? = null

The autoscaling policy config associated with the cluster. Note that once set, if autoscaling_config is the only field set in cluster_config, it can only be removed by setting policy_uri = "", rather than removing the whole block. Structure defined below.

Link copied to clipboard
val bucket: String? = null
Link copied to clipboard
val dataprocMetricConfig: ClusterClusterConfigDataprocMetricConfig? = null

The Compute Engine accelerator (GPU) configuration for these instances. Can be specified multiple times. Structure defined below.

Link copied to clipboard
val encryptionConfig: ClusterClusterConfigEncryptionConfig? = null

The Customer managed encryption keys settings for the cluster. Structure defined below.

Link copied to clipboard
val endpointConfig: ClusterClusterConfigEndpointConfig? = null

The config settings for port access on the cluster. Structure defined below.

Link copied to clipboard
val gceClusterConfig: ClusterClusterConfigGceClusterConfig? = null

Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Structure defined below.

Link copied to clipboard
val initializationActions: List<ClusterClusterConfigInitializationAction>? = null

Commands to execute on each node after config is completed. You can specify multiple versions of these. Structure defined below.

Link copied to clipboard
val lifecycleConfig: ClusterClusterConfigLifecycleConfig? = null

The settings for auto deletion cluster schedule. Structure defined below.

Link copied to clipboard
val masterConfig: ClusterClusterConfigMasterConfig? = null

The Google Compute Engine config settings for the master instances in a cluster. Structure defined below.

Link copied to clipboard
val metastoreConfig: ClusterClusterConfigMetastoreConfig? = null

The config setting for metastore service with the cluster. Structure defined below.

Link copied to clipboard
val preemptibleWorkerConfig: ClusterClusterConfigPreemptibleWorkerConfig? = null

The Google Compute Engine config settings for the additional instances in a cluster. Structure defined below.

Link copied to clipboard
val securityConfig: ClusterClusterConfigSecurityConfig? = null

Security related configuration. Structure defined below.

Link copied to clipboard
val softwareConfig: ClusterClusterConfigSoftwareConfig? = null

The config settings for software inside the cluster. Structure defined below.

Link copied to clipboard
val stagingBucket: String? = null

The Cloud Storage staging bucket used to stage files, such as Hadoop jars, between client machines and the cluster. Note: If you don't explicitly specify a staging_bucket then GCP will auto create / assign one for you. However, you are not guaranteed an auto generated bucket which is solely dedicated to your cluster; it may be shared with other clusters in the same region/zone also choosing to use the auto generation option.

Link copied to clipboard
val tempBucket: String? = null

The Cloud Storage temp bucket used to store ephemeral cluster and jobs data, such as Spark and MapReduce history files. Note: If you don't explicitly specify a temp_bucket then GCP will auto create / assign one for you.

Link copied to clipboard
val workerConfig: ClusterClusterConfigWorkerConfig? = null

The Google Compute Engine config settings for the worker instances in a cluster. Structure defined below.