Cluster Cluster Config Worker Config Args
Constructors
Properties
The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
Disk Config
List of worker instance names which have been assigned to the cluster.
The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4
).
The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
The minimum number of primary worker instances to create. If min_num_instances
is set, cluster creation will succeed if the number of primary workers created is at least equal to the min_num_instances
number.
Specifies the number of worker nodes to create. If not specified, GCP will default to a predetermined computed value (currently 2). There is currently a beta feature which allows you to run a Single Node Cluster. In order to take advantage of this you need to set "dataproc:dataproc.allow.zero.workers" = "true"
in cluster_config.software_config.properties