GoogleCloudDatapipelinesV1RuntimeEnvironmentResponse

data class GoogleCloudDatapipelinesV1RuntimeEnvironmentResponse(val additionalExperiments: List<String>, val additionalUserLabels: Map<String, String>, val bypassTempDirValidation: Boolean, val enableStreamingEngine: Boolean, val ipConfiguration: String, val kmsKeyName: String, val machineType: String, val maxWorkers: Int, val network: String, val numWorkers: Int, val serviceAccountEmail: String, val subnetwork: String, val tempLocation: String, val workerRegion: String, val workerZone: String, val zone: String)

The environment values to set at runtime.

Constructors

constructor(additionalExperiments: List<String>, additionalUserLabels: Map<String, String>, bypassTempDirValidation: Boolean, enableStreamingEngine: Boolean, ipConfiguration: String, kmsKeyName: String, machineType: String, maxWorkers: Int, network: String, numWorkers: Int, serviceAccountEmail: String, subnetwork: String, tempLocation: String, workerRegion: String, workerZone: String, zone: String)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

Additional experiment flags for the job.

Link copied to clipboard

Additional user labels to be specified for the job. Keys and values should follow the restrictions specified in the labeling restrictions page. An object containing a list of key/value pairs. Example: { "name": "wrench", "mass": "1kg", "count": "3" }.

Link copied to clipboard

Whether to bypass the safety checks for the job's temporary directory. Use with caution.

Link copied to clipboard

Whether to enable Streaming Engine for the job.

Link copied to clipboard

Configuration for VM IPs.

Link copied to clipboard

Name for the Cloud KMS key for the job. The key format is: projects//locations//keyRings//cryptoKeys/

Link copied to clipboard

The machine type to use for the job. Defaults to the value from the template if not specified.

Link copied to clipboard

The maximum number of Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000.

Link copied to clipboard

Network to which VMs will be assigned. If empty or unspecified, the service will use the network "default".

Link copied to clipboard

The initial number of Compute Engine instances for the job.

Link copied to clipboard

The email address of the service account to run the job as.

Link copied to clipboard

Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form "https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK" or "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in a Shared VPC network, you must use the complete URL.

Link copied to clipboard

The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with gs://.

Link copied to clipboard

The Compute Engine region (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. "us-west1". Mutually exclusive with worker_zone. If neither worker_region nor worker_zone is specified, default to the control plane's region.

Link copied to clipboard

The Compute Engine zone (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. "us-west1-a". Mutually exclusive with worker_region. If neither worker_region nor worker_zone is specified, a zone in the control plane's region is chosen based on available capacity. If both worker_zone and zone are set, worker_zone takes precedence.

Link copied to clipboard

The Compute Engine availability zone for launching worker instances to run your pipeline. In the future, worker_zone will take precedence.