pulumi-gcp-kotlin/com.pulumi.gcp.dataflow.kotlin/JobArgs

JobArgs

data class JobArgs(val additionalExperiments: Output<List<String>>? = null, val enableStreamingEngine: Output<Boolean>? = null, val ipConfiguration: Output<String>? = null, val kmsKeyName: Output<String>? = null, val labels: Output<Map<String, Any>>? = null, val machineType: Output<String>? = null, val maxWorkers: Output<Int>? = null, val name: Output<String>? = null, val network: Output<String>? = null, val onDelete: Output<String>? = null, val parameters: Output<Map<String, Any>>? = null, val project: Output<String>? = null, val region: Output<String>? = null, val serviceAccountEmail: Output<String>? = null, val skipWaitOnJobTermination: Output<Boolean>? = null, val subnetwork: Output<String>? = null, val tempGcsLocation: Output<String>? = null, val templateGcsPath: Output<String>? = null, val transformNameMapping: Output<Map<String, Any>>? = null, val zone: Output<String>? = null) : ConvertibleToJava<JobArgs>

Import

Dataflow jobs can be imported using the job id e.g.

$ pulumi import gcp:dataflow/job:Job example 2022-07-31_06_25_42-11926927532632678660
Content copied to clipboard

Constructors

Link copied to clipboard
fun JobArgs(additionalExperiments: Output<List<String>>? = null, enableStreamingEngine: Output<Boolean>? = null, ipConfiguration: Output<String>? = null, kmsKeyName: Output<String>? = null, labels: Output<Map<String, Any>>? = null, machineType: Output<String>? = null, maxWorkers: Output<Int>? = null, name: Output<String>? = null, network: Output<String>? = null, onDelete: Output<String>? = null, parameters: Output<Map<String, Any>>? = null, project: Output<String>? = null, region: Output<String>? = null, serviceAccountEmail: Output<String>? = null, skipWaitOnJobTermination: Output<Boolean>? = null, subnetwork: Output<String>? = null, tempGcsLocation: Output<String>? = null, templateGcsPath: Output<String>? = null, transformNameMapping: Output<Map<String, Any>>? = null, zone: Output<String>? = null)

Functions

Link copied to clipboard
open override fun toJava(): JobArgs

Properties

Link copied to clipboard
val additionalExperiments: Output<List<String>>? = null

List of experiments that should be used by the job. An example value is ["enable_stackdriver_agent_metrics"].

Link copied to clipboard
val enableStreamingEngine: Output<Boolean>? = null

Enable/disable the use of Streaming Engine for the job. Note that Streaming Engine is enabled by default for pipelines developed against the Beam SDK for Python v2.21.0 or later when using Python 3.

Link copied to clipboard
val ipConfiguration: Output<String>? = null

The configuration for VM IPs. Options are "WORKER_IP_PUBLIC" or "WORKER_IP_PRIVATE".

Link copied to clipboard
val kmsKeyName: Output<String>? = null

The name for the Cloud KMS key for the job. Key format is: projects/PROJECT_ID/locations/LOCATION/keyRings/KEY_RING/cryptoKeys/KEY

Link copied to clipboard
val labels: Output<Map<String, Any>>? = null

User labels to be specified for the job. Keys and values should follow the restrictions specified in the labeling restrictions page. NOTE: Google-provided Dataflow templates often provide default labels that begin with goog-dataflow-provided. Unless explicitly set in config, these labels will be ignored to prevent diffs on re-apply.

Link copied to clipboard
val machineType: Output<String>? = null

The machine type to use for the job.

Link copied to clipboard
val maxWorkers: Output<Int>? = null

The number of workers permitted to work on the job. More workers may improve processing speed at additional cost.

Link copied to clipboard
val name: Output<String>? = null

A unique name for the resource, required by Dataflow.

Link copied to clipboard
val network: Output<String>? = null

The network to which VMs will be assigned. If it is not provided, "default" will be used.

Link copied to clipboard
val onDelete: Output<String>? = null

One of "drain" or "cancel". Specifies behavior of deletion during terraform destroy.

Link copied to clipboard
val parameters: Output<Map<String, Any>>? = null

Key/Value pairs to be passed to the Dataflow job (as used in the template).

Link copied to clipboard
val project: Output<String>? = null

The project in which the resource belongs. If it is not provided, the provider project is used.

Link copied to clipboard
val region: Output<String>? = null

The region in which the created job should run.

Link copied to clipboard
val serviceAccountEmail: Output<String>? = null

The Service Account email used to create the job.

Link copied to clipboard
val skipWaitOnJobTermination: Output<Boolean>? = null

If true, treat DRAINING and CANCELLING as terminal job states and do not wait for further changes before removing from terraform state and moving on. WARNING: this will lead to job name conflicts if you do not ensure that the job names are different, e.g. by embedding a release ID or by using a random_id.

Link copied to clipboard
val subnetwork: Output<String>? = null

The subnetwork to which VMs will be assigned. Should be of the form "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in a Shared VPC network, you must use the complete URL. For example "googleapis.com/compute/v1/projects/PROJECT_ID/regions/REGION/subnetworks/SUBNET_NAME"

Link copied to clipboard
val tempGcsLocation: Output<String>? = null

A writeable location on GCS for the Dataflow job to dump its temporary data.

Link copied to clipboard
val templateGcsPath: Output<String>? = null

The GCS path to the Dataflow job template.

Link copied to clipboard
val transformNameMapping: Output<Map<String, Any>>? = null

Only applicable when updating a pipeline. Map of transform name prefixes of the job to be replaced with the corresponding name prefixes of the new job. This field is not used outside of update.

Link copied to clipboard
val zone: Output<String>? = null

The zone in which the created job should run. If it is not provided, the provider zone is used.