Package-level declarations

Types

Link copied to clipboard
data class AcceleratorConfigArgs(val acceleratorCount: Output<Int>? = null, val acceleratorTypeUri: Output<String>? = null) : ConvertibleToJava<AcceleratorConfigArgs>

Specifies the type and number of accelerator cards attached to the instances of an instance group (see GPUs on Compute Engine (https://cloud.google.com/compute/docs/gpus/)).

Link copied to clipboard
data class AutoscalingConfigArgs(val policyUri: Output<String>? = null) : ConvertibleToJava<AutoscalingConfigArgs>

Autoscaling Policy config associated with the cluster.

Link copied to clipboard
data class BasicAutoscalingAlgorithmArgs(val cooldownPeriod: Output<String>? = null, val yarnConfig: Output<BasicYarnAutoscalingConfigArgs>? = null) : ConvertibleToJava<BasicAutoscalingAlgorithmArgs>

Basic algorithm for autoscaling.

Link copied to clipboard
data class BasicYarnAutoscalingConfigArgs(val gracefulDecommissionTimeout: Output<String>, val scaleDownFactor: Output<Double>, val scaleDownMinWorkerFraction: Output<Double>? = null, val scaleUpFactor: Output<Double>, val scaleUpMinWorkerFraction: Output<Double>? = null) : ConvertibleToJava<BasicYarnAutoscalingConfigArgs>

Basic autoscaling configurations for YARN.

Link copied to clipboard
data class BindingArgs(val condition: Output<ExprArgs>? = null, val members: Output<List<String>>? = null, val role: Output<String>? = null) : ConvertibleToJava<BindingArgs>

Associates members with a role.

Link copied to clipboard
Link copied to clipboard
data class ClusterConfigArgs(val autoscalingConfig: Output<AutoscalingConfigArgs>? = null, val configBucket: Output<String>? = null, val encryptionConfig: Output<EncryptionConfigArgs>? = null, val endpointConfig: Output<EndpointConfigArgs>? = null, val gceClusterConfig: Output<GceClusterConfigArgs>? = null, val gkeClusterConfig: Output<GkeClusterConfigArgs>? = null, val initializationActions: Output<List<NodeInitializationActionArgs>>? = null, val lifecycleConfig: Output<LifecycleConfigArgs>? = null, val masterConfig: Output<InstanceGroupConfigArgs>? = null, val metastoreConfig: Output<MetastoreConfigArgs>? = null, val secondaryWorkerConfig: Output<InstanceGroupConfigArgs>? = null, val securityConfig: Output<SecurityConfigArgs>? = null, val softwareConfig: Output<SoftwareConfigArgs>? = null, val tempBucket: Output<String>? = null, val workerConfig: Output<InstanceGroupConfigArgs>? = null) : ConvertibleToJava<ClusterConfigArgs>

The cluster config.

Link copied to clipboard
Link copied to clipboard
data class ClusterSelectorArgs(val clusterLabels: Output<Map<String, String>>, val zone: Output<String>? = null) : ConvertibleToJava<ClusterSelectorArgs>

A selector that chooses target cluster for jobs based on metadata.

Link copied to clipboard
data class DiskConfigArgs(val bootDiskSizeGb: Output<Int>? = null, val bootDiskType: Output<String>? = null, val numLocalSsds: Output<Int>? = null) : ConvertibleToJava<DiskConfigArgs>

Specifies the config of disk options for a group of VM instances.

Link copied to clipboard
Link copied to clipboard
data class EncryptionConfigArgs(val gcePdKmsKeyName: Output<String>? = null) : ConvertibleToJava<EncryptionConfigArgs>

Encryption settings for the cluster.

Link copied to clipboard
data class EndpointConfigArgs(val enableHttpPortAccess: Output<Boolean>? = null) : ConvertibleToJava<EndpointConfigArgs>

Endpoint config for this cluster

Link copied to clipboard
Link copied to clipboard
data class ExprArgs(val description: Output<String>? = null, val expression: Output<String>? = null, val location: Output<String>? = null, val title: Output<String>? = null) : ConvertibleToJava<ExprArgs>

Represents a textual expression in the Common Expression Language (CEL) syntax. CEL is a C-like expression language. The syntax and semantics of CEL are documented at https://github.com/google/cel-spec.Example (Comparison): title: "Summary size limit" description: "Determines if a summary is less than 100 chars" expression: "document.summary.size() < 100" Example (Equality): title: "Requestor is owner" description: "Determines if requestor is the document owner" expression: "document.owner == request.auth.claims.email" Example (Logic): title: "Public documents" description: "Determine whether the document should be publicly visible" expression: "document.type != 'private' && document.type != 'internal'" Example (Data Manipulation): title: "Notification string" description: "Create a notification string with a timestamp." expression: "'New message received at ' + string(document.create_time)" The exact variables and functions that may be referenced within an expression are determined by the service that evaluates it. See the service documentation for additional information.

Link copied to clipboard

Builder for ExprArgs.

Link copied to clipboard
data class GceClusterConfigArgs(val internalIpOnly: Output<Boolean>? = null, val metadata: Output<Map<String, String>>? = null, val networkUri: Output<String>? = null, val nodeGroupAffinity: Output<NodeGroupAffinityArgs>? = null, val privateIpv6GoogleAccess: Output<GceClusterConfigPrivateIpv6GoogleAccess>? = null, val reservationAffinity: Output<ReservationAffinityArgs>? = null, val serviceAccount: Output<String>? = null, val serviceAccountScopes: Output<List<String>>? = null, val shieldedInstanceConfig: Output<ShieldedInstanceConfigArgs>? = null, val subnetworkUri: Output<String>? = null, val tags: Output<List<String>>? = null, val zoneUri: Output<String>? = null) : ConvertibleToJava<GceClusterConfigArgs>

Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.

Link copied to clipboard
data class GetAutoscalingPolicyIamPolicyPlainArgs(val autoscalingPolicyId: String, val location: String, val optionsRequestedPolicyVersion: Int? = null, val project: String? = null) : ConvertibleToJava<GetAutoscalingPolicyIamPolicyPlainArgs>
Link copied to clipboard
data class GetAutoscalingPolicyPlainArgs(val autoscalingPolicyId: String, val location: String, val project: String? = null) : ConvertibleToJava<GetAutoscalingPolicyPlainArgs>
Link copied to clipboard
data class GetClusterPlainArgs(val clusterName: String, val project: String? = null, val region: String) : ConvertibleToJava<GetClusterPlainArgs>
Link copied to clipboard
data class GetJobPlainArgs(val jobId: String, val project: String? = null, val region: String) : ConvertibleToJava<GetJobPlainArgs>
Link copied to clipboard
data class GetRegionAutoscalingPolicyIamPolicyPlainArgs(val autoscalingPolicyId: String, val optionsRequestedPolicyVersion: Int? = null, val project: String? = null, val regionId: String) : ConvertibleToJava<GetRegionAutoscalingPolicyIamPolicyPlainArgs>
Link copied to clipboard
data class GetRegionClusterIamPolicyPlainArgs(val clusterId: String, val optionsRequestedPolicyVersion: Int? = null, val project: String? = null, val regionId: String) : ConvertibleToJava<GetRegionClusterIamPolicyPlainArgs>
Link copied to clipboard
data class GetRegionJobIamPolicyPlainArgs(val jobId: String, val optionsRequestedPolicyVersion: Int? = null, val project: String? = null, val regionId: String) : ConvertibleToJava<GetRegionJobIamPolicyPlainArgs>
Link copied to clipboard
data class GetRegionOperationIamPolicyPlainArgs(val operationId: String, val optionsRequestedPolicyVersion: Int? = null, val project: String? = null, val regionId: String) : ConvertibleToJava<GetRegionOperationIamPolicyPlainArgs>
data class GetRegionWorkflowTemplateIamPolicyPlainArgs(val optionsRequestedPolicyVersion: Int? = null, val project: String? = null, val regionId: String, val workflowTemplateId: String) : ConvertibleToJava<GetRegionWorkflowTemplateIamPolicyPlainArgs>
Link copied to clipboard
data class GetWorkflowTemplateIamPolicyPlainArgs(val location: String, val optionsRequestedPolicyVersion: Int? = null, val project: String? = null, val workflowTemplateId: String) : ConvertibleToJava<GetWorkflowTemplateIamPolicyPlainArgs>
Link copied to clipboard
data class GetWorkflowTemplatePlainArgs(val location: String, val project: String? = null, val version: Int? = null, val workflowTemplateId: String) : ConvertibleToJava<GetWorkflowTemplatePlainArgs>
Link copied to clipboard
data class GkeClusterConfigArgs(val namespacedGkeDeploymentTarget: Output<NamespacedGkeDeploymentTargetArgs>? = null) : ConvertibleToJava<GkeClusterConfigArgs>

The GKE config for this cluster.

Link copied to clipboard
data class HadoopJobArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val mainClass: Output<String>? = null, val mainJarFileUri: Output<String>? = null, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<HadoopJobArgs>

A Dataproc job for running Apache Hadoop MapReduce (https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html) jobs on Apache Hadoop YARN (https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html).

Link copied to clipboard
Link copied to clipboard
data class HiveJobArgs(val continueOnFailure: Output<Boolean>? = null, val jarFileUris: Output<List<String>>? = null, val properties: Output<Map<String, String>>? = null, val queryFileUri: Output<String>? = null, val queryList: Output<QueryListArgs>? = null, val scriptVariables: Output<Map<String, String>>? = null) : ConvertibleToJava<HiveJobArgs>

A Dataproc job for running Apache Hive (https://hive.apache.org/) queries on YARN.

Link copied to clipboard
Link copied to clipboard
data class InstanceGroupAutoscalingPolicyConfigArgs(val maxInstances: Output<Int>? = null, val minInstances: Output<Int>? = null, val weight: Output<Int>? = null) : ConvertibleToJava<InstanceGroupAutoscalingPolicyConfigArgs>

Configuration for the size bounds of an instance group, including its proportional size to other groups.

Link copied to clipboard
data class InstanceGroupConfigArgs(val accelerators: Output<List<AcceleratorConfigArgs>>? = null, val diskConfig: Output<DiskConfigArgs>? = null, val imageUri: Output<String>? = null, val machineTypeUri: Output<String>? = null, val minCpuPlatform: Output<String>? = null, val numInstances: Output<Int>? = null, val preemptibility: Output<InstanceGroupConfigPreemptibility>? = null) : ConvertibleToJava<InstanceGroupConfigArgs>

The config settings for Compute Engine resources in an instance group, such as a master or worker group.

Link copied to clipboard
data class JobPlacementArgs(val clusterLabels: Output<Map<String, String>>? = null, val clusterName: Output<String>) : ConvertibleToJava<JobPlacementArgs>

Dataproc job config.

Link copied to clipboard
Link copied to clipboard
data class JobReferenceArgs(val jobId: Output<String>? = null, val project: Output<String>? = null) : ConvertibleToJava<JobReferenceArgs>

Encapsulates the full scoping used to reference a job.

Link copied to clipboard
Link copied to clipboard
data class JobSchedulingArgs(val maxFailuresPerHour: Output<Int>? = null, val maxFailuresTotal: Output<Int>? = null) : ConvertibleToJava<JobSchedulingArgs>

Job scheduling options.

Link copied to clipboard
Link copied to clipboard
data class KerberosConfigArgs(val crossRealmTrustAdminServer: Output<String>? = null, val crossRealmTrustKdc: Output<String>? = null, val crossRealmTrustRealm: Output<String>? = null, val crossRealmTrustSharedPasswordUri: Output<String>? = null, val enableKerberos: Output<Boolean>? = null, val kdcDbKeyUri: Output<String>? = null, val keyPasswordUri: Output<String>? = null, val keystorePasswordUri: Output<String>? = null, val keystoreUri: Output<String>? = null, val kmsKeyUri: Output<String>? = null, val realm: Output<String>? = null, val rootPrincipalPasswordUri: Output<String>? = null, val tgtLifetimeHours: Output<Int>? = null, val truststorePasswordUri: Output<String>? = null, val truststoreUri: Output<String>? = null) : ConvertibleToJava<KerberosConfigArgs>

Specifies Kerberos related configuration.

Link copied to clipboard
Link copied to clipboard
data class LifecycleConfigArgs(val autoDeleteTime: Output<String>? = null, val autoDeleteTtl: Output<String>? = null, val idleDeleteTtl: Output<String>? = null) : ConvertibleToJava<LifecycleConfigArgs>

Specifies the cluster auto-delete schedule configuration.

Link copied to clipboard
data class LoggingConfigArgs(val driverLogLevels: Output<Map<String, String>>? = null) : ConvertibleToJava<LoggingConfigArgs>

The runtime logging config of the job.

Link copied to clipboard
Link copied to clipboard
data class ManagedClusterArgs(val clusterName: Output<String>, val config: Output<ClusterConfigArgs>, val labels: Output<Map<String, String>>? = null) : ConvertibleToJava<ManagedClusterArgs>

Cluster that is managed by the workflow.

Link copied to clipboard
Link copied to clipboard
data class MetastoreConfigArgs(val dataprocMetastoreService: Output<String>) : ConvertibleToJava<MetastoreConfigArgs>

Specifies a Metastore configuration.

Link copied to clipboard
data class NamespacedGkeDeploymentTargetArgs(val clusterNamespace: Output<String>? = null, val targetGkeCluster: Output<String>? = null) : ConvertibleToJava<NamespacedGkeDeploymentTargetArgs>

A full, namespace-isolated deployment target for an existing GKE cluster.

Link copied to clipboard
data class NodeGroupAffinityArgs(val nodeGroupUri: Output<String>) : ConvertibleToJava<NodeGroupAffinityArgs>

Node Group Affinity for clusters using sole-tenant node groups.

Link copied to clipboard
data class NodeInitializationActionArgs(val executableFile: Output<String>, val executionTimeout: Output<String>? = null) : ConvertibleToJava<NodeInitializationActionArgs>

Specifies an executable to run on a fully configured node and a timeout period for executable completion.

Link copied to clipboard
data class OrderedJobArgs(val hadoopJob: Output<HadoopJobArgs>? = null, val hiveJob: Output<HiveJobArgs>? = null, val labels: Output<Map<String, String>>? = null, val pigJob: Output<PigJobArgs>? = null, val prerequisiteStepIds: Output<List<String>>? = null, val prestoJob: Output<PrestoJobArgs>? = null, val pysparkJob: Output<PySparkJobArgs>? = null, val scheduling: Output<JobSchedulingArgs>? = null, val sparkJob: Output<SparkJobArgs>? = null, val sparkRJob: Output<SparkRJobArgs>? = null, val sparkSqlJob: Output<SparkSqlJobArgs>? = null, val stepId: Output<String>) : ConvertibleToJava<OrderedJobArgs>

A job executed by the workflow.

Link copied to clipboard
Link copied to clipboard
data class ParameterValidationArgs(val regex: Output<RegexValidationArgs>? = null, val values: Output<ValueValidationArgs>? = null) : ConvertibleToJava<ParameterValidationArgs>

Configuration for parameter validation.

Link copied to clipboard
data class PigJobArgs(val continueOnFailure: Output<Boolean>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val properties: Output<Map<String, String>>? = null, val queryFileUri: Output<String>? = null, val queryList: Output<QueryListArgs>? = null, val scriptVariables: Output<Map<String, String>>? = null) : ConvertibleToJava<PigJobArgs>

A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

Link copied to clipboard

Builder for PigJobArgs.

Link copied to clipboard
data class PrestoJobArgs(val clientTags: Output<List<String>>? = null, val continueOnFailure: Output<Boolean>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val outputFormat: Output<String>? = null, val properties: Output<Map<String, String>>? = null, val queryFileUri: Output<String>? = null, val queryList: Output<QueryListArgs>? = null) : ConvertibleToJava<PrestoJobArgs>

A Dataproc job for running Presto (https://prestosql.io/) queries. IMPORTANT: The Dataproc Presto Optional Component (https://cloud.google.com/dataproc/docs/concepts/components/presto) must be enabled when the cluster is created to submit a Presto job to the cluster.

Link copied to clipboard
Link copied to clipboard
data class PySparkJobArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val mainPythonFileUri: Output<String>, val properties: Output<Map<String, String>>? = null, val pythonFileUris: Output<List<String>>? = null) : ConvertibleToJava<PySparkJobArgs>

A Dataproc job for running Apache PySpark (https://spark.apache.org/docs/0.9.0/python-programming-guide.html) applications on YARN.

Link copied to clipboard
Link copied to clipboard
data class QueryListArgs(val queries: Output<List<String>>) : ConvertibleToJava<QueryListArgs>

A list of queries to run on a cluster.

Link copied to clipboard
Link copied to clipboard
data class RegexValidationArgs(val regexes: Output<List<String>>) : ConvertibleToJava<RegexValidationArgs>

Validation based on regular expressions.

Link copied to clipboard
data class ReservationAffinityArgs(val consumeReservationType: Output<ReservationAffinityConsumeReservationType>? = null, val key: Output<String>? = null, val values: Output<List<String>>? = null) : ConvertibleToJava<ReservationAffinityArgs>

Reservation Affinity for consuming Zonal reservation.

Link copied to clipboard
data class SecurityConfigArgs(val kerberosConfig: Output<KerberosConfigArgs>? = null) : ConvertibleToJava<SecurityConfigArgs>

Security related configuration, including encryption, Kerberos, etc.

Link copied to clipboard
Link copied to clipboard
data class ShieldedInstanceConfigArgs(val enableIntegrityMonitoring: Output<Boolean>? = null, val enableSecureBoot: Output<Boolean>? = null, val enableVtpm: Output<Boolean>? = null) : ConvertibleToJava<ShieldedInstanceConfigArgs>

Shielded Instance Config for clusters using Compute Engine Shielded VMs (https://cloud.google.com/security/shielded-cloud/shielded-vm).

Link copied to clipboard
data class SoftwareConfigArgs(val imageVersion: Output<String>? = null, val optionalComponents: Output<List<SoftwareConfigOptionalComponentsItem>>? = null, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<SoftwareConfigArgs>

Specifies the selection and config of software inside the cluster.

Link copied to clipboard
Link copied to clipboard
data class SparkJobArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val mainClass: Output<String>? = null, val mainJarFileUri: Output<String>? = null, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<SparkJobArgs>

A Dataproc job for running Apache Spark (http://spark.apache.org/) applications on YARN. The specification of the main method to call to drive the job. Specify either the jar file that contains the main class or the main class name. To pass both a main jar and a main class in that jar, add the jar to CommonJob.jar_file_uris, and then specify the main class name in main_class.

Link copied to clipboard
Link copied to clipboard
data class SparkRJobArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val mainRFileUri: Output<String>, val properties: Output<Map<String, String>>? = null) : ConvertibleToJava<SparkRJobArgs>

A Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) applications on YARN.

Link copied to clipboard
Link copied to clipboard
data class SparkSqlJobArgs(val jarFileUris: Output<List<String>>? = null, val loggingConfig: Output<LoggingConfigArgs>? = null, val properties: Output<Map<String, String>>? = null, val queryFileUri: Output<String>? = null, val queryList: Output<QueryListArgs>? = null, val scriptVariables: Output<Map<String, String>>? = null) : ConvertibleToJava<SparkSqlJobArgs>

A Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

Link copied to clipboard
Link copied to clipboard
data class TemplateParameterArgs(val description: Output<String>? = null, val fields: Output<List<String>>, val name: Output<String>, val validation: Output<ParameterValidationArgs>? = null) : ConvertibleToJava<TemplateParameterArgs>

A configurable parameter that replaces one or more fields in the template. Parameterizable fields: - Labels - File uris - Job properties - Job arguments - Script variables - Main class (in HadoopJob and SparkJob) - Zone (in ClusterSelector)

Link copied to clipboard
data class ValueValidationArgs(val values: Output<List<String>>) : ConvertibleToJava<ValueValidationArgs>

Validation based on a list of allowed values.

Link copied to clipboard
data class WorkflowTemplatePlacementArgs(val clusterSelector: Output<ClusterSelectorArgs>? = null, val managedCluster: Output<ManagedClusterArgs>? = null) : ConvertibleToJava<WorkflowTemplatePlacementArgs>

Specifies workflow execution target.Either managed_cluster or cluster_selector is required.