Package-level declarations

Types

Link copied to clipboard

Describes an autoscaling policy for Dataproc cluster autoscaler.

Link copied to clipboard
data class AutoscalingPolicyArgs(val basicAlgorithm: Output<AutoscalingPolicyBasicAlgorithmArgs>? = null, val location: Output<String>? = null, val policyId: Output<String>? = null, val project: Output<String>? = null, val secondaryWorkerConfig: Output<AutoscalingPolicySecondaryWorkerConfigArgs>? = null, val workerConfig: Output<AutoscalingPolicyWorkerConfigArgs>? = null) : ConvertibleToJava<AutoscalingPolicyArgs>

Describes an autoscaling policy for Dataproc cluster autoscaler.

Link copied to clipboard

Three different resources help you manage your IAM policy for Dataproc AutoscalingPolicy. Each of these resources serves a different use case:

Link copied to clipboard
data class AutoscalingPolicyIamBindingArgs(val condition: Output<AutoscalingPolicyIamBindingConditionArgs>? = null, val location: Output<String>? = null, val members: Output<List<String>>? = null, val policyId: Output<String>? = null, val project: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<AutoscalingPolicyIamBindingArgs>

Three different resources help you manage your IAM policy for Dataproc AutoscalingPolicy. Each of these resources serves a different use case:

Link copied to clipboard

Three different resources help you manage your IAM policy for Dataproc AutoscalingPolicy. Each of these resources serves a different use case:

Link copied to clipboard
data class AutoscalingPolicyIamMemberArgs(val condition: Output<AutoscalingPolicyIamMemberConditionArgs>? = null, val location: Output<String>? = null, val member: Output<String>? = null, val policyId: Output<String>? = null, val project: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<AutoscalingPolicyIamMemberArgs>

Three different resources help you manage your IAM policy for Dataproc AutoscalingPolicy. Each of these resources serves a different use case:

Link copied to clipboard

Three different resources help you manage your IAM policy for Dataproc AutoscalingPolicy. Each of these resources serves a different use case:

Link copied to clipboard
data class AutoscalingPolicyIamPolicyArgs(val location: Output<String>? = null, val policyData: Output<String>? = null, val policyId: Output<String>? = null, val project: Output<String>? = null) : ConvertibleToJava<AutoscalingPolicyIamPolicyArgs>

Three different resources help you manage your IAM policy for Dataproc AutoscalingPolicy. Each of these resources serves a different use case:

Link copied to clipboard

Manages a Cloud Dataproc cluster resource within GCP.

Link copied to clipboard
data class ClusterArgs(val clusterConfig: Output<ClusterClusterConfigArgs>? = null, val gracefulDecommissionTimeout: Output<String>? = null, val labels: Output<Map<String, String>>? = null, val name: Output<String>? = null, val project: Output<String>? = null, val region: Output<String>? = null, val virtualClusterConfig: Output<ClusterVirtualClusterConfigArgs>? = null) : ConvertibleToJava<ClusterArgs>

Manages a Cloud Dataproc cluster resource within GCP.

Link copied to clipboard
Link copied to clipboard

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

Link copied to clipboard
data class ClusterIAMBindingArgs(val cluster: Output<String>? = null, val condition: Output<ClusterIAMBindingConditionArgs>? = null, val members: Output<List<String>>? = null, val project: Output<String>? = null, val region: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<ClusterIAMBindingArgs>

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

Link copied to clipboard

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

Link copied to clipboard
data class ClusterIAMMemberArgs(val cluster: Output<String>? = null, val condition: Output<ClusterIAMMemberConditionArgs>? = null, val member: Output<String>? = null, val project: Output<String>? = null, val region: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<ClusterIAMMemberArgs>

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

Link copied to clipboard

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

Link copied to clipboard
data class ClusterIAMPolicyArgs(val cluster: Output<String>? = null, val policyData: Output<String>? = null, val project: Output<String>? = null, val region: Output<String>? = null) : ConvertibleToJava<ClusterIAMPolicyArgs>

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard

Manages a job resource within a Dataproc cluster within GCE. For more information see the official dataproc documentation. !>Note: This resource does not support 'update' and changing any attributes will cause the resource to be recreated.

Link copied to clipboard
data class JobArgs(val forceDelete: Output<Boolean>? = null, val hadoopConfig: Output<JobHadoopConfigArgs>? = null, val hiveConfig: Output<JobHiveConfigArgs>? = null, val labels: Output<Map<String, String>>? = null, val pigConfig: Output<JobPigConfigArgs>? = null, val placement: Output<JobPlacementArgs>? = null, val prestoConfig: Output<JobPrestoConfigArgs>? = null, val project: Output<String>? = null, val pysparkConfig: Output<JobPysparkConfigArgs>? = null, val reference: Output<JobReferenceArgs>? = null, val region: Output<String>? = null, val scheduling: Output<JobSchedulingArgs>? = null, val sparkConfig: Output<JobSparkConfigArgs>? = null, val sparksqlConfig: Output<JobSparksqlConfigArgs>? = null) : ConvertibleToJava<JobArgs>

Manages a job resource within a Dataproc cluster within GCE. For more information see the official dataproc documentation. !>Note: This resource does not support 'update' and changing any attributes will cause the resource to be recreated.

Link copied to clipboard

Builder for JobArgs.

Link copied to clipboard

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

Link copied to clipboard
data class JobIAMBindingArgs(val condition: Output<JobIAMBindingConditionArgs>? = null, val jobId: Output<String>? = null, val members: Output<List<String>>? = null, val project: Output<String>? = null, val region: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<JobIAMBindingArgs>

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

Link copied to clipboard
data class JobIAMMemberArgs(val condition: Output<JobIAMMemberConditionArgs>? = null, val jobId: Output<String>? = null, val member: Output<String>? = null, val project: Output<String>? = null, val region: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<JobIAMMemberArgs>

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

Link copied to clipboard
data class JobIAMPolicyArgs(val jobId: Output<String>? = null, val policyData: Output<String>? = null, val project: Output<String>? = null, val region: Output<String>? = null) : ConvertibleToJava<JobIAMPolicyArgs>

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard

Builder for Job.

Link copied to clipboard

Federation can be imported using any of these accepted formats

Link copied to clipboard
data class MetastoreFederationArgs(val backendMetastores: Output<List<MetastoreFederationBackendMetastoreArgs>>? = null, val federationId: Output<String>? = null, val labels: Output<Map<String, String>>? = null, val location: Output<String>? = null, val project: Output<String>? = null, val version: Output<String>? = null) : ConvertibleToJava<MetastoreFederationArgs>

Federation can be imported using any of these accepted formats

Link copied to clipboard

For all import syntaxes, the "resource in question" can take any of the following forms* projects/{{project}}/locations/{{location}}/federations/{{federation_id}} * {{project}}/{{location}}/{{federation_id}} * {{location}}/{{federation_id}} * {{federation_id}} Any variables not passed in the import command will be taken from the provider configuration. Dataproc metastore federation IAM resources can be imported using the resource identifiers, role, and member. IAM member imports use space-delimited identifiersthe resource in question, the role, and the member identity, e.g.

Link copied to clipboard
data class MetastoreFederationIamBindingArgs(val condition: Output<MetastoreFederationIamBindingConditionArgs>? = null, val federationId: Output<String>? = null, val location: Output<String>? = null, val members: Output<List<String>>? = null, val project: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<MetastoreFederationIamBindingArgs>

For all import syntaxes, the "resource in question" can take any of the following forms* projects/{{project}}/locations/{{location}}/federations/{{federation_id}} * {{project}}/{{location}}/{{federation_id}} * {{location}}/{{federation_id}} * {{federation_id}} Any variables not passed in the import command will be taken from the provider configuration. Dataproc metastore federation IAM resources can be imported using the resource identifiers, role, and member. IAM member imports use space-delimited identifiersthe resource in question, the role, and the member identity, e.g.

Link copied to clipboard

For all import syntaxes, the "resource in question" can take any of the following forms* projects/{{project}}/locations/{{location}}/federations/{{federation_id}} * {{project}}/{{location}}/{{federation_id}} * {{location}}/{{federation_id}} * {{federation_id}} Any variables not passed in the import command will be taken from the provider configuration. Dataproc metastore federation IAM resources can be imported using the resource identifiers, role, and member. IAM member imports use space-delimited identifiersthe resource in question, the role, and the member identity, e.g.

Link copied to clipboard
data class MetastoreFederationIamMemberArgs(val condition: Output<MetastoreFederationIamMemberConditionArgs>? = null, val federationId: Output<String>? = null, val location: Output<String>? = null, val member: Output<String>? = null, val project: Output<String>? = null, val role: Output<String>? = null) : ConvertibleToJava<MetastoreFederationIamMemberArgs>

For all import syntaxes, the "resource in question" can take any of the following forms* projects/{{project}}/locations/{{location}}/federations/{{federation_id}} * {{project}}/{{location}}/{{federation_id}} * {{location}}/{{federation_id}} * {{federation_id}} Any variables not passed in the import command will be taken from the provider configuration. Dataproc metastore federation IAM resources can be imported using the resource identifiers, role, and member. IAM member imports use space-delimited identifiersthe resource in question, the role, and the member identity, e.g.

Link copied to clipboard

For all import syntaxes, the "resource in question" can take any of the following forms* projects/{{project}}/locations/{{location}}/federations/{{federation_id}} * {{project}}/{{location}}/{{federation_id}} * {{location}}/{{federation_id}} * {{federation_id}} Any variables not passed in the import command will be taken from the provider configuration. Dataproc metastore federation IAM resources can be imported using the resource identifiers, role, and member. IAM member imports use space-delimited identifiersthe resource in question, the role, and the member identity, e.g.

Link copied to clipboard
data class MetastoreFederationIamPolicyArgs(val federationId: Output<String>? = null, val location: Output<String>? = null, val policyData: Output<String>? = null, val project: Output<String>? = null) : ConvertibleToJava<MetastoreFederationIamPolicyArgs>

For all import syntaxes, the "resource in question" can take any of the following forms* projects/{{project}}/locations/{{location}}/federations/{{federation_id}} * {{project}}/{{location}}/{{federation_id}} * {{location}}/{{federation_id}} * {{federation_id}} Any variables not passed in the import command will be taken from the provider configuration. Dataproc metastore federation IAM resources can be imported using the resource identifiers, role, and member. IAM member imports use space-delimited identifiersthe resource in question, the role, and the member identity, e.g.

Link copied to clipboard

A managed metastore service that serves metadata queries. To get more information about Service, see:

Link copied to clipboard
data class MetastoreServiceArgs(val databaseType: Output<String>? = null, val encryptionConfig: Output<MetastoreServiceEncryptionConfigArgs>? = null, val hiveMetastoreConfig: Output<MetastoreServiceHiveMetastoreConfigArgs>? = null, val labels: Output<Map<String, String>>? = null, val location: Output<String>? = null, val maintenanceWindow: Output<MetastoreServiceMaintenanceWindowArgs>? = null, val metadataIntegration: Output<MetastoreServiceMetadataIntegrationArgs>? = null, val network: Output<String>? = null, val networkConfig: Output<MetastoreServiceNetworkConfigArgs>? = null, val port: Output<Int>? = null, val project: Output<String>? = null, val releaseChannel: Output<String>? = null, val serviceId: Output<String>? = null, val telemetryConfig: Output<MetastoreServiceTelemetryConfigArgs>? = null, val tier: Output<String>? = null) : ConvertibleToJava<MetastoreServiceArgs>

A managed metastore service that serves metadata queries. To get more information about Service, see:

Link copied to clipboard

Three different resources help you manage your IAM policy for Dataproc metastore Service. Each of these resources serves a different use case:

Link copied to clipboard
data class MetastoreServiceIamBindingArgs(val condition: Output<MetastoreServiceIamBindingConditionArgs>? = null, val location: Output<String>? = null, val members: Output<List<String>>? = null, val project: Output<String>? = null, val role: Output<String>? = null, val serviceId: Output<String>? = null) : ConvertibleToJava<MetastoreServiceIamBindingArgs>

Three different resources help you manage your IAM policy for Dataproc metastore Service. Each of these resources serves a different use case:

Link copied to clipboard

Three different resources help you manage your IAM policy for Dataproc metastore Service. Each of these resources serves a different use case:

Link copied to clipboard
data class MetastoreServiceIamMemberArgs(val condition: Output<MetastoreServiceIamMemberConditionArgs>? = null, val location: Output<String>? = null, val member: Output<String>? = null, val project: Output<String>? = null, val role: Output<String>? = null, val serviceId: Output<String>? = null) : ConvertibleToJava<MetastoreServiceIamMemberArgs>

Three different resources help you manage your IAM policy for Dataproc metastore Service. Each of these resources serves a different use case:

Link copied to clipboard

Three different resources help you manage your IAM policy for Dataproc metastore Service. Each of these resources serves a different use case:

Link copied to clipboard
data class MetastoreServiceIamPolicyArgs(val location: Output<String>? = null, val policyData: Output<String>? = null, val project: Output<String>? = null, val serviceId: Output<String>? = null) : ConvertibleToJava<MetastoreServiceIamPolicyArgs>

Three different resources help you manage your IAM policy for Dataproc metastore Service. Each of these resources serves a different use case:

Link copied to clipboard

A Workflow Template is a reusable workflow configuration. It defines a graph of jobs with information on where to run those jobs.

Link copied to clipboard
data class WorkflowTemplateArgs(val dagTimeout: Output<String>? = null, val jobs: Output<List<WorkflowTemplateJobArgs>>? = null, val labels: Output<Map<String, String>>? = null, val location: Output<String>? = null, val name: Output<String>? = null, val parameters: Output<List<WorkflowTemplateParameterArgs>>? = null, val placement: Output<WorkflowTemplatePlacementArgs>? = null, val project: Output<String>? = null, val version: Output<Int>? = null) : ConvertibleToJava<WorkflowTemplateArgs>

A Workflow Template is a reusable workflow configuration. It defines a graph of jobs with information on where to run those jobs.

Functions

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
suspend fun clusterResource(name: String, block: suspend ClusterResourceBuilder.() -> Unit): Cluster
Link copied to clipboard
Link copied to clipboard
suspend fun jobIAMMemberResource(name: String, block: suspend JobIAMMemberResourceBuilder.() -> Unit): JobIAMMember
Link copied to clipboard
suspend fun jobIAMPolicyResource(name: String, block: suspend JobIAMPolicyResourceBuilder.() -> Unit): JobIAMPolicy
Link copied to clipboard
suspend fun jobResource(name: String, block: suspend JobResourceBuilder.() -> Unit): Job
Link copied to clipboard
Link copied to clipboard