WorkflowTemplateJob

data class WorkflowTemplateJob(val hadoopJob: WorkflowTemplateJobHadoopJob? = null, val hiveJob: WorkflowTemplateJobHiveJob? = null, val labels: Map<String, String>? = null, val pigJob: WorkflowTemplateJobPigJob? = null, val prerequisiteStepIds: List<String>? = null, val prestoJob: WorkflowTemplateJobPrestoJob? = null, val pysparkJob: WorkflowTemplateJobPysparkJob? = null, val scheduling: WorkflowTemplateJobScheduling? = null, val sparkJob: WorkflowTemplateJobSparkJob? = null, val sparkRJob: WorkflowTemplateJobSparkRJob? = null, val sparkSqlJob: WorkflowTemplateJobSparkSqlJob? = null, val stepId: String)

Constructors

Link copied to clipboard
constructor(hadoopJob: WorkflowTemplateJobHadoopJob? = null, hiveJob: WorkflowTemplateJobHiveJob? = null, labels: Map<String, String>? = null, pigJob: WorkflowTemplateJobPigJob? = null, prerequisiteStepIds: List<String>? = null, prestoJob: WorkflowTemplateJobPrestoJob? = null, pysparkJob: WorkflowTemplateJobPysparkJob? = null, scheduling: WorkflowTemplateJobScheduling? = null, sparkJob: WorkflowTemplateJobSparkJob? = null, sparkRJob: WorkflowTemplateJobSparkRJob? = null, sparkSqlJob: WorkflowTemplateJobSparkSqlJob? = null, stepId: String)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

Job is a Hadoop job.

Link copied to clipboard

Job is a Hive job.

Link copied to clipboard
val labels: Map<String, String>? = null

The labels to associate with this job. Label keys must be between 1 and 63 characters long, and must conform to the following regular expression: {0,63} No more than 32 labels can be associated with a given job.

Link copied to clipboard

Job is a Pig job.

Link copied to clipboard

The optional list of prerequisite job step_ids. If not specified, the job will start at the beginning of workflow.

Link copied to clipboard

Job is a Presto job.

Link copied to clipboard

Job is a PySpark job.

Link copied to clipboard

Job scheduling configuration.

Link copied to clipboard

Job is a Spark job.

Link copied to clipboard

Job is a SparkR job.

Link copied to clipboard

Job is a SparkSql job.

Link copied to clipboard

Required. The step id. The id must be unique among all jobs within the template. The step id is used as prefix for job id, as job goog-dataproc-workflow-step-id label, and in field from other steps. The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.