CrawlerHudiTarget

data class CrawlerHudiTarget(val connectionName: String? = null, val exclusions: List<String>? = null, val maximumTraversalDepth: Int? = null, val paths: List<String>? = null)

Specifies Apache Hudi data store targets.

Constructors

Link copied to clipboard
constructor(connectionName: String? = null, exclusions: List<String>? = null, maximumTraversalDepth: Int? = null, paths: List<String>? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val connectionName: String? = null

The name of the connection to use to connect to the Hudi target.

Link copied to clipboard
val exclusions: List<String>? = null

A list of global patterns used to exclude from the crawl.

Link copied to clipboard

The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.

Link copied to clipboard
val paths: List<String>? = null

One or more Amazon S3 paths that contains Hudi metadata folders as s3://bucket/prefix .