CrawlerIcebergTarget

data class CrawlerIcebergTarget(val connectionName: String? = null, val exclusions: List<String>? = null, val maximumTraversalDepth: Int? = null, val paths: List<String>? = null)

Specifies Apache Iceberg data store targets.

Constructors

Link copied to clipboard
constructor(connectionName: String? = null, exclusions: List<String>? = null, maximumTraversalDepth: Int? = null, paths: List<String>? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val connectionName: String? = null

The name of the connection to use to connect to the Iceberg target.

Link copied to clipboard
val exclusions: List<String>? = null

A list of global patterns used to exclude from the crawl.

Link copied to clipboard

The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Iceberg metadata folder in your Amazon S3 path. Used to limit the crawler run time.

Link copied to clipboard
val paths: List<String>? = null

One or more Amazon S3 paths that contains Iceberg metadata folders as s3://bucket/prefix .