CrawlerS3Target

data class CrawlerS3Target(val connectionName: String? = null, val dlqEventQueueArn: String? = null, val eventQueueArn: String? = null, val exclusions: List<String>? = null, val path: String? = null, val sampleSize: Int? = null)

Specifies a data store in Amazon Simple Storage Service (Amazon S3).

Constructors

Link copied to clipboard
constructor(connectionName: String? = null, dlqEventQueueArn: String? = null, eventQueueArn: String? = null, exclusions: List<String>? = null, path: String? = null, sampleSize: Int? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val connectionName: String? = null

The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

Link copied to clipboard

A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

Link copied to clipboard
val eventQueueArn: String? = null

A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

Link copied to clipboard
val exclusions: List<String>? = null

A list of glob patterns used to exclude from the crawl.

Link copied to clipboard
val path: String? = null

The path to the Amazon S3 target.

Link copied to clipboard
val sampleSize: Int? = null

Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.