FirehoseDeliveryStreamExtendedS3ConfigurationArgs

data class FirehoseDeliveryStreamExtendedS3ConfigurationArgs(val bucketArn: Output<String>, val bufferingInterval: Output<Int>? = null, val bufferingSize: Output<Int>? = null, val cloudwatchLoggingOptions: Output<FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptionsArgs>? = null, val compressionFormat: Output<String>? = null, val dataFormatConversionConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationArgs>? = null, val dynamicPartitioningConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfigurationArgs>? = null, val errorOutputPrefix: Output<String>? = null, val kmsKeyArn: Output<String>? = null, val prefix: Output<String>? = null, val processingConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfigurationArgs>? = null, val roleArn: Output<String>, val s3BackupConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfigurationArgs>? = null, val s3BackupMode: Output<String>? = null) : ConvertibleToJava<FirehoseDeliveryStreamExtendedS3ConfigurationArgs>

Constructors

fun FirehoseDeliveryStreamExtendedS3ConfigurationArgs(bucketArn: Output<String>, bufferingInterval: Output<Int>? = null, bufferingSize: Output<Int>? = null, cloudwatchLoggingOptions: Output<FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptionsArgs>? = null, compressionFormat: Output<String>? = null, dataFormatConversionConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationArgs>? = null, dynamicPartitioningConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfigurationArgs>? = null, errorOutputPrefix: Output<String>? = null, kmsKeyArn: Output<String>? = null, prefix: Output<String>? = null, processingConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfigurationArgs>? = null, roleArn: Output<String>, s3BackupConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfigurationArgs>? = null, s3BackupMode: Output<String>? = null)

Functions

Link copied to clipboard
open override fun toJava(): FirehoseDeliveryStreamExtendedS3ConfigurationArgs

Properties

Link copied to clipboard
val bucketArn: Output<String>

The ARN of the S3 bucket

Link copied to clipboard
val bufferingInterval: Output<Int>? = null

Buffer incoming data for the specified period of time, in seconds between 60 to 900, before delivering it to the destination. The default value is 300s.

Link copied to clipboard
val bufferingSize: Output<Int>? = null

Buffer incoming data to the specified size, in MBs between 1 to 100, before delivering it to the destination. The default value is 5MB.

Link copied to clipboard

The CloudWatch Logging Options for the delivery stream. More details are given below

Link copied to clipboard
val compressionFormat: Output<String>? = null

The compression format. If no value is specified, the default is UNCOMPRESSED. Other supported values are GZIP, ZIP, Snappy, &HADOOP_SNAPPY.

Link copied to clipboard

Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.

Link copied to clipboard

The configuration for dynamic partitioning. See Dynamic Partitioning Configuration below for more details. Required when using dynamic partitioning.

Link copied to clipboard
val errorOutputPrefix: Output<String>? = null

Prefix added to failed records before writing them to S3. Not currently supported for redshift destination. This prefix appears immediately following the bucket name. For information about how to specify this prefix, see Custom Prefixes for Amazon S3 Objects.

Link copied to clipboard
val kmsKeyArn: Output<String>? = null

Specifies the KMS key ARN the stream will use to encrypt data. If not set, no encryption will be used.

Link copied to clipboard
val prefix: Output<String>? = null

The "YYYY/MM/DD/HH" time format prefix is automatically used for delivered S3 files. You can specify an extra prefix to be added in front of the time format prefix. Note that if the prefix ends with a slash, it appears as a folder in the S3 bucket

Link copied to clipboard

The data processing configuration. More details are given below.

Link copied to clipboard
val roleArn: Output<String>

The ARN of the role used to access the Amazon MSK cluster.

Link copied to clipboard

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

Link copied to clipboard
val s3BackupMode: Output<String>? = null

Defines how documents should be delivered to Amazon S3. Valid values are FailedDocumentsOnly and AllDocuments. Default value is FailedDocumentsOnly.