pulumi-aws-kotlin/com.pulumi.aws.kinesis.kotlin.outputs/FirehoseDeliveryStreamExtendedS3Configuration

FirehoseDeliveryStreamExtendedS3Configuration

data class FirehoseDeliveryStreamExtendedS3Configuration(val bucketArn: String, val bufferInterval: Int? = null, val bufferSize: Int? = null, val cloudwatchLoggingOptions: FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptions? = null, val compressionFormat: String? = null, val dataFormatConversionConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfiguration? = null, val dynamicPartitioningConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfiguration? = null, val errorOutputPrefix: String? = null, val kmsKeyArn: String? = null, val prefix: String? = null, val processingConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfiguration? = null, val roleArn: String, val s3BackupConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfiguration? = null, val s3BackupMode: String? = null)

Constructors

fun FirehoseDeliveryStreamExtendedS3Configuration(bucketArn: String, bufferInterval: Int? = null, bufferSize: Int? = null, cloudwatchLoggingOptions: FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptions? = null, compressionFormat: String? = null, dataFormatConversionConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfiguration? = null, dynamicPartitioningConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfiguration? = null, errorOutputPrefix: String? = null, kmsKeyArn: String? = null, prefix: String? = null, processingConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfiguration? = null, roleArn: String, s3BackupConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfiguration? = null, s3BackupMode: String? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val bucketArn: String

The ARN of the S3 bucket

Link copied to clipboard
val bufferInterval: Int? = null

Buffer incoming data for the specified period of time, in seconds, before delivering it to the destination. The default value is 300.

Link copied to clipboard
val bufferSize: Int? = null

Buffer incoming data to the specified size, in MBs, before delivering it to the destination. The default value is 5. We recommend setting SizeInMBs to a value greater than the amount of data you typically ingest into the delivery stream in 10 seconds. For example, if you typically ingest data at 1 MB/sec set SizeInMBs to be 10 MB or higher.

Link copied to clipboard
val cloudwatchLoggingOptions: FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptions? = null

The CloudWatch Logging Options for the delivery stream. More details are given below The extended_s3_configuration object supports the same fields from s3_configuration as well as the following:

Link copied to clipboard
val compressionFormat: String? = null

The compression format. If no value is specified, the default is UNCOMPRESSED. Other supported values are GZIP, ZIP, Snappy, &HADOOP_SNAPPY.

Link copied to clipboard
val dataFormatConversionConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfiguration? = null

Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.

Link copied to clipboard
val dynamicPartitioningConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfiguration? = null

The configuration for dynamic partitioning. See Dynamic Partitioning Configuration below for more details. Required when using dynamic partitioning.

Link copied to clipboard
val errorOutputPrefix: String? = null

Prefix added to failed records before writing them to S3. Not currently supported for redshift destination. This prefix appears immediately following the bucket name. For information about how to specify this prefix, see Custom Prefixes for Amazon S3 Objects.

Link copied to clipboard
val kmsKeyArn: String? = null

Specifies the KMS key ARN the stream will use to encrypt data. If not set, no encryption will be used.

Link copied to clipboard
val prefix: String? = null

The "YYYY/MM/DD/HH" time format prefix is automatically used for delivered S3 files. You can specify an extra prefix to be added in front of the time format prefix. Note that if the prefix ends with a slash, it appears as a folder in the S3 bucket

Link copied to clipboard
val processingConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfiguration? = null

The data processing configuration. More details are given below.

Link copied to clipboard
val roleArn: String

The ARN of the role that provides access to the source Kinesis stream.

Link copied to clipboard
val s3BackupConfiguration: FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfiguration? = null

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

Link copied to clipboard
val s3BackupMode: String? = null

The Amazon S3 backup mode. Valid values are Disabled and Enabled. Default value is Disabled.