pulumi-aws-kotlin/com.pulumi.aws.kinesis.kotlin.inputs/FirehoseDeliveryStreamExtendedS3ConfigurationArgs

FirehoseDeliveryStreamExtendedS3ConfigurationArgs

data class FirehoseDeliveryStreamExtendedS3ConfigurationArgs(val bucketArn: Output<String>, val bufferInterval: Output<Int>? = null, val bufferSize: Output<Int>? = null, val cloudwatchLoggingOptions: Output<FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptionsArgs>? = null, val compressionFormat: Output<String>? = null, val dataFormatConversionConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationArgs>? = null, val dynamicPartitioningConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfigurationArgs>? = null, val errorOutputPrefix: Output<String>? = null, val kmsKeyArn: Output<String>? = null, val prefix: Output<String>? = null, val processingConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfigurationArgs>? = null, val roleArn: Output<String>, val s3BackupConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfigurationArgs>? = null, val s3BackupMode: Output<String>? = null) : ConvertibleToJava<FirehoseDeliveryStreamExtendedS3ConfigurationArgs>

Constructors

constructor(bucketArn: Output<String>, bufferInterval: Output<Int>? = null, bufferSize: Output<Int>? = null, cloudwatchLoggingOptions: Output<FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptionsArgs>? = null, compressionFormat: Output<String>? = null, dataFormatConversionConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationArgs>? = null, dynamicPartitioningConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfigurationArgs>? = null, errorOutputPrefix: Output<String>? = null, kmsKeyArn: Output<String>? = null, prefix: Output<String>? = null, processingConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfigurationArgs>? = null, roleArn: Output<String>, s3BackupConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfigurationArgs>? = null, s3BackupMode: Output<String>? = null)

Properties

bucketArn

val bucketArn: Output<String>

The ARN of the S3 bucket

bufferInterval

val bufferInterval: Output<Int>? = null

Buffer incoming data for the specified period of time, in seconds, before delivering it to the destination. The default value is 300.

bufferSize

val bufferSize: Output<Int>? = null

Buffer incoming data to the specified size, in MBs, before delivering it to the destination. The default value is 5. We recommend setting SizeInMBs to a value greater than the amount of data you typically ingest into the delivery stream in 10 seconds. For example, if you typically ingest data at 1 MB/sec set SizeInMBs to be 10 MB or higher.

cloudwatchLoggingOptions

val cloudwatchLoggingOptions: Output<FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptionsArgs>? = null

The CloudWatch Logging Options for the delivery stream. More details are given below The extended_s3_configuration object supports the same fields from s3_configuration as well as the following:

compressionFormat

val compressionFormat: Output<String>? = null

The compression format. If no value is specified, the default is UNCOMPRESSED. Other supported values are GZIP, ZIP, Snappy, &HADOOP_SNAPPY.

dataFormatConversionConfiguration

val dataFormatConversionConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationArgs>? = null

Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.

dynamicPartitioningConfiguration

val dynamicPartitioningConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationDynamicPartitioningConfigurationArgs>? = null

The configuration for dynamic partitioning. See Dynamic Partitioning Configuration below for more details. Required when using dynamic partitioning.

errorOutputPrefix

val errorOutputPrefix: Output<String>? = null

Prefix added to failed records before writing them to S3. Not currently supported for redshift destination. This prefix appears immediately following the bucket name. For information about how to specify this prefix, see Custom Prefixes for Amazon S3 Objects.

kmsKeyArn

val kmsKeyArn: Output<String>? = null

Specifies the KMS key ARN the stream will use to encrypt data. If not set, no encryption will be used.

prefix

val prefix: Output<String>? = null

The "YYYY/MM/DD/HH" time format prefix is automatically used for delivered S3 files. You can specify an extra prefix to be added in front of the time format prefix. Note that if the prefix ends with a slash, it appears as a folder in the S3 bucket

processingConfiguration

val processingConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfigurationArgs>? = null

The data processing configuration. More details are given below.

roleArn

val roleArn: Output<String>

The ARN of the role that provides access to the source Kinesis stream.

s3BackupConfiguration

val s3BackupConfiguration: Output<FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfigurationArgs>? = null

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

s3BackupMode

val s3BackupMode: Output<String>? = null

The Amazon S3 backup mode. Valid values are Disabled and Enabled. Default value is Disabled.

Functions

toJava

open override fun toJava(): FirehoseDeliveryStreamExtendedS3ConfigurationArgs