TopicIngestionDataSourceSettingsCloudStorageArgs

data class TopicIngestionDataSourceSettingsCloudStorageArgs(val avroFormat: Output<TopicIngestionDataSourceSettingsCloudStorageAvroFormatArgs>? = null, val bucket: Output<String>, val matchGlob: Output<String>? = null, val minimumObjectCreateTime: Output<String>? = null, val pubsubAvroFormat: Output<TopicIngestionDataSourceSettingsCloudStoragePubsubAvroFormatArgs>? = null, val textFormat: Output<TopicIngestionDataSourceSettingsCloudStorageTextFormatArgs>? = null) : ConvertibleToJava<TopicIngestionDataSourceSettingsCloudStorageArgs>

Constructors

constructor(avroFormat: Output<TopicIngestionDataSourceSettingsCloudStorageAvroFormatArgs>? = null, bucket: Output<String>, matchGlob: Output<String>? = null, minimumObjectCreateTime: Output<String>? = null, pubsubAvroFormat: Output<TopicIngestionDataSourceSettingsCloudStoragePubsubAvroFormatArgs>? = null, textFormat: Output<TopicIngestionDataSourceSettingsCloudStorageTextFormatArgs>? = null)

Properties

Link copied to clipboard

Configuration for reading Cloud Storage data in Avro binary format. The bytes of each object will be set to the data field of a Pub/Sub message.

Link copied to clipboard
val bucket: Output<String>

Cloud Storage bucket. The bucket name must be without any prefix like "gs://". See the bucket naming requirements: https://cloud.google.com/storage/docs/buckets#naming.

Link copied to clipboard
val matchGlob: Output<String>? = null

Glob pattern used to match objects that will be ingested. If unset, all objects will be ingested. See the supported patterns: https://cloud.google.com/storage/docs/json_api/v1/objects/list#list-objects-and-prefixes-using-glob

Link copied to clipboard
val minimumObjectCreateTime: Output<String>? = null

The timestamp set in RFC3339 text format. If set, only objects with a larger or equal timestamp will be ingested. Unset by default, meaning all objects will be ingested.

Link copied to clipboard

Configuration for reading Cloud Storage data written via Cloud Storage subscriptions(See https://cloud.google.com/pubsub/docs/cloudstorage). The data and attributes fields of the originally exported Pub/Sub message will be restored when publishing.

Link copied to clipboard

Configuration for reading Cloud Storage data in text format. Each line of text as specified by the delimiter will be set to the data field of a Pub/Sub message. Structure is documented below.

Functions

Link copied to clipboard
open override fun toJava(): TopicIngestionDataSourceSettingsCloudStorageArgs