The connection specifying the credentials to be used to read external storage, such as Azure Blob, Cloud Storage, or S3. The connection_id can have the form {{project}}.{{location}}.{{connection_id}} or projects/{{project}}/locations/{{location}}/connections/{{connection_id}}.

csvOptions

val csvOptions: TableExternalDataConfigurationCsvOptions? = null

Additional properties to set if source_format is set to "CSV". Structure is documented below.

googleSheetsOptions

val googleSheetsOptions: TableExternalDataConfigurationGoogleSheetsOptions? = null

Additional options if source_format is set to "GOOGLE_SHEETS". Structure is documented below.

hivePartitioningOptions

val hivePartitioningOptions: TableExternalDataConfigurationHivePartitioningOptions? = null

When set, configures hive partitioning support. Not all storage formats support hive partitioning -- requesting hive partitioning on an unsupported format will lead to an error, as will providing an invalid specification. Structure is documented below.

ignoreUnknownValues

val ignoreUnknownValues: Boolean? = null

Indicates if BigQuery should allow extra values that are not represented in the table schema. If true, the extra values are ignored. If false, records with extra columns are treated as bad records, and if there are too many bad records, an invalid error is returned in the job result. The default value is false.

maxBadRecords

val maxBadRecords: Int? = null

The maximum number of bad records that BigQuery can ignore when reading data.

referenceFileSchemaUri

val referenceFileSchemaUri: String? = null

When creating an external table, the user can provide a reference file with the table schema. This is enabled for the following formats: AVRO, PARQUET, ORC.

schema

val schema: String? = null

A JSON schema for the external table. Schema is required for CSV and JSON formats if autodetect is not on. Schema is disallowed for Google Cloud Bigtable, Cloud Datastore backups, Avro, ORC and Parquet formats. ~>NOTE: Because this field expects a JSON string, any changes to the string will create a diff, even if the JSON itself hasn't changed. Furthermore drift for this field cannot not be detected because BigQuery only uses this schema to compute the effective schema for the table, therefore any changes on the configured value will force the table to be recreated. This schema is effectively only applied when creating a table from an external datasource, after creation the computed schema will be stored in google_bigquery_table.schema

sourceFormat

val sourceFormat: String

The data format. Supported values are: "CSV", "GOOGLE_SHEETS", "NEWLINE_DELIMITED_JSON", "AVRO", "PARQUET", "ORC", "DATSTORE_BACKUP", and "BIGTABLE". To use "GOOGLE_SHEETS" the scopes must include "https://www.googleapis.com/auth/drive.readonly".

sourceUris

val sourceUris: List<String>

A list of the fully-qualified URIs that point to your data in Google Cloud.