BatchDeploymentArgs

Code configuration for the endpoint deployment.

Compute target for batch inference operation.

Properties relevant to different deployment types.

Description of the endpoint deployment.

ARM resource ID or AssetId of the environment specification for the endpoint deployment.

Environment variables configuration for the deployment.

Error threshold, if the error count for the entire input goes above this value, the batch inference will be aborted. Range is -1, int.MaxValue. For FileDataset, this value is the count of file failures. For TabularDataset, this value is the count of record failures. If set to -1 (the lower bound), all failures during batch inference will be ignored.

Logging level for batch inference operation.

Indicates maximum number of parallelism per instance.

Size of the mini-batch passed to each batch invocation. For FileDataset, this is the number of files per mini-batch. For TabularDataset, this is the size of the records in bytes, per mini-batch.

Reference to the model asset for the endpoint deployment.

Indicates how the output will be organized.

Customized output file name for append_row output action.

Property dictionary. Properties can be added, but not removed or altered.

Indicates compute configuration for the job. If not provided, will default to the defaults defined in ResourceConfiguration.

Retry Settings for the batch inference operation. If not provided, will default to the defaults defined in BatchRetrySettings.