Batch Deployment Response
Batch inference settings per deployment.
Constructors
Properties
Code configuration for the endpoint deployment.
Configuration for compute binding.
Description of the endpoint deployment.
ARM resource ID of the environment specification for the endpoint deployment.
Environment variables configuration for the deployment.
Error threshold, if the error count for the entire input goes above this value, the batch inference will be aborted. Range is -1, int.MaxValue. For FileDataset, this value is the count of file failures. For TabularDataset, this value is the count of record failures. If set to -1 (the lower bound), all failures during batch inference will be ignored.
Logging level for batch inference operation.
Size of the mini-batch passed to each batch invocation. For FileDataset, this is the number of files per mini-batch. For TabularDataset, this is the size of the records in bytes, per mini-batch.
Output configuration for the batch inference operation.
Partition keys list used for Named partitioning.
Property dictionary. Properties can be added, but not removed or altered.
Retry Settings for the batch inference operation.