Endpoint
Constructors
Properties
The size of the Elastic Inference (EI) instance to use for the production variant.
The timeout value, in seconds, for your inference container to pass health check by SageMaker AI Hosting. For more information about health check, see How Your Container Should Respond to Health Check (Ping) Requests. Valid values between 60 and 3600.
Specifies configuration for a core dump from the model container when the process crashes. Fields are documented below.
You can use this parameter to turn on native Amazon Web Services Systems Manager (SSM) access for a production variant behind an endpoint. By default, SSM access is disabled for all production variants behind an endpoints.
Specifies an option from a collection of preconfigured Amazon Machine Image (AMI) images. Each image is configured by Amazon Web Services with a set of software and driver versions. Amazon Web Services optimizes these configurations for different machine learning workloads.
Initial number of instances used for auto-scaling.
Determines initial traffic distribution among all of the models that you specify in the endpoint configuration. If unspecified, it defaults to 1.0.
The type of instance to start.
Settings that control the range in the number of instances that the endpoint provisions as it scales up or down to accommodate traffic.
The timeout value, in seconds, to download and extract the model that you want to host from Amazon S3 to the individual inference instance associated with this production variant. Valid values between 60 and 3600.
Sets how the endpoint routes incoming traffic. See routing_config below.
Specifies configuration for how an endpoint performs asynchronous inference.
The name of the variant. If omitted, this provider will assign a random, unique name.
The size, in GB, of the ML storage volume attached to individual inference instance associated with the production variant. Valid values between 1 and 512.