Endpoint
Constructors
Properties
The size of the Elastic Inference (EI) instance to use for the production variant.
The timeout value, in seconds, for your inference container to pass health check by SageMaker Hosting. For more information about health check, see How Your Container Should Respond to Health Check (Ping) Requests. Valid values between 60 and 3600.
Specifies configuration for a core dump from the model container when the process crashes. Fields are documented below.
You can use this parameter to turn on native Amazon Web Services Systems Manager (SSM) access for a production variant behind an endpoint. By default, SSM access is disabled for all production variants behind an endpoints.
Initial number of instances used for auto-scaling.
Determines initial traffic distribution among all of the models that you specify in the endpoint configuration. If unspecified, it defaults to 1.0.
The type of instance to start.
The timeout value, in seconds, to download and extract the model that you want to host from Amazon S3 to the individual inference instance associated with this production variant. Valid values between 60 and 3600.
Specifies configuration for how an endpoint performs asynchronous inference.
The name of the variant. If omitted, this provider will assign a random, unique name.
The size, in GB, of the ML storage volume attached to individual inference instance associated with the production variant. Valid values between 1 and 512.