Inference Component Specification
data class InferenceComponentSpecification(val computeResourceRequirements: InferenceComponentComputeResourceRequirements, val container: InferenceComponentContainerSpecification? = null, val modelName: String? = null, val startupParameters: InferenceComponentStartupParameters? = null)
The specification for the inference component
Constructors
Link copied to clipboard
constructor(computeResourceRequirements: InferenceComponentComputeResourceRequirements, container: InferenceComponentContainerSpecification? = null, modelName: String? = null, startupParameters: InferenceComponentStartupParameters? = null)
Properties
Link copied to clipboard
The compute resources allocated to run the model assigned to the inference component.
Link copied to clipboard
Defines a container that provides the runtime environment for a model that you deploy with an inference component.
Link copied to clipboard
Settings that take effect while the model container starts up.