InferenceExperimentRealTimeInferenceConfig

data class InferenceExperimentRealTimeInferenceConfig(val instanceCount: Int, val instanceType: String)

The infrastructure configuration for deploying the model to a real-time inference endpoint.

Constructors

constructor(instanceCount: Int, instanceType: String)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

The number of instances of the type specified by InstanceType.

Link copied to clipboard

The instance type the model is deployed to.