InferenceComponentRuntimeConfig

data class InferenceComponentRuntimeConfig(val copyCount: Int? = null, val currentCopyCount: Int? = null, val desiredCopyCount: Int? = null)

The runtime config for the inference component

Constructors

constructor(copyCount: Int? = null, currentCopyCount: Int? = null, desiredCopyCount: Int? = null)

val copyCount: Int? = null

The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.