Inference
data class InferenceExperimentShadowModeConfig(val shadowModelVariants: List<InferenceExperimentShadowModelVariantConfig>, val sourceModelVariantName: String)
The configuration of ShadowMode inference experiment type. Use this field to specify a production variant which takes all the inference requests, and a shadow variant to which Amazon SageMaker replicates a percentage of the inference requests. For the shadow variant also specify the percentage of requests that Amazon SageMaker replicates.
Constructors
Link copied to clipboard
constructor(shadowModelVariants: List<InferenceExperimentShadowModelVariantConfig>, sourceModelVariantName: String)