EndpointConfigurationAsyncInferenceConfigClientConfigArgs

data class EndpointConfigurationAsyncInferenceConfigClientConfigArgs(val maxConcurrentInvocationsPerInstance: Output<Int>? = null) : ConvertibleToJava<EndpointConfigurationAsyncInferenceConfigClientConfigArgs>

Constructors

constructor(maxConcurrentInvocationsPerInstance: Output<Int>? = null)

Properties

Link copied to clipboard

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, Amazon SageMaker will choose an optimal value for you.

Functions

Link copied to clipboard
open override fun toJava(): EndpointConfigurationAsyncInferenceConfigClientConfigArgs