pulumi-azure-native-kotlin/com.pulumi.azurenative.machinelearningservices.kotlin.inputs/OnlineRequestSettingsArgs

OnlineRequestSettingsArgs

data class OnlineRequestSettingsArgs(val maxConcurrentRequestsPerInstance: Output<Int>? = null, val maxQueueWait: Output<String>? = null, val requestTimeout: Output<String>? = null) : ConvertibleToJava<OnlineRequestSettingsArgs>

Online deployment scoring requests configuration.

Constructors

Link copied to clipboard
constructor(maxConcurrentRequestsPerInstance: Output<Int>? = null, maxQueueWait: Output<String>? = null, requestTimeout: Output<String>? = null)

Properties

Link copied to clipboard
val maxConcurrentRequestsPerInstance: Output<Int>? = null

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

Link copied to clipboard
val maxQueueWait: Output<String>? = null

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)

Link copied to clipboard
val requestTimeout: Output<String>? = null

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Functions

Link copied to clipboard
open override fun toJava(): OnlineRequestSettingsArgs