pulumi-azure-native-kotlin/com.pulumi.azurenative.machinelearningservices.kotlin.outputs/OnlineRequestSettingsResponse

OnlineRequestSettingsResponse

data class OnlineRequestSettingsResponse(val maxConcurrentRequestsPerInstance: Int? = null, val maxQueueWait: String? = null, val requestTimeout: String? = null)

Online deployment scoring requests configuration.

Constructors

Link copied to clipboard
constructor(maxConcurrentRequestsPerInstance: Int? = null, maxQueueWait: String? = null, requestTimeout: String? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val maxConcurrentRequestsPerInstance: Int? = null

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

Link copied to clipboard
val maxQueueWait: String? = null

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)

Link copied to clipboard
val requestTimeout: String? = null

The scoring timeout in ISO 8601 format. Defaults to 5000ms.