OnlineRequestSettingsResponse

data class OnlineRequestSettingsResponse(val maxConcurrentRequestsPerInstance: Int? = null, val maxQueueWait: String? = null, val requestTimeout: String? = null)

Online deployment scoring requests configuration.

Constructors

fun OnlineRequestSettingsResponse(maxConcurrentRequestsPerInstance: Int? = null, maxQueueWait: String? = null, requestTimeout: String? = null)

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms.

The scoring timeout in ISO 8601 format. Defaults to 5000ms.