AgentPromptVariantInferenceConfigurationText

data class AgentPromptVariantInferenceConfigurationText(val maxTokens: Int? = null, val stopSequences: List<String>? = null, val temperature: Double? = null, val topP: Double? = null)

Constructors

constructor(maxTokens: Int? = null, stopSequences: List<String>? = null, temperature: Double? = null, topP: Double? = null)

val maxTokens: Int? = null

Maximum number of tokens to return in the response.

List of strings that define sequences after which the model will stop generating.

Controls the randomness of the response. Choose a lower value for more predictable outputs and a higher value for more surprising outputs.

val topP: Double? = null

Percentage of most-likely candidates that the model considers for the next token.