AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfigurationArgs

data class AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfigurationArgs(val maxLength: Output<Int>, val stopSequences: Output<List<String>>, val temperature: Output<Double>, val topK: Output<Int>, val topP: Output<Double>) : ConvertibleToJava<AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfigurationArgs>

Constructors

constructor(maxLength: Output<Int>, stopSequences: Output<List<String>>, temperature: Output<Double>, topK: Output<Int>, topP: Output<Double>)

Properties

Link copied to clipboard
val maxLength: Output<Int>

Maximum number of tokens to allow in the generated response.

Link copied to clipboard
val stopSequences: Output<List<String>>

List of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response.

Link copied to clipboard
val temperature: Output<Double>

Likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options.

Link copied to clipboard
val topK: Output<Int>

Number of top most-likely candidates, between 0 and 500, from which the model chooses the next token in the sequence.

Link copied to clipboard
val topP: Output<Double>

Top percentage of the probability distribution of next tokens, between 0 and 1 (denoting 0% and 100%), from which the model chooses the next token in the sequence.

Functions

Link copied to clipboard
open override fun toJava(): AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfigurationArgs