pulumi-aws-native-kotlin/com.pulumi.awsnative.bedrock.kotlin.outputs/FlowVersionPromptModelInferenceConfiguration

FlowVersionPromptModelInferenceConfiguration

data class FlowVersionPromptModelInferenceConfiguration(val maxTokens: Double? = null, val stopSequences: List<String>? = null, val temperature: Double? = null, val topK: Double? = null, val topP: Double? = null)

Prompt model inference configuration

Constructors

constructor(maxTokens: Double? = null, stopSequences: List<String>? = null, temperature: Double? = null, topK: Double? = null, topP: Double? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val maxTokens: Double? = null

Maximum length of output

Link copied to clipboard
val stopSequences: List<String>? = null

List of stop sequences

Link copied to clipboard
val temperature: Double? = null

Controls randomness, higher values increase diversity

Link copied to clipboard
val topK: Double? = null

Sample from the k most likely next tokens

Link copied to clipboard
val topP: Double? = null

Cumulative probability cutoff for token selection