FlowVersionPromptModelInferenceConfiguration

data class FlowVersionPromptModelInferenceConfiguration(val maxTokens: Double? = null, val stopSequences: List<String>? = null, val temperature: Double? = null, val topP: Double? = null)

Prompt model inference configuration

Constructors

constructor(maxTokens: Double? = null, stopSequences: List<String>? = null, temperature: Double? = null, topP: Double? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val maxTokens: Double? = null

Maximum length of output

Link copied to clipboard
val stopSequences: List<String>? = null

List of stop sequences

Link copied to clipboard
val temperature: Double? = null

Controls randomness, higher values increase diversity

Link copied to clipboard
val topP: Double? = null

Cumulative probability cutoff for token selection