inference Configuration
Parameters
value
Contains inference parameters to use when the agent invokes a foundation model in the part of the agent sequence defined by the promptType
. For more information, see Inference parameters for foundation models .
suspend fun inferenceConfiguration(argument: suspend AgentInferenceConfigurationArgsBuilder.() -> Unit)
Parameters
argument
Contains inference parameters to use when the agent invokes a foundation model in the part of the agent sequence defined by the promptType
. For more information, see Inference parameters for foundation models .