Agent Prompt Variant Args
Constructors
Properties
Contains model-specific inference configurations that aren’t in the inferenceConfiguration field. To see model-specific inference parameters, see Inference request parameters and response fields for foundation models.
Specifies a generative AI resource with which to use the prompt. If this is not supplied, then a gen_ai_resource
must be defined. See Generative AI Resource for more information.
Contains inference configurations for the prompt variant. See Inference Configuration for more information.
A list of objects, each containing a key-value pair that defines a metadata tag and value to attach to a prompt variant. See Metadata for more information.
Unique identifier of the model or inference profile with which to run inference on the prompt. If this is not supplied, then a gen_ai_resource
must be defined.
Contains configurations for the prompt template. See Template Configuration for more information.
Type of prompt template to use. Valid values: CHAT
, TEXT
.