Prompt model inference configuration
Maximum length of output
List of stop sequences
Controls randomness, higher values increase diversity
Cumulative probability cutoff for token selection