DataSourceSemanticChunkingConfigurationArgs

data class DataSourceSemanticChunkingConfigurationArgs(val breakpointPercentileThreshold: Output<Int>, val bufferSize: Output<Int>, val maxTokens: Output<Int>) : ConvertibleToJava<DataSourceSemanticChunkingConfigurationArgs>

Configurations for when you choose semantic chunking. If you set the chunkingStrategy as NONE, exclude this field.

Constructors

constructor(breakpointPercentileThreshold: Output<Int>, bufferSize: Output<Int>, maxTokens: Output<Int>)

Properties

Link copied to clipboard

The dissimilarity threshold for splitting chunks.

Link copied to clipboard
val bufferSize: Output<Int>

The buffer size.

Link copied to clipboard
val maxTokens: Output<Int>

The maximum number of tokens that a chunk can contain.

Functions

Link copied to clipboard
open override fun toJava(): DataSourceSemanticChunkingConfigurationArgs