Data Source Chunking Configuration
data class DataSourceChunkingConfiguration(val chunkingStrategy: DataSourceChunkingStrategy, val fixedSizeChunkingConfiguration: DataSourceFixedSizeChunkingConfiguration? = null)
Details about how to chunk the documents in the data source. A chunk refers to an excerpt from a data source that is returned when the knowledge base that it belongs to is queried.
Constructors
Link copied to clipboard
constructor(chunkingStrategy: DataSourceChunkingStrategy, fixedSizeChunkingConfiguration: DataSourceFixedSizeChunkingConfiguration? = null)
Properties
Link copied to clipboard
Knowledge base can split your source data into chunks. A chunk refers to an excerpt from a data source that is returned when the knowledge base that it belongs to is queried. You have the following options for chunking your data. If you opt for NONE , then you may want to pre-process your files by splitting them up such that each file corresponds to a chunk.
Link copied to clipboard
Configurations for when you choose fixed-size chunking. If you set the chunkingStrategy as NONE , exclude this field.