DataSourceChunkingConfiguration

data class DataSourceChunkingConfiguration(val chunkingStrategy: DataSourceChunkingStrategy, val fixedSizeChunkingConfiguration: DataSourceFixedSizeChunkingConfiguration? = null)

Details about how to chunk the documents in the data source. A chunk refers to an excerpt from a data source that is returned when the knowledge base that it belongs to is queried.

Constructors

Link copied to clipboard
constructor(chunkingStrategy: DataSourceChunkingStrategy, fixedSizeChunkingConfiguration: DataSourceFixedSizeChunkingConfiguration? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

Knowledge base can split your source data into chunks. A chunk refers to an excerpt from a data source that is returned when the knowledge base that it belongs to is queried. You have the following options for chunking your data. If you opt for NONE , then you may want to pre-process your files by splitting them up such that each file corresponds to a chunk.

Link copied to clipboard

Configurations for when you choose fixed-size chunking. If you set the chunkingStrategy as NONE , exclude this field.