Advanced RAG 05: Exploring Semantic Chunking

introducing principles and applications of semantic chunking

After parsing the document, we can obtain structured or semi-structured data. The main task now is to break them down into smaller chunks to extract detailed features, and then embed these features to represent their semantics. Its position in RAG is shown in Figure 1.

Figure 1 : The position of the Chunking process(red box) in RAG. Image by author.