chu2bard/chunkflow
Document chunking pipeline for RAG applications
This tool helps AI application builders prepare long text documents for use with retrieval-augmented generation (RAG) systems. It takes a lengthy document, like a report or article, and breaks it down into smaller, manageable pieces (chunks) using various strategies. Developers building AI applications, especially those incorporating RAG, would find this useful for pre-processing their text data.
Use this if you are a developer building a RAG application and need flexible, robust ways to split your source documents into suitable chunks.
Not ideal if you are an end-user simply looking to summarize or analyze a document without developing a RAG system.
Stars
13
Forks
—
Language
Python
License
MIT
Category
Last pushed
Feb 11, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/embeddings/chu2bard/chunkflow"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jparkerweb/semantic-chunking
🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows
drittich/SemanticSlicer
🧠✂️ SemanticSlicer — A smart text chunker for LLM-ready documents.
smart-models/Normalized-Semantic-Chunker
Cutting-edge tool that unlocks the full potential of semantic chunking
ndgigliotti/afterthoughts
Sentence-aware embeddings using late chunking with transformers.
ReemHal/Semantic-Text-Segmentation-with-Embeddings
Uses GloVe embeddings and greedy sequence segmentation to semantically segment a text document...