chonkie and adaptive-chunking

The tools are complementary: chonkie provides a lightweight ingestion library for RAG pipelines, while adaptive-chunking offers a method to automatically select optimal chunking strategies, which could be integrated into the ingestion process that chonkie facilitates.

chonkie
80
Verified
adaptive-chunking
25
Experimental
Maintenance 22/25
Adoption 15/25
Maturity 25/25
Community 18/25
Maintenance 13/25
Adoption 3/25
Maturity 9/25
Community 0/25
Stars: 3,829
Forks: 256
Downloads:
Commits (30d): 82
Language: Python
License: MIT
Stars: 4
Forks:
Downloads:
Commits (30d): 0
Language: Python
License: MIT
No risk flags
No Package No Dependents

About chonkie

chonkie-inc/chonkie

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

This is a lightweight tool for developers building Retrieval-Augmented Generation (RAG) applications. It takes various forms of text data, processes it by intelligently splitting it into smaller, meaningful parts (chunks), and then refines and embeds these chunks. The output is optimized text chunks ready to be stored in a vector database for efficient retrieval by large language models.

RAG development LLM application development text preprocessing vector database integration AI application engineering

About adaptive-chunking

ekimetrics/adaptive-chunking

Adaptive Chunking: automatically select the best chunking method per document for RAG. Accepted at LREC 2026.

Scores updated daily from GitHub, PyPI, and npm data. How scores work