Chonkie – A Fast, Lightweight Text Chunking Library for RAG

Chonkie is the ultimate no-nonsense RAG chunking library that promises to CHONK your texts with lightning-fast speed and effortless ease. Tired of bloated or feature-less alternatives, the creator set out to develop a lightweight solution that just works. With Chonkie, you get all the CHONKs you need in a fast, easy-to-use package. The library supports various chunking methods like TokenChunker, WordChunker, and SentenceChunker, delivering impressive performance benchmarks that outshine the competition. And let’s not forget the adorable pygmy hippo mascot that adds a touch of charm to this powerful tool. Just install, import, and CHONK away! 🦛✨🚀

https://github.com/bhavnicksm/chonkie

To top