Story

Show HN: Rust-powered document chunker for RAG – 40x faster, O(1) memory

kriralabs Saturday, February 28, 2026

I built a document chunking library for RAG pipelines with a Rust core and Python bindings.

The problem: LangChain's chunker is pure Python and becomes a bottleneck at scale — slow and memory-hungry on large document sets.

What Krira Chunker does differently: - Rust-native processing — 40x faster than LangChain's implementation - O(1) space complexity — memory stays flat regardless of document size - Drop-in Python API — works with any existing RAG pipeline - Production-ready — 17 versions shipped, 315+ installs

pip install krira-augment

Would love brutal feedback from anyone building RAG systems — what chunking problems are you running into that this doesn't solve yet?

Summary
The Krira Chunker is an open-source tool that allows users to split large video files into smaller chunks, enabling efficient video processing and distribution. It provides features such as configurable chunk size, multi-threading, and support for various video formats.
14 3
Summary
github.com
Visit article Read on Hacker News Comments 3