Show HN: See – searchable JSON compression, smaller than ZSTD (on our data)
Tetsuro Wednesday, February 18, 2026
I built SEE (Semantic Entropy Encoding): a page-level JSON/NDJSON format that stays searchable while compressed (exists/pos/eq-style probes), using Bloom+skip + structure-aware encoding.
On our GitHub events dataset, SEE ended up smaller than Zstd-19 while still supporting random access queries: - combined: 40.4MB vs Zstd 71.8MB (raw 524.1MB) → 7.7% of raw - str: 9.1MB vs Zstd 9.5MB - int: 31.3MB vs Zstd 62.3MB Lookup microbench (one column): p50 ~0.085ms.
Repo + release assets are here: https://github.com/kodomonocch1/see_proto
NDA eval request (optional): https://docs.google.com/forms/d/e/1FAIpQLScV2Ti592K3Za2r_WLU...
Happy to answer questions about the design trade-offs and where this beats “Zstd + separate index”.
1
1
github.com