Story

Ask HN: Local RAG with private knowledge base

zephodb Monday, October 28, 2024

Looking for a free, local, open source RAG solution for running a reference library with 1000s of technical PDFs and word docs. Tried the Ollama + open webui, Ollama+Anything LLM with opensource models such as Llama3.2 etc. As expected the more documents we feed the lower the accuracy. Doing it for a bunch of senior citizens who still love geeking out.

106 40
Read on Hacker News Comments 40