jonfairbanks/local-rag
Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.
- Stars
- 765
- Forks
- 95
- Open issues
- 2
- Last push
- 2d ago
About local-rag
local-rag is a free, open-source LLM chat app by jonfairbanks, written mainly in Python. Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network. It has 765 GitHub stars and 95 forks, and was last updated 2d ago. It's released under the GPL-3.0 license, a standard open-source license.
- License
- GPL-3.0
- Language
- Python
- Stars
- 765
- Last update
- 2d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
ollama184k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
local-deep-research9.4k stars · ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encryp
local-rag FAQ
Is local-rag free?
Yes. local-rag is open source and free to use. It's released under the GPL-3.0 license, a standard open-source license.
Does local-rag run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does local-rag need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is local-rag still maintained?
Yes. It was last updated 2d ago and has 2 open issues on GitHub.
What are alternatives to local-rag?
Similar free, open-source tools include Hands-On-Large-Language-Models, open-webui, ollama, Qwen.