ray-project/llm-applications
A comprehensive guide to building RAG-based LLM applications for production.
- Stars
- 1.9k
- Forks
- 258
- Open issues
- 10
- Last push
- 2mo ago
About llm-applications
llm-applications is a free, open-source LLM chat app by ray-project, written mainly in Jupyter Notebook. A comprehensive guide to building RAG-based LLM applications for production. It has 1.9k GitHub stars and 258 forks, and was last updated 2mo ago. It uses the CC-BY-4.0 license; check its terms before commercial use.
- License
- CC-BY-4.0
- Language
- Jupyter Notebook
- Stars
- 1,863
- Last update
- 2mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Yes
Similar free tools
unsloth78k stars · Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
learning7.0k stars · A log of things I'm learning
ml-engineering20k stars · Machine Learning Engineering Open Book
Soup9.5k stars · Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
h2o-llmstudio5.2k stars · H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
one-api37k stars · LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key
llm-applications FAQ
Is llm-applications free?
llm-applications is open source, but it needs a paid third-party API key to work. It uses the CC-BY-4.0 license; check its terms before commercial use.
Does llm-applications run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does llm-applications need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llm-applications still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to llm-applications?
Similar free, open-source tools include unsloth, learning, ml-engineering, Soup.