lyogavin/airllm
AirLLM 2.8T LLM inference with single 4GB GPU
- Stars
- 40k
- Forks
- 4.1k
- Open issues
- 107
- Last push
- today
About airllm
airllm is a free, open-source LLM chat app by lyogavin, written mainly in Jupyter Notebook. AirLLM 2.8T LLM inference with single 4GB GPU. It has 40k GitHub stars and 4.1k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- Jupyter Notebook
- Stars
- 40,375
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Chinese-LLaMA-Alpaca19k stars · 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
ai27k stars · The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
langfuse36k stars · 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
repomix29k stars · 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like
airllm FAQ
Is airllm free?
Yes. airllm is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does airllm run on a Mac?
Yes. According to the project, airllm works on macOS.
Does airllm need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is airllm still maintained?
Yes. It was last updated today and has 107 open issues on GitHub.
What are alternatives to airllm?
Similar free, open-source tools include open-webui, Chinese-LLaMA-Alpaca, ai, Open-LLM-VTuber.