NotPunchnox/rkllama
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
- Stars
- 617
- Forks
- 103
- Open issues
- 64
- Last push
- 1mo ago
About rkllama
rkllama is a free, open-source LLM chat app by NotPunchnox, written mainly in Python. Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm ). It has 617 GitHub stars and 103 forks, and was last updated 1mo ago. It's released under the GPL-3.0 license, a standard open-source license.
- License
- GPL-3.0
- Language
- Python
- Stars
- 617
- Last update
- 1mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
QwenPaw36k stars · Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.
llamafile26k stars · Distribute and run LLMs with a single file.
ai27k stars · The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
rkllama FAQ
Is rkllama free?
Yes. rkllama is open source and free to use. It's released under the GPL-3.0 license, a standard open-source license.
Does rkllama run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does rkllama need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is rkllama still maintained?
It was last updated 1mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to rkllama?
Similar free, open-source tools include khoj, open-webui, Open-LLM-VTuber, QwenPaw.