NightMean/OlliteRT
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
- Stars
- 575
- Forks
- 82
- Open issues
- 8
- Last push
- 14d ago
About OlliteRT
OlliteRT is a free, open-source LLM chat app by NightMean, written mainly in Kotlin. Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source. It has 575 GitHub stars and 82 forks, and was last updated 14d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Kotlin
- Stars
- 575
- Last update
- 14d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
one-api37k stars · LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
llamafile26k stars · Distribute and run LLMs with a single file.
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
gpt4free67k stars · The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3
QwenPaw36k stars · Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.
OlliteRT FAQ
Is OlliteRT free?
Yes. OlliteRT is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does OlliteRT run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does OlliteRT need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is OlliteRT still maintained?
Yes. It was last updated 14d ago and has 8 open issues on GitHub.
What are alternatives to OlliteRT?
Similar free, open-source tools include one-api, open-webui, llamafile, khoj.