Pangu-Immortal/MagicWX
Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.
- Stars
- 857
- Forks
- 363
- Open issues
- 8
- Last push
- 1mo ago
About MagicWX
MagicWX is a free, open-source AI inference tool by Pangu-Immortal, written mainly in Kotlin. Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments. It has 857 GitHub stars and 363 forks, and was last updated 1mo ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Kotlin
- Stars
- 857
- Last update
- 1mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
foundry-local2.6k stars · Foundry Local Download | Documentation | Discord
plano7.1k stars · Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
turbo-fieldfare7.0k stars · Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
MagicWX FAQ
Is MagicWX free?
Yes. MagicWX is open source and free to use. It's released under the MIT license, a standard open-source license.
Does MagicWX run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does MagicWX need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is MagicWX still maintained?
It was last updated 1mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to MagicWX?
Similar free, open-source tools include ai-infra-book, TensorRT-LLM, BentoML, foundry-local.