lordmathis/llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
- Stars
- 160
- Forks
- 34
- Open issues
- 1
- Last push
- today
llamactl star history
+2 this week
About llamactl
llamactl is a free, open-source AI inference tool by lordmathis, written mainly in Go. Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard. It has 160 GitHub stars and 34 forks, and was last updated today. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Commercial use
- Commercial OK
- Language
- Go
- Stars
- 160
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
llama.cpp132k stars · LLM inference in C/C++
vllm95k stars · High-throughput inference engine for LLMs.
llm-action25k stars · 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
OpenLLM13k stars · Self-host any open-source LLM as an OpenAI-compatible API server.
inference9.6k stars · Serve and deploy AI models with a single command.
llamactl FAQ
Can I use llamactl commercially?
Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is llamactl free?
Yes. llamactl is open source and free to use. It's released under the MIT license, a standard open-source license.
Does llamactl run on a Mac?
Yes. According to the project, llamactl works on macOS.
Does llamactl need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llamactl still maintained?
Yes. It was last updated today and has 1 open issues on GitHub.
What are alternatives to llamactl?
Similar free, open-source tools include llama.cpp, vllm, llm-action, OpenLLM.
Maintain llamactl?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/lordmathis/llamactl)