Freim32/vllmops
Self-hosted vLLM made simple. Git-friendly YAML for models and profiles, full lifecycle from an intuitive CLI and TUI.
- Stars
- 100
- Forks
- 14
- Open issues
- 0
- Last push
- 24d ago
vllmops star history
+0 this week
About vllmops
vllmops is a free, open-source AI inference tool by Freim32, written mainly in Python. Self-hosted vLLM made simple. Git-friendly YAML for models and profiles, full lifecycle from an intuitive CLI and TUI. It has 100 GitHub stars and 14 forks, and was last updated 24d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Commercial use
- Commercial OK
- Language
- Python
- Stars
- 100
- Last update
- 24d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
vllm95k stars · High-throughput inference engine for LLMs.
llm-action25k stars · 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
TensorRT-LLM15k stars · Optimizes inference for large language models on NVIDIA GPUs.
nano-vllm16k stars · A fast, lightweight inference engine for language models.
PowerInfer9.8k stars · High-speed Large Language Model Serving for Local Deployment
BentoML8.9k stars · Build and serve AI models as APIs and pipelines.
vllmops FAQ
Can I use vllmops commercially?
Yes. Apache-2.0 is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is vllmops free?
Yes. vllmops is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does vllmops run on a Mac?
Yes. According to the project, vllmops works on macOS.
Does vllmops need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is vllmops still maintained?
Yes. It was last updated 24d ago and has 0 open issues on GitHub.
What are alternatives to vllmops?
Similar free, open-source tools include vllm, llm-action, TensorRT-LLM, nano-vllm.
Maintain vllmops?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/Freim32/vllmops)