NetX-lab/Frontier
Frontier: A Discrete-Event Simulator for Modern LLM Serving
- Stars
- 167
- Forks
- 24
- Open issues
- 1
- Last push
- today
About Frontier
Frontier is a free, open-source AI inference tool by NetX-lab, written mainly in Python. Frontier: A Discrete-Event Simulator for Modern LLM Serving. It has 167 GitHub stars and 24 forks, and was last updated today. It's released under the MIT license, a standard open-source license. According to the project, it runs on a regular CPU without a GPU.
- License
- MIT
- Commercial use
- Commercial OK
- Language
- Python
- Stars
- 167
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not needed (runs on CPU)
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
llm-action25k stars · 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
vllm95k stars · High-throughput inference engine for LLMs.
TensorRT-LLM15k stars · Optimizes inference for large language models on NVIDIA GPUs.
ai-infra-book7.0k stars · 《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
OpenLLM13k stars · Self-host any open-source LLM as an OpenAI-compatible API server.
PowerInfer9.8k stars · High-speed Large Language Model Serving for Local Deployment
Frontier FAQ
Can I use Frontier commercially?
Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is Frontier free?
Yes. Frontier is open source and free to use. It's released under the MIT license, a standard open-source license.
Does Frontier run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Frontier need a GPU?
No. According to the project, Frontier runs on a regular CPU.
Is Frontier still maintained?
Yes. It was last updated today and has 1 open issues on GitHub.
What are alternatives to Frontier?
Similar free, open-source tools include llm-action, vllm, TensorRT-LLM, ai-infra-book.