halfrost/Halfrost-Field
✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记
- Stars
- 13k
- Forks
- 1.9k
- Open issues
- 0
- Last push
- 22d ago
About Halfrost-Field
Halfrost-Field is a free, open-source AI inference tool by halfrost, written mainly in Go. ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记. It has 13k GitHub stars and 1.9k forks, and was last updated 22d ago. It uses the CC-BY-SA-4.0 license; check its terms before commercial use.
- License
- CC-BY-SA-4.0
- Language
- Go
- Stars
- 13,250
- Last update
- 22d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
vllm95k stars · A high-throughput and memory-efficient inference and serving engine for LLMs
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
kimi-k3-in-c9.2k stars · A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
netron34k stars · Visualizer for neural network, deep learning and machine learning models
pytorch105k stars · Tensors and Dynamic neural networks in Python with strong GPU acceleration
Halfrost-Field FAQ
Is Halfrost-Field free?
Yes. Halfrost-Field is open source and free to use. It uses the CC-BY-SA-4.0 license; check its terms before commercial use.
Does Halfrost-Field run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does Halfrost-Field need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Halfrost-Field still maintained?
Yes. It was last updated 22d ago and has 0 open issues on GitHub.
What are alternatives to Halfrost-Field?
Similar free, open-source tools include vllm, BentoML, kimi-k3-in-c, netron.