beam-cloud/beta9
Ultrafast serverless GPU inference, sandboxes, and background jobs
- Stars
- 1.8k
- Forks
- 173
- Open issues
- 10
- Last push
- today
About beta9
beta9 is a free, open-source AI inference tool by beam-cloud, written mainly in Go. Ultrafast serverless GPU inference, sandboxes, and background jobs. It has 1.8k GitHub stars and 173 forks, and was last updated today. It's released under the AGPL-3.0 license, a standard open-source license.
- License
- AGPL-3.0
- Language
- Go
- Stars
- 1,828
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
ColossalAI41k stars · Making large AI models cheaper, faster and more accessible
Made-With-ML50k stars · Learn how to develop, deploy and iterate on production-grade ML applications.
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
vllm95k stars · A high-throughput and memory-efficient inference and serving engine for LLMs
skypilot11k stars · The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
beta9 FAQ
Is beta9 free?
Yes. beta9 is open source and free to use. It's released under the AGPL-3.0 license, a standard open-source license.
Does beta9 run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does beta9 need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is beta9 still maintained?
Yes. It was last updated today and has 10 open issues on GitHub.
What are alternatives to beta9?
Similar free, open-source tools include ColossalAI, Made-With-ML, BentoML, TensorRT-LLM.