dstackai/dstack
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
- Stars
- 2.3k
- Forks
- 271
- Open issues
- 58
- Last push
- today
About dstack
dstack is a free, open-source AI inference tool by dstackai, written mainly in Python. A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters. It has 2.3k GitHub stars and 271 forks, and was last updated today. It's released under the MPL-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- MPL-2.0
- Language
- Python
- Stars
- 2,285
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
pytorch105k stars · Tensors and Dynamic neural networks in Python with strong GPU acceleration
DeepSpeed43k stars · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Made-With-ML50k stars · Learn how to develop, deploy and iterate on production-grade ML applications.
llama-cookbook19k stars · Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model f
FedML4.1k stars · FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a
kubesphere17k stars · The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️
dstack FAQ
Is dstack free?
Yes. dstack is open source and free to use. It's released under the MPL-2.0 license, a standard open-source license.
Does dstack run on a Mac?
Yes. According to the project, dstack works on macOS.
Does dstack need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is dstack still maintained?
Yes. It was last updated today and has 58 open issues on GitHub.
What are alternatives to dstack?
Similar free, open-source tools include pytorch, DeepSpeed, Made-With-ML, llama-cookbook.