awslabs/awsome-distributed-ai
Best practices, reference architectures, and examples for distributed AI training and inference on AWS.
- Stars
- 488
- Forks
- 210
- Open issues
- 5
- Last push
- 1d ago
About awsome-distributed-ai
awsome-distributed-ai is a free, open-source AI inference tool by awslabs, written mainly in Shell. Best practices, reference architectures, and examples for distributed AI training and inference on AWS. It has 488 GitHub stars and 210 forks, and was last updated 1d ago. It uses the MIT-0 license; check its terms before commercial use.
- License
- MIT-0
- Language
- Shell
- Stars
- 488
- Last update
- 1d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
kong44k stars · 🦍 The API and AI Gateway
ColossalAI41k stars · Making large AI models cheaper, faster and more accessible
FedML4.1k stars · FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
DeepSpeed43k stars · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
awsome-distributed-ai FAQ
Is awsome-distributed-ai free?
Yes. awsome-distributed-ai is open source and free to use. It uses the MIT-0 license; check its terms before commercial use.
Does awsome-distributed-ai run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does awsome-distributed-ai need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is awsome-distributed-ai still maintained?
Yes. It was last updated 1d ago and has 5 open issues on GitHub.
What are alternatives to awsome-distributed-ai?
Similar free, open-source tools include kong, ColossalAI, FedML, BentoML.