hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
- Stars
- 41k
- Forks
- 4.5k
- Open issues
- 401
- Last push
- today
About ColossalAI
ColossalAI is a free, open-source AI inference tool by hpcaitech, written mainly in Python. Making large AI models cheaper, faster and more accessible. It has 41k GitHub stars and 4.5k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 41,428
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
DeepSpeed43k stars · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Made-With-ML50k stars · Learn how to develop, deploy and iterate on production-grade ML applications.
ray44k stars · Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
FedML4.1k stars · FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a
pytorch-lightning31k stars · Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
ColossalAI FAQ
Is ColossalAI free?
Yes. ColossalAI is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does ColossalAI run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does ColossalAI need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is ColossalAI still maintained?
Yes. It was last updated today and has 401 open issues on GitHub.
What are alternatives to ColossalAI?
Similar free, open-source tools include DeepSpeed, Made-With-ML, ray, BentoML.