FreeAIRepo
Inference & serving

deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Apache-2.0Python
Stars
43k
Forks
5.1k
Open issues
1.2k
Last push
today

About DeepSpeed

DeepSpeed is a free, open-source AI inference tool by deepspeedai, written mainly in Python. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. It has 43k GitHub stars and 5.1k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.

License
Apache-2.0
Language
Python
Stars
43,251
Last update
today
Runs on Mac
Not stated
GPU
Not stated
Paid API key
Not stated
Self-hostable
Not stated

Similar free tools

All Inference & serving tools →

DeepSpeed FAQ

Is DeepSpeed free?

Yes. DeepSpeed is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.

Does DeepSpeed run on a Mac?

Its README doesn't say. Check the installation guide on GitHub before you start.

Does DeepSpeed need a GPU?

Its README doesn't state hardware needs. AI models generally run much faster with a GPU.

Is DeepSpeed still maintained?

Yes. It was last updated today and has 1,212 open issues on GitHub.

What are alternatives to DeepSpeed?

Similar free, open-source tools include pytorch, ColossalAI, pytorch-lightning, Made-With-ML.

Related topics