mosecorg/mosec
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
- Stars
- 902
- Forks
- 75
- Open issues
- 11
- Last push
- 1d ago
About mosec
mosec is a free, open-source AI inference tool by mosecorg, written mainly in Python. A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine. It has 902 GitHub stars and 75 forks, and was last updated 1d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- Python
- Stars
- 902
- Last update
- 1d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
pytorch105k stars · Tensors and Dynamic neural networks in Python with strong GPU acceleration
keras64k stars · Deep Learning for humans
netron34k stars · Visualizer for neural network, deep learning and machine learning models
ray44k stars · Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Made-With-ML50k stars · Learn how to develop, deploy and iterate on production-grade ML applications.
pytorch-lightning31k stars · Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
mosec FAQ
Is mosec free?
Yes. mosec is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does mosec run on a Mac?
Yes. According to the project, mosec works on macOS.
Does mosec need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is mosec still maintained?
Yes. It was last updated 1d ago and has 11 open issues on GitHub.
What are alternatives to mosec?
Similar free, open-source tools include pytorch, keras, netron, ray.