pykeio/ort
Fast ML inference & training for ONNX models in Rust
- Stars
- 2.6k
- Forks
- 276
- Open issues
- 2
- Last push
- 3d ago
About ort
ort is a free, open-source AI inference tool by pykeio, written mainly in Rust. Fast ML inference & training for ONNX models in Rust. It has 2.6k GitHub stars and 276 forks, and was last updated 3d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Rust
- Stars
- 2,580
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
DeepSpeed43k stars · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
netron34k stars · Visualizer for neural network, deep learning and machine learning models
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
llama-cookbook19k stars · Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model f
FedML4.1k stars · FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a
ray44k stars · Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
ort FAQ
Is ort free?
Yes. ort is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does ort run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does ort need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is ort still maintained?
Yes. It was last updated 3d ago and has 2 open issues on GitHub.
What are alternatives to ort?
Similar free, open-source tools include DeepSpeed, netron, BentoML, llama-cookbook.