jamjamjon/usls
A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, and more.
- Stars
- 445
- Forks
- 46
- Open issues
- 22
- Last push
- 2mo ago
About usls
usls is a free, open-source AI inference tool by jamjamjon, written mainly in Rust. A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, and more. It has 445 GitHub stars and 46 forks, and was last updated 2mo ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Rust
- Stars
- 445
- Last update
- 2mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
OnnxOCR1.9k stars · 基于PaddleOCR重构，并且脱离PaddlePaddle深度学习训练框架的轻量级OCR，推理速度超快 —— A lightweight OCR system based on PaddleOCR, decoupled from the PaddlePaddle deep learning training framework, with ultra-fast inference spee
kokoro-onnx2.8k stars · TTS with kokoro and onnx runtime
obs-backgroundremoval4.6k stars · An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
ort2.6k stars · Fast ML inference & training for ONNX models in Rust
franken_ocr337 stars · Pure-Rust, CPU-only OCR engine for Baidu Unlimited-OCR (a DeepSeek-OCR-derived 3B MoE VLM). Five-model zoo, custom int8 kernels, no ML framework, no Python, no GPU.
usls FAQ
Is usls free?
Yes. usls is open source and free to use. It's released under the MIT license, a standard open-source license.
Does usls run on a Mac?
Yes. According to the project, usls works on macOS.
Does usls need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is usls still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to usls?
Similar free, open-source tools include TensorRT-LLM, OnnxOCR, kokoro-onnx, obs-backgroundremoval.