dromara/Omega-AI
Omega-AI is a Java-based deep learning framework that helps you quickly build neural networks for inference and training. Its engine supports automatic differentiation, multithreading, and GPU acceler
- Stars
- 835
- Forks
- 64
- Open issues
- 0
- Last push
- 5d ago
About Omega-AI
Omega-AI is a free, open-source AI inference tool by dromara, written mainly in Java. Omega-AI is a Java-based deep learning framework that helps you quickly build neural networks for inference and training. Its engine supports automatic differentiation, multithreading, and GPU acceler. It has 835 GitHub stars and 64 forks, and was last updated 5d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Java
- Stars
- 835
- Last update
- 5d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
netron34k stars · Visualizer for neural network, deep learning and machine learning models
distributed-llama3.1k stars · Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Omega-AI FAQ
Is Omega-AI free?
Yes. Omega-AI is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does Omega-AI run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Omega-AI need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Omega-AI still maintained?
Yes. It was last updated 5d ago and has 0 open issues on GitHub.
What are alternatives to Omega-AI?
Similar free, open-source tools include BentoML, ai-infra-book, TensorRT-LLM, netron.