llmware-ai/llmware
Unified framework for building enterprise RAG pipelines with small, specialized models
- Stars
- 15k
- Forks
- 2.9k
- Open issues
- 72
- Last push
- 21d ago
About llmware
llmware is a free, open-source AI inference tool by llmware-ai, written mainly in Python. Unified framework for building enterprise RAG pipelines with small, specialized models. It has 15k GitHub stars and 2.9k forks, and was last updated 21d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 14,817
- Last update
- 21d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
failproofai6.0k stars · Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
plano7.1k stars · Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
ColossalAI41k stars · Making large AI models cheaper, faster and more accessible
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
llmware FAQ
Is llmware free?
Yes. llmware is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does llmware run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does llmware need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llmware still maintained?
Yes. It was last updated 21d ago and has 72 open issues on GitHub.
What are alternatives to llmware?
Similar free, open-source tools include BentoML, failproofai, plano, ColossalAI.