pezzolabs/pezzo
🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
- Stars
- 3.3k
- Forks
- 280
- Open issues
- 42
- Last push
- 2mo ago
About pezzo
pezzo is a free, open-source AI inference tool by pezzolabs, written mainly in TypeScript. 🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more. It has 3.3k GitHub stars and 280 forks, and was last updated 2mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- TypeScript
- Stars
- 3,280
- Last update
- 2mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
plano7.1k stars · Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
openllmetry7.5k stars · Open-source observability for your GenAI or LLM application, based on OpenTelemetry
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
pezzo FAQ
Is pezzo free?
Yes. pezzo is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does pezzo run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does pezzo need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is pezzo still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to pezzo?
Similar free, open-source tools include BentoML, plano, ai-infra-book, openllmetry.