traceloop/openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
- Stars
- 7.5k
- Forks
- 1.2k
- Open issues
- 158
- Last push
- 3d ago
About openllmetry
openllmetry is a free, open-source AI inference tool by traceloop, written mainly in Python. Open-source observability for your GenAI or LLM application, based on OpenTelemetry. It has 7.5k GitHub stars and 1.2k forks, and was last updated 3d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 7,499
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Made-With-ML50k stars · Learn how to develop, deploy and iterate on production-grade ML applications.
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
metaflow10k stars · Build, Manage and Deploy AI/ML Systems
plano7.1k stars · Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
openllmetry FAQ
Is openllmetry free?
Yes. openllmetry is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does openllmetry run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does openllmetry need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is openllmetry still maintained?
Yes. It was last updated 3d ago and has 158 open issues on GitHub.
What are alternatives to openllmetry?
Similar free, open-source tools include BentoML, OpenLLM, Made-With-ML, TensorRT-LLM.