Openlit
verifiedFreemiumopenlit.io
Open-source, OpenTelemetry-native platform for LLM observability, tracing, evaluation and prompt management.
What it does
OpenLIT is an open-source (Apache 2.0) AI-engineering platform built on OpenTelemetry. It provides distributed tracing, real-time monitoring, evaluations, a prompt hub, experiments and multi-deployment management for LLM applications, with 60+ integrations and one-line SDK setup. Everything is free to self-host.
How to use: Integrate OpenLIT into your LLM application by adding `openlit.init()` to start collecting data. You can also run `docker-compose up -d` to quickly start using the open-source tool.
Core features
OpenTelemetry-native distributed tracing
Token usage and cost tracking
LLM evaluations (online/offline)
Prompt management and versioning
GPU and vector-DB monitoring
60+ LLM/framework integrations
Self-hostable via Docker; export to Grafana/Datadog
Best for
→Trace and debug LLM applications
→Monitor AI cost and performance
→Evaluate prompts and models
→Add observability without code changes
Pricing
Self-Hosted
$0
Toolspool rankingby monthly traffic