Llm Observability Monitoring MLOps Tools

There are 9 llm observability monitoring tools tracked. 2 score above 70 (verified tier). The highest-rated is openlit/openlit at 78/100 with 2,281 stars. 4 of the top 10 are actively maintained.

Get all 9 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=llm-observability-monitoring&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 openlit/openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM...

78
Verified
2 evidentlyai/evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate,...

71
Verified
3 deepflowio/deepflow

eBPF Observability - Distributed Tracing and Profiling

69
Established
4 psalias2006/gpu-hot

πŸ”₯ Real-time NVIDIA GPU dashboard

52
Established
5 myscale/myscale-telemetry

Open-source observability for your LLM application.

45
Emerging
6 apache/hertzbeat-helm-chart

An AI-powered next-generation open source real-time observability system.

45
Emerging
7 Herenn/Infralens

InfraLens is a next-generation observability tool that uses eBPF to...

32
Emerging
8 Unicorn-Commander/Ops-Center-OSS

Ops-Center β€” The AI Infrastructure Command Center. Manage users, billing,...

28
Experimental
9 eduardoslonski/telescope-ui

Real-time observability dashboard for the Telescope RL post-training...

25
Experimental