QuesmaOrg/otel-bench
OpenTelemetry Benchmark - can AI trace your failed login?
This project helps evaluate how well AI models can automatically instrument applications with OpenTelemetry to track performance and diagnose issues. You input different AI models and specific OpenTelemetry instrumentation tasks, and it outputs performance benchmarks showing which models are most effective. This tool is for developers, DevOps engineers, or SREs who want to leverage AI for observability and tracing.
Use this if you need to compare and benchmark various AI models on their ability to correctly add OpenTelemetry instrumentation to codebases written in multiple programming languages.
Not ideal if you are looking for a tool to automatically implement OpenTelemetry in your code without evaluating the AI's performance.
Stars
16
Forks
1
Language
Shell
License
Apache-2.0
Category
Last pushed
Mar 01, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/QuesmaOrg/otel-bench"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
traceroot-ai/traceroot
Find the Root Cause in Your Code's Trace
future-agi/traceAI
Open Source AI Tracing Framework built on Opentelemetry for AI Applications and Frameworks
evilmartians/agent-prism
React components for visualizing traces from AI agents
VishApp/multiagent-debugger
Multi-Agent Debugger: An AI-powered debugging system using CrewAI to orchestrate specialized...