AgentOps-AI/agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

63
/ 100
Established

AgentOps helps developers build, evaluate, and monitor AI agents throughout their lifecycle. It takes in your AI agent code and interactions, then outputs detailed execution graphs, cost breakdowns, and performance analytics. This tool is designed for AI/ML engineers and developers who are building, testing, and deploying AI agent-based applications.

5,363 stars. Used by 2 other packages. Available on PyPI.

Use this if you are developing AI agents and need detailed insights into their performance, debugging capabilities, and cost tracking across various LLM providers and agent frameworks.

Not ideal if you are an end-user of an AI agent application rather than a developer, or if you only need basic logging for traditional software applications without AI agent components.

AI-agent-development LLM-observability AI-agent-monitoring AI-agent-debugging LLM-cost-management
Maintenance 6 / 25
Adoption 12 / 25
Maturity 25 / 25
Community 20 / 25

How are scores calculated?

Stars

5,363

Forks

542

Language

Python

License

MIT

Last pushed

Oct 30, 2025

Commits (30d)

0

Dependencies

14

Reverse dependents

2

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/agents/AgentOps-AI/agentops"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.