vectorize-io/agent-memory-benchmark
Agent Memory Benchmark
This project helps evaluate how well AI memory systems perform in complex, multi-step tasks. You input different memory architectures and large language models, and it outputs detailed performance metrics, including accuracy, speed, and cost. AI developers and researchers use this to rigorously compare and improve their agent memory designs.
Use this if you need an objective way to benchmark agent memory systems for modern, long-context AI applications that involve research, planning, and tool use.
Not ideal if you are solely interested in basic chatbot conversation history recall, as this benchmark focuses on more advanced, agentic capabilities.
Stars
11
Forks
2
Language
Python
License
—
Category
Last pushed
Mar 28, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/vectorize-io/agent-memory-benchmark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
StonyBrookNLP/appworld
🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and...
qualifire-dev/rogue
AI Agent Evaluator & Red Team Platform
microsoft/WindowsAgentArena
Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of...
future-agi/ai-evaluation
Evaluation Framework for all your AI related Workflows
RouteWorks/RouterArena
RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics,...