web-arena-x/visualwebarena
VisualWebArena is a benchmark for multimodal agents.
This is a benchmark for anyone building or researching multimodal AI agents that interact with websites. It helps you test how well your agent can perform complex, realistic web tasks by providing a standardized set of challenges and evaluation scripts. You put in your multimodal agent and get out detailed performance metrics on how accurately it completes various tasks like online shopping, social media interactions, or information retrieval.
445 stars. No commits in the last 6 months.
Use this if you are developing or evaluating autonomous AI agents that need to understand and interact with visual elements on websites to complete multi-step tasks.
Not ideal if you are looking for an off-the-shelf tool for general web automation or if your AI agent doesn't require visual comprehension of web pages.
Stars
445
Forks
72
Language
Python
License
MIT
Category
Last pushed
Nov 09, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/web-arena-x/visualwebarena"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
sierra-research/tau2-bench
τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
xlang-ai/OSWorld
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
bigcode-project/bigcodebench
[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
THUDM/AgentBench
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
scicode-bench/SciCode
A benchmark that challenges language models to code solutions for scientific problems