lmarena/search-arena
⚔️ [ICLR 2026] Official code of "Search Arena: Analyzing Search-Augmented LLMs".
This project helps AI researchers and developers understand how people interact with AI models that use search engines to answer questions. It provides a dataset of user queries and responses from various search-augmented AI systems, along with user feedback. The output includes data and analysis scripts to evaluate model performance, user preferences, and citation accuracy, enabling researchers to improve future search-augmented AI.
Use this if you are an AI researcher or developer focused on building and evaluating search-augmented large language models, and you need data and tools to analyze user interactions, preferences, and model behavior in real-world search scenarios.
Not ideal if you are an end-user looking for a pre-built search interface or an off-the-shelf AI tool for general information retrieval, as this project is for research and development into the underlying AI systems.
Stars
53
Forks
7
Language
Jupyter Notebook
License
—
Category
Last pushed
Feb 23, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/lmarena/search-arena"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations 🚀
open-compass/VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
EuroEval/EuroEval
The robust European language model benchmark.
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents