illuin-tech/vidore-benchmark
Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
This tool helps researchers and practitioners evaluate how well their end-to-end visual document retrieval systems perform. You provide your document retrieval pipeline and it runs against various document types like HR, finance, or industrial documents. The output is a set of performance metrics and computing times, allowing you to compare your pipeline against others on a public leaderboard.
265 stars. Available on PyPI.
Use this if you are developing a system that needs to find specific information within a large collection of visual documents and want to rigorously measure its effectiveness and efficiency.
Not ideal if you are only evaluating individual model components, rather than a full, multi-stage document retrieval system.
Stars
265
Forks
35
Language
Python
License
MIT
Category
Last pushed
Feb 27, 2026
Commits (30d)
0
Dependencies
10
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/illuin-tech/vidore-benchmark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
HKUDS/LightRAG
[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"
beir-cellar/beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across...
HKUDS/RAG-Anything
"RAG-Anything: All-in-One RAG Framework"
superlinear-ai/raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
DataScienceUIBK/Rankify
🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented...