RISE-UNIBAS/humanities_data_benchmark
LLM Benchmark Suite for Humanities Data
This suite helps digital humanities researchers and practitioners evaluate how well different AI models perform on tasks involving historical documents and visual materials. You provide the benchmark datasets (images and text files) and prompts, and it produces quantifiable comparisons and performance scores for various AI models. This is for academics, archivists, librarians, and other specialists working with historical or cultural datasets.
Use this if you need to make evidence-based decisions about which AI model is most effective and cost-efficient for specific digital humanities tasks like transcribing historical scripts or extracting metadata from archival documents.
Not ideal if you are looking for pre-computed benchmark results without wanting to run or configure your own evaluations.
Stars
14
Forks
6
Language
Python
License
GPL-3.0
Category
Last pushed
Mar 18, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/RISE-UNIBAS/humanities_data_benchmark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
ma-compbio/DNALONGBENCH
A benchmark suite of five genomics tasks for evaluating DNA foundation models on long-range dependencies.
wgyhhhh/EASE
About Official repository for "Towards Real-Time Fake News Detection under Evidence Scarcity"
Brand24-AI/mms_benchmark
The most extensive open massively multilingual corpus of datasets for training sentiment models....
TreeAI-Lab/NumericBench
A comprehensive benchmark to evaluate and improve the fundamental numerical reasoning abilities...