TreeAI-Lab/NumericBench
A comprehensive benchmark to evaluate and improve the fundamental numerical reasoning abilities of large language models using diverse synthetic and real-world datasets.
This tool helps AI researchers and developers systematically test how well large language models (LLMs) handle numbers and numerical tasks. It takes an LLM and a variety of numerical datasets (like stock trends or weather patterns) as input, then outputs a detailed evaluation of the LLM's arithmetic, number recognition, comparison, and logical reasoning abilities. It's designed for anyone building or deploying LLMs who needs to ensure their models are reliable with numerical data.
No commits in the last 6 months.
Use this if you are developing or evaluating large language models and need a rigorous way to measure their fundamental numerical reasoning capabilities across diverse real-world and synthetic data.
Not ideal if you are looking for a tool to solve specific numerical problems or perform data analysis directly, as this is a benchmark for assessing AI models.
Stars
29
Forks
—
Language
—
License
—
Category
Last pushed
Jun 21, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/TreeAI-Lab/NumericBench"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
RISE-UNIBAS/humanities_data_benchmark
LLM Benchmark Suite for Humanities Data
ma-compbio/DNALONGBENCH
A benchmark suite of five genomics tasks for evaluating DNA foundation models on long-range dependencies.
wgyhhhh/EASE
About Official repository for "Towards Real-Time Fake News Detection under Evidence Scarcity"
Brand24-AI/mms_benchmark
The most extensive open massively multilingual corpus of datasets for training sentiment models....