jd-coderepos/sota
The official training/validation/test dataset repository for the SOTA? task as SimpleText Task4@CLEF2024
For AI researchers tracking the latest advancements, this project provides a dataset to automatically identify and extract performance leaderboards from scholarly articles. It takes in research papers in LaTeX or TEI/XML format and outputs structured annotations detailing tasks, datasets, metrics, and scores for machine learning models. This is for researchers who need to efficiently monitor the state-of-the-art results across various AI tasks without manually sifting through numerous papers or relying solely on curated leaderboards.
No commits in the last 6 months.
Use this if you are an AI researcher or a data scientist who needs to automatically find and extract model performance metrics and leaderboard information from a large collection of research papers.
Not ideal if you are looking for an already built model or a search engine to query existing leaderboards rather than a dataset to develop your own information extraction system.
Stars
15
Forks
2
Language
TeX
License
CC-BY-SA-4.0
Category
Last pushed
Jul 07, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/jd-coderepos/sota"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
monarch-initiative/ontogpt
LLM-based ontological extraction tools, including SPIRES
weAIDB/awesome-data-llm
Official Repository of "LLM × DATA" Survey Paper
AXYZdong/AMchat
AM (Advanced Mathematics) Chat is a large language model that integrates advanced mathematical...
skywalker023/sodaverse
🥤🧑🏻🚀Code and dataset for our EMNLP 2023 paper - "SODA: Million-scale Dialogue Distillation with...
Y-Research-SBU/TimeSeriesScientist
Official Repository for TimeSeriesScientist