hyunwoongko/nlp-datasets
Curation note of NLP datasets
This project helps data scientists and NLP researchers find appropriate text datasets for training machine translation and question-answering models. It provides a curated list of publicly available datasets, specifying their languages, types (e.g., multi-lingual, bi-lingual), and estimated volume. The project serves as a practical guide to quickly identify and access relevant text data for their NLP tasks.
No commits in the last 6 months.
Use this if you need to find diverse, multi-lingual, or bi-lingual text datasets for developing machine translation systems or training models to answer questions from text.
Not ideal if you are looking for datasets beyond machine translation or question-answering, or if you need a tool to directly process and prepare the data rather than just discover it.
Stars
98
Forks
6
Language
—
License
—
Category
Last pushed
Dec 06, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/hyunwoongko/nlp-datasets"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
acl-org/acl-anthology
Data and software for building the ACL Anthology.
anoopkunchukuttan/indic_nlp_library
Resources and tools for Indian language Natural Language Processing
CLUEbenchmark/CLUECorpus2020
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
KennethEnevoldsen/scandinavian-embedding-benchmark
A Scandinavian Benchmark for sentence embeddings
Separius/awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models