dsdanielpark/open-llm-datasets
Repository for organizing datasets and papers used in Open LLM.
This project helps AI practitioners and researchers discover and access a wide range of open-source datasets for training large language models (LLMs). It provides links to general-purpose datasets for pre-training and alignment, as well as specialized datasets for particular domains like legal or finance. The project acts as a curated catalog, helping those who need diverse data to build or fine-tune their LLMs.
101 stars. No commits in the last 6 months.
Use this if you are an AI researcher or practitioner looking for specific open-access datasets to train, fine-tune, or align your large language models.
Not ideal if you are looking for ready-to-use LLMs or an automated pipeline for model training, as this project focuses solely on dataset discovery.
Stars
101
Forks
5
Language
—
License
MIT
Category
Last pushed
Jul 06, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/dsdanielpark/open-llm-datasets"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mlabonne/llm-datasets
Curated list of datasets and tools for post-training.
malteos/llm-datasets
A collection of datasets for language model pretraining including scripts for downloading,...
magpie-align/magpie
[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your...
jd-coderepos/llms4subjects
The official SemEval 2025 Task 5 - LLMs4Subjects - Shared Task Dataset repository
willxxy/ECG-Bench
A Unified Framework for Benchmarking Generative Electrocardiogram-Language Models (ELMs)