datadreamer-dev/DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
DataDreamer helps AI researchers and machine learning engineers create robust language models, even with limited real-world data. It takes plain language prompts and existing models, then generates high-quality synthetic datasets and fine-tuned, instruction-tuned, or distilled models. This tool is ideal for anyone working on natural language processing tasks who needs to efficiently build and improve AI models.
1,100 stars. No commits in the last 6 months.
Use this if you need to generate high-quality synthetic data to train or fine-tune large language models for specific tasks when real-world data is scarce or expensive.
Not ideal if you primarily work with structured numerical data or require a tool without any coding, as this is a Python library.
Stars
1,100
Forks
58
Language
Python
License
MIT
Category
Last pushed
Feb 02, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/datadreamer-dev/DataDreamer"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
tabularis-ai/be_great
A novel approach for synthesizing tabular data using pretrained large language models
EleutherAI/gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron...
shibing624/textgen
TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet...
ai-forever/ru-gpts
Russian GPT3 models.
AdityaNG/kan-gpt
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold...