ssbuild/aigc_data

share data, prompt data , pretraining data

37
/ 100
Emerging

This project provides a collection of large-scale text datasets for training large language models. It offers raw textual data, some requiring cleaning, that can be used as input for developing AI models capable of generating human-like text. It is designed for researchers, AI engineers, and data scientists working on advanced natural language processing tasks.

No commits in the last 6 months.

Use this if you are building or fine-tuning large language models and need access to extensive pre-training datasets in English and Chinese.

Not ideal if you need ready-to-use, perfectly clean, or domain-specific datasets for simpler machine learning tasks.

AI Development Natural Language Processing Large Language Models Text Data AI Training Data
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 7 / 25
Maturity 16 / 25
Community 14 / 25

How are scores calculated?

Stars

36

Forks

6

Language

Python

License

Apache-2.0

Last pushed

Nov 30, 2023

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ssbuild/aigc_data"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.