mookiezi/dataset-cleaning-toolkit
A dataset toolbox for preparing and analyzing conversational datasets, including CSV splitting, CSV → Parquet conversion, dataset statistics, Parquet cleaning and sorting, HuggingFace–style metadata generation, and batched chain insertion into PostgreSQL — with Rich progress, multiprocessing, and 32 GB-RAM-friendly batching.
18
/ 100
Experimental
No commits in the last 6 months.
Stale 6m
No Package
No Dependents
Maintenance
2 / 25
Adoption
1 / 25
Maturity
15 / 25
Community
0 / 25
Stars
1
Forks
—
Language
Python
License
MIT
Category
Last pushed
Oct 02, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/mookiezi/dataset-cleaning-toolkit"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.