ZigeW/data_management_LLM
Collection of training data management explorations for large language models
This resource provides a curated collection of research papers and materials focused on managing training data for large language models (LLMs). It helps AI researchers and machine learning engineers understand how to select, filter, and prepare data effectively for both pre-training and fine-tuning LLMs. The result is better-performing and more efficient language models.
337 stars. No commits in the last 6 months.
Use this if you are a researcher or engineer actively involved in training large language models and need to optimize your data preparation strategies for improved model performance.
Not ideal if you are looking for ready-to-use software tools or an introductory guide to machine learning, as this is a list of academic resources.
Stars
337
Forks
31
Language
—
License
—
Category
Last pushed
Aug 02, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/ZigeW/data_management_LLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jncraton/languagemodels
Explore large language models in 512MB of RAM
microsoft/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
haizelabs/verdict
Inference-time scaling for LLMs-as-a-judge.
albertan017/LLM4Decompile
Reverse Engineering: Decompiling Binary Code with Large Language Models
bytedance/Sa2VA
Official Repo For Pixel-LLM Codebase