EvilFreelancer/impruver
A set of scripts and configurations for pretraining of Large Language Models (LLM)
This framework helps AI/ML engineers and researchers pretrain or fine-tune Large Language Models (LLMs) for specific tasks or datasets. It takes raw text data and configuration settings as input, and outputs a refined, trained language model ready for deployment. The ideal user is someone with experience in machine learning who needs to adapt existing LLMs or train new ones from scratch.
No commits in the last 6 months. Available on PyPI.
Use this if you need to train a new Large Language Model from scratch or fine-tune an existing one with your own data, using a flexible configuration for dataset preparation and training runs.
Not ideal if you are looking for a pre-trained, ready-to-use LLM without any training or customization, or if you don't have access to Nvidia GPUs with sufficient VRAM.
Stars
36
Forks
2
Language
Python
License
MIT
Category
Last pushed
Mar 02, 2025
Commits (30d)
0
Dependencies
16
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/EvilFreelancer/impruver"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started...
arcee-ai/mergekit
Tools for merging pretrained large language models.
changyeyu/LLM-RL-Visualized
๐100+ ๅๅ LLM / RL ๅ็ๅพ๐๏ผใๅคงๆจกๅ็ฎๆณใไฝ่ ๅทจ็ฎ๏ผ๐ฅ๏ผ100+ LLM/RL Algorithm Maps ๏ผ
mindspore-lab/step_into_llm
MindSpore online courses: Step into LLM