5663015/LLMs_train
一套代码指令微调大模型
This project offers a streamlined way to customize large language models (LLMs) for specific tasks. It takes your specialized text data, structured as input-target pairs, and fine-tunes a chosen base LLM to produce more accurate and contextually relevant text outputs. Researchers and engineers working with large language models who need to adapt them for domain-specific applications would use this tool.
No commits in the last 6 months.
Use this if you need to fine-tune a pre-existing large language model (like LLaMA, ChatGLM, or BLOOM) on your own specific dataset using efficient methods like LoRA and DeepSpeed.
Not ideal if you're looking for a user-friendly, no-code interface or if you need to perform full fine-tuning without memory optimization techniques like LoRA.
Stars
39
Forks
3
Language
Python
License
—
Category
Last pushed
Aug 01, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/5663015/LLMs_train"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
agentscope-ai/Trinity-RFT
Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement...
OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO &...
zjunlp/EasyEdit
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
huggingface/alignment-handbook
Robust recipes to align language models with human and AI preferences
hyunwoongko/nanoRLHF
nanoRLHF: from-scratch journey into how LLMs and RLHF really work.