RangiLyu/llama.mmengine
Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!
This project helps machine learning engineers and researchers adapt large language models (LLaMA) for specific tasks or datasets. It takes a pre-trained LLaMA model and your custom data, then outputs a specialized LLaMA model capable of understanding and generating text tailored to your needs. This is ideal for those building custom AI assistants or chatbots.
No commits in the last 6 months.
Use this if you are a machine learning engineer looking to fine-tune LLaMA language models, particularly with low-rank adaptation (LoRA), for specific conversational or text generation purposes.
Not ideal if you are looking for a plug-and-play solution without programming or deep learning expertise, or if you need to train models other than LLaMA.
Stars
40
Forks
1
Language
Python
License
Apache-2.0
Category
Last pushed
Apr 02, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/RangiLyu/llama.mmengine"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
unslothai/unsloth
Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama,...
huggingface/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5, DeepSeek-R1, GLM-5,...
oumi-ai/oumi
Easily fine-tune, evaluate and deploy gpt-oss, Qwen3, DeepSeek-R1, or any open source LLM / VLM!
linkedin/Liger-Kernel
Efficient Triton Kernels for LLM Training