one-some/lazy-transformers-merge
Merge transformers without using like a bajillion GB of RAM
This tool helps you combine several large language models into a single, new model without needing a powerful computer with vast amounts of memory. You input a list of existing models, each with a specific weight indicating its contribution, and it outputs a new, merged model. It's designed for machine learning practitioners and researchers who want to experiment with model merging on standard hardware.
No commits in the last 6 months.
Use this if you need to merge multiple large transformer models and are limited by your computer's RAM capacity.
Not ideal if you need to merge tokenizers alongside your models or require more complex merging algorithms than a weighted average.
Stars
10
Forks
—
Language
Python
License
AGPL-3.0
Category
Last pushed
Aug 05, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/one-some/lazy-transformers-merge"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started...
arcee-ai/mergekit
Tools for merging pretrained large language models.
changyeyu/LLM-RL-Visualized
๐100+ ๅๅ LLM / RL ๅ็ๅพ๐๏ผใๅคงๆจกๅ็ฎๆณใไฝ่ ๅทจ็ฎ๏ผ๐ฅ๏ผ100+ LLM/RL Algorithm Maps ๏ผ
mindspore-lab/step_into_llm
MindSpore online courses: Step into LLM