T5 mT5 Fine-tuning Transformer Models

Tools and frameworks for training, fine-tuning, and adapting T5 and mT5 transformer models for specific tasks (paraphrasing, simplification, language identification, domain-specific applications). Does NOT include general question-answering systems, content detection, or applications that use pre-trained models without fine-tuning code.

There are 26 t5 mt5 fine-tuning models tracked. 2 score above 50 (established tier). The highest-rated is Shivanandroy/simpleT5 at 55/100 with 400 stars.

Get all 26 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=t5-mt5-fine-tuning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	Shivanandroy/simpleT5 simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets...	55	Established	400	Python
2	chanind/frame-semantic-transformer Frame Semantic Parser based on T5 and FrameNet	51	Established	65	Python
3	Shivanandroy/KeyPhraseTransformer KeyPhraseTransformer lets you quickly extract key phrases, topics, themes...	49	Emerging	106	Python
4	osainz59/t5-encoder A extension of Transformers library to include T5ForSequenceClassification class.	37	Emerging	40	Python
5	conceptofmind/t5-pytorch Implementation of Exploring the Limits of Transfer Learning with a Unified...	37	Emerging	53	Python
6	0x7o/text2keywords Trained T5 and T5-large model for creating keywords from text	36	Emerging	73	Jupyter Notebook
7	rachel-pai/T5Elasticsearch Elasticsearch with T5/Bert/Other models provided by huggingface Transfomers.	27	Experimental	14	Python
8	ThaminduR/mt5-simplification Scripts related to training and predicting Google's mt5 model	27	Experimental	3	Python
9	leonjovanovic/keywords-extraction Keyword extraction using Scake, KeyBERT, Fine-tuning Transformer BERT-like...	27	Experimental	12	Jupyter Notebook
10	KrishnanJothi/MT5_Language_identification_NLP MT5-small is fine-tuned on the downstream task of Natural Language...	25	Experimental	7	Jupyter Notebook
11	gabriellst/paraphrase.ia paraphrase.ia is a Chrome extension that let's you make paraphrases of a...	25	Experimental	5	CSS
12	llap4585/T5-Refiner-DomainFocus Derived from Medical Literature Development: Injecting domain expertise into...	23	Experimental	2	Python
13	llap4585/T5-Refiner-DomainFocus-TrainOnly This project provides code for fine-tuning T5/mT5 models on data...	22	Experimental	1	Python
14	devrahulbanjara/Nepali-Language-Paraphraser-in-Devanagari A Nepali paraphrasing system using NLP, built with Transformer-based models...	21	Experimental	3	Jupyter Notebook
15	awpggexcutor-beep/T5-Refiner-DomainFocus 🌟 Enhance T5 model performance with domain-specific word masking for...	21	Experimental	—	Python
16	hermanpetrov/KeyBERT-Estonian-setup This is setup for Estonian text use of keyword extraction with KeyBERT. The...	18	Experimental	2	—
17	chrislemke/deep-martin Text simplification for a better world: Deep-Martin Transformer 🤗	18	Experimental	22	Python
18	azizbarank/Czech-T5-Base-Model This is the t5 base model for the Czech that is based on the smaller version...	18	Experimental	2	Jupyter Notebook
19	yjg30737/pyqt-paraphrase-model-using-gui Using paraphrase(text2text generation) model from huggingface in Python desktop app	18	Experimental	2	Python
20	utkarshranaa/Paraphraser.io Paraphraser.io is a T5 transformer-based paraphrase generation model...	17	Experimental	1	Jupyter Notebook
21	vikasnair76/text-simplification-using-transformer-models A transformer-based NLP project for text simplification using BART, T5, and...	13	Experimental	—	Jupyter Notebook
22	dane-meister/TellMeWhy-Context-Injection Fine-tunes a T5-small model on the TellMeWhy dataset using context injection...	13	Experimental	—	Jupyter Notebook
23	TianHongZXY/T5-pytorch-lightning A simple framework to pre-train and fine-tune T5 model with...	12	Experimental	8	Python
24	sercaksoy/MT5-Turkish-Paraphrase-Generation mT5 based pre-trained model to generate question paraphrases in Turkish language.	12	Experimental	6	—
25	abdulvahapmutlu/medicalqa-t5-model This project involves fine-tuning the T5 transformer model for medical...	11	Experimental	—	Jupyter Notebook
26	RahulNenavath/Keyword-Generation Automatic Keyword Generation using Statistical and Language Models....	10	Experimental	1	Jupyter Notebook