ratteripenta/transformers-seminar-workshop
Notebooks for teaching transformers and fine-tuning a pre-trained BERT model
This workshop material helps AI/ML researchers and PhD students learn how to fine-tune pre-trained language models like BERT for specific text-based tasks. It also guides you through developing custom transformer architectures. You'll work with text datasets to train and evaluate models, gaining practical skills in applying modern natural language processing techniques.
No commits in the last 6 months.
Use this if you are an AI/ML researcher or PhD student looking for hands-on experience with transformer models and fine-tuning techniques for text data.
Not ideal if you are looking for a complete, production-ready solution for a specific NLP problem without wanting to delve into the underlying model architecture and training process.
Stars
7
Forks
1
Language
Jupyter Notebook
License
—
Category
Last pushed
May 26, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/ratteripenta/transformers-seminar-workshop"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
uds-lsv/bert-stable-fine-tuning
On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
MeryylleA/lunariscodex
A high-performance PyTorch toolkit for pre-training modern, Llama-style language models. Based...
VanekPetr/flan-t5-text-classifier
Fine-tuning of Flan-5T LLM for text classification 🤖 focuses on adapting a state-of-the-art...
kingTLE/literary-alpaca2
从词表到微调这就是你所需的一切
YuweiYin/HLT-MT
[IJCAI-ECAI 2022] HLT-MT: High-resource Language-specific Training for Multilingual Neural...