rishub-tamirisa/transformer-mlm
Implementation of Transformer Encoders / Masked Language Modeling Objective
This project helps machine learning engineers and researchers train a Transformer Encoder model for masked language modeling. You provide text data, and it outputs a trained model capable of understanding context and relationships between words in your specific domain. It's designed for practitioners working on natural language processing tasks who need to pre-train custom language models.
No commits in the last 6 months.
Use this if you need to pre-train a Transformer Encoder from scratch or fine-tune it on a specific text dataset for tasks like text classification, named entity recognition, or question answering.
Not ideal if you are looking for a pre-trained, ready-to-use language model without needing to handle the training process yourself.
Stars
8
Forks
—
Language
Python
License
Unlicense
Category
Last pushed
Jun 18, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/rishub-tamirisa/transformer-mlm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.