KrishnanJothi/MT5_Language_identification_NLP
MT5-small is fine-tuned on the downstream task of Natural Language Identification. The Hugging Face package and the Pytorch library are used for fine-tuning.
This tool helps anyone working with multilingual text quickly identify the language of a given text snippet. You input text in one of 15 supported languages, and it tells you which language it is (e.g., 'es' for Spanish, 'hi' for Hindi). This is useful for content managers, customer support teams, or data analysts who need to sort or process text based on its original language.
No commits in the last 6 months.
Use this if you need to automatically determine the language of short text inputs from a predefined list of 15 common languages.
Not ideal if you need to identify languages outside the list of 15 supported languages (Arabic, Bulgarian, Chinese, English, French, German, Greek, Hindi, Russian, Spanish, Swahili, Thai, Turkish, Urdu, Vietnamese) or if your text inputs are exceptionally long.
Stars
7
Forks
2
Language
Jupyter Notebook
License
—
Category
Last pushed
Oct 26, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/KrishnanJothi/MT5_Language_identification_NLP"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Shivanandroy/simpleT5
simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train...
chanind/frame-semantic-transformer
Frame Semantic Parser based on T5 and FrameNet
Shivanandroy/KeyPhraseTransformer
KeyPhraseTransformer lets you quickly extract key phrases, topics, themes from your text data ...
osainz59/t5-encoder
A extension of Transformers library to include T5ForSequenceClassification class.
conceptofmind/t5-pytorch
Implementation of Exploring the Limits of Transfer Learning with a Unified Text-to-Text...