ymcui/LERT
LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）
This project offers an enhanced pre-trained language model, LERT, designed to improve the accuracy of natural language understanding tasks, specifically for Chinese text. By incorporating linguistic knowledge during its training, LERT takes raw Chinese text and provides more accurate classifications, entity recognition, or reading comprehension answers. It's ideal for data scientists, NLP researchers, or anyone building applications that need to precisely understand and process Chinese language content.
223 stars. No commits in the last 6 months.
Use this if you are working with Chinese text data and need a pre-trained model that offers superior performance on tasks like sentiment analysis, news categorization, or extracting specific information from documents.
Not ideal if your primary focus is on languages other than Chinese, or if you require a pre-trained model that includes linguistic heads for PyTorch or TensorFlow 2 versions.
Stars
223
Forks
15
Language
Python
License
Apache-2.0
Category
Last pushed
Jul 15, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/ymcui/LERT"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
codertimo/BERT-pytorch
Google AI 2018 BERT pytorch implementation
JayYip/m3tl
BERT for Multitask Learning
920232796/bert_seq2seq
pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。
sileod/tasknet
Easy modernBERT fine-tuning and multi-task learning
graykode/toeicbert
TOEIC(Test of English for International Communication) solving using pytorch-pretrained-BERT model.