Korean Language Models

Pretrained transformer models specifically designed for Korean language processing, including BERT, ELECTRA, and specialized variants. Does NOT include general multilingual models, non-Korean language models, or downstream task-specific applications (unless they primarily showcase the Korean model architecture itself).

There are 33 korean language models tracked. 2 score above 50 (established tier). The highest-rated is SKTBrain/KoBERT at 53/100 with 1,407 stars.

Get all 33 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=korean-language-models&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	SKTBrain/KoBERT Korean BERT pre-trained cased (KoBERT)	53	Established	1,407	Python
2	monologg/KoELECTRA Pretrained ELECTRA Model for Korean	51	Established	630	Python
3	monologg/KoBERT-Transformers KoBERT on 🤗 Huggingface Transformers 🤗 (with Bug Fixed)	47	Emerging	212	Python
4	VinAIResearch/PhoBERT PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)	47	Emerging	775	—
5	KB-AI-Research/KB-ALBERT KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델	46	Emerging	241	Python
6	ymcui/MacBERT Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)	44	Emerging	702	—
7	monologg/KoBERT-KorQuAD Korean MRC (KorQuAD) with KoBERT	44	Emerging	65	Python
8	monologg/DistilKoBERT Distillation of KoBERT from SKTBrain (Lightweight KoBERT)	42	Emerging	198	Python
9	Beomi/KcELECTRA 🤗 Korean Comments ELECTRA: 한국어 댓글로 학습한 ELECTRA 모델	41	Emerging	261	—
10	monologg/korean-hate-speech-koelectra Bias, Hate classification with KoELECTRA 👿	40	Emerging	27	Python
11	monologg/KoCharELECTRA Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)	40	Emerging	54	Python
12	monologg/KoBigBird 🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)	40	Emerging	201	Python
13	thevasudevgupta/bigbird Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers	40	Emerging	49	Jupyter Notebook
14	monologg/KoELECTRA-Pipeline Transformers Pipeline with KoELECTRA	37	Emerging	40	Python
15	toriving/text-classification-transformers Easy text classification for everyone : Bert based models via Huggingface...	37	Emerging	39	Python
16	monologg/HanBert-Transformers HanBert on 🤗 Huggingface Transformers 🤗	36	Emerging	87	Python
17	bayartsogt-ya/albert-mongolian ALBERT trained on Mongolian text corpus	34	Emerging	18	Jupyter Notebook
18	sajjjadayobi/ParsBigBird Persian Bert For Long-Range Sequences	33	Emerging	63	Jupyter Notebook
19	SciCrunch/bio_electra Bio-Electra - Small and efficient discriminatively pre-trained language...	31	Emerging	4	Python
20	yejoon-lee/kr3 KR3: Korean Restaurant Review with Ratings / Experiments on...	25	Experimental	6	Jupyter Notebook
21	oneonlee/KoAirBERT 🤗 항공 안전 도메인에 특화된 한국어 BERT 모델 ✈️	25	Experimental	2	Jupyter Notebook
22	codegram/calbert Catalan ALBERT (A Lite BERT for self-supervised learning of language representations)	23	Experimental	14	Python
23	Nikki-oo7/pos-tagger Part-of-Speech Tagger implemented in PyTorch using BiLSTM and Transformer models.	21	Experimental	—	Python
24	edoost/pert Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Tagging	20	Experimental	10	Jupyter Notebook
25	HRSadeghi/Joint_Comma_and_Kasreh_Recognizer In this repository, we provide a joint neural model based on BERT and two...	19	Experimental	3	Python
26	phanxuanphucnd/CoBERTa CoBERTa is a pre-trained models are the pre-trained language models for...	19	Experimental	3	Python
27	ilos-vigil/bigbird-small-indonesian Lighweight Indonesian language model for long sequence.	19	Experimental	4	Python
28	bab2min/kiwi-farm Kiwi 형태소 분석기를 활용한 딥러닝 언어 모델 실험실	16	Experimental	52	Python
29	amanaser/BabyLM-ELECTRA-Pre-training BabyLM ELECTRA Pre-training on NVIDIA L40 GPU Cluster.	13	Experimental	—	Jupyter Notebook
30	vanhai1231/phobert-vi-comment Finetune mô hình PhoBERT cho phân loại comment trên không gian mạng	12	Experimental	4	Jupyter Notebook
31	Quasar-Kim/kc-moe 한국어 댓글 데이터셋에 훈련시킨 Pretrained MoE(Mixture-of-Experts) 모델	12	Experimental	8	Python
32	davitjnz/electra-ka BERT / ELETRA model for Georgian Language	11	Experimental	4	Jupyter Notebook
33	rrayhka/pos-tagger POS Tagger menggunakan model dari Hugging Face untuk melakukan tagging...	11	Experimental	—	HTML

Comparisons in this category

KoBERT and KoBERT-Transformers (53 vs 47) KoBERT and KoBigBird (53 vs 40) KoBERT and DistilKoBERT (53 vs 42) KoBERT and KoBERT-KorQuAD (53 vs 44) KoELECTRA and KcELECTRA (51 vs 41) KoELECTRA and KoCharELECTRA (51 vs 40) KoELECTRA and KoELECTRA-Pipeline (51 vs 37) KoELECTRA and korean-hate-speech-koelectra (51 vs 40)