GPT2 Language Models NLP Tools

Implementations, training guides, and fine-tuning tools for GPT-2 and GPT-2-based models across languages. Includes pretrained weights, training pipelines, and tutorials. Does NOT include other transformer architectures (BERT, T5), inference-only wrappers, or non-GPT2 generative models.

There are 44 gpt2 language models tools tracked. 4 score above 50 (established tier). The highest-rated is graykode/gpt-2-Pytorch at 51/100 with 1,014 stars.

Get all 44 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=gpt2-language-models&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	graykode/gpt-2-Pytorch Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation	51	Established	1,014	Python
2	imcaspar/gpt2-ml GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型	51	Established	1,703	Python
3	Morizeyao/GPT2-Chinese Chinese version of GPT2 training code, using BERT tokenizer.	51	Established	7,598	Python
4	gyunggyung/KoGPT2-FineTuning 🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥	50	Established	226	Python
5	liucongg/GPT2-NewsTitle Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。	49	Emerging	1,114	Python
6	lipiji/Guyu Chinese GPT2: pre-training and fine-tuning framework for text generation	47	Emerging	187	Python
7	seanie12/neural-question-generation Pytorch implementation of Paragraph-level Neural Question Generation with...	46	Emerging	140	Python
8	CyberZHG/keras-gpt-2 Load GPT-2 checkpoint and generate texts	46	Emerging	127	Python
9	devjwsong/gpt2-dialogue-generation-pytorch The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-trained...	43	Emerging	176	Python
10	vlarine/ruGPT2 Russian GPT2 model	38	Emerging	61	Python
11	watermelon-3012/gp_image_to_latex LaTeX Generation for Mathematical Expressions: An experiment with different models	37	Emerging	1	Jupyter Notebook
12	snoop2head/KoGPT-Joong-2 ✍️ Finetuning KoGPT-Trinity to write acrostic poem \| 중2 감성 N행시 빌더	36	Emerging	15	Jupyter Notebook
13	ADGEfficiency/creative-writing-with-gpt2 Fine tune GPT-2 with your favourite authors	36	Emerging	70	Python
14	zhenhao-huang/CPM-1-Finetune-Text-Generation Finetune CPM-1 For Text Generation	34	Emerging	18	Python
15	datares/ez-gpt plug and play training of GPT-2 based language models	33	Emerging	2	Python
16	quentinlintz/synthetic-data-generator 🦄 Use GPT to generate and label data	33	Emerging	25	Python
17	ttop32/KoGPT2novel Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어	32	Emerging	12	Jupyter Notebook
18	viewsetting/MindSpore-GPT2 An OpenAI's GPT2 implementation with MindSpore. The most updated version can...	31	Emerging	4	Python
19	manthan89-py/AI-Blog-Writter This project is used to generate a blog post using Natural Language...	30	Emerging	17	Jupyter Notebook
20	imsanjoykb/Text-Generation The goal of this project is to detect the topic of the text and write a...	29	Experimental	7	Jupyter Notebook
21	rahul-jha98/JustJoking.ai Using a Transformer for learning the Language Model and Generate Short Jokes	24	Experimental	13	Jupyter Notebook
22	Pushkar1853/nanoGPT The simple repository for training/finetuning medium-sized GPTs.	23	Experimental	3	Jupyter Notebook
23	aashrafh/anees-dataset The dataset used to fine-tune the GPT-2 model used in Anees for the...	22	Experimental	2	—
24	hakancangunerli/sun-tzu GPT2 finetuned with Art of War by Sun Tzu	21	Experimental	1	Jupyter Notebook
25	Dai-Wenxun/Pointer-Generator-Networks Pytorch implementation of "Get To The Point: Summarization with...	20	Experimental	8	Python
26	Koziev/vector2text Generate Russian text using GPT model given LaBSE text embedding vector	20	Experimental	5	Python
27	crackalamoo/bardgpt BardGPT is a miniature GPT-style model for generating poetry, coded from...	19	Experimental	3	Python
28	IndexFziQ/LongLM-Eyas Implement of IIE-NLP-Eyas@OutGen: Chinese Outline-guided Story Generation...	19	Experimental	4	Python
29	WordsonRobert/joke-circuits An "interpretable" low res joke generator	19	Experimental	—	—
30	SRM47/gpt2-paraphraser-comparisons Finetune GPT-2 models for paraphrasing and compare its outputs with other...	19	Experimental	3	Jupyter Notebook
31	NikSchaefer/Quotes-Generation Creating captivating quotes from a single word input in PyTorch	19	Experimental	3	Jupyter Notebook
32	ianomunga/backTrack Reverse engineering STTM for backtracking texts to their source Language...	17	Experimental	1	Jupyter Notebook
33	boru-roylu/DialGenModel The offical PyTorch implementation of the models used in DialGen paper.	17	Experimental	1	Python
34	sghawana/custom-gpt2-tokenizer I built a gpt-2 style tokenizer that can be trained on any .txt data to...	17	Experimental	1	Python
35	damilojohn/Text-Descrambling Finetuning GPT2 to descramble sentences	13	Experimental	3	Jupyter Notebook
36	Daddy-Myth/fine-tuning-gpt2-for-latex-generation We’ll be fine-tuning GPT-2 using a specially designed prompt to teach this...	12	Experimental	1	Jupyter Notebook
37	asokraju/nanoGPT_TF This repository contains the implementation of GPT-2 in TensorFlow.	11	Experimental	4	Python
38	RohitKrish46/huberman-GPT A GPT-2-style character level language model emulating Andrew Huberman's...	11	Experimental	—	Python
39	sobamchan/engawa Python package to pre-train BART from scratch with your corpus	11	Experimental	3	Python
40	sinaapolo969/GPT-From-Scratch I coded GPT language model from basic building blocks and trained it on...	10	Experimental	1	Jupyter Notebook
41	sathishkumar67/GPT2-Pretraining_Finewebedu10B Pretraining the 124m GPT2 model	10	Experimental	1	Python
42	Sushitrashhhh/gpt-from-scratch a basic GPT-style language model from the ground up using PyTorch. The focus...	10	Experimental	1	Jupyter Notebook
43	ashdtu/quick-recipe Extracting procedural instructions from cooking videos	10	Experimental	2	Jupyter Notebook
44	traeuker/CreateGPT Easy to understand implementation of GPT-2 with instruction on how to train...	10	Experimental	2	Python

Comparisons in this category

GPT2-Chinese and gpt2-ml (51 vs 51) gpt-2-Pytorch and gpt2-dialogue-generation-pytorch (51 vs 43) KoGPT2-FineTuning and KoGPT-Joong-2 (50 vs 36) KoGPT2-FineTuning and KoGPT2novel (50 vs 32)