BERT Model Deployment NLP Tools

Tools for deploying, serving, and running BERT models in production environments. Includes pre-training frameworks, model optimization, and inference APIs. Does NOT include fine-tuning BERT for specific downstream tasks (covered by task-specific categories) or general text similarity/matching applications.

There are 119 bert model deployment tools tracked. 14 score above 50 (established tier). The highest-rated is codertimo/BERT-pytorch at 60/100 with 6,517 stars.

Get all 119 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=bert-model-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	codertimo/BERT-pytorch Google AI 2018 BERT pytorch implementation	60	Established	6,517	Python
2	JayYip/m3tl BERT for Multitask Learning	59	Established	544	Jupyter Notebook
3	920232796/bert_seq2seq pytorch实现 Bert...	58	Established	1,307	Python
4	sileod/tasknet Easy modernBERT fine-tuning and multi-task learning	56	Established	64	Jupyter Notebook
5	graykode/toeicbert TOEIC(Test of English for International Communication) solving using...	55	Established	124	Python
6	guotong1988/BERT-pre-training multi-gpu pre-training in one machine for BERT without horovod (Data Parallelism)	54	Established	171	Python
7	gaphex/bert_experimental code and supplementary materials for a series of Medium articles about the BERT model	54	Established	77	Jupyter Notebook
8	yongzhuo/Macadam Macadam是一个以Tensorflow(Keras)和bert4keras为基础，专注于文本分类、序列标注和关系抽取的自然语言处理工具包。支持RAND...	52	Established	326	Python
9	google-research/bert TensorFlow code and pre-trained models for BERT	51	Established	39,918	Python
10	lonePatient/albert_pytorch A Lite Bert For Self-Supervised Learning Language Representations	51	Established	714	Python
11	ymcui/Chinese-XLNet Pre-Trained Chinese XLNet（中文XLNet预训练模型）	51	Established	1,648	Python
12	Separius/BERT-keras Keras implementation of BERT with pre-trained weights	51	Established	815	Python
13	ymcui/Chinese-BERT-wwm Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）	50	Established	10,184	Python
14	microsoft/AzureML-BERT End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine...	50	Established	403	Jupyter Notebook
15	ymcui/Chinese-ELECTRA Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）	49	Emerging	1,440	Python
16	MuQiuJun-AI/bert4pytorch 超轻量级bert的pytorch版本，大量中文注释，容易修改结构，持续更新	48	Emerging	415	Python
17	huggingface/hmtl 🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network...	47	Emerging	1,195	Python
18	jasonwu0731/ToD-BERT Pre-Trained Models for ToD-BERT	47	Emerging	294	Python
19	ShannonAI/glyce Code for NeurIPS 2019 - Glyce: Glyph-vectors for Chinese Character Representations	47	Emerging	425	Python
20	practicingman/bert_serving export bert model for serving	47	Emerging	141	Python
21	instadeepai/tunbert TunBERT is the first release of a pre-trained BERT model for the Tunisian...	47	Emerging	130	Python
22	BI4O/rasa_milktea_chatbot Chatbot with bert chinese model, base on rasa framework（中文聊天机器人，结合bert意图分析，基于rasa框架）	47	Emerging	110	Python
23	imgarylai/bert-embedding 🔡 Token level embeddings from BERT model on mxnet and gluonnlp	46	Emerging	451	Python
24	xiongma/chinese-law-bert-similarity bert chinese similarity	46	Emerging	140	Python
25	zliucr/coach Coach: A Coarse-to-Fine Approach for Cross-domain Slot Filling (ACL-2020)	44	Emerging	77	Python
26	autoliuweijie/K-BERT Source code of K-BERT (AAAI2020)	43	Emerging	984	Python
27	MartinoMensio/spacy-sentence-bert Sentence transformers models for SpaCy	43	Emerging	108	Python
28	alisafaya/Arabic-BERT Arabic edition of BERT pretrained language models	43	Emerging	133	—
29	mlwithme/BertWithPretrained An implementation of the BERT model and its related downstream tasks based...	43	Emerging	605	Python
30	writer/fitbert Use BERT to Fill in the Blanks	42	Emerging	84	Python
31	jonathanbratt/RBERT Implementation of BERT in R	41	Emerging	163	R
32	prakhar21/Writing-with-BERT Using BERT for doing the task of Conditional Natural Language Generation by...	41	Emerging	41	Jupyter Notebook
33	lonePatient/MobileBert_PyTorch MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices	41	Emerging	71	Python
34	sudharsan13296/Getting-Started-with-Google-BERT Build and train state-of-the-art natural language processing models using BERT	41	Emerging	226	Jupyter Notebook
35	zhusleep/pytorch_chinese_lm_pretrain pytorch中文语言模型预训练	41	Emerging	385	Python
36	ShuHuang/batterybert BatteryBERT: A Pre-trained Language Model for Battery Database Enhancement	40	Emerging	35	Python
37	Lipairui/textgo Text preprocessing, representation, similarity calculation, text search and...	40	Emerging	45	Python
38	ymcui/LERT LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）	39	Emerging	223	Python
39	rokid/ELMo-chinese Deep contextualized word representations for Chinese	39	Emerging	151	Python
40	soskek/bert-chainer Chainer implementation of "BERT: Pre-training of Deep Bidirectional...	38	Emerging	224	Python
41	Brokenwind/BertSimilarity Computing similarity of two sentences with google's BERT...	38	Emerging	510	Python
42	jhgan00/ko-sentence-transformers 한국어 사전학습 모델을 활용한 문장 임베딩	38	Emerging	209	Python
43	lonePatient/electra_pytorch ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators	37	Emerging	91	Python
44	lgessler/microbert A tiny BERT for low-resource monolingual models	37	Emerging	31	HTML
45	indiejoseph/chinese-char-rnn Character-Level language models	36	Emerging	77	Python
46	tunib-ai/tunib-electra Korean-English Bilingual Electra Models	36	Emerging	110	—
47	yulleyi/bert-kanji-graph Using LLMs and graph algorithms to understand the semantics of Japanese Kanji	35	Emerging	7	Jupyter Notebook
48	jeffchy/RE2RNN Source code for the EMNLP 2020 paper "Cold-Start and Interpretability:...	35	Emerging	115	Python
49	richarddwang/electra_pytorch Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the...	35	Emerging	331	Python
50	taishan1994/pytorch-distributed-NLP pytorch分布式训练	35	Emerging	74	Python
51	nishiwen1214/GLUE-bert4keras 基于bert4keras的GLUE基准代码	35	Emerging	65	Python
52	CLUEbenchmark/LightLM 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese...	34	Emerging	60	Python
53	HuBoren99/SmartBert The implementation of SmartBERT: A Promotion of Dynamic Early Exiting...	34	Emerging	9	Python
54	JosselinSomervilleRoberts/BERT-Multitask-learning Multitask-learning of a BERT backbone. Allows to easily train a BERT model...	34	Emerging	20	Python
55	tugstugi/mongolian-bert Pre-trained Mongolian BERT models	34	Emerging	50	Jupyter Notebook
56	kryvokhyzha/how-to-understand-bert In this repository, I have collected different sources, visualizations, and...	34	Emerging	8	Jupyter Notebook
57	kuzgnlar/models Pre-trained Electra models specific to Q&A, NER and Sentiment Analysis tasks	33	Emerging	5	Jupyter Notebook
58	muhwagua/color-bert ColorBERT: Colorizing BERT's perception of the world for visual downstream tasks	33	Emerging	2	Jupyter Notebook
59	snunlp/KR-BERT KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch	32	Emerging	211	Python
60	StefenSal/Bert-Tokens-Tools A useful tools to handle multi-lingual tokens when you use Bert.	32	Emerging	5	Python
61	MalteHB/-l-ctra Ælæctra was created as part of a Cognitive Science bachelor thesis, in the...	32	Emerging	28	Jupyter Notebook
62	pysentimiento/robertuito A pre-trained language model for social media text in Spanish	31	Emerging	35	Jupyter Notebook
63	dh1105/Sentence-Entailment Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on...	31	Emerging	28	Jupyter Notebook
64	nguyenvulebinh/vietnamese-electra Electra pre-trained model using Vietnamese corpus	31	Emerging	67	Jupyter Notebook
65	IceFlameWorm/TextPair 文本对关系比较 - 语义相似度、字面相似度、文本蕴含等等	31	Emerging	55	Python
66	nishiwen1214/SuperGLUE-bert4keras 基于bert4keras的SuperGLUE基准代码	31	Emerging	14	Python
67	cbenge509/BERTVision A parameter-efficient compression model architecture for a variety of NLP...	31	Emerging	10	Jupyter Notebook
68	kipi-ai/korpatbert 특허분야 특화된 한국어 AI언어모델 KorPatBERT	30	Emerging	67	—
69	LetianLee/BERT-Jittor A BERT model built with Jittor \| 计图版 BERT 模型 \| 计图 NLP 教程	30	Emerging	6	Jupyter Notebook
70	PengboLiu/Slot-Filling Spoken Language Understanding(SLU)/Slot Filling(语义槽填充) in PyTorch	30	Emerging	14	Perl
71	shibing624/text2vec-service Service for Bert model to Vector....	30	Emerging	12	Python
72	SunYanCN/BAND BAND：BERT Application aNd Deployment, A simple and efficient BERT model...	30	Emerging	6	JavaScript
73	vmware-archive/bert-pretraining The project is a python module that facilitates BERT pretraining. The...	30	Emerging	6	Python
74	wisdomify/wisdomify A BERT-based reverse dictionary of Korean proverbs	29	Experimental	97	Python
75	sayakpaul/BERT-for-Mobile Compares the DistilBERT and MobileBERT architectures for mobile deployments.	28	Experimental	33	Jupyter Notebook
76	sunyilgdx/RoBERTa4Keras An English RoBERTa based on bert4keras	28	Experimental	8	Python
77	lonePatient/bert-sentence-similarity-pytorch This repo contains a PyTorch implementation of a pretrained BERT model for...	28	Experimental	48	Python
78	lanwuwei/GigaBERT Zero-shot Transfer Learning from English to Arabic	28	Experimental	30	Python
79	mhardalov/bg-reason-BERT Beyond English-Only Reading Comprehension: Experiments in Zero-Shot...	28	Experimental	8	Jupyter Notebook
80	ImperialNLP/BertGen Training and evaluation codes for the BertGen paper (ACL-IJCNLP 2021)	28	Experimental	11	Python
81	felicitywang/TFMTL A TensorFlow Framework for Multi-Task Learning and Text Classification	28	Experimental	11	Python
82	lancopku/CascadeBERT Code for CascadeBERT, Findings of EMNLP 2021	27	Experimental	12	Python
83	himkt/awesome-bert-japanese 📝 A list of pre-trained BERT models for Japanese with word/subword...	27	Experimental	131	—
84	kipi-ai/korpatelectra 특허분야 특화된 한국어 AI언어모델 KorPatELECTRA	27	Experimental	8	—
85	OctopusMind/longBert 长文本相似度模型	26	Experimental	21	Python
86	bioinf-mcb/BERT-torchserve-quickstart Serving BERT embeddings via Torchserve	25	Experimental	4	Python
87	ZhenwenZhang/Slot_Filling Latest research advances on semantic slot filling.	25	Experimental	25	—
88	Akruzen/Briefer An Android application based on TensorFlow's BERT to perform NLP operations...	25	Experimental	8	Java
89	LegalInsight/PretrainedModel 한국어 법률특화 사전학습모델(BERT)	24	Experimental	5	—
90	sunyilgdx/Prompts4Keras Prompt-learning methods used BERT4Keras (PET, EFL and NSP-BERT), both for...	23	Experimental	30	Python
91	felixstuart/Megablunder-Prediction-Model A BERT model fine-tuned to classify 8 grammatical errors.	23	Experimental	2	Jupyter Notebook
92	leeway0507/Bert_For_Domain_Adaptation Huggingface를 활용해 Bert에 대한 Domain Adaptation 설명	23	Experimental	3	Jupyter Notebook
93	GaoQ1/bert4pl Use bert by transformer and pytorch-lightning	23	Experimental	16	Python
94	shiva-s936/ELMo-Deep-Contextualized-Word-Representations An implementation of ELMo embeddings using PyTorch, featuring stacked...	21	Experimental	1	Python
95	NivAm12/Enhancing-By-Subtasks-Components This project aims to tackle data scarcity in a specific task by training a...	21	Experimental	1	Python
96	syeda434am/Domain-Adaptive-BERT-Pretraining This repository contains the code for pretraining a BERT model on...	20	Experimental	4	Python
97	devjwsong/dialogue-sentence-bert-pytorch DialogueSentenceBERT: SentenceBERT for More Representative Utterance...	20	Experimental	8	Python
98	Sami9166/ELMo_Experiment ELMo Performance Experiment using Pytorch	20	Experimental	5	Python
99	W6WM9M/MA-BERT Pretrained checkpoint for MA-BERT	19	Experimental	3	Python
100	MasoudKargar/RBMD RBMD: RoBERTa-Based Module Detection in Multi-Programming Language Software Systems	19	Experimental	1	C++
101	andreped/NLP-MTL Training neural networks to solve multiple tasks simultaneously from free...	18	Experimental	2	Python
102	ramiyappan/BERT Implemented BERT from scratch in PyTorch framework using Stanford Sentiment...	18	Experimental	2	Python
103	ervin-kiose/citation-link-prediction Academic paper link prediction using TF-IDF, Sentence-BERT, Doc2Vec, and LDA...	18	Experimental	1	Jupyter Notebook
104	aroagomez/STS_NLP_Transformers Proyecto de Procesamiento del Lenguaje Natural (PLN) para evaluar la...	14	Experimental	—	Jupyter Notebook
105	paschistrobel/CookBERT Domain Specific BERT Model for the Cooking Domain	12	Experimental	5	Jupyter Notebook
106	StepanTita/semi-supervised-regression COREG with Transformers Exploration: This research project delves into...	12	Experimental	5	Jupyter Notebook
107	PRITHIVSAKTHIUR/BERT-UNCASED BERT is a transformers model pretrained on a large corpus of English data in...	12	Experimental	6	Python
108	jasonvanf/text-matching NLP Text Matching	11	Experimental	3	Python
109	rplacucci/BERT Full PyTorch implementation of BERT: Pre-training of Deep Bidirectional...	11	Experimental	—	Python
110	ayperiKhudaybergenova/bert-distilbert-comparison-WNLI-NER ⚙️Comparison of Transformer-based Language Models	11	Experimental	—	Python
111	GJ98/DialogBERT DialogBERT implemented by TensorFlow	11	Experimental	4	Python
112	mmdjiji/bert-chinese-idioms A Chinese idiom recommendation system based on BERT pre-training language model.	11	Experimental	—	Python
113	nasrin-taghizadeh/SinaBERT Data and codes for SinaBERT Language Model	11	Experimental	—	Jupyter Notebook
114	tomcohen13/BERT Evaluations of BERT on the tasks: Word Similarity, Analogy Solving, and...	11	Experimental	3	Python
115	claudiomarm/BertRanking A semantic ranking system for scientific projects using BERT language models	10	Experimental	2	Python
116	joh-ga/Through-time-with-BERT Scripts, data, and results from the "Through time with BERT" project, which...	10	Experimental	2	Jupyter Notebook
117	PARVATHY-VIJAYAN/CaseStudy Understanding and Fine-Tuning BERT for NLP Tasks	10	Experimental	2	Jupyter Notebook
118	Manas02/FragmentBERT Masked Language Models are Fragment Based Drug Designers	10	Experimental	1	Jupyter Notebook
119	etetteh/bio-electra BioMedical Language Processing with ELECTRA	10	Experimental	2	Python

Comparisons in this category

bert and BERT-keras (51 vs 51)