BERT Model Deployment NLP Tools

Tools for deploying, serving, and running BERT models in production environments. Includes pre-training frameworks, model optimization, and inference APIs. Does NOT include fine-tuning BERT for specific downstream tasks (covered by task-specific categories) or general text similarity/matching applications.

There are 109 bert model deployment tools tracked. 8 score above 50 (established tier). The highest-rated is codertimo/BERT-pytorch at 65/100 with 6,517 stars and 238 monthly downloads.

Get all 109 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=bert-model-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	codertimo/BERT-pytorch Google AI 2018 BERT pytorch implementation	65	Established	6,517	Python
2	sileod/tasknet Easy modernBERT fine-tuning and multi-task learning	58	Established	64	Jupyter Notebook
3	920232796/bert_seq2seq pytorch实现 Bert...	56	Established	1,307	Python
4	JayYip/m3tl BERT for Multitask Learning	54	Established	544	Jupyter Notebook
5	google-research/bert TensorFlow code and pre-trained models for BERT	51	Established	39,918	Python
6	graykode/toeicbert TOEIC(Test of English for International Communication) solving using...	50	Established	124	Python
7	gaphex/bert_experimental code and supplementary materials for a series of Medium articles about the BERT model	50	Established	77	Jupyter Notebook
8	ymcui/Chinese-BERT-wwm Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）	50	Established	10,184	Python
9	guotong1988/BERT-pre-training multi-gpu pre-training in one machine for BERT without horovod (Data Parallelism)	47	Emerging	171	Python
10	yongzhuo/Macadam Macadam是一个以Tensorflow(Keras)和bert4keras为基础，专注于文本分类、序列标注和关系抽取的自然语言处理工具包。支持RAND...	47	Emerging	326	Python
11	MuQiuJun-AI/bert4pytorch 超轻量级bert的pytorch版本，大量中文注释，容易修改结构，持续更新	44	Emerging	415	Python
12	ymcui/Chinese-XLNet Pre-Trained Chinese XLNet（中文XLNet预训练模型）	44	Emerging	1,648	Python
13	Separius/BERT-keras Keras implementation of BERT with pre-trained weights	44	Emerging	815	Python
14	lonePatient/albert_pytorch A Lite Bert For Self-Supervised Learning Language Representations	44	Emerging	714	Python
15	microsoft/AzureML-BERT End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine...	43	Emerging	403	Jupyter Notebook
16	ymcui/Chinese-ELECTRA Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）	42	Emerging	1,440	Python
17	MartinoMensio/spacy-sentence-bert Sentence transformers models for SpaCy	41	Emerging	108	Python
18	instadeepai/tunbert TunBERT is the first release of a pre-trained BERT model for the Tunisian...	40	Emerging	130	Python
19	huggingface/hmtl 🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network...	40	Emerging	1,195	Python
20	ShannonAI/glyce Code for NeurIPS 2019 - Glyce: Glyph-vectors for Chinese Character Representations	40	Emerging	425	Python
21	BI4O/rasa_milktea_chatbot Chatbot with bert chinese model, base on rasa framework（中文聊天机器人，结合bert意图分析，基于rasa框架）	40	Emerging	110	Python
22	jasonwu0731/ToD-BERT Pre-Trained Models for ToD-BERT	40	Emerging	294	Python
23	practicingman/bert_serving export bert model for serving	40	Emerging	141	Python
24	imgarylai/bert-embedding 🔡 Token level embeddings from BERT model on mxnet and gluonnlp	39	Emerging	451	Python
25	xiongma/chinese-law-bert-similarity bert chinese similarity	39	Emerging	140	Python
26	zliucr/coach Coach: A Coarse-to-Fine Approach for Cross-domain Slot Filling (ACL-2020)	37	Emerging	77	Python
27	Lipairui/textgo Text preprocessing, representation, similarity calculation, text search and...	37	Emerging	45	Python
28	alisafaya/Arabic-BERT Arabic edition of BERT pretrained language models	36	Emerging	133	—
29	autoliuweijie/K-BERT Source code of K-BERT (AAAI2020)	36	Emerging	984	Python
30	mlwithme/BertWithPretrained An implementation of the BERT model and its related downstream tasks based...	36	Emerging	605	Python
31	writer/fitbert Use BERT to Fill in the Blanks	35	Emerging	84	Python
32	prakhar21/Writing-with-BERT Using BERT for doing the task of Conditional Natural Language Generation by...	34	Emerging	41	Jupyter Notebook
33	sudharsan13296/Getting-Started-with-Google-BERT Build and train state-of-the-art natural language processing models using BERT	34	Emerging	226	Jupyter Notebook
34	zhusleep/pytorch_chinese_lm_pretrain pytorch中文语言模型预训练	34	Emerging	385	Python
35	lonePatient/MobileBert_PyTorch MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices	34	Emerging	71	Python
36	jonathanbratt/RBERT Implementation of BERT in R	34	Emerging	163	R
37	ShuHuang/batterybert BatteryBERT: A Pre-trained Language Model for Battery Database Enhancement	33	Emerging	35	Python
38	ymcui/LERT LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）	32	Emerging	223	Python
39	rokid/ELMo-chinese Deep contextualized word representations for Chinese	32	Emerging	151	Python
40	jhgan00/ko-sentence-transformers 한국어 사전학습 모델을 활용한 문장 임베딩	31	Emerging	209	Python
41	Brokenwind/BertSimilarity Computing similarity of two sentences with google's BERT...	31	Emerging	510	Python
42	soskek/bert-chainer Chainer implementation of "BERT: Pre-training of Deep Bidirectional...	31	Emerging	224	Python
43	lonePatient/electra_pytorch ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators	30	Emerging	91	Python
44	lgessler/microbert A tiny BERT for low-resource monolingual models	30	Emerging	31	HTML
45	indiejoseph/chinese-char-rnn Character-Level language models	29	Experimental	77	Python
46	tunib-ai/tunib-electra Korean-English Bilingual Electra Models	29	Experimental	110	—
47	taishan1994/pytorch-distributed-NLP pytorch分布式训练	28	Experimental	74	Python
48	jeffchy/RE2RNN Source code for the EMNLP 2020 paper "Cold-Start and Interpretability:...	28	Experimental	115	Python
49	nishiwen1214/GLUE-bert4keras 基于bert4keras的GLUE基准代码	28	Experimental	65	Python
50	yulleyi/bert-kanji-graph Using LLMs and graph algorithms to understand the semantics of Japanese Kanji	28	Experimental	7	Jupyter Notebook
51	richarddwang/electra_pytorch Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the...	28	Experimental	331	Python
52	JosselinSomervilleRoberts/BERT-Multitask-learning Multitask-learning of a BERT backbone. Allows to easily train a BERT model...	27	Experimental	20	Python
53	HuBoren99/SmartBert The implementation of SmartBERT: A Promotion of Dynamic Early Exiting...	27	Experimental	9	Python
54	kryvokhyzha/how-to-understand-bert In this repository, I have collected different sources, visualizations, and...	27	Experimental	8	Jupyter Notebook
55	tugstugi/mongolian-bert Pre-trained Mongolian BERT models	27	Experimental	50	Jupyter Notebook
56	CLUEbenchmark/LightLM 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese...	27	Experimental	60	Python
57	muhwagua/color-bert ColorBERT: Colorizing BERT's perception of the world for visual downstream tasks	26	Experimental	2	Jupyter Notebook
58	shibing624/text2vec-service Service for Bert model to Vector....	26	Experimental	12	Python
59	kuzgnlar/models Pre-trained Electra models specific to Q&A, NER and Sentiment Analysis tasks	26	Experimental	5	Jupyter Notebook
60	MalteHB/-l-ctra Ælæctra was created as part of a Cognitive Science bachelor thesis, in the...	25	Experimental	28	Jupyter Notebook
61	StefenSal/Bert-Tokens-Tools A useful tools to handle multi-lingual tokens when you use Bert.	25	Experimental	5	Python
62	snunlp/KR-BERT KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch	25	Experimental	211	Python
63	pysentimiento/robertuito A pre-trained language model for social media text in Spanish	24	Experimental	35	Jupyter Notebook
64	dh1105/Sentence-Entailment Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on...	24	Experimental	28	Jupyter Notebook
65	nguyenvulebinh/vietnamese-electra Electra pre-trained model using Vietnamese corpus	24	Experimental	67	Jupyter Notebook
66	cbenge509/BERTVision A parameter-efficient compression model architecture for a variety of NLP...	24	Experimental	10	Jupyter Notebook
67	IceFlameWorm/TextPair 文本对关系比较 - 语义相似度、字面相似度、文本蕴含等等	24	Experimental	55	Python
68	nishiwen1214/SuperGLUE-bert4keras 基于bert4keras的SuperGLUE基准代码	24	Experimental	14	Python
69	vmware-archive/bert-pretraining The project is a python module that facilitates BERT pretraining. The...	23	Experimental	6	Python
70	kipi-ai/korpatbert 특허분야 특화된 한국어 AI언어모델 KorPatBERT	23	Experimental	67	—
71	LetianLee/BERT-Jittor A BERT model built with Jittor \| 计图版 BERT 模型 \| 计图 NLP 教程	23	Experimental	6	Jupyter Notebook
72	PengboLiu/Slot-Filling Spoken Language Understanding(SLU)/Slot Filling(语义槽填充) in PyTorch	23	Experimental	14	Perl
73	SunYanCN/BAND BAND：BERT Application aNd Deployment, A simple and efficient BERT model...	23	Experimental	6	JavaScript
74	wisdomify/wisdomify A BERT-based reverse dictionary of Korean proverbs	22	Experimental	97	Python
75	lonePatient/bert-sentence-similarity-pytorch This repo contains a PyTorch implementation of a pretrained BERT model for...	21	Experimental	48	Python
76	felicitywang/TFMTL A TensorFlow Framework for Multi-Task Learning and Text Classification	21	Experimental	11	Python
77	mhardalov/bg-reason-BERT Beyond English-Only Reading Comprehension: Experiments in Zero-Shot...	21	Experimental	8	Jupyter Notebook
78	sunyilgdx/RoBERTa4Keras An English RoBERTa based on bert4keras	21	Experimental	8	Python
79	ImperialNLP/BertGen Training and evaluation codes for the BertGen paper (ACL-IJCNLP 2021)	21	Experimental	11	Python
80	lanwuwei/GigaBERT Zero-shot Transfer Learning from English to Arabic	21	Experimental	30	Python
81	sayakpaul/BERT-for-Mobile Compares the DistilBERT and MobileBERT architectures for mobile deployments.	21	Experimental	33	Jupyter Notebook
82	lancopku/CascadeBERT Code for CascadeBERT, Findings of EMNLP 2021	20	Experimental	12	Python
83	himkt/awesome-bert-japanese 📝 A list of pre-trained BERT models for Japanese with word/subword...	20	Experimental	131	—
84	kipi-ai/korpatelectra 특허분야 특화된 한국어 AI언어모델 KorPatELECTRA	20	Experimental	8	—
85	OctopusMind/longBert 长文本相似度模型	19	Experimental	21	Python
86	Akruzen/Briefer An Android application based on TensorFlow's BERT to perform NLP operations...	18	Experimental	8	Java
87	ZhenwenZhang/Slot_Filling Latest research advances on semantic slot filling.	18	Experimental	25	—
88	bioinf-mcb/BERT-torchserve-quickstart Serving BERT embeddings via Torchserve	18	Experimental	4	Python
89	LegalInsight/PretrainedModel 한국어 법률특화 사전학습모델(BERT)	17	Experimental	5	—
90	felixstuart/Megablunder-Prediction-Model A BERT model fine-tuned to classify 8 grammatical errors.	17	Experimental	2	Jupyter Notebook
91	leeway0507/Bert_For_Domain_Adaptation Huggingface를 활용해 Bert에 대한 Domain Adaptation 설명	16	Experimental	3	Jupyter Notebook
92	GaoQ1/bert4pl Use bert by transformer and pytorch-lightning	16	Experimental	16	Python
93	sunyilgdx/Prompts4Keras Prompt-learning methods used BERT4Keras (PET, EFL and NSP-BERT), both for...	16	Experimental	30	Python
94	syeda434am/Domain-Adaptive-BERT-Pretraining This repository contains the code for pretraining a BERT model on...	14	Experimental	4	Python
95	NivAm12/Enhancing-By-Subtasks-Components This project aims to tackle data scarcity in a specific task by training a...	14	Experimental	1	Python
96	aroagomez/STS_NLP_Transformers Proyecto de Procesamiento del Lenguaje Natural (PLN) para evaluar la...	14	Experimental	—	Jupyter Notebook
97	shiva-s936/ELMo-Deep-Contextualized-Word-Representations An implementation of ELMo embeddings using PyTorch, featuring stacked...	14	Experimental	1	Python
98	devjwsong/dialogue-sentence-bert-pytorch DialogueSentenceBERT: SentenceBERT for More Representative Utterance...	13	Experimental	8	Python
99	Sami9166/ELMo_Experiment ELMo Performance Experiment using Pytorch	13	Experimental	5	Python
100	MasoudKargar/RBMD RBMD: RoBERTa-Based Module Detection in Multi-Programming Language Software Systems	12	Experimental	1	C++
101	ervin-kiose/citation-link-prediction Academic paper link prediction using TF-IDF, Sentence-BERT, Doc2Vec, and LDA...	12	Experimental	1	Jupyter Notebook
102	W6WM9M/MA-BERT Pretrained checkpoint for MA-BERT	12	Experimental	3	Python
103	ayperiKhudaybergenova/bert-distilbert-comparison-WNLI-NER ⚙️Comparison of Transformer-based Language Models	11	Experimental	—	Python
104	rplacucci/BERT Full PyTorch implementation of BERT: Pre-training of Deep Bidirectional...	11	Experimental	—	Python
105	nasrin-taghizadeh/SinaBERT Data and codes for SinaBERT Language Model	11	Experimental	—	Jupyter Notebook
106	mmdjiji/bert-chinese-idioms A Chinese idiom recommendation system based on BERT pre-training language model.	11	Experimental	—	Python
107	ramiyappan/BERT Implemented BERT from scratch in PyTorch framework using Stanford Sentiment...	11	Experimental	2	Python
108	andreped/NLP-MTL Training neural networks to solve multiple tasks simultaneously from free...	11	Experimental	2	Python
109	Manas02/FragmentBERT Masked Language Models are Fragment Based Drug Designers	10	Experimental	1	Jupyter Notebook

Comparisons in this category

bert and BERT-keras (51 vs 44)