TinyML Edge Deployment ML Frameworks

Frameworks, tools, and systems for training and deploying machine learning models on resource-constrained microcontrollers, IoT devices, and embedded systems. Does NOT include general ML frameworks, cloud-based ML platforms, or non-embedded edge computing solutions.

There are 34 tinyml edge deployment frameworks tracked. 1 score above 70 (verified tier). The highest-rated is pytorch/executorch at 82/100 with 4,374 stars. 1 of the top 10 are actively maintained.

Get all 34 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=tinyml-edge-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	pytorch/executorch On-device AI across mobile, embedded and edge for PyTorch	82	Verified	4,374	Python
2	catalyst-team/catalyst Accelerated deep learning R&D	61	Established	3,372	Python
3	z-mahmud22/Dlib_Windows_Python3.x Dlib compiled binaries (.whl) for Python 3.7-3.14 and Windows x64	59	Established	335	—
4	mit-han-lab/mcunet [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021]...	57	Established	664	Python
5	gigwegbe/tinyml-papers-and-projects This is a list of interesting papers and projects about TinyML.	55	Established	982	—
6	ai-techsystems/deepC vendor independent TinyML deep learning library, compiler and inference...	50	Established	602	C++
7	mit-han-lab/tinyengine [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021]...	49	Emerging	928	C
8	uTensor/uTensor TinyML AI inference library	49	Emerging	1,904	C++
9	harvard-acc/smaug SMAUG: Simulating Machine Learning Applications Using Gem5-Aladdin	45	Emerging	114	C++
10	gauravfs-14/awesome-tinyml A carefully curated collection of high-quality libraries, projects,...	42	Emerging	80	JavaScript
11	bharathsudharsan/TinyML-Benchmark-NNs-on-MCUs Code for WF-IoT paper 'TinyML Benchmark: Executing Fully Connected Neural...	41	Emerging	40	Python
12	nesl/tinyodom TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation	40	Emerging	63	C++
13	itemis/tflite-esp-template Template to kick-start TinyML projects on ESP32	37	Emerging	18	Jupyter Notebook
14	Santandersecurityresearch/CurrentSense-TinyML Spying on Microcontrollers using Current Sensing and embedded TinyML models	35	Emerging	84	C++
15	tszydlo/fogml_sdk Implementation of machine learning algorithms for resource-constrained...	34	Emerging	6	C
16	l-nmch/hailo-mnist A guide on training a model, testing it, and optimizing it for deployment on...	32	Emerging	6	Python
17	pittisl/ElasticTrainer Code for paper "ElasticTrainer: Speeding Up On-Device Training with Runtime...	31	Emerging	14	Python
18	MicrochipTech/ml-edgeimpulse-project-builder Edge Impulse deployment for XC32 platforms	31	Emerging	3	Shell
19	mircodemarchi/EdgeLearning Deep Learning for Edge Computing	30	Emerging	6	C++
20	tszydlo/FogML-Arduino Example of anomaly detection and classification algorithms provided by the...	30	Emerging	6	C
21	tkeyo/tinyml-esp Machine Learning on ESP32 with MicroPython and standard ML algorithms to...	30	Emerging	60	Python
22	mllite/TinyML_On_MicroControllers_Demo Demo of a prototype using MLLite for training and deployment of Machine...	30	Emerging	2	Assembly
23	Boring-Dude/neurovortex An AI Optimizer module for improving performance.	28	Experimental	1	Python
24	TronixLab/ArduinoMicroML It generate C code for microcontrollers from Python with Scikit-learn.	26	Experimental	19	Jupyter Notebook
25	leekaize/tinyol-hitl An Open-Standard, TinyML Online-Learning Framework for Unsupervised...	24	Experimental	3	C
26	nesl/neurosymbolic-tinyml TinyNS: Platform-Aware Neurosymbolic Auto Tiny Machine Learning	23	Experimental	25	C
27	edgeimpulse/firmware-infineon-cy8ckit-062-ble The official Edge Impulse firmware for PSoC63 (CY8CKIT-062-BLE)	22	Experimental	—	C
28	sergey-worm/wml Tiny ML Framework by Worm.	19	Experimental	3	C
29	nthnn/n2cmu Feedforward Neural Network Coprocessing Microcontroller Unit (CPC via UART)...	19	Experimental	3	Go
30	PARSA-MHMDI/TinyML Embedded AI - Power Consumption Prediction uses TinyML to forecast energy...	18	Experimental	2	C
31	sr-m7md/tANS-Integration 📦 Integrate the tANS algorithm into ContikiNG for efficient data...	14	Experimental	—	C
32	rahulkvr/tinyml ML on microcontrollers	13	Experimental	—	TypeScript
33	WiresharkIO/TinyML_4_Good This repository deals with the notion of applied Tiny Machine Learning and...	11	Experimental	—	C
34	EZ-Optimium/Optimium Your AI Catalyst: inference backend to maximize your model's inference performance	11	Experimental	4	C++

Comparisons in this category

mcunet and tinyengine (57 vs 49)