TinyML Edge Deployment ML Frameworks

Frameworks, tools, and systems for training and deploying machine learning models on resource-constrained microcontrollers, IoT devices, and embedded systems. Does NOT include general ML frameworks, cloud-based ML platforms, or non-embedded edge computing solutions.

There are 32 tinyml edge deployment frameworks tracked. 2 score above 70 (verified tier). The highest-rated is pytorch/executorch at 95/100 with 4,374 stars and 133,251 monthly downloads. 1 of the top 10 are actively maintained.

Get all 32 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=tinyml-edge-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Framework Score Tier
1 pytorch/executorch

On-device AI across mobile, embedded and edge for PyTorch

95
Verified
2 catalyst-team/catalyst

Accelerated deep learning R&D

71
Verified
3 mit-han-lab/mcunet

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021]...

54
Established
4 z-mahmud22/Dlib_Windows_Python3.x

Dlib compiled binaries (.whl) for Python 3.7-3.14 and Windows x64

52
Established
5 gigwegbe/tinyml-papers-and-projects

This is a list of interesting papers and projects about TinyML.

48
Emerging
6 ai-techsystems/deepC

vendor independent TinyML deep learning library, compiler and inference...

43
Emerging
7 uTensor/uTensor

TinyML AI inference library

42
Emerging
8 mit-han-lab/tinyengine

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021]...

42
Emerging
9 gauravfs-14/awesome-tinyml

A carefully curated collection of high-quality libraries, projects,...

39
Emerging
10 harvard-acc/smaug

SMAUG: Simulating Machine Learning Applications Using Gem5-Aladdin

38
Emerging
11 bharathsudharsan/TinyML-Benchmark-NNs-on-MCUs

Code for WF-IoT paper 'TinyML Benchmark: Executing Fully Connected Neural...

34
Emerging
12 nesl/tinyodom

TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation

33
Emerging
13 itemis/tflite-esp-template

Template to kick-start TinyML projects on ESP32

30
Emerging
14 Santandersecurityresearch/CurrentSense-TinyML

Spying on Microcontrollers using Current Sensing and embedded TinyML models

28
Experimental
15 tszydlo/fogml_sdk

Implementation of machine learning algorithms for resource-constrained...

27
Experimental
16 l-nmch/hailo-mnist

A guide on training a model, testing it, and optimizing it for deployment on...

25
Experimental
17 pittisl/ElasticTrainer

Code for paper "ElasticTrainer: Speeding Up On-Device Training with Runtime...

24
Experimental
18 MicrochipTech/ml-edgeimpulse-project-builder

Edge Impulse deployment for XC32 platforms

24
Experimental
19 mllite/TinyML_On_MicroControllers_Demo

Demo of a prototype using MLLite for training and deployment of Machine...

23
Experimental
20 mircodemarchi/EdgeLearning

Deep Learning for Edge Computing

23
Experimental
21 tszydlo/FogML-Arduino

Example of anomaly detection and classification algorithms provided by the...

23
Experimental
22 Boring-Dude/neurovortex

An AI Optimizer module for improving performance.

23
Experimental
23 tkeyo/tinyml-esp

Machine Learning on ESP32 with MicroPython and standard ML algorithms to...

23
Experimental
24 edgeimpulse/firmware-infineon-cy8ckit-062-ble

The official Edge Impulse firmware for PSoC63 (CY8CKIT-062-BLE)

22
Experimental
25 TronixLab/ArduinoMicroML

It generate C code for microcontrollers from Python with Scikit-learn.

19
Experimental
26 leekaize/tinyol-hitl

An Open-Standard, TinyML Online-Learning Framework for Unsupervised...

18
Experimental
27 nesl/neurosymbolic-tinyml

TinyNS: Platform-Aware Neurosymbolic Auto Tiny Machine Learning

16
Experimental
28 sr-m7md/tANS-Integration

📦 Integrate the tANS algorithm into ContikiNG for efficient data...

14
Experimental
29 sergey-worm/wml

Tiny ML Framework by Worm.

12
Experimental
30 nthnn/n2cmu

Feedforward Neural Network Coprocessing Microcontroller Unit (CPC via UART)...

12
Experimental
31 PARSA-MHMDI/TinyML

Embedded AI - Power Consumption Prediction uses TinyML to forecast energy...

11
Experimental
32 rahulkvr/tinyml

ML on microcontrollers

11
Experimental

Comparisons in this category