Edge Device ML Deployment ML Frameworks

Optimized ML model implementations and inference frameworks for resource-constrained edge devices like Jetson Nano, Raspberry Pi, and embedded systems using lightweight runtimes (ncnn, TensorRT). Does NOT include general ML frameworks, cloud deployment, model training, or setup guides without actual inference implementations.

There are 49 edge device ml deployment frameworks tracked. The highest-rated is Qengineering/Jetson-Nano-Ubuntu-20-image at 44/100 with 926 stars.

Get all 49 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=edge-device-ml-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Framework Score Tier
1 Qengineering/Jetson-Nano-Ubuntu-20-image

Jetson Nano with Ubuntu 20.04 image
44
Emerging
2 piyoki/jetson-packages-family

The ultimate software installation guide for Nvidia Jetson Nano/Xavier Dev Kit
40
Emerging
3 Qengineering/Jetson-Nano-image

Jetson Nano image with deep learning frameworks
37
Emerging
4 rbonghi/jetson_easy

🔩 Automatically script to setup and configure your NVIDIA Jetson [Nano,...
37
Emerging
5 Baiyuetribe/ncnn-models

awesome AI models with NCNN, and how they were converted ✨✨✨
36
Emerging
6 Qengineering/RPi-image

Raspberry Pi 4 Buster 64-bit OS with deep learning examples
35
Emerging
7 Qengineering/realsr-ncnn-Jetson-Nano

Award winning RealSR super resolution with ncnn on Jetson Nano
34
Emerging
8 Qengineering/YoloV5-ncnn-Jetson-Nano

YoloV5 for Jetson Nano
33
Emerging
9 Qengineering/YoloV7-ncnn-Jetson-Nano

YoloV7 for a Jetson Nano using ncnn.
32
Emerging
10 Qengineering/RPi-Bullseye-DNN-image

Raspberry Pi 4 Bullseye 64-bit OS with deep learning examples
30
Emerging
11 Qengineering/NanoDet-ncnn-Jetson-Nano

NanoDet for Jetson Nano
28
Experimental
12 Qengineering/YoloX-ncnn-Jetson-Nano

YoloX for a Jetson Nano using ncnn.
27
Experimental
13 Qengineering/TensorFlow_Lite_Face_Mask_Jetson-Nano

Face mask detection on a Jetson Nano
26
Experimental
14 Qengineering/NanoDetPlus-ncnn-Raspberry-Pi-4

NanoDet Plus for a bare Raspberry Pi 4

26
Experimental
15 Qengineering/YoloV5-segmentation-ncnn-RPi4

YoloV5 segmentation for a bare Raspberry Pi 4
26
Experimental
16 Corning-AI/embedded-linux

11ms NPU object detection on i.MX 8M Plus | MIPI camera → TFLite INT8 → HDMI...
26
Experimental
17 In2infinity/dragon-npu

🐉 Revolutionary NPU framework for Linux | 24,988 FPS face recognition | AMD...
26
Experimental
18 Qengineering/Real-ESRGAN-ncnn-Raspberry-Pi-4

ESRGAN super resolution with ncnn on Raspberry Pi

26
Experimental
19 Qengineering/Hand-Pose-ncnn-Raspberry-Pi-4

Fast hand pose estimation on a bare Raspberry Pi 4 at 7 FPS
25
Experimental
20 Qengineering/YoloV6-ncnn-Jetson-Nano

YoloV6 for a Jetson Nano using ncnn.
25
Experimental
21 Qengineering/YoloX-NPU

YoloX NPU for the RK3566/68/88
25
Experimental
22 Qengineering/LFFD-MNN-Jetson-Nano

Face detection with MNN on a Jetson Nano
25
Experimental
23 Qengineering/LFFD-ncnn-Jetson-Nano

LFFD face detection with ncnn for Jetson Nano
25
Experimental
24 Qengineering/LFFD-MNN-Raspberry-Pi-4

Face detection with MNN for Raspberry Pi 4
25
Experimental
25 Qengineering/YoloV5-seg-NPU

YoloV5 segmentation NPU for the RK 3566/68/88
24
Experimental
26 Qengineering/PP-PicoDet-ncnn-Raspberry-Pi-4

PP-PicoDet for Raspberry Pi 4
24
Experimental
27 Qengineering/PP-PicoDet-ncnn-Jeston-Nano

PP-PicoDet for Jetson Nano
23
Experimental
28 Qengineering/YoloV7-NPU

YoloV7 NPU for the RK3566/68/88
23
Experimental
29 Qengineering/YoloX-ncnn-Raspberry-Pi-4

YoloX for a bare Raspberry Pi 4 using ncnn.

20
Experimental
30 Qengineering/YoloFastest-ncnn-Jetson-Nano

YoloFastestV2 for a Jetson Nano
20
Experimental
31 Qengineering/NanoDet-ncnn-Raspberry-Pi-4

NanoDet for a bare Raspberry Pi 4

19
Experimental
32 Qengineering/Traffic-Counter-Rock5C

A fully functional traffic counter on a bare RK3588 with MQTT and remote live viewer
17
Experimental
33 jetson-nano-wheels/jetson-nano-wheels

Unofficial wheels for some machine-learning Python libraries, for the Nvidia...
15
Experimental
34 ankandrew/nanodet-face-detection

Some Nanodet trained models
15
Experimental
35 Qengineering/ncnn-Colorization_Raspberry-Pi-4

Colorization with ncnn on a bare Raspberry Pi
13
Experimental
36 Qengineering/NanoDet-Tracking-ncnn-RPi_64-bit

NanoDet with tracking for a bare Raspberry Pi 4 using ncnn.
13
Experimental
37 Qengineering/YoloV4-ncnn-Jetson-Nano

YoloV4 for Jetson Nano
13
Experimental
38 terry-ess/JetsonOrin

Jetson AGX Orin Developer Kit
12
Experimental
39 Qengineering/NanoDetPlus-ncnn-Jetson-Nano

NanoDet Plus for Jetson Nano
12
Experimental
40 Qengineering/PPYoloE-NPU

PP YoloE NPU for the RK3566/68/88
12
Experimental
41 aeonSolutions/AeonLabs-Jetson-Nano

This is home for a new open hardware catalogue , one that uses NVidia's...
12
Experimental
42 webnizam/home-automator

Jetson Nano Home Automator with Homebridge
12
Experimental
43 risb21/pico-shape-detection

Running a shape detection machine learning model using accelerometer data on...
11
Experimental
44 Qengineering/LFFD-ncnn-Raspberry-Pi-4

LFFD face detection with ncnn for Raspberry Pi 4
11
Experimental
45 Qengineering/CenterFace-ncnn-Raspberry-Pi-4

CenterFace face detection with ncnn for Raspberry Pi 4
11
Experimental
46 Qengineering/CenterFace-ncnn-Jetson-Nano

CenterFace face detection with ncnn for Raspberry Pi 4
11
Experimental
47 dataplayer12/cooknet

Automated cooking with Jetson nano
11
Experimental
48 Qengineering/YoloV6-NPU

YoloV6 NPU for the RK3566/68/88
10
Experimental
49 Qengineering/YoloV3-ncnn-Jetson-Nano

YoloV3 for Jetson Nano
10
Experimental

Comparisons in this category

Jetson-Nano-Ubuntu-20-image and Jetson-Nano-image (44 vs 37) RPi-image and RPi-Bullseye-DNN-image (35 vs 30) YoloV5-ncnn-Jetson-Nano and YoloV7-ncnn-Jetson-Nano (33 vs 32) YoloV5-ncnn-Jetson-Nano and YoloX-ncnn-Jetson-Nano (33 vs 27) YoloV7-ncnn-Jetson-Nano and YoloX-ncnn-Jetson-Nano (32 vs 27) YoloV5-ncnn-Jetson-Nano and NanoDet-ncnn-Jetson-Nano (33 vs 28) YoloV7-ncnn-Jetson-Nano and NanoDet-ncnn-Jetson-Nano (32 vs 28)