Edge Device ML Deployment ML Frameworks

Optimized ML model implementations and inference frameworks for resource-constrained edge devices like Jetson Nano, Raspberry Pi, and embedded systems using lightweight runtimes (ncnn, TensorRT). Does NOT include general ML frameworks, cloud deployment, model training, or setup guides without actual inference implementations.

There are 44 edge device ml deployment frameworks tracked. 1 score above 50 (established tier). The highest-rated is Qengineering/Jetson-Nano-Ubuntu-20-image at 51/100 with 926 stars.

Get all 44 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=edge-device-ml-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Framework Score Tier
1 Qengineering/Jetson-Nano-Ubuntu-20-image

Jetson Nano with Ubuntu 20.04 image

51
Established
2 piyoki/jetson-packages-family

The ultimate software installation guide for Nvidia Jetson Nano/Xavier Dev Kit

47
Emerging
3 Qengineering/Jetson-Nano-image

Jetson Nano image with deep learning frameworks

44
Emerging
4 rbonghi/jetson_easy

🔩 Automatically script to setup and configure your NVIDIA Jetson [Nano,...

44
Emerging
5 Baiyuetribe/ncnn-models

awesome AI models with NCNN, and how they were converted ✨✨✨

43
Emerging
6 Qengineering/RPi-image

Raspberry Pi 4 Buster 64-bit OS with deep learning examples

42
Emerging
7 Qengineering/realsr-ncnn-Jetson-Nano

Award winning RealSR super resolution with ncnn on Jetson Nano

41
Emerging
8 Qengineering/YoloV5-ncnn-Jetson-Nano

YoloV5 for Jetson Nano

40
Emerging
9 Qengineering/YoloV7-ncnn-Jetson-Nano

YoloV7 for a Jetson Nano using ncnn.

39
Emerging
10 Qengineering/RPi-Bullseye-DNN-image

Raspberry Pi 4 Bullseye 64-bit OS with deep learning examples

37
Emerging
11 Qengineering/NanoDet-ncnn-Jetson-Nano

NanoDet for Jetson Nano

35
Emerging
12 Qengineering/YoloX-ncnn-Jetson-Nano

YoloX for a Jetson Nano using ncnn.

34
Emerging
13 Qengineering/Real-ESRGAN-ncnn-Raspberry-Pi-4

ESRGAN super resolution with ncnn on Raspberry Pi

33
Emerging
14 Qengineering/NanoDetPlus-ncnn-Raspberry-Pi-4

NanoDet Plus for a bare Raspberry Pi 4

33
Emerging
15 Qengineering/TensorFlow_Lite_Face_Mask_Jetson-Nano

Face mask detection on a Jetson Nano

33
Emerging
16 Qengineering/YoloX-NPU

YoloX NPU for the RK3566/68/88

32
Emerging
17 Qengineering/LFFD-MNN-Raspberry-Pi-4

Face detection with MNN for Raspberry Pi 4

32
Emerging
18 Qengineering/YoloV6-ncnn-Jetson-Nano

YoloV6 for a Jetson Nano using ncnn.

32
Emerging
19 Qengineering/Hand-Pose-ncnn-Raspberry-Pi-4

Fast hand pose estimation on a bare Raspberry Pi 4 at 7 FPS

32
Emerging
20 Qengineering/LFFD-MNN-Jetson-Nano

Face detection with MNN on a Jetson Nano

32
Emerging
21 Qengineering/LFFD-ncnn-Jetson-Nano

LFFD face detection with ncnn for Jetson Nano

32
Emerging
22 In2infinity/dragon-npu

🐉 Revolutionary NPU framework for Linux | 24,988 FPS face recognition | AMD...

32
Emerging
23 Qengineering/PP-PicoDet-ncnn-Raspberry-Pi-4

PP-PicoDet for Raspberry Pi 4

31
Emerging
24 Qengineering/PP-PicoDet-ncnn-Jeston-Nano

PP-PicoDet for Jetson Nano

30
Emerging
25 Qengineering/YoloFastest-ncnn-Jetson-Nano

YoloFastestV2 for a Jetson Nano

27
Experimental
26 Qengineering/YoloX-ncnn-Raspberry-Pi-4

YoloX for a bare Raspberry Pi 4 using ncnn.

27
Experimental
27 Qengineering/NanoDet-ncnn-Raspberry-Pi-4

NanoDet for a bare Raspberry Pi 4

26
Experimental
28 Corning-AI/embedded-linux

11ms NPU object detection on i.MX 8M Plus | MIPI camera → TFLite INT8 → HDMI...

25
Experimental
29 Qengineering/Traffic-Counter-Rock5C

A fully functional traffic counter on a bare RK3588 with MQTT and remote live viewer

24
Experimental
30 jetson-nano-wheels/jetson-nano-wheels

Unofficial wheels for some machine-learning Python libraries, for the Nvidia...

22
Experimental
31 Qengineering/YoloV4-ncnn-Jetson-Nano

YoloV4 for Jetson Nano

20
Experimental
32 Qengineering/ncnn-Colorization_Raspberry-Pi-4

Colorization with ncnn on a bare Raspberry Pi

20
Experimental
33 aeonSolutions/AeonLabs-Jetson-Nano

This is home for a new open hardware catalogue , one that uses NVidia's...

19
Experimental
34 Qengineering/NanoDetPlus-ncnn-Jetson-Nano

NanoDet Plus for Jetson Nano

19
Experimental
35 webnizam/home-automator

Jetson Nano Home Automator with Homebridge

19
Experimental
36 terry-ess/JetsonOrin

Jetson AGX Orin Developer Kit

19
Experimental
37 Qengineering/PPYoloE-NPU

PP YoloE NPU for the RK3566/68/88

19
Experimental
38 dataplayer12/cooknet

Automated cooking with Jetson nano

18
Experimental
39 Qengineering/LFFD-ncnn-Raspberry-Pi-4

LFFD face detection with ncnn for Raspberry Pi 4

18
Experimental
40 risb21/pico-shape-detection

Running a shape detection machine learning model using accelerometer data on...

18
Experimental
41 Qengineering/CenterFace-ncnn-Jetson-Nano

CenterFace face detection with ncnn for Raspberry Pi 4

18
Experimental
42 Qengineering/CenterFace-ncnn-Raspberry-Pi-4

CenterFace face detection with ncnn for Raspberry Pi 4

18
Experimental
43 Choaib-ELMADI/getting-started-with-jetson-orin-nano

A beginner-friendly guide to setting up and working with the Jetson Orin...

13
Experimental
44 big-yellow-duck/Automated-Fire-Extinguisher-Robot-powered-by-Jetson-Nano-2GB

Automated Fire Extinguishing robot powered by the Jetson Nano 2GB

10
Experimental