OAID/Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
This project helps embedded device manufacturers and AI solution providers efficiently deploy deep learning models onto resource-constrained hardware like AIoT devices. It takes trained neural network models and optimizes them to run quickly and with low memory usage on various chipsets (CPUs, GPUs, NPUs), enabling advanced AI features directly on the device. Developers building AI products for specialized hardware will find this useful.
4,510 stars. No commits in the last 6 months.
Use this if you need to deploy sophisticated AI models onto embedded systems and low-power devices, ensuring fast inference and minimal resource consumption.
Not ideal if you are developing AI models for cloud-based servers or powerful desktop environments with abundant computational resources.
Stars
4,510
Forks
979
Language
C++
License
Apache-2.0
Category
Last pushed
Mar 06, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/OAID/Tengine"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
microsoft/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
onnx/onnx
Open standard for machine learning interoperability
PINTO0309/onnx2tf
Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The...
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This...
onnx/onnxmltools
ONNXMLTools enables conversion of models to ONNX