zerollzeng/tiny-tensorrt
Deploy your model with TensorRT quickly.
This project helps machine learning engineers efficiently deploy their deep learning models on NVIDIA GPUs. It takes an ONNX model as input and produces an optimized TensorRT engine, enabling faster inference. It's designed for developers working on high-performance AI applications.
764 stars. No commits in the last 6 months.
Use this if you need to integrate and run your ONNX-formatted deep learning models with NVIDIA TensorRT for accelerated inference in C++ or Python applications.
Not ideal if you are looking for a currently maintained solution, as this project is no longer actively developed and better alternatives exist.
Stars
764
Forks
100
Language
C++
License
—
Category
Last pushed
Nov 21, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/zerollzeng/tiny-tensorrt"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
onnx/onnx
Open standard for machine learning interoperability
PINTO0309/onnx2tf
Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The...
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This...
onnx/onnxmltools
ONNXMLTools enables conversion of models to ONNX