qbxlvnf11/convert-pytorch-onnx-tensorrt
Converting weights of Pytorch models to ONNX & TensorRT engines
This tool helps deep learning engineers and MLOps professionals accelerate the performance of their PyTorch models for deployment. It takes a trained PyTorch model and converts it into optimized ONNX and TensorRT engine formats, resulting in faster inference. The end product is a highly efficient deep learning model ready for production environments.
No commits in the last 6 months.
Use this if you need to significantly speed up the inference time of your PyTorch deep learning models on NVIDIA GPUs.
Not ideal if you are working with non-PyTorch models or do not require high-performance inference on NVIDIA hardware.
Stars
50
Forks
11
Language
Python
License
MIT
Category
Last pushed
Mar 29, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/qbxlvnf11/convert-pytorch-onnx-tensorrt"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
onnx/onnx
Open standard for machine learning interoperability
PINTO0309/onnx2tf
Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The...
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This...
onnx/onnxmltools
ONNXMLTools enables conversion of models to ONNX