hidet-org/hidet
An open-source efficient deep learning framework/compiler, written in python.
This project helps deep learning engineers and researchers make their neural network models run faster on NVIDIA GPUs. It takes your existing PyTorch or ONNX deep learning models and transforms them into highly efficient CUDA kernels. The output is a significantly optimized model ready for deployment, reducing the computational resources and time needed for inference.
738 stars. No commits in the last 6 months. Available on PyPI.
Use this if you are developing deep learning applications and need to accelerate the inference performance of your PyTorch or ONNX models on NVIDIA GPUs, especially for large-scale deployments or latency-sensitive scenarios.
Not ideal if you are working with deep learning models on CPUs or other GPU architectures, or if your primary focus is on model training rather than inference optimization.
Stars
738
Forks
68
Language
Python
License
Apache-2.0
Category
Last pushed
Sep 04, 2025
Commits (30d)
0
Dependencies
18
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/hidet-org/hidet"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
tensorflow/tensorflow
An Open Source Machine Learning Framework for Everyone
microsoft/tensorwatch
Debugging, monitoring and visualization for Python Machine Learning and Data Science
KomputeProject/kompute
General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics...
hailo-ai/hailort-drivers
The Hailo PCIe driver is required for interacting with a Hailo device over the PCIe interface
NVIDIA/nvshmem
NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM...