Llm Inference Engines ML Frameworks
There are 3 llm inference engines frameworks tracked. 1 score above 50 (established tier). The highest-rated is quic/cloud-ai-sdk at 50/100 with 74 stars.
Get all 3 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=llm-inference-engines&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Framework | Score | Tier |
|---|---|---|---|
| 1 |
quic/cloud-ai-sdk
Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep... |
|
Established |
| 2 |
coderonion/awesome-cuda-and-hpc
🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS,... |
|
Emerging |
| 3 |
jbenongftw/gpu-perf-engineering-resources
🚀 Master GPU kernel programming and optimization for high-performance AI... |
|
Experimental |