Llm Cuda Optimization ML Frameworks

There are 6 llm cuda optimization frameworks tracked. 1 score above 50 (established tier). The highest-rated is d9d-project/d9d at 51/100 with 13 stars.

Get all 6 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=llm-cuda-optimization&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	d9d-project/d9d d9d - d[istribute]d - distributed training framework based on PyTorch that...	51	Established	13	Python
2	microsoft/nnscaler nnScaler: Compiling DNN models for Parallel Training	46	Emerging	125	Python
3	Scottcjn/exo-cuda Exo distributed inference with NVIDIA CUDA support via tinygrad	44	Emerging	43	Python
4	nirw4nna/dsc Tensor library & inference framework for machine learning	34	Emerging	116	C++
5	Zzzxkxz/cuda-fp8-ampere 🚀 Accelerate FP8 GEMM tasks on RTX 3090 Ti using lightweight storage and...	22	Experimental	—	Cuda
6	Wasisange/cuda-kernels-collection Custom CUDA kernels for optimized tensor operations in deep learning.	14	Experimental	—	Cuda