Llm Cuda Optimization ML Frameworks

There are 4 llm cuda optimization frameworks tracked. 1 score above 50 (established tier). The highest-rated is d9d-project/d9d at 53/100 with 13 stars and 597 monthly downloads.

Get all 4 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=llm-cuda-optimization&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	d9d-project/d9d d9d - d[istribute]d - distributed training framework based on PyTorch that...	53	Established	13	Python
2	Scottcjn/exo-cuda Exo distributed inference with NVIDIA CUDA support via tinygrad	47	Emerging	43	Python
3	microsoft/nnscaler nnScaler: Compiling DNN models for Parallel Training	46	Emerging	125	Python
4	nirw4nna/dsc Tensor library & inference framework for machine learning	34	Emerging	116	C++