fancyovo/XingLing-cpp
🚀 High-performance C++/CUDA Inference Engine for XingLing-0.68B. Hand-written kernels (GEMM, Attention), KV Cache, AVX2, and Pybind11 integration.
Stars
1
Forks
—
Language
Cuda
License
—
Category
Last pushed
Mar 02, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/fancyovo/XingLing-cpp"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
onnx/onnx
Open standard for machine learning interoperability
PINTO0309/onnx2tf
Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The...
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This...
microsoft/onnxconverter-common
Common utilities for ONNX converters