HexaForge-1/highperf-ai-ml-inference

High-perf C++ AI/ML inference engine with ONNX Runtime & LibTorch. CPU default, GPU opt-in. CLI + REST API, cross-platform via CMake/Docker. Auto-fetch models/assets, CUDA runtime check, CI merge gating, future multi-model & GPU training support.

11
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 2 / 25
Adoption 0 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

C++

License

—

Category

onnx-model-deployment

Last pushed

Aug 16, 2025

Commits (30d)

0

GitHub
ONNX Model Deployment · 115 frameworks

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/HexaForge-1/highperf-ai-ml-inference"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

microsoft/onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

100

onnx/onnx

Open standard for machine learning interoperability

98

PINTO0309/onnx2tf

Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The...

91

NVIDIA/TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This...

87

microsoft/onnxconverter-common

Common utilities for ONNX converters

79

Explore ML Frameworks

All categories Trending ML Framework directory Insights