Tensor Computation Libraries ML Frameworks

C++ and multi-language libraries providing core tensor operations, linear algebra, and multidimensional array manipulation for machine learning. Does NOT include end-to-end deep learning frameworks, neural network layers, or domain-specific applications—focus is on low-level tensor primitives and algebraic optimizations.

There are 115 tensor computation libraries frameworks tracked. 5 score above 70 (verified tier). The highest-rated is apache/tvm at 76/100 with 13,183 stars. 3 of the top 10 are actively maintained.

Get all 115 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=tensor-computation-libraries&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	apache/tvm Open Machine Learning Compiler Framework	76	Verified	13,183	Python
2	uxlfoundation/oneDNN oneAPI Deep Neural Network Library (oneDNN)	76	Verified	3,962	C++
3	Tencent/ncnn ncnn is a high-performance neural network inference framework optimized for...	74	Verified	22,890	C++
4	OpenMined/TenSEAL A library for doing homomorphic encryption operations on tensors	73	Verified	1,006	C++
5	iree-org/iree-turbine IREE's PyTorch Frontend, based on Torch Dynamo.	71	Verified	105	Python
6	VeriSilicon/TIM-VX VeriSilicon Tensor Interface Module	55	Established	250	C
7	apache/tvm-ffi Open ABI and FFI for Machine Learning Systems	54	Established	361	C++
8	lisitsyn/tapkee A flexible and efficient С++ template library for dimension reduction	54	Established	234	C++
9	ARM-software/armnn Arm NN ML Software.	54	Established	1,299	C++
10	libxsmm/tpp-mlir TPP experimentation on MLIR for linear algebra	53	Established	146	MLIR
11	koba-jon/pytorch_cpp Deep Learning sample programs using PyTorch in C++	51	Established	309	C++
12	NervanaSystems/neon Intel® Nervana™ reference deep learning framework committed to best...	51	Established	3,869	Python
13	dmlc/dlpack common in-memory tensor structure	51	Established	1,178	C++
14	XUANTIE-RV/csi-nn2 An optimized neural network operator library for chips base on Xuantie CPU.	49	Emerging	99	C
15	MegEngine/MegEngine MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架	47	Emerging	4,808	C++
16	keith2018/TinyTorch A tiny deep learning training framework implemented from scratch in C++ that...	47	Emerging	160	C++
17	axonn-ai/axonn Parallel framework for training and fine-tuning deep neural networks	46	Emerging	72	Python
18	mrphys/tensorflow-nufft Fast, Native Non-Uniform Fast Fourier Transform for TensorFlow	46	Emerging	24	C++
19	apple/turicreate Turi Create simplifies the development of custom machine learning models.	46	Emerging	11,183	C++
20	zkmkarlsruhe/ofxTensorFlow2 TensorFlow 2 AI/ML library wrapper for openFrameworks	46	Emerging	119	C++
21	OpenMachine-ai/tinyfive TinyFive is a lightweight RISC-V emulator and assembler written in Python...	44	Emerging	71	Python
22	Neargye/hello_tf_c_api Neural Network TensorFlow C API	44	Emerging	474	C++
23	NiuTrans/NiuTensor NiuTensor is an open-source toolkit developed by a joint team from NLP Lab....	44	Emerging	385	C++
24	alibaba/BladeDISC BladeDISC is an end-to-end DynamIc Shape Compiler project for machine...	43	Emerging	919	C++
25	neo-ai/neo-ai-dlr Neo-AI-DLR is a common runtime for machine learning models compiled by AWS...	43	Emerging	496	C++
26	tqchen/tinyflow Tutorial code on how to build your own Deep Learning System in 2k Lines	43	Emerging	2,016	C++
27	wy1iu/LargeMargin_Softmax_Loss Implementation for	43	Emerging	352	C++
28	hpi-xnor/BMXNet (New version is out: https://github.com/hpi-xnor/BMXNet-v2) BMXNet: An...	43	Emerging	351	C++
29	PatWie/tensorflow-cmake TensorFlow examples in C, C++, Go and Python without bazel but with cmake...	43	Emerging	444	CMake
30	prabhuomkar/pytorch-cpp C++ Implementation of PyTorch Tutorials for Everyone	42	Emerging	2,129	C++
31	apache/tvm-vta Open, Modular, Deep Learning Accelerator	42	Emerging	333	Scala
32	LISTENAI/thinker a lightweight deep learning framework for CSK60XX serial products	42	Emerging	25	C
33	TensoriumCore/Tensorium_lib An early-stage HPC tensor and grid-kernel library for numerical relativity,...	41	Emerging	13	C++
34	Tiramisu-Compiler/tiramisu A polyhedral compiler for expressing fast and portable data parallel algorithms	41	Emerging	957	C++
35	chochain/tensorForth Forth does tensors, in CUDA.	41	Emerging	56	C++
36	apache/tvm-rfcs A home for the final text of all TVM RFCs.	41	Emerging	109	—
37	memoakten/ofxMSATensorFlow C++ openframeworks addon and examples integrating Google's TensorFlow...	41	Emerging	459	C++
38	CEA-LIST/N2D2 N2D2 is an open source CAD framework for Deep Neural Network simulation and...	40	Emerging	158	C
39	nguyenphuminh/catniff Torch-like deep learning framework for Javascript	40	Emerging	8	TypeScript
40	Infatoshi/batmobile High-performance CUDA kernels for equivariant graph neural networks (MACE,...	40	Emerging	43	Cuda
41	AngusG/tensorflow-xnor-bnn BinaryNets in TensorFlow with XNOR GEMM op	40	Emerging	154	C++
42	facebookresearch/TensorComprehensions A domain specific language to express machine learning workloads.	40	Emerging	1,765	C++
43	vlang/vtl The V Tensor Library	40	Emerging	160	V
44	merrymercy/awesome-tensor-compilers A list of awesome compiler projects and papers for tensor computation and...	39	Emerging	2,734	—
45	jiazhihao/TASO The Tensor Algebra SuperOptimizer for Deep Learning	39	Emerging	740	C++
46	ducha-aiki/LSUVinit Reference caffe implementation of LSUV initialization	39	Emerging	114	C++
47	neilcz/libGDL 一个移动端跨平台的gpu+cpu并行计算的cnn框架(A mobile-side cross-platform gpu+cpu parallel...	39	Emerging	92	C++
48	RubixML/Tensor A library and extension that provides objects for scientific computing in PHP.	36	Emerging	275	PHP
49	hpi-xnor/BMXNet-v2 BMXNet 2: An Open-Source Binary Neural Network Implementation Based on MXNet	36	Emerging	232	C++
50	leggedrobotics/tensorflow-cpp Pre-built TensorFlow for C/C++ and CMake.	35	Emerging	117	Shell
51	mgorshkov/np ⚡ NumPy-style arrays in C++ \| CUDA GPU + AVX512 CPU \| Tikhonov Regularized...	34	Emerging	10	C++
52	Pigrecos/TensorFlow.Delphi TensorFlow.Delphi (TF.Delphi) provides a Delphi(Pascal) Standard binding for...	34	Emerging	88	Pascal
53	tensil-ai/tensil Open source machine learning accelerators	34	Emerging	397	Scala
54	iree-org/iree-torch Torch Frontend for IREE	33	Emerging	25	Python
55	google/minimalloc A lightweight memory allocator for hardware-accelerated machine learning	33	Emerging	180	C++
56	skylook/tensorflow_cpp C and C++ examples for tensorflow	32	Emerging	128	C++
57	nict-wisdom/rannc RaNNC is an automatic parallelization middleware used to train very...	32	Emerging	57	C++
58	joennlae/halutmatmul Hashed Lookup Table based Matrix Multiplication (halutmatmul) - Stella Nera...	30	Emerging	216	Python
59	solomontesema/nn-weight-extractor Neural network weight extractor with batch normalization folding for...	29	Experimental	1	C++
60	marty1885/tiny-htm A tiny yet flexable framework for (HTM) Hierarchical Temporal Memory	28	Experimental	7	C++
61	akielaries/openGPMP Hardware Accelerated General Purpose Mathematics Package (very stale)	28	Experimental	7	C++
62	entropy-flux/Tannic A C++ Tensor Library	27	Experimental	3	C++
63	lucasdelimanogueira/PyNorch Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with...	27	Experimental	164	Python
64	explosion/thinc_gpu_ops 🔮 GPU kernels for Thinc	27	Experimental	9	C++
65	jasmcaus/hazel A Tensor Library written in C++.	27	Experimental	5	C++
66	Savernish/forgeNN forgeNN is a in-development purpose‑built neural network framework combining...	27	Experimental	2	Python
67	EECS-583-Group-24/ML-LOOP Using Machine Learning to Predict the Sequences of Optimization Passes in LLVM	26	Experimental	8	C
68	edelsys/colibri Communication and scheduling framework for MAVlink-based companion systems [...	26	Experimental	6	C++
69	vishnupsatish/microtensor Deep learning library (training & inference) and GPT-2 in C++ from scratch.	26	Experimental	36	C++
70	karimknaebel/itar tar file index for constant-time member access	26	Experimental	4	Python
71	Tamerkobba/Parallel-CNN This project explores the parallelization of Convolutional Neural Networks...	25	Experimental	5	C++
72	Tensor-Array/Tensor-Array A C++ machine learning framework/library.	25	Experimental	2	C++
73	marcosalvalaggio/kiwigrad Mini deep learning framework written in Python C-API for Speed	25	Experimental	3	C
74	SanftMonster/megengine_cpp_training_example Examples for using MegEngine cpp API for model training, which support...	24	Experimental	2	C++
75	Gilberto-Galan/Mini-Framework-Deep-Learning-T-Tensor 🚀 Mini-Framework de Deep Learning desarrollado en C++/CUDA con bindings de...	24	Experimental	2	Cuda
76	Amanda-Barbara/nvcaffe study nvcaffe code	24	Experimental	—	C++
77	tensortask/ttp Tensor Transport Protocol (TTP)	24	Experimental	3	Go
78	YconquestY/Needle Imperative deep learning framework with customized GPU and CPU backend	24	Experimental	29	Python
79	Accumulated/Accelerating-CNN-on-GPU-using-CUDA-C This repository is for implementing and accelerating CNN on GPU using NVIDIA...	24	Experimental	6	Jupyter Notebook
80	EzraWolf/TinyMOA RISC-V CPU with an integrated SRAM-based compute-in-memory (CIM) accelerator...	23	Experimental	1	Python
81	PedroHenriqueBatistaSilva/AdderNet Neural networks with zero multiplications at inference. AdderNet + HDC for...	23	Experimental	1	C
82	trevorpogue/algebraic-nnhw Algebraic enhancements for GEMM & AI accelerators	23	Experimental	290	Python
83	Xeanos7913/Vensor A simple C++ machine learning library, using Vulkan for GPU acceleration.	23	Experimental	5	C++
84	alarxx/Tensor-library Analogue to Math and ML libraries like numpy or pytorch	23	Experimental	6	C++
85	Li-TianCheng/TinyDL 基于Eigen运算库的深度学习框架(支持CUDA加速)	22	Experimental	18	C++
86	moritztng/cuda-ml Machine Learning Framework with Automatic Differentiation and Cuda...	22	Experimental	1	Cuda
87	Sharveswar007/SSBLAST First open-source FP8 linear solver for consumer NVIDIA GPUs — 2-3x faster...	22	Experimental	—	Python
88	Nathanael007/8bit-cpu 🖥️ Design and simulate a custom 8-bit CPU with a 16-instruction ISA, 5-stage...	22	Experimental	—	Assembly
89	dbjwhs/inference-systems-lab C++17 inference platform: belief propagation, Mamba SSM, MoE, neuro-symbolic...	22	Experimental	—	C++
90	rikhil-amonkar/pytorch-cpp-layernorm-accelerator Implemented a custom LayerNorm forward and backward pass extension in C++...	20	Experimental	1	C++
91	ianmkim/snnpp Spiking Neural Network implementation in pure C++ with minimal dependencies	20	Experimental	13	C++
92	Frobeniusnorm/Flint Tensor math framework for machine learning	19	Experimental	5	C++
93	albertopirillo/NITRO-D Novel framework for deep integer-only CNNs operating entirely in the...	18	Experimental	3	Jupyter Notebook
94	l1nkr/DL-Compiler-Navigation Machine Learning Compiler Road Map	18	Experimental	46	Jupyter Notebook
95	rizkysaputradev/Syntralinepp-Compiler SyntraLine++ is a compiler-based domain-specific language (DSL) for...	16	Experimental	1	C++
96	ColeAndrae/tensorgrad A high-performance deep learning framework written in C++, engineered from...	15	Experimental	1	Jupyter Notebook
97	muditbhargava66/llvm-dl-optimizer LLVM-based Compiler Optimization for Deep Learning Kernels	15	Experimental	—	C++
98	Shengxiang-Lin/ParticleFlow-Lite This is an official implementation of "Lightweight Deep Learning Framework...	15	Experimental	16	C++
99	xusworld/tars Tars is a cool deep learning framework.	14	Experimental	1	C++
100	Naveen-Baburaj/Porting-PyTorch-to-LibTorch-Iris-Neural-Network-Implementation Porting a PyTorch neural network for Iris classification from Python to...	14	Experimental	—	C++
101	Tanniefooted733/qemu-cpu-guide 🔍 Explore QEMU CPU models for KVM guests to enhance performance in...	14	Experimental	—	—
102	dhrvrc/Sparsity Native Similarity Searching for Dense & Sparse Vectors. Final Year Project....	14	Experimental	—	C++
103	tmm-dl/tmm A hardware-agnostic, plugin-extensible CLI for training deep learning models...	14	Experimental	—	CMake
104	hysmio/tensors-cpp Just a small repo intended for me to recreate a minimally working example of...	14	Experimental	—	C++
105	StxGuy/TenaciousTensors Fortran/C++ library for multidimensional algebra.	12	Experimental	4	C++
106	rizukirr/ctorch Re-implement Pytorch in C	12	Experimental	1	C
107	BlaiseMuhirwa/gladius An easy-to-use dynamic computation graph library for running e2e ML training.	11	Experimental	2	C++
108	laluxx/tensors single header machine learning library	11	Experimental	—	C
109	saivishwak/DeepLearning_Compilers_Research DeepLearning Compilers Research	11	Experimental	2	—
110	DhruvSrikanth/CUDANN A distributed implementation of a deep learning framework in CUDA.	11	Experimental	2	C++
111	pgmesa/synapx A deep learning library powered by a C++ autograd engine, featuring a...	11	Experimental	—	C++
112	manili/ctorch CTorch is a super lightweight C implementation of PyTorch, built for...	11	Experimental	2	C
113	rexionmars/ctorch A next library stb-style header-only library for Neural Networks	10	Experimental	1	C
114	Rishav-hub/GNetTrainer-package GNetTrainer is a Deep Learning web application for training and predicting...	10	Experimental	1	HTML
115	Mobink980/Network-on-Chip As we transition into the era characterized by many-core architectures and...	10	Experimental	1	C++

Comparisons in this category

ncnn and armnn (74 vs 54) ncnn and csi-nn2 (74 vs 49) tvm and tvm-ffi (76 vs 54)