Kubernetes ML Deployment ML Frameworks

Tools and platforms for deploying, orchestrating, and managing machine learning workloads on Kubernetes clusters. Includes infrastructure-as-code, operators, and integrated stacks combining ML frameworks with K8s. Does NOT include general Kubernetes management tools, standalone ML frameworks, or non-containerized deployment solutions.

There are 49 kubernetes ml deployment frameworks tracked. 1 score above 50 (established tier). The highest-rated is muna-ai/muna-py at 50/100 with 84 stars.

Get all 49 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=kubernetes-ml-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	muna-ai/muna-py Run AI models anywhere. https://muna.ai/explore	50	Established	84	Python
2	clearml/clearml-pycharm-plugin ClearML PyCharm Plugin	47	Emerging	36	Java
3	sql-machine-learning/elasticdl Kubernetes-native Deep Learning Framework	41	Emerging	746	Python
4	Langhalsdino/Kubernetes-GPU-Guide This guide should help fellow researchers and hobbyists to easily automate...	40	Emerging	816	Shell
5	microsoft/AKSDeploymentTutorial Tutorial on how to deploy Deep Learning models on GPU enabled Kubernetes cluster	40	Emerging	77	Jupyter Notebook
6	Datura-ai/lium Rent ready-to-use cloud GPUs in seconds. Lium CLI makes it easy to launch,...	38	Emerging	5	Python
7	clouatre-labs/setup-kiro-action GitHub Action to install and cache Kiro CLI for workflows	38	Emerging	5	—
8	tamohannes/urartu Build ML pipelines with smart caching and remote execution. Develop locally,...	38	Emerging	13	Python
9	Kretski/ScalePredict Run a 2-min local benchmark → predict how long your AI job will take on...	37	Emerging	3	Python
10	freed-dev-llc/turing-rk1-cluster 4-node bare-metal Kubernetes cluster on Turing RK1 (RK3588) with Talos...	37	Emerging	3	Shell
11	radheshpai87/checkDK checkDK — AI-powered Docker Compose & Kubernetes config validator. Catch...	36	Emerging	6	Python
12	docker-aiml/tech-stack-advisor Tech Stack Advisor Sample ML App - Project to Learn to Package ML App with...	35	Emerging	4	Python
13	cognizant-ai-lab/studio-go-runner ML/ENN Runner for privately hosted, cloud, and data-center production...	34	Emerging	2	Go
14	codewithmuh/react-aws-eks-github-actions We plan to utilize GitHub Actions and Terraform to deploy our React project...	33	Emerging	8	HCL
15	KAMONOHASHI/kamonohashi AI開発プラットフォームKAMONOHASHI	33	Emerging	86	C#
16	Alluxio/k8s-operator An operator for managing Alluxio system on Kubernetes cluster	31	Emerging	13	Go
17	k3ai/plugins A lightweight tool to get an AI Infrastructure Stack up in minutes not days....	28	Experimental	6	—
18	ccheshirecat/fledge Fledge converts applications into bootable microvm artifacts. Feed it an OCI...	28	Experimental	7	Go
19	aws-samples/ecs-gpu-scaling Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads	28	Experimental	17	TypeScript
20	devopscorner/nifi Production Grade Nifi & Nifi Registry. Deploy for VM (Virtual Machine) with...	27	Experimental	13	Python
21	polyaxon/polyaxon-operator Polyaxon Operator & Controller for Kubernetes	27	Experimental	6	Go
22	dlops-io/dlops Open source platform for the deep learning development lifecycle	26	Experimental	3	Dockerfile
23	helmcode/kubectl-ai Kubectl plugin for AI-assisted Kubernetes cluster management	25	Experimental	2	Go
24	btcgetpro/oci-plugin-example 🌐 Enhance your Volant microVMs with this official Nginx plugin, providing...	23	Experimental	1	—
25	mdzaheerjk/Kubernetes-Penetration-Testing-and-Benchmarking-with-KubeHunter-KubeBench This project tests an intentionally vulnerable MLOps ML app on a Minikube...	23	Experimental	7	—
26	danielmaddaleno/azure-ml-pipeline Serverless ML inference pipeline on Azure Functions + Blob Storage	22	Experimental	—	Python
27	paulbvrm/initramfs-plugin-example 🚀 Create and deploy stateless services with this initramfs plugin example,...	22	Experimental	—	—
28	Kaamfjdm/kina 🚀 Run Kubernetes easily in Apple Containerization with kina, a quick...	22	Experimental	—	Shell
29	MukundaKatta/DeployKit Deployment config generator — Docker Compose, Kubernetes, systemd, Nginx...	22	Experimental	—	Python
30	idso-fa1-pathology/k8s-cluster-env Environment Configuration for Kubernetes Cluster Usage	22	Experimental	1	Dockerfile
31	esdras01-droid/gokart 🛠️ Simplify your Go service setup with GoKart, a toolkit that streamlines...	22	Experimental	—	Go
32	simonaco/serverless-cognitive-services Serverless endpoints calling Cognitive Services APIs	22	Experimental	15	JavaScript
33	kedastral/kedastral Kedastral is an open-source, domain-agnostic predictive autoscaling...	21	Experimental	—	Go
34	justin-oleary/straggler-shield Patent-pending K8s DaemonSet that validates GPU nodes via GEMM latency,...	19	Experimental	—	Go
35	asklokesh/k8s-gpu-workload-enhancer Intelligent GPU Resource Management Platform for Kubernetes - Topology-aware...	19	Experimental	—	Go
36	AICoE/prometheus-lts Store prometheus metrics with thanos	19	Experimental	8	Shell
37	MazenMoneim/Mastering-Kubernetes This repository contains comprehensive resources and code examples to help...	16	Experimental	4	—
38	scttfrdmn/conduit AWS-native platform for publishing, discovering, and deploying scientific ML models	15	Experimental	—	Go
39	idvoretskyi/linode-gpu-k8s Infrastructure as Code for deploying GPU-enabled Kubernetes clusters on...	15	Experimental	—	HCL
40	AzureLocal/azurelocal-ml-ai Machine learning and AI inference workloads on Azure Local — GPU VM...	14	Experimental	—	—
41	aayostem/riskoracle 🔘 Production ML platform — MLflow, Feast, Kubeflow, Delta Lake, Kubernetes,...	14	Experimental	—	Makefile
42	alice-viola/dora An all-in-one solution for training, testing and maintaining your AI based software	13	Experimental	5	JavaScript
43	ankursoni/kubernetes-operator-roiergasias 'Roiergasias' kubernetes operator is meant to address a fundamental...	13	Experimental	7	Go
44	Techn0logic/kubeflow-pipelines-standalone A Helm chart containing Kubeflow Pipelines as a standalone service.	13	Experimental	8	—
45	k3ai/k3ai.github.io K3ai is a lightweight tool to setup quickly an AI stack: K8s + AI platforms...	13	Experimental	—	JavaScript
46	Roll4d4/KLEP KLEP (Key-Lock-Executable-Process) is a groundbreaking AI framework that...	13	Experimental	5	C#
47	uhstray-io/open-k8s Easy kubernetes deployments and guides from uhstray.io	12	Experimental	4	Shell
48	Kerdos-Infrasoft-Private-Limited/Kerdos-Infrasoft Kerdos Infrasoft Private Limited, founded in 2023 and based in Bengaluru,...	11	Experimental	—	JavaScript
49	spacejar-labs/spacejar-cli Build, pre-tain, finetune, deploy ML models with one command from your local...	10	Experimental	1	Shell