Kubernetes Ml Deployment MLOps Tools

There are 59 kubernetes ml deployment tools tracked. 6 score above 70 (verified tier). The highest-rated is dstackai/dstack at 90/100 with 2,062 stars and 149,507 monthly downloads. 6 of the top 10 are actively maintained.

Get all 59 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=kubernetes-ml-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 dstackai/dstack

dstack is an open-source control plane for running development, training,...

90
Verified
2 skypilot-org/skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system...

83
Verified
3 m3dev/gokart

Gokart solves reproducibility, task dependencies, constraints of good code,...

79
Verified
4 ray-project/kuberay

A toolkit to run Ray applications on Kubernetes

74
Verified
5 volcano-sh/volcano

A Cloud Native Batch System (Project under CNCF)

74
Verified
6 kubeflow/kale

Kubeflow’s superfood for Data Scientists

74
Verified
7 run-house/kubetorch

Distribute and run AI workloads on Kubernetes magically in Python, like...

65
Established
8 clearml/clearml-server

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment...

64
Established
9 secretflow/kuscia

Kuscia(Kubernetes-based Secure Collaborative InfrA) is a K8s-based...

63
Established
10 containers/omlmd

OCI Artifact for ML model & metadata

62
Established
11 kubeflow/arena

A CLI for Kubeflow.

61
Established
12 caraml-dev/merlin

Kubernetes-friendly ML model management, deployment, and serving.

58
Established
13 kubeflow/blog

Kubeflow blog based on fastpages

58
Established
14 nebius/soperator

Run Slurm in Kubernetes

58
Established
15 raids-lab/crater

Crater is a cloud-native AI training & inference platform.

57
Established
16 Meesho/BharatMLStack

BharatMLStack is an open-source, end-to-end machine learning infrastructure...

56
Established
17 kubeflow/kubeflow

Machine Learning Toolkit for Kubernetes

55
Established
18 jay-johnson/deploy-to-kubernetes

Deploy a distributed AI stack to a multi-host or single-host Kubernetes...

54
Established
19 microsoft/pai

Resource scheduling and cluster management for AI

51
Established
20 SeldonIO/seldon-server

Machine Learning Platform and Recommendation Engine built on Kubernetes

51
Established
21 kubernetes-retired/kube-batch

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML,...

51
Established
22 apache/submarine

Submarine is Cloud Native Machine Learning Platform.

51
Established
23 KusionStack/kusion

Declarative Intent Driven Platform Orchestrator for Internal Developer...

50
Established
24 burakince/mlflow

Mlflow Docker Image

49
Emerging
25 aws-samples/machine-learning-using-k8s

Train and Deploy Machine Learning Models on Kubernetes using Amazon EKS

48
Emerging
26 kubeflow/example-seldon

Example for end-to-end machine learning on Kubernetes using Kubeflow and Seldon Core

48
Emerging
27 katanaml/katana-skipper

Simple and flexible ML workflow engine

48
Emerging
28 deployKF/deployKF

deployKF builds machine learning platforms on Kubernetes. We combine the...

47
Emerging
29 polyaxon/mloperator

Machine learning operator & controller for Kubernetes

46
Emerging
30 kubedl-io/kubedl

Run your deep learning workloads on Kubernetes more easily and efficiently.

46
Emerging
31 kleveross/ormb

Docker for Your ML/DL Models Based on OCI Artifacts

45
Emerging
32 kleveross/klever-model-registry

Cloud Native Machine Learning Model Registry

45
Emerging
33 microsoft/hivedscheduler

Kubernetes Scheduler for Deep Learning

44
Emerging
34 treebeardtech/kubeflow-bootstrap

🪐 1-click Kubeflow using ArgoCD

44
Emerging
35 provectus/sak-kubeflow

🚀 Deploy Kubeflow on AWS EKS with Terraform 🤖

44
Emerging
36 kleveross/klever

Cloud Native ML/DL Platform

43
Emerging
37 Lightning-AI/ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.

42
Emerging
38 k3ai/k3ai

A lightweight tool to get an AI Infrastructure Stack up in minutes not days....

40
Emerging
39 m3dev/kannon

Kannon is a wrapper for the gokart library that allows gokart tasks to be...

38
Emerging
40 slai-labs/get-beam

Run GPU inference and training jobs on serverless infrastructure that scales...

37
Emerging
41 kf5i/k3ai

K3ai is a lightweight, fully automated, AI infrastructure-in-a-box solution...

37
Emerging
42 ParadigmAI/paradigm

Hassle-free ML Pipelines on Kubernetes

33
Emerging
43 kf5i/k3ai-core

K3ai-core is the core library for the GO installer. Go installer will...

33
Emerging
44 robolaunch/robot-operator

Kubernetes Robot Operator for ROS/2 Based Robots

32
Emerging
45 h2oai/h2o-kubernetes

H2O Open Source Kubernetes operator and a command-line tool to ease...

32
Emerging
46 lambdazy/lzy

Platform for a hybrid execution of ML workflows that transparently...

31
Emerging
47 AICoE/thanos-openshift

Thanos on OpenShift

31
Emerging
48 Roulbac/pulumi-eks-ml

An infrastructure library for building scalable Machine Learning platforms on AWS.

31
Emerging
49 AICoE/openshift_kubeflow_workshop

Kubeflow on OpenShift

30
Emerging
50 heyfey/vodascheduler

GPU scheduler for elastic/distributed deep learning workloads in Kubernetes...

29
Experimental
51 perlogix/dama

a simplified machine learning container platform that helps teams get...

29
Experimental
52 combinator-ml/combinator

Combinator.ml's central repo, documentation and website

29
Experimental
53 PapiHack/gai-demo

Demo project of my talk for Galsen AI Dakar community on How to Deploy &...

28
Experimental
54 ccheshirecat/volant

Modular orchestration engine for microvms

28
Experimental
55 egdaemon/eg

The only developer focused ci/cd platform.

27
Experimental
56 ashishpatel26/Kubeflow-installation-on-windows-10

Kubeflow installation on windows 10/11

24
Experimental
57 ArdentMC/ai-streamliner

The AI Streamliner Project

24
Experimental
58 hyper-ml/hyperML

Frictionless Machine Learning on Kubernetes

20
Experimental
59 myelintek/primehub-controller

🎮 PrimeHub Controller

16
Experimental