ML API Deployment ML Frameworks

Tools and frameworks for deploying trained machine learning models as production-ready APIs with containerization, serving infrastructure, and best practices. Includes FastAPI/Flask services, Docker packaging, and inference optimization. Does NOT include model training, data preparation, or general cloud deployment guidelines without ML-specific serving patterns.

There are 55 ml api deployment frameworks tracked. 1 score above 50 (established tier). The highest-rated is eightBEC/fastapi-ml-skeleton at 51/100 with 600 stars.

Get all 55 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=ml-api-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	eightBEC/fastapi-ml-skeleton FastAPI Skeleton App to serve machine learning models production-ready.	51	Established	600	Python
2	satellite-image-deep-learning/model-training-and-deployment Training and deployment of deep learning models for satellite & aerial imagery	46	Emerging	67	—
3	MarwanDebbiche/post-tuto-deployment Build and deploy a machine learning app from scratch 🚀	43	Emerging	393	Python
4	BolajiAyodeji/deploy-ml-web-workshop In this workshop, you will learn how to build a machine learning model using...	40	Emerging	23	Jupyter Notebook
5	codingforentrepreneurs/AI-as-an-API Learn to create & deploy a deep learning algorithm into a production REST...	39	Emerging	76	Jupyter Notebook
6	kingabzpro/FastAPI-for-ML Building a simple FastAPI application for model inference.	36	Emerging	65	Python
7	wahyudesu/Fastapi-AI-Production-Template Simple starter template for your ML/AI projects (uv package manager, RestAPI...	35	Emerging	94	Jupyter Notebook
8	DanilBaibak/real-time-ml-prediction Build a production ready Machine Learning service for real-time prediction...	34	Emerging	35	Python
9	MDalamin5/FastAPI-for-Machine-Learning-and-Agentic-Ai A practical FastAPI-based repository for building and deploying APIs,...	33	Emerging	3	Python
10	kingabzpro/Stress-Testing-FastAPI Build a FastAPI web application and perform stress testing using Locust.	30	Emerging	6	HTML
11	khanh41/fastapi-mongodb-base-project This is base code of fastapi, mongodb and machine learning with poetry env	29	Experimental	13	Python
12	mlexpertio/ml-project-template Starter template for your ML/AI projects (uv package manager, RestAPI with...	29	Experimental	33	Python
13	Hoopoes/FastStart A modular and flexible starter kit for FastAPI projects, featuring branches...	29	Experimental	34	—
14	twilio-labs/ml-training-api A service template for asynchronous machine learning model training	27	Experimental	18	Python
15	0-mostafa-rezaee-0/ML_API_with_PostgreSQL_Integration ML Engineering best practices \| Deploying an ML API with FastAPI,...	27	Experimental	5	Jupyter Notebook
16	0-mostafa-rezaee-0/ML_API_with_FastAPI_and_Docker ML Engineering best practices \| ML model deployment as a FastAPI service,...	27	Experimental	5	Jupyter Notebook
17	haicheviet/fullstack-machine-learning-inference Fullstack machine learning inference template	26	Experimental	31	Jupyter Notebook
18	atick-faisal/Deep-Learning-Cloud-Run-Starter Starter Code for Deploying an Machine Learning App to the Google Cloud Run	26	Experimental	3	Jupyter Notebook
19	dnguyenngoc/ml-models-in-production This repo gives an introduction to how to make full working example to serve...	26	Experimental	30	Python
20	arnaudlemaignen/resource-model-exporter Resource Model Exporter is a prometheus exporter that collects resource...	25	Experimental	2	Go
21	fjdurlop/deploy-GAISSA Guidelines to deploy AI models in different cloud providers aligned with...	24	Experimental	3	Jupyter Notebook
22	sosannaunregenerate143/gcp-financial-data-platform Build and manage a production-grade financial data platform on GCP with...	22	Experimental	—	HCL
23	Omoluabi1003/ETL-AI AI-enabled data pipeline framework for transforming raw data into...	22	Experimental	—	Python
24	huangruiran666/analysis-system High-performance financial ETL framework and feature engineering pipeline...	22	Experimental	—	Python
25	riadh565/beta-binomial-classifier-api 📊 Build and deploy a beta-binomial classifier API using FastAPI and Docker...	22	Experimental	—	Jupyter Notebook
26	Szeryy/Midm-2.0 🚀 Build and deploy the Mi:dm 2.0 model for efficient machine learning tasks,...	22	Experimental	—	Jupyter Notebook
27	Dean12345644533/gamepulse-rawg-ml-api 🎮 Build an end-to-end ML project using RAWG video game data with AWS...	22	Experimental	—	Python
28	anshupandey/Deploy_Machine_Learning_Projects This repository contains the examples of deploying AI, ML models using...	21	Experimental	10	Jupyter Notebook
29	ejhusom/d2m A machine learning pipeline taking you from raw data to fully trained...	21	Experimental	8	Python
30	kingabzpro/Redis-ml-project Model serving with FastAPI and Redis caching to enable fast and efficient...	19	Experimental	9	Python
31	trydoff/ML-Portal-FastAPI A complete end-to-end machine learning portal that covers processes starting...	19	Experimental	42	Python
32	hasancoded/CloudFileSystem A robust, distributed cloud file system simulation featuring proactive...	19	Experimental	—	Java
33	Kimosabey/auto-etl Enterprise auto-etl Technical Architecture focusing on Scalability and High...	19	Experimental	—	—
34	nateraw/lambdacloud An unofficial Python client library for Lambda Lab's Cloud Computing Platform	18	Experimental	12	Python
35	SteliosGian/fastapi-celery-redis-flower A FastAPI application with Redis, Celery, and Flower	18	Experimental	11	Python
36	techequitytraining/gcp-project-blueprints Advanced Google Cloud Blueprints for Accelerating Time to Value in Client Projects	17	Experimental	2	—
37	ArjunPramod/realtime-ai-backend Realtime AI backend with WebSockets, LLM streaming, and Supabase.	15	Experimental	—	Python
38	greemaltend4/int-gration-cloud-machine-learning Ce projet propose une solution d'intégration cloud pour déployer et gérer...	15	Experimental	—	JavaScript
39	paramasridevi/ml-inference-api-with-llm-agent LLM-powered ML inference API with FastAPI, AWS deployment, and tool-calling...	14	Experimental	—	Python
40	Sandip-2001/multi-model-ai-api A highly scalable FastAPI gateway routing unified JSON requests to isolated...	14	Experimental	—	Python
41	swarali-more/python-backend-ml Python Backend + ML learning journey	14	Experimental	—	Python
42	zekely/activity-prediction-api FastAPI backend for real-time ML-based activity prediction with MongoDB	14	Experimental	—	—
43	Ares-Infenus/penguin-ml-api Production-ready ML API built with FastAPI and scikit-learn, featuring a...	14	Experimental	—	Python
44	Dhivindharshan/student-score-ml-api A beginner-friendly MLOps project showcasing the deployment of a trained...	14	Experimental	—	Python
45	yoonjihyung2023/ctr-api FastAPI + Docker serving demo for CTR-style model inference	14	Experimental	—	Python
46	mtichikawa/dockerized-ml-api FastAPI + Docker ML inference service with Redis caching and ensemble anomaly scoring	14	Experimental	—	Jupyter Notebook
47	efealtiparmakoglu/enterprise-ai-platform 🏗️ Enterprise-grade AI Platform with microservices, FastAPI, Celery, ML...	14	Experimental	—	Python
48	Khatantamir/ml-model-deployment-system-khatantamir End-to-end machine learning model deployment system with FastAPI and Docker.	14	Experimental	—	Python
49	kalopez/ml-inference-service Containerized ML inference service exposing a churn prediction model via...	14	Experimental	—	Python
50	shreypatel2311/CRUD-and-FastAPI Order Management API	14	Experimental	4	Python
51	AxelGard/machine-learning-microservice My template for how to make a simple micro service for machine learning...	13	Experimental	2	Jupyter Notebook
52	aaronlmathis/GoETL A high-performance Go library for building complete ETL (Extract,...	12	Experimental	1	Go
53	OElesin/modeldb-aws Verta ai ModelDB on AWS Cloud with integration into Amazon SageMaker for ML...	12	Experimental	1	TypeScript
54	soheylfalahzade/Database_Migration_Tool Robust ETL tool for migrating and synchronizing data between different...	11	Experimental	—	Python
55	whatphilipcodes/taupy Template repository to get you started with Tauri, React and a Python backend API	11	Experimental	2	Rust

Comparisons in this category

fastapi-ml-skeleton and FastAPI-for-ML (51 vs 36) Fastapi-AI-Production-Template and ml-project-template (35 vs 29)