Multimodal Conditioned Generation Diffusion Models

Tools that generate images from non-text inputs (voice, speech, captions, parameters, specifications) or combine multiple input modalities to drive image generation. Does NOT include pure text-to-image, video generation, or image editing tools.

There are 166 multimodal conditioned generation models tracked. 3 score above 50 (established tier). The highest-rated is sakalond/StableGen at 58/100 with 699 stars. 1 of the top 10 are actively maintained.

Get all 166 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=diffusion&subcategory=multimodal-conditioned-generation&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	sakalond/StableGen Transform your 3D texturing workflow with the power of generative AI,...	58	Established	699	Python
2	neggles/animatediff-cli a CLI utility/library for AnimateDiff stable diffusion generation	57	Established	269	Python
3	victordibia/peacasso UI interface for experimenting with multimodal (text, image) models (stable...	53	Established	368	Jupyter Notebook
4	ai-forever/Kandinsky-2 Kandinsky 2 — multilingual text2image latent diffusion model	47	Emerging	2,817	Jupyter Notebook
5	SyntheticAutonomicMind/ALICE Artificial Latent Image Composition Engine	40	Emerging	9	Python
6	samedii/perceptor Modular image generation library	40	Emerging	5	Python
7	carefree0910/carefree-drawboard 🎨 Infinite Drawboard in Python	40	Emerging	701	Python
8	Teriks/dgenerate dgenerate is a scriptable command line tool (and library) for generating...	40	Emerging	42	Python
9	carefree0910/carefree-creator AI magics meet Infinite draw board.	39	Emerging	1,938	Jupyter Notebook
10	movenb3at/snap-pocket SnapPocket — Capture. Transform. Save.	37	Emerging	2	Python
11	bil9148/LyricDiffusion LyricDiffusion is a versatile application that transforms song lyrics into...	37	Emerging	8	Python
12	NeuralRealm/StableFusion Transform text into images and images into new ones using AI. Our...	37	Emerging	61	Python
13	LUMI2049/deepfake-detection-streamlit 🔍 Detect deepfakes with advanced AI using EfficientNetB7 and an attention...	37	Emerging	3	Python
14	mwydmuch/ZoomVideoComposer Pyhton script for generating zoom in/out videos from a set of images	36	Emerging	118	Python
15	vicgalle/stable-diffusion-aesthetic-gradients Personalization for Stable Diffusion via Aesthetic Gradients 🎨	35	Emerging	741	Jupyter Notebook
16	gordicaleksa/stable_diffusion_playground Playing around with stable diffusion. Generated images are reproducible...	35	Emerging	204	Python
17	cloneofsimo/paint-with-words-sd Implementation of Paint-with-words with Stable Diffusion : method from...	35	Emerging	645	Jupyter Notebook
18	minimaxir/stable-diffusion-negative-prompt Jupyter Notebooks for experimenting with negative prompting with Stable...	35	Emerging	87	Jupyter Notebook
19	yownas/shift-attention In stable diffusion, generate a sequence of images shifting attention in the prompt.	33	Emerging	166	Python
20	open-mmlab/Live2Diff Live2Diff: A Pipeline that processes Live video streams by a uni-directional...	33	Emerging	200	Python
21	mix1009/stable-diffusion-video-maker Video generation tool for Stable Diffusion.	33	Emerging	32	Python
22	lunarring/latentblending Create butter-smooth transitions between prompts, powered by stable diffusion	33	Emerging	367	Python
23	AvishakeAdhikary/Text-To-Image-Generator Python GUI application that generates images based on user prompts using the...	32	Emerging	14	Jupyter Notebook
24	prompthero/openjourney A fine-tuned model based on Stable Diffusion to create images in the style...	32	Emerging	79	—
25	JSJeong-me/Generate_AI_for_Image 생성형AI는 어떻게 이미지를 만들까요?	32	Emerging	10	Jupyter Notebook
26	Kittensx/Simple_KES Simple KES blends single or multiple schedulers and provides a noise...	31	Emerging	4	Python
27	rootLocalGhost/ArtTic-LAB An open-source AI image generation suite. Features a beautiful UI along with...	31	Emerging	11	Python
28	Nota-NetsPresso/BK-SDM A Compressed Stable Diffusion for Efficient Text-to-Image Generation [ECCV'24]	31	Emerging	313	Python
29	aagdev/mlimgsynth Image synthesis using machine learning	31	Emerging	23	C
30	Leonm99/Stable-Diffusion-Video2Video Small script for AUTOMATIC1111/stable-diffusion-webui to run video through img2img.	31	Emerging	62	Python
31	dimitreOliveira/stable-diffusion-textual-inversion-app Custom Textual-Inversion for Stable-Diffusion models with Keras.	30	Emerging	19	Jupyter Notebook
32	sbaier1/pyttv A tool for generating (music-)videos using generative models	30	Emerging	44	Python
33	Alyxsissy/Sissy-Research-Projects Alyxsissy x Sissy Research Institute collaborative projects.	30	Emerging	17	Python
34	RandomGamingDev/MCSkinsGen A repository for a Minecraft skin generator based off of Stable Diffusion...	30	Emerging	17	Jupyter Notebook
35	Purushothaman-natarajan/Synth-SONAR A controllable SONAR image generation with text-to-image diffusion models,...	30	Emerging	20	Python
36	lasthero3819/DeepFakeAI-GUI-2026 DeepFake Soft AI is a powerful and user-friendly desktop software designed...	29	Experimental	41	—
37	ototadana/imgflw A demo application for image editing using LLM	29	Experimental	9	Python
38	sofiadparamo/DiffusionCraft Diffusioncraft python img2img pipeline integration using diffusers with...	28	Experimental	14	Python
39	torresflo/Picture-Machine A little Python application to generate pictures from a text prompt. Based...	28	Experimental	8	Python
40	miguelCalado/prompt-to-prompt-tensorflow TensorFlow implementation of the "Prompt-to-Prompt Image Editing with Cross...	28	Experimental	16	Jupyter Notebook
41	sshh12/planet-diffusion Fine-tuning stable diffusion to generate planet/moon textures.	27	Experimental	18	Python
42	albertotrunk/depth2video stable diffusion V2 depth2video - animation - coherence	27	Experimental	47	Jupyter Notebook
43	Zeqiang-Lai/Anything2Image Generate image from anything with ImageBind and Stable Diffusion	27	Experimental	201	Jupyter Notebook
44	paolorechia/openimagegenius Stable Diffusion	26	Experimental	26	Python
45	numz/StableDiffusionPygameInpaintIsometricMap This technical demo is an open-source project that allows users to customize...	26	Experimental	25	Python
46	Anashel-RPG/echoai Echo AI - Passsive AI Image Generation	26	Experimental	26	Python
47	Logeswaran123/Stable-Diffusion-Playground An application that generates images or videos using Stable Diffusion models.	26	Experimental	22	Python
48	DN6/giffusion Create GIFs and Videos using Stable Diffusion	25	Experimental	225	Python
49	h2oai/wave-image-styling-playground A interactive playground to style and edit images, generate art and have fun.	25	Experimental	15	Python
50	schmidtdominik/stablediffusion-interpolation-tools Tools for smoothly interpolating between prompts for Stable Diffusion models	25	Experimental	60	Jupyter Notebook
51	habedi/mosaic-art-maker Making mosaic art using a Stable Diffusion model	25	Experimental	12	Jupyter Notebook
52	Extraltodeus/noise_latent_perlinpinpin This allows to create latent spaces filled with perlin-based noise that can...	25	Experimental	34	Python
53	MonishSoundarRaj/image-generator-streamlit IMAGINATE HUB: Text-to-Image Streamlit App Select from six cutting-edge...	25	Experimental	3	Python
54	sae-llm-coconut/coconut-ai Python library that ease the installation process of Stable Diffusion, and...	24	Experimental	3	Python
55	sayakpaul/caption-upsampling This repository implements the idea of "caption upsampling" from DALL-E 3...	24	Experimental	159	Python
56	RubenGres/Seg2Sat Using StableDiffusion and ControlNet to generate synthetic aerial images	24	Experimental	94	Jupyter Notebook
57	uninterruptedpowersupply/Stable-Diffusion-Mobile-UI For generating images using Stable Diffusion 1.5 with as less as 2gb Vram	24	Experimental	1	Python
58	chenruiRae/GalaxySD Fine-tuning sd-1.5 for galaxy image generation by given morphological prompts.	23	Experimental	7	Python
59	inferless/stable-diffusion-xl-turbo A distilled and cost-effective variant of SDXL that delivers high-quality...	23	Experimental	3	Python
60	matt-dreyer/ai_art_generator This script generates AI-based artwork based on a text prompt. It uses...	22	Experimental	4	Python
61	sumitsahoo/img-to-video-svd img-to-video-svd	22	Experimental	4	Python
62	mtkaya/stable-diffusion-text2img Stable Diffusion Text-to-Image & Image-to-Image Generator with Gradio	22	Experimental	—	Python
63	palakv07/Text_to_video A text prompt to video generation	22	Experimental	—	Jupyter Notebook
64	FxThomas08/stable-diffusion Generate high-quality images from text prompts using an efficient latent...	22	Experimental	—	Jupyter Notebook
65	CodelarXgusaw/score 🧪 Enhance scientific writing with AI-generated expert-level empirical...	22	Experimental	—	—
66	hrvojet/bela-dataset-gen Hungarian (Belote) card dataset generator	22	Experimental	—	Python
67	inferless/animagine-xl-3.0 High-quality image generation from text prompts, with improved hand anatomy...	22	Experimental	3	Python
68	abgache/Genmoji Reproduction of Apple Intelligence Genmoji for apple style emoji generation...	22	Experimental	3	Python
69	pica-labs/picachain ⚡️ Build quick LLM pipelines for AI applications	22	Experimental	1	Python
70	YouvenZ/Imagegen_ink Inkscape extension to create image with generative model within inkscape.	21	Experimental	—	Python
71	mmehmetisik/ai-text-to-image-generator AI-powered image generation tool using Hugging Face API and Stable...	21	Experimental	2	Python
72	melchisedech333/laser-scanning-microscopy 🧪 Reproducing the concept of Confocal Laser Scanning Microscope. Using...	21	Experimental	8	PHP
73	nihaljn/multimodal-prompting Enabling the use of multiple modalities while prompting Stable Diffusion	21	Experimental	15	Python
74	thinh-vu/ai_artist Image generator using Stable Diffusion AI model	21	Experimental	3	Jupyter Notebook
75	inferless/animagine-xl-3.1 Generates high-quality anime images with improved hand anatomy and new...	21	Experimental	4	Python
76	akx/lcm_test Quick and dirty Streamlit UI for Latent Consistency Models	21	Experimental	8	Python
77	shirayu/purepale 🎨 A simple web interface of image generations	21	Experimental	8	Python
78	lcysyzxdxc/AGIQA-3k-Database [IEEE TCSVT2023] A Fine-grained Subjective Perception & Alignment Database...	21	Experimental	69	—
79	karand120497/glaze Glaze is langchain for images. If you're building a text-to-image app with...	21	Experimental	26	Python
80	Haoke98/FrameDiffusion A frame2frame, video2video Video Editor based on the stable-diffusion	21	Experimental	10	Python
81	geocine/sd-easy-mode Easy Mode Stable Diffusion process allows you to generate images based on...	21	Experimental	47	Python
82	sshh12/terrain-diffusion-app An infinite collaborative inpainter which allows users to dynamic generate...	21	Experimental	8	JavaScript
83	dlimeng/awesome-ai-generated 独立开源创作者，积累AI生成相关，随着学习提交资料（教程，原理，新闻，使用）	21	Experimental	6	Jupyter Notebook
84	boostcampaitech5/level3_cv_finalproject-cv-16 "앗, 『이 세계』로부터의 손님이 내게 찾아왔다!?"는 사진에서 선택 인물만 추출해서 원하는 화풍으로 애니메이션화 하는 프로젝트입니다.	20	Experimental	8	Jupyter Notebook
85	360CVGroup/Bridge_Diffusion_Model Chinese-native image generation while compatible with SD eco-system,...	20	Experimental	13	Python
86	LyFl0w/TextureMaker TextureMaker is an innovative Minecraft tool that utilizes AI (stable...	20	Experimental	14	Batchfile
87	akleine/sdcpp-on-android Create images from text using sd.cpp on Android	20	Experimental	1	Java
88	inferless/playground-v2.5 Generate highly aesthetic 1024x1024 images with superior quality, flexible...	20	Experimental	7	Python
89	yangheng95/SuperResolutionAnimeDiffusion Super Resolution Anime Diffusion, waifu2x	20	Experimental	38	Python
90	SJTU-TES/awesome-sjtu-tes SJTU Technology Engage Square	19	Experimental	7	Python
91	inferless/sdxl-lightning A lightning-fast text-to-image generation model that generate high-quality...	19	Experimental	4	Python
92	palaashatri/jforge Text-to-image powered by Stable Diffusion. Image upscaling with ESRGAN....	19	Experimental	—	Java
93	shinn-bit/image-maker AI画像生成アプリ（Colab版）- Stable Diffusion + LoRA + ControlNet...	19	Experimental	—	Python
94	hyeonsangjeon/AIsketcher Text-to-image generation using Huggingface stable diffusion ControlNet...	19	Experimental	14	Python
95	YUKII2K3/Image-generator A powerful AI image generator powered by Stable Diffusion, Gradio, and...	19	Experimental	6	Python
96	DonMischo/Billions-of-Wildcards-for-Stable-Diffusion Billions of Wildcards for Stable Diffusion and maybe other generative AI	19	Experimental	24	Python
97	samuelvinay91/image-generation Cloud-native Image Generation Service with diffusion models, VAE, and...	19	Experimental	—	Python
98	Cominclip/Long_Video_Generation A pipeline to generate long videos according to text prompt	18	Experimental	8	Python
99	andreafailla/Diff2GIF-Animated-Diffusion-Models Create your own animated network visualization by exploiting a diffusion model!	18	Experimental	8	Python
100	RhythrosaLabs/loom Loom is a Streamlit-based application designed to generate and process...	18	Experimental	2	Python
101	s-du/FocusPocusAI Realtime diffusion (LCM-LoRA) from screen capture or webcam, for...	17	Experimental	29	Python
102	sidhantls/minimal-casteer Minimal and extensible implementation of CASteer	17	Experimental	6	Jupyter Notebook
103	yeonsumia/momentum-textual-inversion [NCSOFT 23' winter internship] Enhance personalizing stable diffusion for...	16	Experimental	3	Python
104	cesarolvr/gif-generator-ai A command-line tool to create GIFs from AI-generated images. Works only in...	16	Experimental	1	Python
105	shadowlamer/diffusezx DiffuseZX is a demo project showcasing the capabilities of pretrained Stable...	15	Experimental	6	Python
106	causeri3/selfusion-pi Art installation for Fusion 2025 - automated selfies, diffuser...	15	Experimental	—	Python
107	DolicaAkelloEgwel/studies-show Not tech-art, but TeX-art ???	15	Experimental	—	Python
108	ylp1455/Flask-A-Graph "Flask-A-Graph' is a Flask app that uses Stable Diffusion Pipeline to...	15	Experimental	2	Jupyter Notebook
109	Stefan356/Stable-Diffusion-X-Dreamhold FHOOE Semester Project, AI based visualization of interactive fiction game	15	Experimental	2	Python
110	PRITHIVSAKTHIUR/Canopus-Realism Realistic Image Generation, Realistic trigger works properly, better for...	15	Experimental	8	Jupyter Notebook
111	jerenchen/simple-diffusion-pose-gen A simple Python/Godot example of an AI prompt-based 3D human pose generator	15	Experimental	5	Python
112	FareedKhan-dev/digiart-Powerful-AI-Image-generator DigiArt is a powerful AI image generator built on top of Stable Diffusion....	14	Experimental	9	Python
113	tigrisdata-community/tigris-text-to-image Text-To-Image Generator with Hugging Face model, Fly GPUs and Tigris as storage	14	Experimental	9	Python
114	aredden/denoisemoji command-line tool that allows you to create a pseudo diffusion denoised...	14	Experimental	10	Python
115	5anjana/StyleSwap Localized fashion image editing using text-driven latent diffusion and...	14	Experimental	3	Jupyter Notebook
116	LazyShuyaa/Tensor.art-Scaper A simple scraper for tensor.art.. it will help u to generate images	14	Experimental	1	Python
117	nhatm6586/ScreenDiffusion 🌌 Transform your screen into living art with real-time AI rendering,...	14	Experimental	—	Python
118	tejank10/null-text-inversion Unofficial Implementation of Null-text Inversion (https://arxiv.org/abs/2211.09794)	14	Experimental	12	Jupyter Notebook
119	Robin-WZQ/Text-Guide-Chinese-Landscape-Painting-Generation Fine Tuning Stable Diffusion on Chinese Landscape Painting Generation(基于扩散模型的中国山水画生成)	14	Experimental	10	Jupyter Notebook
120	Ba5bit/echoscape Interactive generative city simulation using webcam motion, audio input,...	14	Experimental	—	Python
121	PsorTheDoctor/generative-ai Generative AI techniques including Stable Diffusion based image generation.	14	Experimental	9	Jupyter Notebook
122	ytl0623/Stable-Diffusion-LINE-app-Vercel Implements Stable-Diffusion text-to-image function on LINE app with Vercel platform	14	Experimental	1	Python
123	nub340/DreamsOfAJaguar Dreams of a Jaguar is a side scrolling video game made with pygame and...	13	Experimental	2	Python
124	aimagelab/Alfie Democratising RGBA Image Generation With No $$$ (AI4VA@ECCV24)	13	Experimental	36	Python
125	ranjanashwin/digital-twin-generator Advanced digital twin generator using IPAdapter FaceID with batch image...	13	Experimental	—	Python
126	bigsk1/sd-ascii-image Stable Diffusion Script to turn images into Ascii Art	13	Experimental	6	Python
127	jzbor/sdiff-gtk GTK+ front end for AI image generation using StableDiffusion	13	Experimental	8	Python
128	soheil-mp/GameAssetLab AI-powered game asset generation studio - transform prompts into...	13	Experimental	6	Jupyter Notebook
129	ihsavru/sd-text-effects Inspired by Adobe Firefly's text effects, Stable Diffusion Text Effects...	12	Experimental	30	JavaScript
130	IlIllII/diffusion-sketch Draw with Stable Diffusion	12	Experimental	14	Python
131	Friday202/ComicGenerator Comic generator that works using Stable Diffusion 1.5	12	Experimental	25	Python
132	jan1na/Un-Stable-Diffusion Test the text- and image-encoder CLIP against adversarial text attacks using...	12	Experimental	4	Python
133	graceduansu/IdentifyingPromptedArtists Identifying Prompted Artist Names from Generated Images: a large-scale...	12	Experimental	1	Python
134	dilums/ml-bytedance-sdxl-lightning experiments with ByteDance's SDXL-Lightning model for generating images from...	12	Experimental	3	Jupyter Notebook
135	Fardeen37/BRANDGENAI BrandGenAI is a text-based AI Iamge/logo generator that uses Stable...	12	Experimental	1	Jupyter Notebook
136	zeittresor/pygame-mizzzout Simple skillgame written in python using pygame with sound and AI generated...	11	Experimental	—	Python
137	Razorwings18/Stable-Totem UNMAINTAINED! Stable Totem is a user-friendly desktop application for...	11	Experimental	—	Python
138	viniciusslvdor/image-automation Simple Python Web application for OpenAI Image models inference	11	Experimental	—	Python
139	epauliat/Project_4BIM 4BIM @ INSA LYON - Group project on AI used to create sketches of people...	11	Experimental	—	Python
140	TheCleverIdiott/stable-diffusion-3 gradio based starter transcript for generating images from text	11	Experimental	2	Python
141	dizys/nyu-cv-final-project NYU CV Final Project: build a AI-generated v.s. real-world-captured image classifier	11	Experimental	—	Jupyter Notebook
142	dieBaerigenBerchtesgadener/PlOtter Ein selbstmalender Bilderrahmen	11	Experimental	2	Python
143	adithya-s-k/diffusechain 🎨Streamlining the creation of consistent diffusion images with AI-powered...	11	Experimental	2	Jupyter Notebook
144	AstraBert/awesome-tiny-sd Tiny stable diffusion chatbot based on segmind/small-sd to generate images...	11	Experimental	2	Python
145	RolandoAndrade/stable-diffusion-instagram-publisher Small script used to generate images from a prompt, define the caption and...	11	Experimental	2	Python
146	PoyBoi/AynAssg Generate Images, Upscale Images, Fix Faces and Replace background using...	11	Experimental	2	Python
147	ixtal23/neuroimage This is an image generation tool that implements the generating of images by...	11	Experimental	2	Python
148	brucethemoose/StableDiffusion-Video2Video Experiments using modified Diffusers img2img and Vapoursynth for temporally...	11	Experimental	2	Python
149	MohamedAliRashad/Imaginate Imaginate is a gradio app for generating images from initial images and prompts	11	Experimental	2	Python
150	Sher-Kal/hf-space-poetry-art Portfolio demo: Hugging Face Space with text + image generation (poetry & painting)	11	Experimental	—	Python
151	kianelbo/magic-rugs A dataset of oriental rugs and a diffusion image generator	11	Experimental	—	Jupyter Notebook
152	R4F405/python-stable-diffusion-generator An image generator implemented in Python using the powerful Stable Diffusion...	11	Experimental	—	Python
153	Pixel4bit/pxd-image-generator Streamlit-based application that allows you to generate AI images from text...	11	Experimental	—	Python
154	mohammadzainabbas/Deep-Learning-CS 🎨 Monet like Painting 👩🏻‍🎨 with stable diffusion model 👨🏻‍💻	11	Experimental	—	Jupyter Notebook
155	zzbuzzard/sd-variant-anim Create animations where each frame is an AI-generated variation of the one before.	11	Experimental	—	Python
156	M26I/image-generation-system A fast, lightweight command-line tool for text-to-image generation using...	11	Experimental	—	Python
157	ty70/stable-diffusion-image-generator A simple and flexible Python script for generating images using Stable...	11	Experimental	—	Python
158	GagDrag/ThreadShift ThreadShift leverages advanced segmentation, image editing, and generation...	10	Experimental	1	Jupyter Notebook
159	DebarghaSanyal/Music_And_Video_Generator This project uses Stable Diffusion to generate AI-driven images & musics...	10	Experimental	1	Jupyter Notebook
160	dhanushreddy291/lcm-sdxl-cog Generate high-quality images faster with Latent Consistency Models (LCM), a...	10	Experimental	1	Python
161	ncdisrup-ai/Captioning4Generation Caption image and with that base generate new images (with stable diffusion...	10	Experimental	1	Jupyter Notebook
162	aahmed-se/generate_image Stable Diffusion Image Generator	10	Experimental	1	Python
163	gopalchand/rotopy Combine PNG or JPEG files in a folder into a movie file. Useful for...	10	Experimental	1	Python
164	AtharvaTaras/Stable-Diffusion-Library A library of images generated using Stable Diffusion	10	Experimental	1	—
165	inferless/stable-diffusion-3-5-large-turbo A fast, optimized diffusion model that generates high-quality images from...	10	Experimental	—	Python
166	player29879/Kandinsky Kandinsky 2 — multilingual text2image latent diffusion model	10	Experimental	1	Jupyter Notebook