cloneofsimo/paint-with-words-sd
Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.
Modifies Stable Diffusion's cross-attention mechanism to spatially condition generation via per-region text weights derived from segmentation maps, enabling precise object placement and composition control. Supports configurable attention weight scaling functions, regional random seeding for independent object synthesis, and inpainting workflows. Integrates with Hugging Face Diffusers and accepts community-standard checkpoint formats through conversion utilities.
645 stars. No commits in the last 6 months.
Stars
645
Forks
49
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Mar 24, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/cloneofsimo/paint-with-words-sd"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
sakalond/StableGen
Transform your 3D texturing workflow with the power of generative AI, directly within Blender!
neggles/animatediff-cli
a CLI utility/library for AnimateDiff stable diffusion generation
victordibia/peacasso
UI interface for experimenting with multimodal (text, image) models (stable diffusion).
carefree0910/carefree-drawboard
🎨 Infinite Drawboard in Python
Teriks/dgenerate
dgenerate is a scriptable command line tool (and library) for generating images and animation...