open-mmlab/PIA

[CVPR 2024] PIA, your Personalized Image Animator. Animate your images by text prompt, combing with Dreambooth, achieving stunning videos. PIA,你的个性化图像动画生成器,利用文本提示将图像变为奇妙的动画

43
/ 100
Emerging

Implements plug-and-play motion modules injected into Stable Diffusion's UNet to decouple motion generation from content preservation, enabling fine-grained control over motion magnitude while maintaining image fidelity. Integrates with DreamBooth-LoRA for personalized style adaptation and leverages PyTorch 2.0's scaled dot-product attention for memory-efficient inference on consumer GPUs (16GB VRAM for 1024×1024 images). Supports multi-framework deployment via HuggingFace, Replicate, and OpenXLab with configurable YAML-based inference pipelines.

978 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 17 / 25

How are scores calculated?

Stars

978

Forks

73

Language

Python

License

Apache-2.0

Last pushed

Aug 05, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/open-mmlab/PIA"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.