ExponentialML/Text-To-Video-Finetuning
Finetune ModelScope's Text To Video model using Diffusers 🧨
ArchivedSupports training full models or parameter-efficient LoRA adapters compatible with Stable Diffusion webui extensions. Implements memory optimizations including gradient checkpointing and Torch 2.0's Scaled Dot-Product Attention, enabling training on GPUs with ≤16GB VRAM. Provides flexible data preprocessing with automatic video captioning support and YAML-based configuration for customizing training on custom video datasets.
697 stars. No commits in the last 6 months.
Stars
697
Forks
111
Language
Python
License
MIT
Category
Last pushed
Dec 14, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/ExponentialML/Text-To-Video-Finetuning"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
huggingface/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
bghira/SimpleTuner
A general fine-tuning kit geared toward image/video/audio diffusion models.
mcmonkeyprojects/SwarmUI
SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an...
nateraw/stable-diffusion-videos
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
AUTOMATIC1111/stable-diffusion-webui
Stable Diffusion web UI