eloialonso/diamond
DIAMOND (DIffusion As a Model Of eNvironment Dreams) is a reinforcement learning agent trained in a diffusion world model. NeurIPS 2024 Spotlight.
Builds diffusion-based world models capable of multi-step visual rollouts in complex environments like Atari and Counter-Strike, enabling both policy training entirely within imagination and interactive play with human control. Uses Hydra for configuration management and integrates with Hugging Face Hub for pretrained model distribution, supporting training resumption, W&B logging, and model-free RL baselines for comparison. Implements configurable diffusion sampling (denoising steps, stochasticity) with playable visualizations that allow switching between learned policies, human control, and real environment interaction across imagination horizons.
1,988 stars. No commits in the last 6 months.
Stars
1,988
Forks
145
Language
Python
License
MIT
Category
Last pushed
Dec 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/eloialonso/diamond"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
huggingface/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
bghira/SimpleTuner
A general fine-tuning kit geared toward image/video/audio diffusion models.
mcmonkeyprojects/SwarmUI
SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an...
nateraw/stable-diffusion-videos
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
probabilists/azula
Diffusion models in PyTorch