PKU-YuanGroup/ChronoMagic-Bench
[NeurIPS 2024 D&B Spotlightš„] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation
Provides metamorphic evaluation of text-to-video models through time-lapse generation tasks grounded in physics, biology, and chemistry priors, with curated ChronoMagic-Pro datasets containing 460K+ video-text pairs. Introduces CHScore, a robust temporal coherence metric for assessing physics-aware transformations, and hosts an open leaderboard for benchmarking diverse text-to-video models including proprietary systems like Sora.
210 stars.
Stars
210
Forks
14
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 08, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/PKU-YuanGroup/ChronoMagic-Bench"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Higher-rated alternatives
Vchitect/VBench
[CVPR2024 Highlight] VBench - We Evaluate Video Generation
VectorSpaceLab/OmniGen
OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340
EndlessSora/focal-frequency-loss
[ICCV 2021] Focal Frequency Loss for Image Reconstruction and Synthesis
JIA-Lab-research/DreamOmni2
This project is the official implementation of 'DreamOmni2: Multimodal Instruction-based Editing...
SkyworkAI/UniPic
Open-source SOTA multi-image editing model