ViStoryBench/vistorybench
[CVPR 2026] ViStoryBench: AI Story Visualization Benchmark
Provides a modular evaluation framework built on a `BaseEvaluator` abstract class that supports pluggable metrics for assessing narrative consistency, character fidelity, and visual coherence across 80 diverse stories in Chinese and English. The benchmark includes standardized dataset adapters for major story visualization methods (StoryDiffusion, UNO, StoryGen, etc.) and handles long-text prompts via SD embeddings to overcome token limitations. Published results and an active leaderboard are maintained on HuggingFace and a dedicated web portal for continuous community evaluation.
139 stars.
Stars
139
Forks
8
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 04, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/ViStoryBench/vistorybench"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Higher-rated alternatives
Vchitect/VBench
[CVPR2024 Highlight] VBench - We Evaluate Video Generation
VectorSpaceLab/OmniGen
OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340
EndlessSora/focal-frequency-loss
[ICCV 2021] Focal Frequency Loss for Image Reconstruction and Synthesis
JIA-Lab-research/DreamOmni2
This project is the official implementation of 'DreamOmni2: Multimodal Instruction-based Editing...
PKU-YuanGroup/ChronoMagic-Bench
[NeurIPS 2024 D&B Spotlightš„] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of...