EvalCrafter
by EvalCrafter authors (CVPR 2024)
What is EvalCrafter? EvalCrafter is an image & vision eval made by EvalCrafter authors (CVPR 2024). An early large-model video-generation evaluation suite (CVPR 2024) covering visual quality and basic temporal behaviour over a prompt set of about 700 examples (as later compared on the WorldScore project page). Official code: github.com/evalcrafter/EvalCrafter. The repo had no LICENSE file and last push 3 Oct 2024 when checked on 14 Nov 2026; later suites such as VBench-2.0 and StreamEval now cover more of this ground.
Editor note
An early large-model video-generation evaluation suite (CVPR 2024) covering visual quality and basic temporal behaviour over a prompt set of about 700 examples (as later compared on the WorldScore project page). Official code: github.com/evalcrafter/EvalCrafter. The repo had no LICENSE file and last push 3 Oct 2024 when checked on 14 Nov 2026; later suites such as VBench-2.0 and StreamEval now cover more of this ground.
- What it tests
- Quality and temporal behaviour of large video generation models.
- Original source
- evalcrafter.github.io/
- Last updated
- Repo last push 2024-10-03 (GitHub API, earlier read 14 Nov 2026); LICENSE still absent 14 Nov 2026
- License
- Not checked yet — see source
Related image & vision evals
Discussion
No one has discussed EvalCrafter yet. Have you run it? Share what it caught, what it missed or how you set it up.