SixthView
by Pooya Khosravi, Jen-Feng Chang and Fnu Pramono (repository under facebookresearch)
What is SixthView? SixthView is an image & vision eval made by Pooya Khosravi, Jen-Feng Chang and Fnu Pramono (repository under facebookresearch). A spatial-reasoning benchmark. The model gets five orthographic views of a block built from interlocking cube pieces, plus information about the pieces, and must predict the sixth, hidden view as a grid of part labels, scored both on the exact grid and cell by cell. The paper (arXiv:2611.23891) describes 602 synthetic assemblies of 2 to 10 parts and checks each item so that only one hidden view fits the inputs; the repository's data files list 604 rows. Inputs come as text only, as images, or both. The authors report that three vision-language models reached 33.2% to 85.4% exact-grid accuracy with images plus exact text, and that adding exact text helped far more than adding images.
Editor note
A spatial-reasoning benchmark. The model gets five orthographic views of a block built from interlocking cube pieces, plus information about the pieces, and must predict the sixth, hidden view as a grid of part labels, scored both on the exact grid and cell by cell. The paper (arXiv:2611.23891) describes 602 synthetic assemblies of 2 to 10 parts and checks each item so that only one hidden view fits the inputs; the repository's data files list 604 rows. Inputs come as text only, as images, or both. The authors report that three vision-language models reached 33.2% to 85.4% exact-grid accuracy with images plus exact text, and that adding exact text helped far more than adding images.
- What it tests
- 3D assembly and occlusion reasoning from multiple views, with and without exact symbolic geometry.
- Original source
- github.com/facebookresearch/sixthview_benchmark
- Last updated
- arXiv:2611.23891 (18 Nov 2026); repo last push 2026-10-29 (GitHub API, read 19 Nov 2026)
- License
- CC BY-NC 4.0, non-commercial (repo LICENSE file, read 19 Nov 2026)
Related image & vision evals
Discussion
No one has discussed SixthView yet. Have you run it? Share what it caught, what it missed or how you set it up.