|国家预印本平台
首页|InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models

InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models

InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models

来源:Arxiv_logoArxiv
英文摘要

Recent benchmarks and datasets have been proposed to improve spatial reasoning in vision-language models (VLMs), yet existing open resources remain limited in scale, visual diversity, and instruction expressiveness. In this work, we introduce InternSpatial, the largest open-source dataset for spatial reasoning in VLMs, along with InternSpatial-Bench, a corresponding evaluation benchmark designed to assess spatial understanding under diverse instruction formats. InternSpatial comprises 12 million QA pairs spanning both single-view and multi-view settings, drawn from diverse visual environments and supporting 19 instruction formats that reflect varied query styles. For evaluation, we propose InternSpatial-Bench for single-view tasks and expand multi-view reasoning by introducing a novel rotation angle prediction task that has not been explored in prior work. Experimental results show that models trained on InternSpatial achieve 12.1% improvement on InternSpatial-Bench and 10.7% on VSI-Bench, while maintaining strong performance on general-purpose benchmarks. We hope these resources will support the development of spatially capable VLMs in practical applications such as robotics and embodied AI.

Nianchen Deng、Lixin Gu、Shenglong Ye、Yinan He、Zhe Chen、Songze Li、Haomin Wang、Xingguang Wei、Tianshuo Yang、Min Dou、Tong He、Wenqi Shao、Kaipeng Zhang、Yi Wang、Botian Shi、Yanting Zhang、Jifeng Dai、Yu Qiao、Hongjie Zhang、Wenhai Wang

计算技术、计算机技术

Nianchen Deng,Lixin Gu,Shenglong Ye,Yinan He,Zhe Chen,Songze Li,Haomin Wang,Xingguang Wei,Tianshuo Yang,Min Dou,Tong He,Wenqi Shao,Kaipeng Zhang,Yi Wang,Botian Shi,Yanting Zhang,Jifeng Dai,Yu Qiao,Hongjie Zhang,Wenhai Wang.InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models[EB/OL].(2025-06-23)[2025-07-16].https://arxiv.org/abs/2506.18385.点此复制

评论