Object Concepts Emerge from Motion
Object Concepts Emerge from Motion
Object concepts play a foundational role in human visual cognition, enabling perception, memory, and interaction in the physical world. Inspired by findings in developmental neuroscience - where infants are shown to acquire object understanding through observation of motion - we propose a biologically inspired framework for learning object-centric visual representations in an unsupervised manner. Our key insight is that motion boundary serves as a strong signal for object-level grouping, which can be used to derive pseudo instance supervision from raw videos. Concretely, we generate motion-based instance masks using off-the-shelf optical flow and clustering algorithms, and use them to train visual encoders via contrastive learning. Our framework is fully label-free and does not rely on camera calibration, making it scalable to large-scale unstructured video data. We evaluate our approach on three downstream tasks spanning both low-level (monocular depth estimation) and high-level (3D object detection and occupancy prediction) vision. Our models outperform previous supervised and self-supervised baselines and demonstrate strong generalization to unseen scenes. These results suggest that motion-induced object representations offer a compelling alternative to existing vision foundation models, capturing a crucial but overlooked level of abstraction: the visual instance. The corresponding code will be released upon paper acceptance.
Haoqian Liang、Xiaohui Wang、Zhichao Li、Ya Yang、Naiyan Wang
计算技术、计算机技术
Haoqian Liang,Xiaohui Wang,Zhichao Li,Ya Yang,Naiyan Wang.Object Concepts Emerge from Motion[EB/OL].(2025-05-27)[2025-07-22].https://arxiv.org/abs/2505.21635.点此复制
评论