|国家预印本平台
首页|RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaboration

RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaboration

RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaboration

来源:Arxiv_logoArxiv
英文摘要

The dawn of embodied intelligence has ushered in an unprecedented imperative for resilient, cognition-enabled multi-agent collaboration across next-generation ecosystems, revolutionizing paradigms in autonomous manufacturing, adaptive service robotics, and cyber-physical production architectures. However, current robotic systems face significant limitations, such as limited cross-embodiment adaptability, inefficient task scheduling, and insufficient dynamic error correction. While End-to-end VLA models demonstrate inadequate long-horizon planning and task generalization, hierarchical VLA models suffer from a lack of cross-embodiment and multi-agent coordination capabilities. To address these challenges, we introduce RoboOS, the first open-source embodied system built on a Brain-Cerebellum hierarchical architecture, enabling a paradigm shift from single-agent to multi-agent intelligence. Specifically, RoboOS consists of three key components: (1) Embodied Brain Model (RoboBrain), a MLLM designed for global perception and high-level decision-making; (2) Cerebellum Skill Library, a modular, plug-and-play toolkit that facilitates seamless execution of multiple skills; and (3) Real-Time Shared Memory, a spatiotemporal synchronization mechanism for coordinating multi-agent states. By integrating hierarchical information flow, RoboOS bridges Embodied Brain and Cerebellum Skill Library, facilitating robust planning, scheduling, and error correction for long-horizon tasks, while ensuring efficient multi-agent collaboration through Real-Time Shared Memory. Furthermore, we enhance edge-cloud communication and cloud-based distributed inference to facilitate high-frequency interactions and enable scalable deployment. Extensive real-world experiments across various scenarios, demonstrate RoboOS's versatility in supporting heterogeneous embodiments. Project website: https://github.com/FlagOpen/RoboOS

Huajie Tan、Xiaoshuai Hao、Minglan Lin、Pengwei Wang、Yaoxu Lyu、Mingyu Cao、Zhongyuan Wang、Shanghang Zhang

自动化技术、自动化技术设备计算技术、计算机技术

Huajie Tan,Xiaoshuai Hao,Minglan Lin,Pengwei Wang,Yaoxu Lyu,Mingyu Cao,Zhongyuan Wang,Shanghang Zhang.RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaboration[EB/OL].(2025-05-06)[2025-05-29].https://arxiv.org/abs/2505.03673.点此复制

评论