|国家预印本平台
首页|MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems

MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems

MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems

来源:Arxiv_logoArxiv
英文摘要

LLM-based multi-agent systems (MAS) have demonstrated significant potential in enhancing single LLMs to address complex and diverse tasks in practical applications. Despite considerable advancements, the field lacks a unified codebase that consolidates existing methods, resulting in redundant re-implementation efforts, unfair comparisons, and high entry barriers for researchers. To address these challenges, we introduce MASLab, a unified, comprehensive, and research-friendly codebase for LLM-based MAS. (1) MASLab integrates over 20 established methods across multiple domains, each rigorously validated by comparing step-by-step outputs with its official implementation. (2) MASLab provides a unified environment with various benchmarks for fair comparisons among methods, ensuring consistent inputs and standardized evaluation protocols. (3) MASLab implements methods within a shared streamlined structure, lowering the barriers for understanding and extension. Building on MASLab, we conduct extensive experiments covering 10+ benchmarks and 8 models, offering researchers a clear and comprehensive view of the current landscape of MAS methods. MASLab will continue to evolve, tracking the latest developments in the field, and invite contributions from the broader open-source community.

Rui Ye、Keduan Huang、Qimin Wu、Yuzhu Cai、Tian Jin、Xianghe Pang、Xiangrui Liu、Jiaqi Su、Chen Qian、Bohan Tang、Kaiqu Liang、Jiaao Chen、Yue Hu、Zhenfei Yin、Rongye Shi、Bo An、Yang Gao、Wenjun Wu、Lei Bai、Siheng Chen

计算技术、计算机技术

Rui Ye,Keduan Huang,Qimin Wu,Yuzhu Cai,Tian Jin,Xianghe Pang,Xiangrui Liu,Jiaqi Su,Chen Qian,Bohan Tang,Kaiqu Liang,Jiaao Chen,Yue Hu,Zhenfei Yin,Rongye Shi,Bo An,Yang Gao,Wenjun Wu,Lei Bai,Siheng Chen.MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems[EB/OL].(2025-05-22)[2025-08-02].https://arxiv.org/abs/2505.16988.点此复制

评论