When a Paper Has 1000 Authors: Rethinking Citation Metrics in the Era of LLMs
When a Paper Has 1000 Authors: Rethinking Citation Metrics in the Era of LLMs
Author-level citation metrics provide a practical, interpretable, and scalable signal of scholarly influence in a complex research ecosystem. It has been widely used as a proxy in hiring decisions. However, the past five years have seen the rapid emergence of large-scale publications in the field of large language models and foundation models, with papers featuring hundreds to thousands of co-authors and receiving tens of thousands of citations within months. For example, Gemini has 1361 authors and has been cited around 4600 times in 19 months. In such cases, traditional metrics, such as total citation count and the $h$-index, fail to meaningfully distinguish individual contributions. Therefore, we propose the following research question: How can one identify standout researchers among thousands of co-authors in large-scale LLM papers? This question is particularly important in scenarios such as academic hiring and funding decisions. In this paper, we introduce a novel citation metric designed to address this challenge by balancing contributions across large-scale and small-scale publications. We propose the SBCI index, analyze its theoretical properties, and evaluate its behavior on synthetic publication datasets. Our results demonstrate that the proposed metric provides a more robust and discriminative assessment of individual scholarly impact in the era of large-scale collaborations.
Weihang Guo、Zhao Song、Jiahao Zhang
信息科学、信息技术自然科学研究方法计算技术、计算机技术
Weihang Guo,Zhao Song,Jiahao Zhang.When a Paper Has 1000 Authors: Rethinking Citation Metrics in the Era of LLMs[EB/OL].(2025-08-08)[2025-08-24].https://arxiv.org/abs/2508.06004.点此复制
评论