|国家预印本平台
首页|基于响应面分析的国家预印本平台自组织同行评议参数设计

基于响应面分析的国家预印本平台自组织同行评议参数设计

Key Parameter Optimization Design of Self-organizing Peer Review in National Preprint Publishing Platform Based on Response Surface Analysis

中文摘要英文摘要

目的/ 意义]为保障国家预印本平台论文质量,需引入同行评议。近年来自组织同行评议逐渐受到关注。为达到国家预印本平台管理机构预期的性能表现,需要研究自组织同行评议关键参数优化设计。[方法/ 过程]以论文评议完成率渊CR冤、评议人任务分配均衡度渊TBD冤、论文平均评议时间渊A_r_time冤为自组织同行评议性能评价的3 个因变量,评议人休息时间、评议人拒审率、作者人数、评议资格比例4 个关键参数为自变量,对Box-Behnken 抽样设计得到数据进行响应面分析,得到性能评价因变量与关键参数自变量的量化表达关系式。[结果/ 结论]通过4 个关键参数自变量取值不同组合,国家预印本论文平台可以调整自组织同行评议的3 个性能参数表现,保障国家预印本平台发布论文平均质量。

Purpose/Significance] The National Preprint Publishing Platform of China had been put into operation by the end of 2022. Inorder to ensure the quality of papers posted on the Platform and encourage a large number of researchers to submit articles to thePlatform, it is necessary to introduce a paper quality assurance mechanism into the Platform. There are deficiencies in existing qualityassurance mechanism for a preprint publishing platform. Self-organizing peer review has gradually attracted attention in recent years. Inorder to achieve the performance expected by the management agency of the National Preprint Publishing Platform, it is necessary tostudy the optimization design of key parameters of self-organizing peer review. [Method/Process] Design-expert software has been usedfor Box Behnken experimental design. The number of papers submitted by authors within a year, the distribution of review time, and theparameters of article review time are randomly set. The total number of papers is calculated according to the parameters of Lotka's law,and is not included in the Box-Behnken experimental sampling. We selected four key parameters of rest time, rejection rate, number ofresearchers, and review qualification ratio as independent variables, took three levels for each variable, and used -1, 0, +1 for coding,representing three levels of low, medium, and high, respectively. The three dependent variables for self-organizing peer reviewperformance evaluation are the completion rate of paper review (CR), the balance of reviewer task allocation (TBD), and the averagereview time of the paper (A_r_time). A Box-Behnken experiment table was designed separately for each Lotka's law parameter, threerepeated experiments were conducted on each key parameter combination in the table, and the summary() function and mean() functionin R language were used to calculate the average performance indicators of each key parameter combination. Then, the response surfaceanalysis was carried out on the Box-Behnken sampling data, and the quantitative relationship expression between the dependent variableof performance evaluation and the independent variable of key parameters was obtained. [Results/Conclusions] The ratio of reviewqualifications and reviewer rest time have greater impact on the performance of self-organized peer review, especially the ratio of reviewqualifications is much more important than other three key parameters. By combining different values of key parameter independentvariables, the National Preprint Publishing Platform can achieve the expected self-organized peer review performance, ensuring theaverage quality of papers published by the Platform. In addition, because of our limited knowledge of computational resources, there isstill room for improvement in simulation accuracy. If equipped with more powerful computational resources, more precise simulationcalculation can be carried out based on the methods and parameters proposed in this paper.

王凌峰、王申鹏

DOI:10.13998/j.cnki.issn1002-1248.23-0303

计算技术、计算机技术自动化技术、自动化技术设备

国家预印本平台论文质量自组织同行评议Box-Behnken 设计响应面分析

National Pre-print Publishing Platformpaper qualityself-organizing peer reviewbox-behnken designresponse surface analysis

王凌峰,王申鹏.基于响应面分析的国家预印本平台自组织同行评议参数设计[EB/OL].(2024-04-03)[2025-08-18].https://chinaxiv.org/abs/202404.00099.点此复制

评论