不同学科标准化方法对于高校科研质量评价结果的影响研究  

The Impact of Different Field Normalization Methods on the Evaluation Results of Scientific Research Quality in Universities

作　　者：任元秋 王兴[1,2] 李杰[1,2] Ren Yuanqiu;Wang Xing;Li Jie(School of Information,Shanxi University of Finance&Economics,Taiyuan 030006;Financial Innovation and Big Data Statistical Analysis Laboratory,Shanxi University of Finance&Economics,Taiyuan 030006)

机构地区：[1]山西财经大学信息学院,太原030006 [2]山西财经大学金融创新与大数据统计分析实验室,太原030006

出　　处：《评价与管理》2022年第2期52-59,共8页Evaluation & Management

基　　金：山西省高等学校哲学社会科学研究项目“基于区块链技术的文化资源数字化建设及保护研究”(2021W058)。

摘　　要：[目的/意义]探究不同学科标准化方法对于我国高校科研质量评价结果的影响,为科研评价中标准化方法的选择提供客观依据。[方法/过程]本研究选取我国首批“双一流”建设高校137所和2020年软科世界大学学术排名(Shanghai Ranking’s Academic Ranking of World Universities,ARWU)发布的中国大学排名前100中的双非院校15所作为样本大学,在Essential Science Indicators(ESI)学科分类方案下分别比较经比均值法、比中位数法、Zscore法标准化处理后,上述高校论文影响力排名的变动情况。[结果/结论]当大学论文影响力表现为单篇论文标准分均值时,比中位数法下部分大学的排名结果相较其他两种标准化方法下的排名结果发生了较大改变;而当大学论文影响力表现为单篇论文标准分之和时,三种标准化方法下的大学排名结果虽然存在波动但变化较小,其敏感性低于单篇论文标准分求均值的方法下的结果。文章就研究结果对科研评价实践所给与的启示进行了讨论。[Purpose/Significance]Explore the impact of different discipline standardization methods on the evaluation results of scientific research quality in universities.Provide an objective basis for the selection of standardized methods in scientific research evaluation.[Method/Process]This study selects the first batch of 137 double first-class construction universities in China,and 15 dual-non-university institutions among the top 100 Chinese universities released by Shanghai Ranking's Academic Ranking of World Universities(ARWU)in 2020.Under the Essential Science Indicators(ESI)subject classification scheme,the changes in the above-mentioned university rankings were compared after the field normalization of the mean method,the median method,and the Z-score method.[Result/Conclusion]Based on the results of the two calculation methods for the overall influence of papers,when the overall influence of the paper collection is the average value of the influence of a single paper,the ranking changes of some universities under the median method are greater than that of the other two normalization methods.When the overall influence of the paper collection is the sum of the influence of a single paper,the results of the university rankings under the mean method,median method,and Z-score method fluctuate but the changes are small.Their sensitivity is lower than the results under the method of averaging the normalization scores of a single paper.This study also discusses the enlightenment given by the research results to the practice of scientific research evaluation.

关 键 词：学科标准化 标准化效果 引文分析 大学科研评价 

分 类 号：G644[文化科学—高等教育学]