融合文献计量与同行评议共识的期刊评价方法研究  

Journal Evaluation Method Based on the Integration of Peer-Review Consensus and Bibliometric Indicators

作　　者：张旭 吕冬晴 阮选敏 成颖[1] 鞠秀芳 Zhang Xu;Lyu Dongqing;Ruan Xuanmin;Cheng Ying;Ju Xiufang(School of Information Management,Nanjing University,Nanjing 210023;Chinese Social Sciences Research Evaluation Center,Nanjing University,Nanjing 210093)

机构地区：[1]南京大学信息管理学院,南京210023 [2]南京大学中国社会科学研究评价中心,南京210093

出　　处：《情报学报》2022年第5期486-496,共11页Journal of the China Society for Scientific and Technical Information

基　　金：国家社会科学基金项目“学术文献颠覆性创新评价的理论及实证研究”(20BTQ086)。

摘　　要：针对当前期刊评价研究与实践中存在的定性与定量融合不足的问题,本研究将学科/领域同行对一流期刊的共识作为评价出发点,借助TrustRank算法,提出了融合同行评议共识与文献计量方法的期刊权威性因子JAF(journal authoritativeness factor),并进一步整合JAF与JIF(journal impact factor)提出了融合指标JAII(journal authoritativeness and impact index),用于进行期刊双维度评价。为验证JAF与JAII的有效性,本研究选取FMS(Federation of Management Societies of China)管理科学领域推荐的期刊作为评价对象,采用CSSCI(Chinese Social Sciences Citation Index)数据库2000—2018年的引文数据进行实证分析。结果表明,JAF对引文时间窗口具有稳健性;与两种基线指标相比,JAF与FMS的结果更加一致;JAF与JIF的融合指标JAII与FMS的相关性高达0.716。Current research on journal evaluation lacks in-depth consideration about integrating qualitative and quantitative methods.This study takes advantage of the consensus of peer review among first-rate journals and proposes a new indicator,Journal Authoritativeness Factor(JAF),by integrating peer-review consensus and bibliometric indicators with the help of TrustRank.We also introduce the Journal Authoritativeness and Impact Index(JAII)by combining JAF and Journal Impact Factor(JIF).To verify the effectiveness of JAF and JAII,this study conducts empirical research by selecting journals recommended by the Federation of Management Societies of China(FMS)as the“gold standard”and citation data from 2000 to 2018 in the Chinese Social Sciences Citation Index(CSSCI)database as evaluation data.Results show that JAF is robust among different citation windows.Compared with the two baseline indicators,the ranking of journals by JAF and by FMS are more consistent,with the correlation between the journal ranking of JAII and FMS being as high as0.716.

关 键 词：TrustRank PAGERANK 期刊影响因子 指标融合 

分 类 号：G353.1[文化科学—情报学]