What Are They Talking About？ Analyzing Code Reviews in Pull-Based Development Model  

作　　者：Zhi-Xing Li Yue Yu Gang Yin Tao Wang Huai-Min Wang 

机构地区：[1]College of Computer, National University of Defense Technology, Changsha 410073, China

出　　处：《Journal of Computer Science & Technology》2017年第6期1060-1075,共16页计算机科学技术学报（英文版）

基　　金：This work was supported by the National Key Research and Development Program of China under Grant No. 2016YFB1000805 and the National Natural Science Foundation of China under Grant Nos. 61432020, 61303064, 61472430 and 61502512.

摘　　要：Code reviews in pull-based model are open to community users on GitHub. Various participants are taking part in the review discussions and the review topics are not only about the improvement of code contributions but also about project evolution and social interaction. A comprehensive understanding of the review topics in pull-based model would be useful to better organize the code review process and optimize review tasks such as reviewer recommendation and pull-request prioritization. In this paper, we first conduct a qualitative study on three popular open-source software projects hosted on GitHub and construct a fine-grained two-level taxonomy covering four level-1 categories （code correctness, pull- request decision-making, project management, and social interaction） and 11 level-2 subcategories （e.g., defect detecting, reviewer assigning, contribution encouraging）. Second, we conduct preliminary quantitative analysis on a large set of review comments that were labeled by TSHC （a two-stage hybrid classification algorithm）, which is able to automatically classify review comments by combining rule-based and machine-learning techniques. Through the quantitative study, we explore the typical review patterns. We find that the three projects present similar comments distribution on each subeategory. Pull-requests submitted by inexperienced contributors tend to contain potential issues even though they have passed the tests. Furthermore, external contributors are more likely to break project conventions in their early contributions.Code reviews in pull-based model are open to community users on GitHub. Various participants are taking part in the review discussions and the review topics are not only about the improvement of code contributions but also about project evolution and social interaction. A comprehensive understanding of the review topics in pull-based model would be useful to better organize the code review process and optimize review tasks such as reviewer recommendation and pull-request prioritization. In this paper, we first conduct a qualitative study on three popular open-source software projects hosted on GitHub and construct a fine-grained two-level taxonomy covering four level-1 categories （code correctness, pull- request decision-making, project management, and social interaction） and 11 level-2 subcategories （e.g., defect detecting, reviewer assigning, contribution encouraging）. Second, we conduct preliminary quantitative analysis on a large set of review comments that were labeled by TSHC （a two-stage hybrid classification algorithm）, which is able to automatically classify review comments by combining rule-based and machine-learning techniques. Through the quantitative study, we explore the typical review patterns. We find that the three projects present similar comments distribution on each subeategory. Pull-requests submitted by inexperienced contributors tend to contain potential issues even though they have passed the tests. Furthermore, external contributors are more likely to break project conventions in their early contributions.

关 键 词：pull-request code review review comment 

分 类 号：TP0[自动化与计算机技术]