多目标优化的测试用例优先级在线调整策略  

Multi-Objective Optimization Based On-Line Adjustment Strategy of Test Case Prioritization

作　　者：张娜[1] 姚澜[2] 包晓安[1] 董萌[1] 桂宁[1,3] 

机构地区：[1]浙江理工大学信息学院,浙江杭州310018 [2]中国电子科技集团第五十二研究所,浙江杭州310013 [3]Distrinet Laboratory, University of Leuven

出　　处：《软件学报》2015年第10期2451-2464,共14页Journal of Software

基　　金：国家自然科学基金(61502430;61379036);浙江省自然科学基金(LY12F02041;Y13F020175);浙江省人才计划(2013 R10015;2013R1029);浙江理工大学521人才培养计划

摘　　要：从需求的角度对测试用例的优先级进行排序,定义了一个多目标的测试用例优化排序问题,引入关注需求覆盖率、测试用例重要度和测试用例失效率这3个测试用例优先级影响因子,分别定义权重因子?,?,?用于权衡3个因子.设计了关注需求覆盖率和测试用例失效率的在线估计方法及算法,在此基础上,设计了一种基于多目标优化的测试用例优先级在线调整策略,该策略可利用测试过程中收集到的反馈信息,对测试用例优先级进行在线调整,实现在尽早达到测试覆盖率标准的同时,尽早覆盖重要的和具有较高失效率的测试需求,从而解决尽早检测到更多的、严重等级较高的软件缺陷这一多目标测试用例优化问题.实验结果表明:与随机测试、传统的单目标优先级排序方法和确定性排序方法相比,所提出的策略能够在更短的时间内完成同等质量的软件测试,从而提高了测试效率.In order to properly rank the priority of test cases from the requirement＇s perspective, this paper introduces three impact factors： Concerned-Requirements coverage, test case importance degree and test case failure rate. Meanwhile, three weight factors α, β and γ are introduced to balance the three impact factors. This paper designs on-line estimating methods and algorithms based on the concerned-requirements coverage and the test case failure rate. Based on those metrics, a multi-objective optimization based test case prioritization on-line adjustment strategy is developed. The strategy is able to adjust the priorities of test cases dynamically using the feedback information collected in the test process, and thus can meet the coverage criteria earlier and cover test cases of importance and high failure rate. This strategy can also resolve the multi-object test case prioritization problem by detecting more severe bugs earlier. Experimental results show that, compared with random test, the traditional single-object test and the test with deterministic test case prioritization, the presented strategy can complete the test with equal quality by shorter time, thus improves the testing efficiency.

关 键 词：测试用例优先级 关注需求覆盖 测试用例重要度 测试用例失效率 测试用例在线调整策略 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]