基于图像匹配的Web UI自动测试方法研究  

Research on Web UI Automated Testing Method Based on Image Matching

作　　者：罗正军[1] 金旭东 张丽丽[1] LUO Zheng-jun;JIN Xu-dong;ZHANG Li-li(Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China)

机构地区：[1]南京航空航天大学,江苏南京211106

出　　处：《计算机技术与发展》2022年第10期65-69,共5页Computer Technology and Development

基　　金：中央高校基本科研业务费专项资金资助(ND2021002)。

摘　　要：传统的Web UI自动化测试以底层调用为基础,其测试方法如文本验证法、页面元素验证法和窗口变化验证法等,存在着图片、动态元素和元素样式无法测试和测试结果不够全面等问题,代码迁移成本高,用例覆盖度低。图像匹配技术可以有效避开网页底层结构设计,以用户视角进行UI测试。该文将图像匹配技术引入Web UI自动化测试进行方法研究,测试Web UI是否存在元素样式错乱和内容显示错误等现象。使用了基于特征点匹配的改进型SURF(Speeded Up Robust Features,加速鲁棒特性)算法作为方法设计验证主体,并结合了RANSAC(Random Sample Consensus,随机采样一致)算法优化特征点对,降低SURF算法中误差匹配和错误匹配的发生概率。在此基础上还利用了基于模板匹配的SSDA(Sequential Similarity Detection Algorithm,序贯相似性检测算法)完成误匹配图片集的辅助验证。在实验中,验证了所设计的图像匹配综合测试方法在Web UI自动化测试中的有效性,并且与传统方法相比具有一定的优势。Traditional Web UI automated testing is based on low-level call.Testing methods include text verification,page element verification and window change verification.There are problems such as inability to test pictures,dynamic elements and element styles,and insufficient test results.The code migration cost is high,and the use case coverage is low.However,image matching technology can avoid the design of the underlying structure of Web pages and conduct UI testing from the perspective of users.In this paper,image matching technology is introduced into Web UI automation testing method research,testing whether there are elements style disorder and content display errors and other phenomena.SURF(Speeded Up Robust Features)based on feature point matching is used as the main body of method design and verification,and RANSAC(Random Sample Consensus)is combined to optimize feature point pairs to reduce the probability of error matching and error matching in SURF.On this basis,the SSDA(Sequential Similarity Detection Algorithm)based on template matching is used to complete the auxiliary verification of mismatched image sets.In the experiment,the effectiveness of the proposed integrated test method for image matching in Web UI automation test is verified,and it has certain advantages compared with the traditional method.

关 键 词：Web UI 自动化测试 图像匹配 SURF SSDA 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]