基于图像的航天业务软件Web UI自动化测试方法  

Image-Based Web UI Automated Testing Methods for Aerospace Business Software

作　　者：彭飞 王建[1] 寇超 田芳 PENG Fei;WANG Jian;KOU Chao;TIAN Fang(Xichang Satellite Launch Center,Xichang 615000,China)

机构地区：[1]西昌卫星发射中心,四川西昌615000

出　　处：《测控技术》2024年第9期21-27,共7页Measurement & Control Technology

摘　　要：当前航天业务繁重,如何高效准确地完成相关软件的测试尤为重要。设计了一种基于图像的航天业务软件Web UI自动化测试方法。该方法以用户视角进行自动化测试,使用YOLOv8模型检测被测Web软件截图,识别出表格、折线图和导航按键(包括导航菜单、面包屑、按钮等按键)3类网页元素。之后利用Selenium工具自动测试导航按键元素的可访问性,使用文字识别技术PaddleOCR、结构相似性(Structural Similarity, SSIM)指数算法分别测试表格元素和折线图元素信息的正确性,并生成测试报告。该方法可移植性好,能够自动为Selenium提供元素定位,改善Selenium脚本易失效的问题,并且可以自动检查图表数据的正确性。实验结果表明,该方法能够覆盖90%的测试用例,可检测具体错误位置和相关信息,显著减少了手动测试工作量,提高了测试效率。Currently aerospace bisnesses are heavy,how to accomplish the testing of related software efficiently and accurately become particularly important.An image-based Web UI automated testing method for aerospace business software is designed.This method conducts automated testing from the user's perspective,and uses YOLOv8 model to detect the screenshot of tested web software page,and identifies three types of elements:ta-bles,line charts,and navigation buttons(including navigation menus,breadcrumbs,buttons,etc.).Then,Sele-nium is used to automatically test the accessibility of navigation button elements,and the text recognition tech-nology named PaddleOCR and Structural Similarity(SSIM)algorithm is used to test the accuracy of information for table elements and line chart elements respectively,and a test report is formed.This method is easy to port-able,it can provide the localization of elements for Selenium automatically and improve the issue that Selenium scripts are prone failure,and check the correctness of chart data automatically.Experimental results show that this method can cover 90%of the test cases,detect the location and information of errors clearly and reduce the workload of manual testing significantly and improve the testing efficiency.

关 键 词：Web UI自动化测试 YOLOv8算法 结构相似性算法 PaddleOCR SELENIUM 

分 类 号：TP206[自动化与计算机技术—检测技术与自动化装置]