基于蜕变测试的面向用户搜索引擎性能分析  

User-oriented Performance Analysis of Search Engine Based on Metamorphic Test

作　　者：杨正龙 高建华[1] YANG Zhenglong;GAO Jianhua(Department of Computer Science and Technology,Shanghai Normal University,Shanghai 200234,China)

机构地区：[1]上海师范大学计算机科学与技术系

出　　处：《计算机工程》2019年第10期52-56,63,共6页Computer Engineering

基　　金：国家自然科学基金(61672355)

摘　　要：面对海量的互联网信息,用户在进行搜索时缺乏客观公认的Oracle验证搜索引擎所返回结果是否正确。为此,将蜕变测试应用于搜索引擎的性能测试。针对搜索引擎Baidu、Bing和360,结合搜索操作符定义相应的蜕变关系,对其检索能力和排序稳定性进行测试,并通过异常率和平均Jaccard系数量化测试结果。分析结果表明,在搜索引擎Baidu、Bing和360中,Bing的异常率最低,Baidu的排序稳定性最高,三者对于不同领域的关键词搜索表现相差不大,但对于不同语言搜索表现存在很大差别。该结果为不同领域用户在选择合适的搜索引擎时提供了参考,同时可帮助搜索引擎的开发人员发现和移除程序中的错误。Facing a large amount of Internet information,users lack an objective recognized Oracle to verify whether the results returned by the search engine are correct or not.Therefore,the metamorphic test is applied for search engine performance test.For search engines like Baidu,Bing and 360,the corresponding metamorphic relationship is defined by combining search operators.Their retrieval ability and sorting stability are tested,and the test results are quantified by abnormal rate and average Jaccard coefficient.Analysis results show that,among search engines Baidu,Bing and 360,Bing has the lowest abnormal rate and Baidu has the highest ranking stability.Meanwhile,Baidu,Bing and 360 have little difference in keyword search performance in different fields,but there are big differences in search performance of different languages.The results provide a reference for users of different domain when choosing the right search engine,and help search engine developers to find and remove errors in the program.

关 键 词：搜索引擎 蜕变测试 蜕变关系 Oracle问题 异常率 Jaccard系数 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]