ShadowDB:基于SQL引擎的全链路压力测试分流系统  

ShadowDB:A SQL engine based traffic-split system for full-link stress test

作　　者：姜俊 李文慧 张亮 王善民 李瑞远 JIANG Jun;LI Wen-hui;ZAHNG Liang;WANG Shan-min;LI Rui-yuan(College of Computer Science,Chongqing University,Chongqing 400044;SphereEx Laboratory,Beijing 100010,China)

机构地区：[1]重庆大学计算机学院,重庆400044 [2]思斐实验室,北京100010

出　　处：《计算机工程与科学》2023年第12期2165-2174,共10页Computer Engineering & Science

基　　金：国家自然科学基金(62202070);中国博士后科学基金(2022M720567)。

摘　　要：全链路压力测试作为一种新兴的软件测试技术,直接在生产系统中做压力测试,旨在准确评估线上环境的性能。基于影子库的数据分流技术能够保证全链路压力测试过程中生产数据不受测试污染。基于SQL引擎技术设计并实现了一套完整的针对全链路压力测试的开源数据分流系统ShadowDB,其基本思想是通过SQL解析、SQL路由对用户请求正确分流。ShadowDB目前支持6种关系型数据库系统中所有SQL语句的数据分流;提出了2种数据分流算法:基于列的影子算法和基于Hint的影子算法;实现了所有JDBC的接口,允许线上应用程序无需修改代码即可使用ShadowDB;ShadowDB嵌入应用程序中,无需网络转发请求,对请求效率影响很小,保证了全链路压力测试结果的可靠性。使用2个通用的性能测试工具进行了大量的实验,结果表明ShadowDB的性能远远高于对比方案的。Full-link stress test,as an emerging software testing technique,performs stress tests in the production system directly.It aims at evaluating the performance of online systems accurately.Traffic-split techniques based on shadow databases can guarantee the production data not to be polluted during the process of full-link stress test.Based on SQL engine,this paper designs and implements a complete open-source traffic-split system,named ShadowDB,for full-link stress test.The main idea of ShadowDB is to split the traffic of user requests through a SQL parser and a SQL router.Currently,ShadowDB can correctly distribute all SQL statements of six different kinds of relational database management systems.Furthermore,it can support two traffic-split algorithms,i.e.,column-based shadow algorithm and hint-based shadow algorithm.ShadowDB implements all of the interfaces of JDBC,enabling online systems to incorporate it without any change.ShadowDB can be embedded in the application programs,thus it do not forward the requests through networks,which has the minimal impact on the request efficiency and guarantees the reliability of full-link stress test.Extensive experiments wire conducted based on two widely-used benchmarking tools.The experimental results show that ShadowDB performs much better than the comparing systems.

关 键 词：全链路压力测试 SQL引擎 数据分流 影子库 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]