面向内存表的可动态配置预写日志框架  

Dynamic Configurable Write-Ahead Logging Framework for Memory Table

作　　者：朱海铭 黄向东[1,2] 乔嘉林 王建民 ZHU Haiming;HUANG Xiangdong;QIAO Jialin;WANG Jianmin(School of Software,Tsinghua University,Beijing 100084,China;National Engineering Laboratory of Big Data System Software,Beijing 100084,China)

机构地区：[1]清华大学软件学院,北京100084 [2]大数据系统软件国家工程研究中心,北京100084

出　　处：《计算机科学与探索》2023年第11期2777-2783,共7页Journal of Frontiers of Computer Science and Technology

基　　金：国家重点研发计划(2021YFB3300500);国家自然科学基金(62021002,62232005);预研项目(31511130201)。

摘　　要：通常情况下,NoSQL数据库管理系统启动后,其多个数据库或数据分区的预写日志(WAL)会固定地写入一个或多个日志文件,因而形成强耦合的对应关系。由于数据库逻辑模型与分区配置是由应用业务和计算环境所决定的,在预写日志被强耦合的情况下,数据库管理系统无法对预写日志的个数、大小等进行配置以实现性能调优。针对该问题,提出了一种面向内存表的可动态配置预写日志框架,该框架记录了重写日志,内存表可以动态地被分配给不同的预写日志队列,支持可变的对应关系,实现了预写日志与具体应用之间的解耦。在物联网时序数据库Apache IoTDB上实现了该框架,并进行了相关实验,结果表明使用可动态配置预写日志框架后可以找到比强耦合的预写日志更优的配置方案,写入性能可提高8%~19%,说明该框架能针对不同计算环境和应用负载实现动态性能调优。Normally,the NoSQL database management systems’databases or data partitions fixedly write their write-ahead logging(WAL)into one or more log files after they are started up,forming a strong-coupled relationship.Since the database logical model and partition configuration are determined by the application business and computing environments,with the write-ahead logging tightly coupled,the database management systems cannot optimize performance via simply configuring parameters such as the number and size of the write-ahead logging.In response to this problem,this paper proposes a dynamic configurable write-ahead logging framework for memory table.This framework records Redo log,and memory tables can be dynamically allocated to different write-ahead logging queues,supporting mutable relationship and decoupling write-ahead logging and applications.This paper implements this framework on the time series database Apache IoTDB,and relevant experiments are conducted.Experimental results show that,compared with strong-coupled write-ahead logging,this dynamic configurable writeahead logging framework can find a better configuration and improve the write performance by 8%to 19%,indicating that this framework can achieve dynamic performance tuning for different computing environments and application loads.

关 键 词：预写日志(WAL) 重写日志 日志结构合并树(LSM) 时序数据库 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]