基于非易失性存储器的存储引擎性能优化  

Performance Optimization of Storage Engine Based on Non-Volatile Memory

作　　者：王海涛[1,2,3] 李战怀[1,2,3] 张晓 赵晓南[1,2,3] WANG Haitao;LI Zhanhuai;ZHANG Xiao;ZHAO Xiaonan(School of Computer Science,Northwestern Polytechnical University,Xi’an 710129,China;Key Laboratory of Big Data Storage and Management,Ministry of Industry and Information Technology,Northwestern Polytechnical University,Xi’an 710129,China;National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology,Xi’an 710072,China)

机构地区：[1]西北工业大学计算机学院,西安710129 [2]西北工业大学大数据存储与管理工业和信息化部重点实验室,西安710129 [3]空天地海一体化大数据应用技术国家工程实验室,西安710072

出　　处：《集成技术》2022年第3期56-70,共15页Journal of Integration Technology

基　　金：国家重点研发计划项目(2018YFB1004401);国家自然科学基金青年项目(61502392);北京市自然科学基金-海淀原始创新联合基金项目(L192027);陕西省重点产业链项目(2021ZDLGY03-02,2021ZDLGY03-08);国家自然科学基金重大集成项目(92152301)。

摘　　要：非易失性存储器具有接近内存的读写速度,可利用其替换传统的存储设备,从而提升存储引擎的性能。但是,传统的存储引擎通常使用通用块接口读写数据,导致了较长的I/O软件栈,增加了软件层的读写延迟,进而限制了非易失性存储器的性能优势。针对这一问题,该文以Ceph大数据存储系统为基础,研究设计了基于非易失性存储器的新型存储引擎NVMStore,通过内存映射的方式访问存储设备,根据非易失性存储器的字节可寻址和数据持久化特性,优化数据读写流程,从而减小数据写放大以及软件栈的开销。实验结果表明,与使用非易失性存储器的传统存储引擎相比,NVMStore能够显著提升Ceph的小块数据读写性能。Non-volatile memory has a read/write speed that is comparable to dynamic random access memory and can be used to replace traditional storage devices to improve the performance of storage engines.However, existing storage engines typically use generic block interfaces to access devices, resulting in a long I/O software stack, increasing read/write latency at software layers, thereby limiting the performance benefits of non-volatile memory. To solve this problem, this paper proposes a new storage engine, named NVMStore,which is based on non-volatile memory and the Ceph big-data storage system platform. NVMStore accesses storage devices through memory mapping and optimizes data read/write processes according to byteaddressability and data persistence characteristics of non-volatile memory, thus reducing the data write amplification and software stack overhead. Experimental results on real non-volatile memory devices show that NVMStore can significantly improve the performance of Ceph when dealing with small block data read/write workloads, compared with traditional storage engines using non-volatile memory.

关 键 词：非易失性存储器 存储引擎 软件栈 性能优化 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]