NVMe在气象大数据分布式存储中的研究与应用  

Research and application of NVMe in distributed storage of meteorological big data

作　　者：陈旭辉[1] 刘洋 高鹏 徐娟[1] Chen Xuhui;Liu Yang;Gao Peng;Xu Juan(Gansu Meteorological Information and Equipment Technical Support Center,Lanzhou 730020)

机构地区：[1]甘肃省气象信息与技术装备保障中心,兰州730020

出　　处：《气象水文海洋仪器》2021年第4期12-15,共4页Meteorological,Hydrological and Marine Instruments

基　　金：2019年甘肃省雷达数据共享平台省级信息基础设施建设项目(GC-HG4190824)资助.

摘　　要：文章利用fio测试工具,对甘肃省气象局气象大数据云平台中的NVMe固态盘及软件RAID等性能进行了详细研究,结果表明,NVMe固态盘软件RAID0适合构建分布式存储,可以满足数据中心存储高性能、高可靠及低延迟的需求,软件RAID5性能损耗太大,不建议使用;同时,结果显示使用XFS文件系统时NVMe固态盘性能最佳;此外,在使用none调度器时NVMe固态盘性能发挥更充分;最后,Linux高版本内核可以更好地支持NVMe,使NVMe固态盘在较少的CPU下发挥出较高的性能。By using fio test tool,this paper studies the performance of NVMe solid-state disk and software RAID in the meteorological big data cloud platform of Gansu meteorological bureau in detail.The results show that the NVMe solid-state disk software RAID0 is suitable for constructing distributed storage,which can meet the requirements of high performance,high reliability and low latency of data center storage.And the software RAID5 has too much performance loss and is not recommended to use.At the same time,the results show that NVMe solid state disk performs best when using XFS file system.In addition,NVMe solid-state drives perform better with the none scheduler.Finally,it can be seen that high-version Linux kernels can better support NVMe,which allows NVMe SSD to achieve higher performance with fewer CPUs.

关 键 词：NVMe固态盘 分布式存储 大数据 文件系统 性能 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]