高能物理环境中混合存储系统的设计与优化  

Design and Optimization of Hybrid Storage System in HEP Environment

作　　者：徐琪 程耀东[2] 陈刚[2] 

机构地区：[1]中国科学院大学物理科学学院,北京100049 [2]中国科学院高能物理研究所,北京100049

出　　处：《计算机科学》2017年第10期75-79,90,共6页Computer Science

基　　金：国家自然科学基金项目:高能物理实验的大规模离线数据存储技术研究(11575223);国家自然科学基金项目:基于SDN的高能物理云数据中心弹性网络关键技术研究与应用(11605224)资助;国家重点研发计划项目:科学大数据管理系统(2016YFB1000605)

摘　　要：高能物理是典型的数据密集型计算环境,数据处理包括模拟计算、重建计算以及物理分析。其中大文件计算占据较大比重,并且高能物理文件访问模式以跳读为主,因此大文件的高速访问成为整个系统性能的重要影响因素。首先剖析传统高能物理计算环境的典型架构及其文件访问模式的特点,介绍混合存储模式在高能物理计算环境中的优势,总结其数据访问方式的特点,对其各种读写方式进行数据测试;然后提出针对该环境的混合存储系统的部署设计和优化,使该环境下的数据读写性能得到明显提高;同时将成本因素考虑到系统设计中,实现了一个低成本高性能的存储系统。测试表明,混合存储系统在高能物理等大数据存储系统中具有高效的I/O性能。文中全面分析了影响其性能的各种因素,实现了最优化配置的低成本高性能混合存储系统,并对该系统的未来发展趋势进行了分析和展望。Computing in high energy physics（HEP）is a typical data-intensive application including simulation,reconstruction and physical analysis.Generally,the HEP experiment file is very big and the way of accessing to the files is usually skipping through large data blocks.Therefore,the performance of accessing to big files is one of decisive factors for the HEP computing system.Firstly,this paper analyzed the typical structure of the computing environment in high energy physics and the characters of accessing to files,introduced the advantages of hybrid storage system in high energy physics,summarized the characteristics of data access mode,evaluated the performance of different read/write mode,then proposed a new deployment model of hybrid storage system in high energy physics,which is proved to have higher I/O performance,at the same time the cost was considered to implement a high-performance system with low cost.The test result shows that the hybrid storage system has good performance in some fields such as HEP.Based on the analysis,it can help to get better I/O performance with lower price in High Energy Physics.At the last,the future of the hybrid storage system was analyzed.

关 键 词：海量存储系统 高能物理 混合存储系统 缓存 块设备 高性能计算 性价比 

分 类 号：TP399[自动化与计算机技术—计算机应用技术]