HPC海量存储系统Pass-Through访问策略研究  

An Access Pass-Through Policy of Storage Unit Under HPC Mass Storage System

作　　者：朱平[1,2] 

机构地区：[1]哈尔滨工业大学计算机科学与技术学院,哈尔滨150001 [2]江南计算技术研究所,江苏无锡214083

出　　处：《计算机研究与发展》2013年第8期1667-1673,共7页Journal of Computer Research and Development

基　　金：国家"八六三"高技术研究发展计划基金项目(2009AA01A402)

摘　　要：为了解决海量信息处理中实时访问中的"I/O墙"的问题,提高海量信息分布式存储系统的性能,提出了一种基于高性能计算(high performance computing,HPC)的存储部件新型访问策略.首先,分析传统访问模型存在的问题;其次,研究存储部件直通路模式的工作机理,建立存储系统分解为多层次、分布式的模型,根据不同的层次和映射策略实现存储空间物理地址、缓存地址、存储系统逻辑空间地址的连续映射;第三,分析直通路访问模式下的存储路径时间开销;第四,在模拟环境下存储部件访问的性能测试,在实际采用该策略的应用系统中进行验证.通过验证测试结果表明,该方法能有效提高存储系统的性能,能够不断满足海量信息处理实时需要.To solve the ＂I/O wall＂ problem in the case of real-time accessing about mass information processing and improve the performance of distributed mass storage systems, an access policy based on storage unit pass-through is proposed. Firstly we analyse the problem of traditional access models. Then we study the mechanism of pass-through pattern, and build the model whieh divides the storage system into multi-level, distributed storage system. Next, the continuous mapping of physical address, cache address of storage space and logical space address of storage system is realized depending on the different levels and mapping strategies. Thirdly we analyse the time consuming of pass-through storage path in pass-through pattern. Fourthly we test the performance of the storage unit in the simulated environment, and validate the application system which employs the strategies. The validated results show that the method can improve the performance of storage system effectively, and can meet the needs of real time accessing about massive information proeessing in the ubiquitous network architecture.

关 键 词：高性能计算 海量存储系统 存储部件直通路 存储层次映射 存储策略 

分 类 号：TP333[自动化与计算机技术—计算机系统结构]