GVDS:面向广域高性能计算环境的虚拟数据空间  

GVDS:a global virtual data space for wide-area high-performance computing environments

作　　者：肖利民[1,2] 宋尧 秦广军 周汉杰 王超波 韦冰 魏巍 霍志胜 XIAO Limin;SONG Yao;QIN Guangjun;ZHOU Hanjie;WANG Chaobo;WEI Bing;WEI Wei;HUO Zhisheng(School of Computer Science and Engineering,Beihang University,Beijing 100191,China;State Key Laboratory of Software Development Environment,Beijing 100191,China;Smart City College,Beijing Union University,Beijing 100101,China;School of Computer Science and Engineering,Xi’an University of Technology,Xi’an 710048,China)

机构地区：[1]北京航空航天大学计算机学院,北京100191 [2]软件开发环境国家重点实验室,北京100191 [3]北京联合大学智慧城市学院,北京100101 [4]西安理工大学计算机科学与工程学院,陕西西安710048

出　　处：《大数据》2021年第2期123-146,共24页Big Data Research

基　　金：国家重点研发计划资助项目(No.2018YFB0203901)。

摘　　要：广域高性能计算环境是支撑科技创新和社会经济发展的核心信息基础设施。然而,在广域高性能计算环境中,异构存储资源在地理位置上的分散分布导致无法发挥广域存储资源的聚合效应,难以满足对广域分布数据的统一管理和高效访问需求。为此,提出了虚拟数据空间构建方法及数据访问性能优化方法,并实现了一个面向广域高性能计算环境的全局虚拟数据空间(GVDS)。GVDS可聚合广域分布的异构存储资源,形成统一的虚拟数据空间,有效支撑用户以统一访问模式高效访问广域分散的异构存储资源,实现广域环境中分布数据的跨域共享和协同处理。测试结果表明,与国际领先的面向广域高性能计算环境的OneData、GFFS等存储系统相比,GVDS实现了相当的功能,且数据访问性能明显提升。The wide-area high-performance computing environment is the core information infrastructure to support technology innovation,economic development,and national defense.However,heterogeneous storage resources are geographically distributed in wide-area high-performance computing environments,resulting in the barriers between applications and data.The requirements of unified data management and efficient data access cannot be met.A method of establishing virtual data space and a data access optimization method was presented,and a global virtual data space(GVDS)for wide-area high-performance computing environments to satisfy the requirements was implemented.GVDS aggregates geographically distributed and heterogeneous storage resources,creating a unified virtual data space to provide unified and efficient data access.Sharing and collaborative processing of geographically distributed data were achieved in widearea environments.The experimental results indicate that compared with the state-of-the-art wide-area storage system in the field of high-performance computing,such as OneData and GFFS,GVDS has similar functions and improves the read bandwidth significantly.

关 键 词：全局虚拟数据空间 广域高性能计算环境 高效数据访问 异构存储资源 

分 类 号：TP316[自动化与计算机技术—计算机软件与理论]