气象数据归档元数据索引重组织的并行算法设计与验证  

Design and verification of parallel algorithm of metadata index re-organization for meteorological data archiving

作　　者：许婧[1] 任开军[2] 

机构地区：[1]国防科学技术大学计算机学院,湖南长沙410073 [2]国防科学技术大学海洋科学与工程研究院,湖南长沙410073

出　　处：《计算机工程与科学》2016年第6期1078-1085,共8页Computer Engineering & Science

基　　金：公益性行业(气象)科研专项(GYHY201306003)

摘　　要：气象资料归档和检索系统(MARS)实现了气象科学数据包括数值预报产品的归档和检索管理。但是,随着精细化数值预报技术的提高,MARS系统管理的气象科学数据呈海量增长趋势,对归档和检索处理技术提出了新的挑战。针对MARS系统归档操作时物理视图元数据索引结构串行更新效率低的问题,提出一种并行处理更新方法。该方法能够有效降低数据归档时物理索引结构再组织的系统开销。实验表明,相比原始的串行更新算法,采用索引结构并行更新的处理方法,使系统物理视图元数据索引结构的最大更新效率平均提高3倍左右,从而提高了气象科学数据快速归档效率。Meteorological archival and retrieval system （MARS） enables archival and retrieval man- agement for meteorological data, including many numerical prediction products. However, with the refinement of numerical forecasting techniques, the data under the MARS management is soaring in a mas- sive growing trend, which presents a new challenge to archival and retrieval techniques. As an archival issue in the physical view of MARS, the metadata index currently has very low update efficiency. To address the problem, we propose a parallel approach to accelerate index update speed, which reduces the index reorganizing overhead during data archiving time. Experimental results show that compared with the original serial one, our parallel approach accelerates the maximum update speed by 3 times on aver- age, hence improving the efficiency of meteorological data archiving.

关 键 词：气象资料归档和检索系统 物理索引结构 并行更新 快速归档 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]