基于MPI的大规模遥感影像金字塔并行构建方法  

An MPI-based Parallel Pyramid Building Algorithm for Large-scale RS Image

作　　者：赫高进 熊伟[1] 陈荦[1] 吴秋云[1] 景宁[1] 

机构地区：[1]国防科学技术大学电子科学与工程学院,长沙410073

出　　处：《地球信息科学学报》2015年第5期515-522,共8页Journal of Geo-information Science

基　　金：国家高技术研究发展计划("863"计划)项目"面向新型硬件架构的复杂地理计算平台"(2011AA120300);国家自然科学基金项目"集群环境下内存空间数据库管理与查询技术研究"(41471321)

摘　　要：影像金字塔是实现影像数据多分辨率组织的重要方式,是提高影像可视化性能的有效手段。传统串行金字塔构建算法,对大规模影像数据的构建性能已无法满足遥感影像快速浏览的预处理需求。故此,其成为一个亟待解决的问题,而利用多核、多节点的高性能集群计算环境和并行机制是一个重要的技术途径。本文在共享外存的高性能集群环境下,提出使用消息传递接口(MPI)的金字塔并行构建算法,对构建遥感影像金字塔过程中的重采样与I/O过程进行并行处理,大大缩短了遥感影像金字塔构建时间。实验结果表明:(1)该算法比传统串行构建方法的加速效果明显,对于单波段遥感影像,其加速效果可达到GDAL的5倍以上,而对于多波段遥感影像,加速效果可达到GDAL的2倍以上;(2)遥感影像数据量越大,并行构建算法加速效果越显著,对于大规模的遥感影像,本文提出的金字塔并行构建算法的速度可达到GDAL的10倍左右。With the rapid development of remote sensing （RS） image acquisition and processing technology, the spatial resolution and temporal resolution of RS image have been greatly improved. For large-scale RS image, traditional sequential pyramid building algorithms have been found difficult to meet the quick browsing require- ments. Technologies and facilities of high performance computing have become more and more feasible to re- searchers. Taking the advantages of multi-core, multi-node cluster computing environments and parallel process- ing mechanism is turning to be an inevitable trend. Some of recent works explore the efficiency and flexibility of parallel pyramid building methods. However, these methods all have deficiencies. For example, GPU-based par- allel method is hardware-aware, the improvement of its performance is limited on a single node, and the system architecture will be too complicated when applied in a cluster environment. Whereas the distributed cluster- based method requires the data to be distributed to be stored in different nodes, and the complete pyramid file needs to be merged, which is excessive time consuming. Therefore, using the high-performance disk-shared clus- ter is an alternative mechanism for achieving the parallel building pyramid of large-scale RS images. In this pa- per, we proposed a parallel algorithm based on Message Passing Interface （MPI）. Based on this, the whole pyra- mid building task is decomposed into several subtasks. The result of each subtask can be written to the same pyr- amid file simultaneously by incorporating MPI/IO. The algorithm can greatly improve the performance of pyra- mid building through parallel resampling and parallel I/O. Specially, with regard to the multi-band pyramid file stored in BIP format, a parallel I/O strategy using file view was proposed to improve the performance of parallel writing. Experimental results show that our algorithm has better acceleration effect compared to the sequential method, and there is a positive correlation be

关 键 词：遥感影像金字塔 消息传递接口 并行 集群 

分 类 号：P237[天文地球—摄影测量与遥感] TP751[天文地球—测绘科学与技术]