面向LICOM2的并行I/O优化  

Parallel I/O Optimization for High Resolution Ocean Model LICOM2

作　　者：季旭[1,2] 武海平[3] 邹寅隆 梁亚雄[1,2] 薛巍[1,2,3] 尹万旺[4] 林鹏飞 刘海龙 俞永强 

机构地区：[1]清华大学计算机科学与技术系,北京100084 [2]清华大学清华信息科学与技术国家实验室(筹),北京100084 [3]清华大学地球系统数值模拟教育部重点实验室,北京100084 [4]江南计算技术研究所,江苏无锡214083 [5]大气科学和地球流体力学数值模拟国家重点实验室,北京100029

出　　处：《科研信息化技术与应用》2014年第5期37-48,共12页E-science Technology & Application

基　　金：国家重点基础研究发展计划(973计划)(2010CB951903);国家自然科学基金(61361120098;51190101);中国科学院信息技术专项(XXH12503-02-02-03);清华大学实验室开放基金

摘　　要：全球变暖导致自然灾害频度和强度都有所增加,发展高精度地球系统模式,对防灾减灾、促进经济发展有重要意义。随模式分辨率提高,地球系统模式的I/O性能正逐渐成为制约模式可扩展性和计算效率的瓶颈。本文针对地球系统模式的I/O问题,以代表性的海洋环流模式LICOM2为研究对象,全面分析了地球系统模式的典型I/O特点,研究通用的高并发I/O技术。本文设计实现了LICOM2系统的ADIOS并行读写方案,都取得了显著的优化效果。LICOM2系统ADIOS优化在天河1A系统内网测试,在288-6480并行度下I/O时间占比均不到4%,在6480并行度下写带宽达8.46GB/s。本文通过在天河1A上的大量测试,对提高LICOM2系统的I/O性能做了进一步的研究,不同系统配置会对I/O性能有影响。With the global warming, natural disasters have happened more frequently and severely. It is critical to foster the research and development of the earth system model, which helps disaster prevention and economic development. As the forecast model requires higher resolution, the I/O performance has become the bottleneck of computation scalability and efifciency for the earth system model. We use the global ocean circulation model LICOM2 as a typical case, to comprehensively analyse its I/O features and ifnd out the high performance I/O techniques for the earth system model. We have implemented the parallel I/O modules of LICOM2 by using ADIOS, which has achieved good I/O performance improvement. The I/O time of LICOM2 based on ADIOS is no more than 4%of total time with 288-6480 cores on the Tianhe-1A system. Its write bandwidth is up to 8.46GB/s on 6480 cores. we have made large amounts of tests on the Tianhe-1A system to further research on improving the I/O performance, to ifnd out that different system settings have inlfuence on the I/O performance.

关 键 词：海洋环流模式 并行I/O优化 ADIOS 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]