GekkoFS—A Temporary Burst Buffer File System for HPC Applications  

作　　者：Marc-AndréVef Nafiseh Moti Tim Süβ Markus Tacke Tommaso Tocci Ramon Nou Alberto Miranda Toni Cortes AndréBrinkmann 

机构地区：[1]Zentrum für Datenverarbeitung,Johannes Gutenberg University Mainz,Mainz 55128,Germany [2]Barcelona Supercomputing Center,Barcelona 08034,Spain [3]Computer Architecture Department,Universitat Politècnica de Catalunya,Barcelona 08034,Spain

出　　处：《Journal of Computer Science & Technology》2020年第1期72-91,共20页计算机科学技术学报（英文版）

基　　金：This work has been funded by the German Research Foundation(DFG)through the Priority Programme 1648"Software for Exascale Computing"and the ADA-FS project;also partially supported by the Spanish Ministry of Science and Innovation under Grant No.TIN2015-65316;the Generalitat de Catalunya under Contract 2014-SGR-1051;as well as the European Union's Horizon 2020 Research and Innovation Programme,under Grant Agreement No.671951(NEXTGenIO).

摘　　要：Many scientific fields increasingly use high-performance computing(HPC)to process and analyze massive amounts of experimental data while storage systems in today's HPC environments have to cope with new access patterns.These patterns include many metadata operations,small I/O requests,or randomized file I/O,while general-purpose parallel file systems have been optimized for sequential shared access to large files.Burst buffer file systems create a separate file system that applications can use to store temporary data.They aggregate node-local storage available within the compute nodes or use dedicated SSD clusters and offer a peak bandwidth higher than that of the backend parallel file system without interfering with it.However,burst buffer file systems typically offer many features that a scientific application,running in isolation for a limited amount of time,does not require.We present GekkoFS,a temporary,highly-scalable file system which has been specifically optimized for the aforementioned use cases.GekkoFS provides relaxed POSIX semantics which only offers features which are actually required by most(not all)applications.GekkoFS is,therefore,able to provide scalable I/O performance and reaches millions of metadata operations already for a small number of nodes,significantly outperforming the capabilities of common parallel file systems.

关 键 词：distributed file SYSTEM high-performance computing(HPC) BURST BUFFER POSIX(portable operating SYSTEM interface) 

分 类 号：TP31[自动化与计算机技术—计算机软件与理论]