大规模分布式文件系统元数据管理综述  

A Review on Metadata Management in Large-Scale Distributed File Systems

作　　者：王洋[1] 刘星[1] 须成忠[1,2] 江松[1,2] 王刚[1] 文韬[3] 范小朋 陆平[3] 

机构地区：[1]中国科学院深圳先进技术研究院云计算研究中心,深圳518055 [2]美国韦恩州立大学电子与计算机工程系,底特律48202 [3]中兴通讯股份有限公司,南京210012

出　　处：《集成技术》2016年第2期57-72,共16页Journal of Integration Technology

基　　金：科技部973计划(2015CB352400);国家自然科学基金(U1401258;61550110250)

摘　　要：文件系统的元数据主要是用来描述它的命名空间,访问权限和数据定位等信息的数据。由于50%-80%的文件系统访问要涉及到元数据,元数据服务的性能将极大地影响整个分布式文件系统的性能。为此,文章重点讨论元数据管理面临的问题,从元数据服务的高可扩展技术、高性能技术和高可用技术三个主要方向进行综述,重点分析了各自的主要问题以及目前发展起来的一些主流技术,同时对未来分布式文件系统的元数据管理一些值得关注的问题进行了梳理和展望,为相关研究提供一定的参考。Metadata of file systems is the data in charge of maintaining namespace, permission semantics and location of file data blocks. Metadata operations can account for up to 80% of total file system operations. As such, the performance of metadata services substantially impacts the overall performance of distributed file systems, especially with the advent of big data era, posing great pressure on the underlying storage systems. This paper reports the state-of-the-art research on the metadata services in large-scale distributed file systems. The study was conducted from three perspectives that are always used to characterize the file systems： high-scalability, high-performance and high-availability, with focus squarely on their respective major challenges as well as their developed mainstream technologies. Additionally, some existing problems in this research were also identified and analyzed, which could be used as a reference for related studies.

关 键 词：元数据 分布式文件系统 工作负载 高可扩展 高性能 高可用 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]