基于纠删码的HDFS存储方案  

HDFS Storage Solutions Based on Erasure Codes

作　　者：卞艺杰[1] 马瑞敏[1] 李亚冰[1] 吴慧[1] 

机构地区：[1]河海大学商学院,南京211100

出　　处：《计算机系统应用》2014年第11期208-213,共6页Computer Systems & Applications

摘　　要：HDFS文件系统通过多副本备份的方式解决数据损坏或丢失的问题,但是随着存储系统内容增多,在数据量级很大的时候,这种容灾方案消耗的额外存储空间是实际存储内容的数倍,不利于系统资源长期积累.文章提出使用纠删码编/解码文件代替HDFS的副本备份容灾策略,在保证数据安全性的前提下大大提高了存储空间利用率,降低存储额外消耗.Through the multiple-backup strategy HDFS can restore data easily when data is damaged or missed. However, the data stored in system increases all the time. When the data scale has become very big, the strategy will need several times of storage space to store the backup data. This article proposes to use erasure codes to replace the multiple-backup strategy, which can greatly improve the storage efficiency and reduce extra storage expend.

关 键 词：纠删码 副本备份容灾 

分 类 号：TP333[自动化与计算机技术—计算机系统结构]