一种广域网环境下的分布式冗余删除存储系统  

Distributed De-Duplication Storage Systems in Wide Area Networks

作　　者：尹玉冰[1] 孙竞[1] 余宏亮[1] 

机构地区：[1]清华大学高性能计算研究所,北京100084

出　　处：《中兴通讯技术》2010年第5期20-23,共4页ZTE Technology Journal

基　　金：国家重点基础研究发展("973")规划(2007CB311100)

摘　　要：分布式存储系统中存储了海量的数据,这些数据中存在着大量的冗余,将冗余数据删除技术应用到分布式存储系统当中,用来发现并去除数据中的冗余,可以有效地提高存储空间以及网络带宽利用率。文章设计并实现了广域网环境下的分布式冗余删除存储系统——Aegean Store。该系统在数据被上传之前将冗余数据去除,达到提高存储资源和网络资源利用率的目的,并且进一步地降低存储系统的成本,在保持分布式系统固有的容灾特性的同时,可提高存储系统的可扩展性和整体性能。The problem of redundancy often occurs in mass data stored in distributed storage systems. Greater efficiency in storage and network bandwidth utilization can be achieved by employing de-duplication techniques to eliminate this problem. This article introduces the design and implementation of redundancy-removal systems in a distributed WAN environment. AegeanStore can eliminate redundancy prior to data being uploaded. This frees up storage space and resource use, and lowers the total cost of storage. Furthermore, disaster recovery features inherent in the distributed system are maintained, storage system scalability is enhanced, and overall performance of the network is improved.

关 键 词：分布式系统 存储系统 冗余数据删除 

分 类 号：TP333[自动化与计算机技术—计算机系统结构]