分布式存储系统的哈希算法研究  

Research on hash algorithm for distributed storage system

作　　者：黄秋兰[1] 程耀东[1] 陈刚[1] 

机构地区：[1]中国科学院高能物理研究所计算中心,北京100049

出　　处：《计算机工程与应用》2014年第1期1-4,77,共5页Computer Engineering and Applications

基　　金：国家自然科学基金(No.11205179);中国科学院知识创新工程基金重大项目(No.KJCX1-YW-17)

摘　　要：针对分布式存储系统中如何实现数据在物理存储上的均匀分布和高效定位的问题,对多种哈希算法展开研究,提出了衡量分布式存储系统哈希算法优劣的标准;从散列分布性、哈希冲突和计算效率等多个维度对这些哈希算法进行分析比较,指出各种哈希算法的应用场景;结合分布式存储系统的应用,给出最优的哈希算法选择。实验结果证明,Davies-Meyer算法具有很好的均匀分布性和很高的计算效率,很适合分布式存储系统的应用。Considering the uniform data distribution in physical storage and efficient data positioning in distributed storage system, this paper studies different hash algorithms and proposes how to measure the merits of hash algorithm in distributed storage system. Based on experiments, the detail comparative analysis of various hash algorithms are shown in aspect of hash value distribution, hash conflict and computational efficiency and application scenarios of those algorithms are pointed out. In addition, the optimal scheme combining with distributed storage file system is demonstrated. Experimental results show that Davies-Meyer algorithm has a good uniform distribution and high computational efficiency which is suitable for distributed storage systems.

关 键 词：分布式存储系统 哈希算法 散列分布性 哈希冲突 Davies-Meyer算法 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]