基于Hadoop的云存储系统的设计与研究  

Design and research of cloud storage system based on Hadoop

作　　者：刘姝[1] 

机构地区：[1]中原工学院计算机学院,河南郑州450007

出　　处：《郑州轻工业学院学报（自然科学版）》2014年第5期60-63,共4页Journal of Zhengzhou University of Light Industry:Natural Science

基　　金：河南省科技攻关项目(132102310284)

摘　　要：针对海量数据的存储和处理,设计了一个基于Hadoop的云存储系统.该系统在分布式文件系统和MapReduce编程模型2个核心技术的基础上建立基于Hadoop的云存储模型,优化了存储方式,提高了集群中网络带宽和磁盘的利用率,同时MapReduce编程框架的设计使系统拥有更强的计算能力.该系统可通过Linux集群技术搭建Hadoop平台,进行测试和分析.应用实践表明,该系统具有低成本、高效率、易扩展和安全可靠等特点,能稳定高效地满足海量数据的处理要求.Aiming at the problem of mass data storage and processing,a cloud storage system based on Hadoop was designed. The system established a cloud storage model on the basis of studying the two core technologies of Hadoop including Hadoop distributed file system and programming model MapReduce. The system optimized the computer storage mode,and increased the efficiency of the network bandwidth and disk in the cluster. At the same time,the MapReduce programming framework design made the system have higher performance of computing ability. Through testing and analysis of Hadoop platform using Linux cluster technology,the results showed that the system had the characteristics of low cost,high efficiency,easy extension,safty and reliability,and could meet the requirement of the mass data processing stably and efficiently.

关 键 词：云存储 HADOOP 分布式并行计算 HDFS MAPREDUCE 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]