Hadoop与Spark应用场景研究  

Survey on Hadoop and Spark application scenarios

作　　者：冯兴杰[1,2] 王文超 Feng Xingjie;Wang Wenchao(School of Computer Science&Technology,Civil Aviation University of China,Tianjin 300300,China;Information Network Center,Civil Aviation University of China,Tianjin 300300,China)

机构地区：[1]中国民航大学计算机科学与技术学院,天津300300 [2]中国民航大学信息网络中心,天津300300

出　　处：《计算机应用研究》2018年第9期2561-2566,共6页Application Research of Computers

基　　金：国家自然科学基金委员会与中国民用航空局联合基金资助项目(U1233113);国家自然科学基金青年基金资助项目(61301245;61201414)

摘　　要：Spark的崛起对作为当前最为流行的大数据问题解决方案的Hadoop及其生态系统形成了有力的冲击,甚至一度有人认为Spark有取代Hadoop的趋势,但是因为Hadoop与Spark有着各自不同的特点,使得两者拥有不同的应用场景,从而Spark无法完全取代Hadoop。针对以上问题,对Hadoop与Spark的应用场景进行了分析。首先介绍了Hadoop与Spark的相关技术以及各自的生态系统,详细分析了两者的特性;最后针对两者特性,阐述了Hadoop与Spark各自所适应的应用场景。The rise of Spark has a strong impact on Hadoop and its ecological system as two big data problems solutions,even some people think that Spark has the trend to replace Hadoop,but because Hadoop and Spark have different characteristics,so they have different application scenarios,as a result,Spark cannot completely replace Hadoop.Based on the above problems,this paper analyzed the application scenarios of Hadoop and Spark.First it introduced the Hadoop and Spark related technologies and their ecosystems,and then detailed analysis of the characteristics of the two,finally for the two characteristics,described the Hadoop and Spark each adapted to the application scenarios.

关 键 词：HADOOP SPARK 大数据 生态系统 应用场景 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]