虚拟机环境下Hadoop集群部署与简化配置的研究与实现  

Hadoop Cluster Deployment and Simplified Configuration in Virtual Machine

作　　者：乔永峰[1] 孙承秀 孙玉强 

机构地区：[1]郑州电力职业技术学院信息工程系,河南郑州451450

出　　处：《工业控制计算机》2021年第9期130-131,133,共3页Industrial Control Computer

摘　　要：Hadoop集群是学习与研究大数据不可或缺的操作平台。部署Hadoop集群需要多台计算机,在具体实践上有一定难度,也给用户带来不小的经济负担。从降低经济压力和简化Hadoop集群的部署方法着手,在低配电脑上实现Hadoop集群虚拟机的安装与优化配置。通过VMware和CentOS在单机环境下,搭建分布式Hadoop集群的方法,并给出了详细的搭建步骤。通过节点网络的配置,实现节点之间的免密登录。最后,作者简要介绍了Hadoop在安装和配置过程中常见的问题和解决方案。Hadoop cluster is an indispensable operation platform for learning and researching big data.Deployment of Hadoop cluster which is difficult in practice requires more than one computer,it brings a lot of economic burden to users.Starting from reducing the economic pressure and simplifying the deployment method of Hadoop cluster,this paper studies and realizes the installation and optimal configuration of hadoop cluster by virtual machine for general low configuration computer.This paper expands the detailed steps of building a distributed Hadoop cluster under the single cycle of the VMware and CentOS.Non-secret loging is achieved between nodes through the configuration of the node network.Finally,the writer briefly proposes the common problems and solutions during the installation and configuration of the Hadoop.

关 键 词：HADOOP集群 虚拟机 免密登录 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]