基于Docker技术的Hadoop集群实验环境设计与实现  

Design and Implementation of Hadoop Cluster Experimental Environment Based on Docker Technology

作　　者：许新刚 吕国庆 王梦婷 XU Xingang;LYU Guoqing;WANG Mengting(School of Information Engineering,Xuzhou College of Industrial Technology,Xuzhou Jiangsu 221140,China)

机构地区：[1]徐州工业职业技术学院信息工程学院,江苏徐州1221140

出　　处：《信息与电脑》2023年第19期38-42,131,共6页Information & Computer

基　　金：江苏省教育科学“十四五”规划立项课题“基于大数据的高职学生心理危机预警研究”(项目编号:D202103129);国家自然科学基金面上项目“矿井电性源电磁法多参数动态监测机理及联合反演”(项目编号:41974128)。

摘　　要：针对大数据教学实训环境存在成本高、维护难的问题,提出基于Docker技术在个人计算机上搭建Hadoop集群实验环境的方案。该方案在不改动计算机原有软件环境的情况下,在Windows操作系统中创建一台虚拟机,并在该台虚拟机内创建3个Docker容器搭建完全分布式的Hadoop集群实验环境。该方案简单、易实现,能够为教师和学生的大数据实践提供基础平台环境。In view of the high cost and difficult maintenance of the commercial big data teaching and training environment,this paper proposes a scheme to build a Hadoop cluster experimental environment on personal computers based on Docker technology.In this scheme,a virtual machine is created under the Windows operating system without changing the original software environment in the computer,and three Docker containers are created in this virtual machine to build a fully distributed Hadoop cluster experimental environment.The scheme is simple and easy to implement,and can provide a basic platform environment for teachers and students to practice big data.

关 键 词：Docker容器 大数据技术 HADOOP集群 分布式环境 

分 类 号：TP316.81[自动化与计算机技术—计算机软件与理论]