基于Openstack与Hadoop的实验教学大数据系统应用研究  

Research on the Application of Experimental Teaching Big Data System Based on Openstack and Hadoop

作　　者：齐连众[1,2] 张小凤 QI Lianzhong;ZHANG Xiaofeng(Beijing Institute of Technology,Zhuhai,Zhuhai 519088,China;School of Statistics,University of International Business and Economics,Beijing 100029,China)

机构地区：[1]北京理工大学珠海学院,广东珠海519088 [2]对外经济贸易大学统计学院,北京100029

出　　处：《现代信息科技》2023年第17期131-135,共5页Modern Information Technology

基　　金：广东高校省级重点平台和重大科研项目(2021GXJK425);广东省教育科学规划课题(高等教育专项)(2021GXJK434)。

摘　　要：针对高校实验教学普遍存在的问题,提出构建基于OpenStack与Hadoop技术的在线实验教学大数据系统,融合Swift和HDFS技术,优化数据处理,整合分散的教学资源,提高学生自主学习的效率。根据实验教学需求灵活配置虚拟机,搭建Hadoop、Spark、Hive等各种大数据实验镜像环境。实现了教学资源的统一管理,各项应用的快速部署,以及大数据的采集和存储。系统经测试可稳定运行,满足教学、管理等需求,亦可应用于大数据计算、云计算等科研领域。In view of the common problems in experimental teaching in colleges and universities,it is proposed to build an online experimental teaching big data system based on OpenStack and Hadoop technology,integrate Swift and HDFS technology,and optimize data processing.Integrate scattered teaching resources and improve the efficiency of students'autonomous learning.Configure virtual machines flexibly according to the needs of experimental teaching,and build Hadoop,Spark,Hive and other big data experimental image environments.It realizes the unified management of teaching resources,the rapid deployment of various applications,and the collection and storage of big data.After testing,the system can run stably,meet the needs of teaching and management,and can also be applied to scientific research field such as big data computing and cloud computing.

关 键 词：大数据应用 OPENSTACK HADOOP 实验教学 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]