基于Hadoop的电力环保数据采集平台设计  

Design of Electric Power Environmental Protection Data Collection Platform Based on Hadoop

作　　者：宋子涛 张秋霞 郭大亮 陈义学 莫文涛 于楚凡 Song Zitao;Zhang Qiuxia;Guo Daliang;Chen Yixue;Mo Wentao;Yu Chufan(State Power Investment Corporation Central Research Institute,Beijing 102209,China;State Power Investment Corporation Limited,Beijing 100029,China)

机构地区：[1]国家电投集团中央研究院,北京102209 [2]国家电力投资集团有限公司,北京100029

出　　处：《粘接》2021年第12期168-172,共5页Adhesion

摘　　要：随着信息化时代的到来,网络通信能力的提高,数据采集也有了多种方式。环保数据作为常用信息载体,数量在急剧增加中,处理数据的技术还停留在基础阶段。在此背景下设计了基于Hadoop的环保数据采集平台。该平台是基于Hadoop框架,配合子项目Hive和HBase,完成全面的数据分析支持。采用PIC18F8722单片机为核心组件,对传感器收集到的数据通过GPRS无线网络上传,利用CLARA聚类算法对数据进行整合归类,最后通过数据节点完成对数据的储存、备份过程。With the advent of the information age,the network communication capability is improved,and the data collection has a variety methods.As a common information carrier,the number of environmental protection data is increasing rapidly,but the data processing technology is still in the basic stage.Therefore,an environmental protection data collection platform based on Hadoop is designed,which is based on the Hadoop framework and cooperates with the sub-projects Hive and Hbase to provide a support for comprehensive data analysis.Using PIC18F8722 single-chip microcomputer as the core component,the data collected by the sensor is uploaded through the GPRS wireless network,and the CLARA clustering algorithm is used to integrate and classify the data.Finally,the data storage and backup process are completed through the data node.

关 键 词：HADOOP 数据采集 CLARA算法 

分 类 号：TP274.2[自动化与计算机技术—检测技术与自动化装置] TP311.13[自动化与计算机技术—控制科学与工程]