基于Hadoop技术的气象数据实时传输监控系统设计  

Design of Real-time Meteorological Data Transmission and Monitoring System Based on Hadoop Technology

作　　者：陶淘 彭颖 张晨亮 TAO Tao;PENG Ying;ZHANG Chenliang(Xinjiang Meteorological Information Center,Urumqi 830002,China;School of Computer Science and Engineering,Southwest Minzu University,Chengdu 610041,China;Xinjiang Uygur Autonomous Region Meteorological Technology Equipment Support Center,Urumqi 830002,China)

机构地区：[1]新疆维吾尔自治区气象信息中心,乌鲁木齐830002 [2]西南民族大学计算机科学与工程学院,成都610041 [3]新疆维吾尔自治区气象技术装备保障中心,乌鲁木齐830002

出　　处：《计算机测量与控制》2024年第1期114-120,共7页Computer Measurement &Control

基　　金：自治区创新环境(人才、基地)建设专项(2022287713)。

摘　　要：气象数据在传输过程中,可能会出现数据丢失、重复、错误等问题,为准确分析气象问题表现情况,实现对气象问题的实时监控,设计了基于Hadoop技术的气象数据实时传输监控系统;联合JTAG调试电路与数据采集器,调节风速风向、雨雪、雷电、温湿度4个基础监控模块,完成气象数据实时传输监控系统的硬件设计;根据Hadoop架构体系连接形式,搭建Hadoop架构体系,预处理气象数据;在此基础上,匹配数据库机制与业务信息表单,实现应用系统的实时传输监控功能,再联合相关系统硬件,完成基于Hadoop技术的气象数据实时传输监控系统的设计;实验结果表明,在文章设计系统作用下,A、B、C三个场景的风力、降雨、降雪、雷电等级监控结果均与气象数据取样结果保持一致,能够有效实现对风、雨、雪、雷4种气象问题的实时监测,可以准确分析气象问题表现情况,且平均响应时间仅为61.3 ms,具有较好的实时性。During the transmission of meteorological data,there may be issues such as data loss,duplication,and errors.In order to accurately analyze the meteorological problems and achieve the real-time monitoring of meteorological problems,a real-time transmission and monitoring system for the meteorological data based on Hadoop technology is designed.JTAG is combined to debug the circuit and data collector,adjust the four basic monitoring modules of wind speed and direction,rain and snow,lightning,and temperature and humidity,and complete the hardware design of the real-time transmission and monitoring system for the meteorological data.According to the Hadoop architecture system,the Hadoop architecture system and preprocess meteorological data are built to process the meteorological data.On this basis,the database mechanism with business information forms is matched to achieve the real-time transmission and monitoring function of the application system.Then,in conjunction with the relevant system hardware,the meteorological data real-time transmission and monitoring system based on Hadoop technology is designed.The experimental results show that the designed system has the monitoring results of wind,rainfall,snowfall,and lightning levels in scenarios of A,B,and C,which is consistent with the meteorological data sampling results,the system can effectively achieve the real-time monitoring of four meteorological problems of wind,rain,snow,and thunder,accurately analyze the performance of the meteorological problems,and the average response time is only 61.3 ms,which has a good real-time performance.

关 键 词：Hadoop技术 气象数据 传输监控系统 JTAG电路 数据采集器 数据库 业务信息表 气象问题 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]