基于Hadoop技术的物联网大数据同步存储系统设计  

Design of big data synchronous storage system of Internet of Things based on Hadoop technology

作　　者：邹文景 唐良运 甘莹 孙刚 ZOU Wenjing;TANG Liangyun;GAN Ying;SUN Gang(China Southern Power Grid Digital Grid Research Institute Co.,Ltd.,Guangzhou 510663,China)

机构地区：[1]南方电网数字电网研究院有限公司,广东广州510663

出　　处：《电子设计工程》2023年第18期114-117,122,共5页Electronic Design Engineering

摘　　要：目前研究的物联网大数据同步存储系统,对于海量物联网数据的存储效率低、同步性差,不利于数据安全、稳定且高效的存储,难以满足动态存储需求,为了解决上述问题,基于Hadoop技术设计了一种新的物联网大数据同步存储系统。集合采集单元、处理器、存储器构建硬件平台,完善系统接口设计,合理设计软件程序,进一步提升系统的实际应用性能,并采用加密算法对存储数据进行加密处理,保证数据存储的安全性。实验结果表明,针对海量物联网数据,基于Hadoop技术的物联网大数据同步存储系统能够有效提高数据存储的同步性和存储效率,减少数据存储时延。The current research on the Internet of Things big data synchronous storage system has low storage efficiency and poor synchronization for massive Internet of Things data,which is not conducive to the safe,stable and efficient storage of data,and is difficult to meet the dynamic storage requirements.In order to solve the above problems,a new Internet of Things big data synchronous storage system is designed based on Hadoop technology.Collect the acquisition unit,processor and memory to build the hardware platform,improve the system interface design,reasonably design the software program,further improve the practical application performance of the system,and use the encryption algorithm to encrypt the stored data to ensure the security of data storage.The experimental results show that for massive Internet of Things data,the Internet of Things big data synchronous storage system based on Hadoop technology can effectively improve the synchronization and storage efficiency of data storage and reduce the data storage delay.

关 键 词：Hadoop技术 物联网大数据 同步存储 存储系统 

分 类 号：TN98[电子电信—信息与通信工程]