基于Hbase的车联网海量数据存储  

Mass Data Storage of Internet of Vehicles Based on Hbase

作　　者：李星 邬少飞[1] LI Xing;WU Shao-fei(Wuhan Institute of Technology,Wuhan 430000,Hubei)

机构地区：[1]武汉工程大学计算机科学与工程学院,湖北武汉430000

出　　处：《电脑与电信》2021年第5期59-62,共4页Computer & Telecommunication

摘　　要：针对如何处理车联网数据的峰值问题,提出了一种基于Hbase的车联网海量数据存储的中间件控制方案。首先报文通过Kafka传递到中间件,再对传递至中间件的数据进行计数器处理,限制对Kafka的拉取消费;其次对传递至中间件的数据进行筛选处理,确保数据都是有效的数据,然后进行存储;最后针对车联网海量数据的应用场景选择能够满足需求的行键设计以及表结构设计。经实验表明,该中间件控制方案在存储的稳定性上比没有控制方案的具有优越性,该行键设计方案对比没有行键设计的方案在性能上具有显著的性能提升。In view of how to deal with the peak value of data in the Internet of vehicles,this paper proposes a middleware control scheme for massive data storage in the Internet of vehicles based on HBase.Firstly,the message is transmitted to the middleware through Kafka,and the data transmitted to the middleware is counter processed to limit the pull consumption of Kafka;secondly,the data transmitted to the middleware is filtered to ensure that the data are valid data for storage;finally,the design of row key and table structure that can meet the demand is selected for the application scenario of massive data in the Internet of vehicles.The experimental results show that the middleware control scheme has significant advantages in storage stability compared with no control scheme,and the row key design scheme has significant performance improvement compared with no row key design scheme.

关 键 词：HBASE 车联网 kafka 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]