基于Storm的城市智慧交通大数据处理系统的构建  

Construction of Urban Smart Transportation Big Data Processing System Based on Storm

作　　者：张淑梅[1] 李福兴[2] ZHANG Shu-mei;LI Fu-xing(Nanjing Jiaotong Vocational and Technical College,Nanjing Jiangsu 211188;Education Technology Center,Southeast University,Nanjing Jiangsu 210036)

机构地区：[1]南京交通职业技术学院,江苏南京211188 [2]东南大学教育技术中心,江苏南京210036

出　　处：《数字技术与应用》2019年第9期126-128,共3页Digital Technology & Application

基　　金：南京交通职业技术学院院级科研项目“基于云平台的交通信息系统建设研究”(JR1701)

摘　　要：针对城市交通产生大量的实时、连续数据处理的问题,提出采用Storm分布式实时计算框架解决该问题。系统采用Kafka软件实时采集生产现场各类大量参数、发布-订阅消息,经Storm的Trident应用软件组件对大数据进行过滤、拆分、分组、函数、状态更新、状态查询、重新分区等操作完成大数据计算;结合分布式远程过程调用软件(DRPC软件)满足并行查询需求。经验证,该设计可提高原系统计算速度、效率和吞吐量,降低开销,确保数据安全。To solve the problem of large amount of real-time and continuous data processing in urban traffic,a Storm distributed real-time computing framework is proposed to solve the problem.The system uses Kafka software to collect a large number of parameters and publish-subscribe messages on the production site in real time.Through the Trident application software component of Storm,large data are filtered,split,grouped,functions,status updates,status queries,re-partitioning and other operations to complete large data calculation.and combines distributed remote procedure call software(DRPC software)to meet the needs of parallel query.It has been proved that the design can improve the computing speed,efficiency and throughput of the original system,reduce the overhead and ensure data security.

关 键 词：城市交通 大数据 分布式 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]