基于Flume、Kafka、Storm、HDFS的航空维修大数据系统  

Big Data System of Aircraft Maintenance Based on Flume,Kafka,Storm and HDFS

作　　者：徐海荣[1] 陈闵叶[1] 张兴媛[1] 

机构地区：[1]上海工程技术大学航空运输学院,上海201620

出　　处：《上海工程技术大学学报》2015年第4期303-305,311,共4页Journal of Shanghai University of Engineering Science

基　　金：上海工程技术大学课程建设资助项目(k201508007)

摘　　要：提出了基于Flume、Kafka、Storm、HDFS等技术的航空维修大数据系统,系统通过对维修大数据的处理,提供故障诊断、故障预测、优化维修方案等功能.该系统采用Flume采集历史数据和接收实时数据,采用Kafka对数据进行分发,采用实时流处理引擎Storm对维修相关数据进行处理,在HDFS上进行数据存储.系统具有分布式、高吞吐量、实时、可扩展等特点.One kind of big data system of aircraft maintenance based on Flume, Kafka, Storm, HDFS technologies was introduced. This system can provide real - time fault diagnosis, fault prediction, optimization of maintenance programs through processing big data of aircraft. Flume was used to receive real-time data and historical data collection, Kafka was used to distribute data, data was processed by a distributed real-time computation engine Storm, and all data were stored on HDFS. The system has features of distributed, high-throughput, real-time, scalability.

关 键 词：大数据系统 航空维修 故障预测 实时流处理引擎 

分 类 号：TP391.5[自动化与计算机技术—计算机应用技术]