基于流式计算的DPI数据处理方案及实践  

Scheme and Practice on DPI Data Processing Based on Stream Computing

作　　者：范家杰 田熙清[1] 郑博[2] 

机构地区：[1]中国电信股份有限公司广州研究院,广东广州510630 [2]中国电信股份有限公司广东分公司,广东广州510080

出　　处：《移动通信》2018年第1期80-86,共7页Mobile Communications

摘　　要：如何对海量的DPI数据进行实时的采集以及处理是运营商研究的热点,传统基于MapReduce的批处理模式难以满足流式计算实时性要求,因此首先介绍了流式处理相关概念,然后分析了目前流行的流式计算技术,提出一种基于流式计算的DPI数据处理方案,并应用在实际项目中,满足电信运营商对数据处理实时性的要求,最后通过实践总结了流式处理的应用场景。How to collect and process the massive DPI data in real time is the hotspot of telecom operators. The traditional batch mode Map Reduce is difficult to meet the real-time requirements based on stream computing. Therefore, the related concepts of stream computing were introduced. Then, popular stream computing technologies were analyzed to propose a DPI data processing scheme based on stream computing which is applied to the practical projects to meet the real-time requirements of data processing for operators. Finally, the application scenario of stream processing was summarized by the practice.

关 键 词：DPI 流式计算 数据处理 

分 类 号：TN399[电子电信—物理电子学]