一种基于流数据处理的预警系统设计  

Design of an Early Warning System Based on Processing of Stream Data

作　　者：王性国 郝文静 董建[1] 谢康 杜佳颖[1] WANG Xing-guo;HAO Weng-jing;DONG Jian;DU Jia-ying;LIU Zhan-bin(Third Research Institute of Ministry of Public Security,Shanghai 20120,China;Shuicheng Middle School,Liaocheng 252000,China)

机构地区：[1]公安部第三研究所,上海201204 [2]水城中学,山东聊城252000

出　　处：《电脑知识与技术》2019年第10X期69-73,共5页Computer Knowledge and Technology

基　　金：国家重点研发计划项目(项目编号：2018YFC0830401;2018YFC0806903);公安部第三研究所2019年基本科研业务费专项资金项目(项目编号：C19354)

摘　　要：随着大数据应用的深入,如何提高大数据应用的时效性,成为大数据工作中的关键。针对实时海量数据预警处置的问题,设计了一种基于流数据处理的预警系统,系统包含了数据预处理、预警规则设置、预警数据识别、预警数据存储等模块,系统中关键组件包括了分布式消息系统Kafka、分布式流式计算框架Storm。预警规则支持关键词匹配或正则表达式匹配两种方式。系统可广泛应用于实时性要求较高的各类预警处置系统。With the development of big data application,how to improve the timeliness of big data application becomes the key of big data work.Aiming at the problem of real-time massive data early warning disposal,an early warning system Based on stream data processing is designed.The system includes data preprocessing,early warning rules setting,early warning data identification,early warning data storage and other modules.The key components of the system include distributed message system Kafka,distributed stream computing framework Storm.Early warning rules support keyword matching or regular expression matching.The system can be widely used and real-time requirements of various early warning disposal systems.

关 键 词：流数据 预警规则 kafka STORM 预警系统 

分 类 号：TP302.1[自动化与计算机技术—计算机系统结构]