一种基于消息中间件的网页实时处理技术  

A Real-time Web Page Processing Technique Based on Message-Oriented Middleware

作　　者：周城[1] 葛斌[1] 蒋林承[1] 

机构地区：[1]国防科技大学信息系统工程重点实验室,湖南长沙410073

出　　处：《电脑知识与技术》2011年第4期2269-2271,共3页Computer Knowledge and Technology

基　　金：国防科技大学优秀研究生创新基金（S100502）

摘　　要：针对传统网页采集分析系统在实时性上的不足，提出了一种基于消息中间件的网页实时处理技术。该技术利用消息中间件在消息队列驱动流程中引入并行调度策略，既继承了传统网页处理系统的可靠性，又实现信息抽取、话题聚类和网页分类等模块的分布式并行处理，增强了系统的实时处理能力。实验证明该文提出的技术在舆情实时采集、处理中较传统方法实时性高。For the traditional web acquisition and analysis system lacking of real-time, this article proposed a web real-time processing technique based on message-oriented middleware. This technique not only inherits the simple principle of traditional web processing sys- tem to ensure the reliability of it; but also brings in parallel scheduling strategies, which make modules, such as information extraction module, topic clustering module and web pages classification module, achieve distributed parallel processing which further enhances the real- time processing capability of system. Experimental results show the proposed technique is more real-time than traditional method.

关 键 词：消息中间件 网页处理 实时性 并行调度 舆情 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]