资讯类新闻套图系统  

Web Information Extraction and Knowledge Presentation System

作　　者：江浩亮 左春[1,2,3] 

机构地区：[1]中国科学院软件研究所软件工程技术研发中心,北京100190 [2]中国科学院大学,北京100190 [3]中科软科技股份有限公司,北京100190

出　　处：《计算机系统应用》2014年第10期57-62,共6页Computer Systems & Applications

基　　金："核高基"重大专项(2010ZX01045-001-006)

摘　　要：考虑到图片具有对事件诠释力强,传播便利的特点,研究了从大量数据密集的新闻Web页面中自动提取数据,并组织成套图结构展现给用户.基于页面模板实现动态页面抽取和解析,处理转换为对应的套图数据结构.基于余弦相关性对来自不同网站的新闻套图数据进行去重,并根据相应的标准,为数据集进行评分排序.考虑巨大的新闻数据和用户数量,本系统基于hadoop分布式平台,满足系统的高可扩展性.本文将详细描述我们的系统设计和实现,并公布在百度资讯图片栏目上的运行结果.Considering the picture has the futures that a strong interpretation of events and convenient disseminating, this paper studies extraction of data from a large number of news web pages, and organizational structure chart presented to the users. It achieves dynamic pages based on page template extraction and analysis, processing converted to the corresponding sets of datastructure. Based on the news cosine correlation graph data sets from different sites are differentiated, and in accordance with the appropriate standards for data collection to score sorted. This system is based on hadoop distributed platform, considering the large number of users and imgsets. This paper will describe the design and implementation of our system in detail, and report the results of running the system on Baidu news image column.

关 键 词：WEB信息提取 动态数据集 高可扩展性 个性化推荐 套图 

分 类 号：TP393.092[自动化与计算机技术—计算机应用技术]