主题网络爬虫研究综述  

Overview of Research on Topic-focused Web Crawler

作　　者：左薇 张熹[2] 董红娟 于梦君 ZUO Wei;ZHANG Xi;DONG Hong-juan;YU Meng-jun(School of Professional and Continuing Education,Yunnan University;School of Information,Yunnan University,Kunming 650000,China)

机构地区：[1]云南大学职业与继续教育学院 [2]云南大学信息学院,云南昆明650000

出　　处：《软件导刊》2020年第2期278-281,共4页Software Guide

基　　金：云南大学职业与继续教育学院一般项目(YK1704ZJ)。

摘　　要：随着人们对信息资源的个性化需求不断加大,主题网络爬虫应时而生。阐述主题网络爬虫定义及工作原理;介绍了主题网络爬虫研究进展,对主题网络爬虫爬行策略、网页抓取优先级以及系统设计实现进行阐述;总结当前研究的不足,对未来研究方向进行了展望。With the increase of people’s personalized demand for information resources,topic-focused web crawler emerged at the right time.The topic-focused web crawler and its working principle are stated.The research progress of theme web crawler is systematically analyzed,and three fields of topic-focused web crawler crawling strategy,web page crawling priority and design and implementation oftopic-focused web crawler system are expounded.The deficiencies of current research are summarized and the future research direction is prospected.

关 键 词：主题网络爬虫 主题爬虫 搜索引擎 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]