Web信息采集研究进展  

A Survey on Web Crawling

作　　者：李盛韬[1] 余智华[1] 程学旗[1] 白硕[1] 

机构地区：[1]中国科学院计算机技术研究所,北京100080

出　　处：《计算机科学》2003年第2期151-157,171,共8页Computer Science

摘　　要：As a basic component of search engine and a series of other services on Web,Web crawler is playing an important role. Roughly,a Web crawler is a program which automatically traverses the Web by downloading documents and following links from page to page. This article detailedly explains the principles and difficulties on the Web crawler,comprehensively argues several hot directions of Web crawler,and at last views the new direction of Web crawler.As a basic component of search engine and a series of other services on Web,Web crawler is playing an important role. Roughly,a Web crawler is a program which automatically traverses the Web by downloading documents and following links from page to page. This article detailedly explains the principles and difficulties on the Web crawler, comprehensively argues several hot directions of Web crawler,and at last views the new direction of Web crawler.

关 键 词：WEB 信息采集 信息发布 INTERNET INTRANET 计算机网络 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]