基于Python技术的校园网搜索引擎设计  

Design of Campus Network Search Engine Based on Python Technology

作　　者：闫丽丽 YAN Lili(Anhui Bozhou New Energy School,Bozhou Anhui 236700,China)

机构地区：[1]安徽亳州新能源学校,安徽亳州1236700

出　　处：《信息与电脑》2023年第17期183-185,共3页Information & Computer

摘　　要：传统搜索引擎模式存在新消息获取不及时、无法搜索通用引擎等问题,为此设计基于Python技术的校园网搜索引擎。首先分析搜索引擎的建立流程,其次分析Scrapy爬虫框架的工作原理,再次借助统一资源定位系统(Uniform Resource Locator,URL)去重策略优化校园信息查询流程,最后分析Scrapy爬虫框架爬虫防禁止策略。The traditional search engine model has problems such as delayed acquisition of new messages and inability to search universal engines.Therefore,a campus network search engine based on Python technology is designed.Firstly,the process of establishing a search engine is analyzed.Secondly,the working principle of the Scrapy crawler framework is analyzed.Thirdly,the campus information query process is optimized using the Uniform Resource Locator(URL)deduplication strategy.Finally,the Scrapy crawler framework's crawling prevention and prohibition strategy is analyzed.

关 键 词：校园网搜索引擎 Python技术 Scrapy爬虫框架 

分 类 号：TP391.3[自动化与计算机技术—计算机应用技术]