面向科研统计的机构发表论文数据的爬取——以知网为例  

Crawling the Data of Papers for Scientific Research Statistics: Taking HowNet as an Example

作　　者：吴嘉兴 王玉龙 孙美凤 WU Jiaxing;WANG Yulong;SUN Meifeng(Guangling Collage,Yangzhou University,Yangzhou Jiangsu 225000)

机构地区：[1]扬州大学广陵学院,江苏扬州225000

出　　处：《软件》2022年第12期31-35,共5页Software

基　　金：2021年江苏省大学生创新创业训练计划资助项目(202113987004Y)。

摘　　要：为了提高科研统计的效率,研究从文献数据库中自动获取机构发表论文数据的问题。给出了发表论文数据的爬虫程序设计,探讨了其关键环节即爬取网页源码和提取论文数据的实现方法。编写程序从知网数据库中爬取了某机构发表论文,结果与人工检索一致。In order to improve the efficiency of scientific research statistics, the problem of automatically obtaining the data about papers published by an institution from the literature database is studied. This paper presents the design of a program crawling data of papers, and discusses the implementation method of its key steps, that are, crawling web page source code and extracting paper data. This paper compiles the program and actually crawls the paper data of an organization from the HowNet database, and the results are consistent with the manual retrieval.

关 键 词：网络爬虫 科研统计 知网数据库 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]