基于Python的招聘数据爬虫设计与实现  

The Design and Implementation of Recruitment Data Crawler Using Python

作　　者：常逢佳[1] 李宗花[1] 文静[1] 常逢锦[2] CHANG Feng-jia;Li Zonghua;WEN Jing;CHANG Feng-jin(School of Computer Science and Technology,Huaiyin Teachers College;School of Education Science,Huaiyin Teachers College,Huai’an 223001,China)

机构地区：[1]淮阴师范学院计算机科学与技术学院 [2]淮阴师范学院教育科学学院,江苏淮安223301

出　　处：《软件导刊》2019年第12期130-133,共4页Software Guide

基　　金：江苏高校自然科学研究项目(18KJB190001);江苏省高校自然科学研究一般项目(18KJB520006)

摘　　要：随着就业压力日渐增加,准确全面地获取数据可以帮助高校学生规避就业风险、正确认识自身价值,具有相当重要的研究价值。基于Python的网络动态招聘数据抓取方案利用requests库抓取Ajax异步请求多页数据源,抓取的内容更为全面;对抓取到的招聘数据进行统计分析,对多线程效率进行对比分析,显示爬虫具有良好的适应性。该方案抓取的网络资讯在科研、求职等方面具有一定实用价值。With the increasing employment pressure,the acquisition of accurate and comprehensive data can help college students avoid employment risks and correctly understand their own value,which is of considerable research value.The Python-based network dynamic recruitment data capture scheme utilizes the requests library to capture Ajax asynchronous requests for multi-page data sourc?es,and the content captured is more comprehensive;statistical analysis of the captured recruitment data and comparative analysis of multi-thread efficiency show that the reptile has good adaptability.The network information captured by the program has certain practi?cal value in scientific research and job hunting.

关 键 词：网络爬虫 招聘 PYTHON 数据分析 

分 类 号：TP312[自动化与计算机技术—计算机软件与理论]