基于大数据技术的岗位信息爬取与分析  

Crawling and Analysis of Job Information Based on Big Data Technology

作　　者：李连天[1] LI Liantian(Yangjiang Polytechnic,Yangjiang Guangdong 529566,China)

机构地区：[1]阳江职业技术学院,广东阳江529566

出　　处：《信息与电脑》2021年第2期177-180,共4页Information & Computer

摘　　要：随着计算机网络技术的迅速发展,网络招聘信息平台已成为招聘者发布信息和应聘者获取职位的主要途径。大量的网络招聘信息蕴含着用人单位和市场对人才需求的情况,诸如对人才的能力、素质等方面的要求。本文探索使用Scrapy框架爬取Web技术岗位的招聘信息,并使用pandas库进行数据清洗和数据分析,最后使用matplotlib技术进行可视化分析。通过职位分析结果能够帮助求职者了解用人单位的具体情况,高校也可以根据职位分析结果制订人才培养计划。With the rapid development of computer network technology, online recruitment information platforms have become the main way for recruiters to release information and candidates to obtain positions. A large amount of online recruitment information contains the needs of employers and the market for talents, such as the requirements for talents’ ability and quality. This article explores the use of Scrapy framework to crawl the recruitment information of Web technical positions, and use the pandas library for data cleaning and data analysis, and finally use matplotlib technology for visual analysis. The job analysis results can help job seekers understand the specific situation of the employer, and universities can also formulate talent training plans based on the job analysis results.

关 键 词：爬虫 WEB 招聘信息 PANDAS Matplotlib 

分 类 号：TP311.13-4[自动化与计算机技术—计算机软件与理论]