基于Scrapy的岗位推荐系统的设计与实现  

Design and implementation of a job recommendation system based on Scrapy

作　　者：曹培 林永意 Cao Pei;Lin Yongyi(Nanjing Vocational University of Industry Technology,Nanjing 210023,China;Communication University of China Nanjing,Nanjing 211172,China)

机构地区：[1]南京工业职业技术大学,江苏南京210023 [2]南京传媒学院,江苏南京211172

出　　处：《无线互联科技》2023年第24期75-77,共3页Wireless Internet Technology

摘　　要：大数据和人工智能的发展,使得网络上的信息呈爆炸式增长。如何从海量数据中迅速精准地挖掘出有效信息已经成为一个研究热点。文章以爬虫框架Scarpy为基础,结合Redis、布隆过滤器(Bloom Filter,BF)和PostgreSQL数据库,设计并实现了一种基于Scrapy的岗位推荐系统。该系统可以从指定的URL获取信息,存入数据库,并以网页或者邮件的形式呈现给用户。The development of big data and artificial intelligence has led to an explosive growth of information on the internet.How to quickly and accurately mine effective information from massive data has become a research hotspot.This article is based on the Scarpy framework and combines Redis,Bloom Filter(BF),and PostgreSQL databases to design and implement a recommendation system based on Scrapy.The system can obtain information from specified URLs,store them in the database,and present them to users in the form of web pages or emails.

关 键 词：岗位推荐系统 布隆过滤器 Scarpy POSTGRESQL 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]