基于Python的数据爬虫的设计与实现  

Design and Implementation of Data Crawler Based on Python

作　　者：杨国军[1] YANG Guo-jun(Neijiang Normal University,Neijiang Sichuan 641112)

机构地区：[1]内江师范学院,四川内江641112

出　　处：《数字技术与应用》2020年第10期153-154,158,共3页Digital Technology & Application

摘　　要：本文针对互联网的海量数据信息查找、搜索繁琐的问题,提出通过网络爬虫的理念,模仿人的过程来帮助人们查找更有价值的数据信息,节约时间,提高工作效率。并针对网络爬虫的概念,工作原理,以及系统分析设计与实现进行了详细的分析和讨论,并提出行之有效的实现方案。This paper puts forward the idea of web crawler and imitates human process to help people find more valuable data information,save time and improve work efficiency.The concept,working principle,In view of the tedious problem of searching and searching massive data information on the Internet,system analysis,design and implementation of web crawler are analyzed and discussed in detail,and an effective implementation scheme is proposed.

关 键 词：PYTHON 爬虫系统 设计 实现 

分 类 号：TP312.1[自动化与计算机技术—计算机软件与理论]