Python中用多线程爬取网页图像的好处  

Advantages of Multi Thread Crawling Web Images in Python

作　　者：关丽梅[1] GUAN Limei(Wuhan City Polytechnic,Wuhan Hubei 430064,China)

机构地区：[1]武汉城市职业学院,湖北武汉430064

出　　处：《信息与电脑》2020年第22期63-65,共3页Information & Computer

摘　　要：线程是操作系统中非常重要的概念,它是操作系统能够分配资源和调度的最小单位,Python爬虫在从网页爬取数据时也可以使用多线程,这样可以大大提高任务的执行效率并促进系统资源的合理高效利用.基于此,本文以Python使用BeautifulSoup爬取一个网页内的图像为例,从代码及执行结果角度,通过对比论述使用多线程的好处.Thread is a very important concept in the operating system.It is the smallest urit that the operating system can allocate resources and schedule.Python crawler can also use mult threading when crawling data from web pages,which can greatly improve the efficiency of task execution and promote the rational and efficient utilization of system resources.In this paper,Python uses BeautifulSoup to crawl the image of a web page as an example,from the perspective of code and execution results,the advantages of using multithreading are discussed by comparison.

关 键 词：线程 PYTHON 爬虫 BeautifulSoup 

分 类 号：TP309.7[自动化与计算机技术—计算机系统结构]