针织原料价格的主题网络爬虫设计与实现  

Design and Implementation of Theme Web Crawler for Knitting Raw Materials Price

作　　者：石云瑞 蒋高明[1] Shi Yunrui;Jiang Gaoming(Engineering Research Center of Knitting Techology,Ministry of Education,Jiangnan University,Wuxi,Jiangsu 214122,China)

机构地区：[1]江南大学针织技术教育部工程研究中心,江苏无锡214122

出　　处：《针织工业》2020年第9期23-25,共3页Knitting Industries

基　　金：国家自然科学基金(61772238,61602212);泰山产业领军人才(tscy20180224)。

摘　　要：网络数据形式的多样性以及复杂程度对数据获取造成影响,为了能在互联网中获取自身需要的个性化数据,实现数据自动收集整理,利用数据库技术和主题网络爬虫技术,并将Python作为主要开发语言,设计基于Python的主题网络爬虫系统,实现针织原料成本的数据提取及关键字自动获取,并在互联网中对相关信息进行自动解析及检索。详细介绍系统的工作原理、体系结构、设计开发过程及实现过程。实践证明,所设计的主题网络爬虫系统能够快速获取原料价格信息,为后续数据的挖掘研究提供了支持。The diversity and complexity of network data forms have an impact on data acquisition.In order to obtain the personalized data in the internet and realize the data automatic collection and collation,using database technology and theme web crawler technology,and taking Python as the main development language,a theme web crawler system based on Python is designed in this paper.The system realizes the data extraction of knitting material cost and the automatic acquisition of keywords,and automatically analyzes and searches the relevant information on the internet.The working principle,architecture,design and development process and implementation process of the system are introduced in detail.The practice has proved that the designed theme web crawler system can quickly obtain the knitting raw material price information,which provides support for the subsequent data mining research.

关 键 词：PYTHON语言 网络爬虫 针织原料价格 智能化 数据采集 

分 类 号：TS181.9[轻工技术与工程—纺织材料与纺织品设计]