基于云计算的网络信息采集系统设计  

Design of Network Information Collection System Based on Cloud Computing

作　　者：王振坤 WANG Zhenkun(Zhangzhou College of Science&Technology,Zhangzhou Fujian 363202,China)

机构地区：[1]漳州科技职业学院,福建漳州363202

出　　处：《信息与电脑》2021年第21期127-129,共3页Information & Computer

摘　　要：针对现有网络信息采集系统存在数据抓取时间较长的问题,笔者基于云计算设计网络信息采集系统。对于硬件部分,搭建虚拟服务器集群,实现对网页端信息资源的有效管理;对于软件部分,基于云计算获取网页更新概率,采集分布式网络信息。实验结果表明:与传统系统相比,基于云计算的网络信息采集系统能够有效缩短信息采集时间间隔。Aiming at the problem of long data capture time in the existing network information collection system, the author designs the network information collection system based on cloud computing. For the hardware part, build a virtual server cluster to realize the effective management of Web information resources;For the software part, the web page update probability is obtained based on cloud computing, and the distributed network information is collected. The experimental results show that compared with the traditional system, the network information collection system based on cloud computing can effectively shorten the information collection time interval.

关 键 词：云计算 网络信息采集 虚拟服务器 

分 类 号：TP311.52[自动化与计算机技术—计算机软件与理论]