加密网页数据获取初探  

A Preliminary Study on Encrypted Web Data Acquisition

作　　者：郑文全[1] 何希望 刘鑫炼 ZHENG Wen-quan;HE Xi-wang;LIU Xin-lian(Dazhou Meteorological Bureau,Dazhou 635000,Sichuan)

机构地区：[1]达州市气象局,四川达州635000

出　　处：《电脑与电信》2023年第6期77-81,93,共6页Computer & Telecommunication

摘　　要：网络爬虫的飞速发展,促进了网页加密技术的发展,让数据获取变得不再容易。以某环境质量网站为例,结合多种技术详细分析其加密方式,并对比其解密成本,最终选择成本最低、防御最弱处进行突破,实现数据还原提取,巧妙解决加密网页数据获取难题,从而爬取数据。The rapid development of web crawlers has promoted the development of web page encryption technology,which makes data acquisition no longer easy.In this paper,we take an environmental quality website as an example,combine a variety of techniques to inspect and analyze its encryption in detail,compare its decryption costs such as time and effort,and finally choose the lowest cost and weakest defense to make a breakthrough,realizing data restoration and extraction,and cleverly solving the problem of encrypted web page data acquisition,so as to crawl data.

关 键 词：网页加密解密 VBA JAVASCRIPT BASE64 正则表达式 

分 类 号：TP393.08[自动化与计算机技术—计算机应用技术]