大型网站的实时流量分析技术研究——以CNKI网站为例  

Real-Time Traffic Analysis Techniques for Large-Scale Websites:A Case Study of the CNKI Website

作　　者：张娜 姜占宇 丁豪 高盛祥[2,3] ZHANG Na;JIANG Zhanyu;DING Hao;GAO Shengxiang(Tongfang Knowledge Network Technology Co.,Ltd.(Beijing),Beijing 100192,China;Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,China;Yunnan Key Laboratory of Artificial Intelligence,Kunming University of Science and Technology,Kunming 650500,China)

机构地区：[1]同方知网(北京)技术有限公司,北京100192 [2]昆明理工大学信息工程与自动化学院,云南昆明650500 [3]昆明理工大学云南省人工智能重点实验室,云南昆明650500

出　　处：《昆明理工大学学报(自然科学版)》2025年第2期88-97,共10页Journal of Kunming University of Science and Technology(Natural Science)

基　　金：云南省科技人才与平台计划项目(202105AC160018).

摘　　要：大型网站实时流量分析是监控和统计分析网站实时流量数据,并对日志数据进行挖掘和提取信息的有效过程.通过分析网络日志数据、微服务日志数据和业务日志数据之间的逻辑关系,实现对网站业务产生日志数据的统计分析.从网站的系统概况、业务分析、性能分析和用户分析等维度分析流量数据,建立用户行为、各子系统网站访问来源链接入口、系统响应和服务运行告警等方面的统计指标数据.搭建网站实时流量监控运维平台,实现各统计指标数据的可视化展示,以及网络监控故障告警服务.通过运维平台进行网站运营管理,能够管理网站各业务的运行情况,提供网络服务故障告警,及时、高效、准确地掌控网站状况,为后期网站运营和优化提供保障和依据.Real-time traffic analysis for large-scale websites involves monitoring and statistically analyzing real-time traffic data,as well as effectively mining and extracting information from log data.By analyzing the logical relationships between network log data,microservice log data,and business log data,statistical analysis of the log data generated by website services is achieved.Traffic data is analyzed from various dimensions such as the system overview,business analysis,performance analysis,and user analysis,establishing statistical indicators for user behavior,entry links to sub-system websites,system response,and service operation alerts.A real-time traffic monitoring and operation platform for the website is established to visualize the statistical indicators and provide network monitoring and fault alert services.By managing the website through the operation platform,it is possible to manage the operation of each business on the website,provide network service fault alerts,and promptly,efficiently,and accurately grasp the website s status,providing assurance and basis for subsequent website operation and optimization.

关 键 词：大型网站 网站实时流量 用户行为 指标体系 故障告警 

分 类 号：TP393.06[自动化与计算机技术—计算机应用技术]