基于WEB挖掘的高校网络日志BI系统的设计与实现  

Design and Implementation of BI System of University Network Log Based on WEB Mining

作　　者：刘斌[1] 高尚兵[2] 吴庆国 LIU Bin;GAO Shang-bing;WU Qing-guo(Information Construction Department,Huaiyin Institute of Technology,Huai'an Jiangsu 223001,China;Science and Technology Department,Huaiyin Institute of Technology,Huai'an Jiangsu 223001,China)

机构地区：[1]淮阴工学院信息化建设与管理处,江苏淮安223000 [2]淮阴工学院科学与技术处,江苏淮安223000

出　　处：《淮阴工学院学报》2021年第1期22-26,39,共6页Journal of Huaiyin Institute of Technology

基　　金：江苏省现代教育技术研究所2019年度智慧校园专项课题(2019-R-75630)。

摘　　要：随着网络用户的增多和网络行为的多样性,高校网络浏览记录快速增长到Tb级,传统的数据统计已经无法满足使用。通过Excel进行统计,会出现无法打开或失去响应等问题,因此众多学校投入到网络信息管理系统的开发。本文通过Pandas对Excel中的高校网络WEB日志数据进行统计和分析、生成统计图等方式使得管理员可以直观了解到网络浏览情况。系统前端采用了CSS架构用于优化界面,选择Mysql数据库进行数据存储,使用Django框架进行系统搭建,实现前后端的连接和用户管理。在系统的使用过程中,通过生成的统计图,管理员可以直观了解到用户在各个时间段的浏览情况和用户的浏览网站类别倾向,从而对实现网络舆情的监督。With the rapid growth of browsing records in the university network,traditional data statistics have loopholes.Through Excel statistics,there will be problems such as unable to open or lose response.Therefore,many schools have invested in the development of network information management system.In this paper,Pandas is used to the University Network Web log data in Excel for statistics and analysis,the generation of statistical charts and other ways so that administrators can intuitively understand the network browsing situation.The front-end uses CSS architecture to optimize the interface.Mysql database is selected for data storage,and Django framework is used for system construction to realize the connection between the front and back end and the administrator for user management.In the process of using the system,the generated statistical chart,the administrator can intuitively understand the browsing situation of users in each time period and the browsing site category tendency of users,so as to realize the supervision of network public opinion.

关 键 词：WEB挖掘 PANDAS 可视化 DJANGO 

分 类 号：TP393.02[自动化与计算机技术—计算机应用技术]