基于MapReduce的新会话识别方法  

A new session identification method based on MapReduce

作　　者：黄伟建[1] 宋园园[1] 

机构地区：[1]河北工程大学信息与电气工程学院,河北邯郸056038

出　　处：《计算机工程与科学》2016年第3期425-430,共6页Computer Engineering & Science

基　　金：河北省自然科学基金(F2015402077);河北省高等学校科学技术研究重点项目(ZD2014054)

摘　　要：Web日志预处理因其输出结果的重要性而受到越来越多的重视,同时Hadoop对海量数据的分布式处理也得到广泛研究和应用,因此使用MapReduce进行Web日志预处理成为一种必然的发展趋势。为了提高会话识别结果的准确率,在分析会话识别算法研究现状的基础上,提出一种基于网络拓扑结构和动态阈值相结合的新会话识别方法并讨论其优势所在,接着用MapReduce模型实现新方法的分布式处理,最后通过对比实验分析验证MapReduce模型实现新算法的高效性和高精确度。Web log preprocessing attracts more and more attention due to the importance of its output result.Meanwhile distributed processing of massive data based on Hadoop is being widely studied and applied,so Web log preprocessing with MapReduce becomes an inevitable development trend.In order to improve the accuracy of session identification results,we propose a new method to identify user session based on network topology and dynamic threshold.The current research state is analyzed and the advantages of this method are also discussed.Then,the MapReduce model is used to implement the distributed processing of the new method.Experimental results demonstrate high efficiency and high accuracy of the proposed method.

关 键 词：Web日志预处理 会话识别 MAPREDUCE 分布式处理 

分 类 号：TP305[自动化与计算机技术—计算机系统结构]