复杂网络大数据中重叠社区检测算法  

Algorithm for Detecting Overlapping Communities from Complex Network Big Data

作　　者：乔少杰[1] 韩楠[2] 张凯峰[3] 邹磊[4] 王宏志[5] Louis Alberto GUTIERREZ 

机构地区：[1]成都信息工程大学信息安全工程学院,四川成都610225 [2]成都信息工程大学管理学院,四川成都610103 [3]西南交通大学信息科学与技术学院,四川成都611756 [4]北京大学计算机科学技术研究所,北京100871 [5]哈尔滨工业大学计算机科学与技术学院,黑龙江哈尔滨150006 [6]Department of Computer Science, Rensselaer Polytechnic Institute

出　　处：《软件学报》2017年第3期631-647,共17页Journal of Software

基　　金：国家自然科学基金(61100045;61363037);教育部人文社会科学研究规划基金(15YJAZH058);教育部人文社会科学研究青年基金(14YJCZH046);成都市软科学项目(2015-RK00-00059-ZF);四川省教育厅资助科研项目(14ZB0458)~~

摘　　要：提出一种新的面向复杂网络大数据的重叠社区检测算法DOC(detecting overlapping communities over complex network big data),时间复杂度为O(nlog2(n)),算法基于模块度聚类和图计算思想,应用新的节点和边的更新方法,利用平衡二叉树对模块度增量建立索引,基于模块度最优的思想设计一种新的重叠社区检测算法.相对于传统的重叠节点检测算法,对每个节点分析的频率大为降低,可以在较低的算法运行时间下获得较高的识别准确率.复杂网络大数据集上的算法测试结果表明:DOC算法能够有效地检测出网络重叠社区,社区识别准确率较高,在大规模LFR基准数据集上其重叠社区检测标准化互信息指标NMI最高能达到0.97,重叠节点检测指标F-score的平均值在0.91以上,且复杂网络大数据下的运行时间明显优于传统算法.Currently, the number of Internet users, along with complex networks including online social networks and electronic commerce networks, is growing explosively. To effectively and efficiently detecting overlapping community structure from complex network, big data plays an essential role in point of interest recommendation and hotspot propagation. In this study, a new algorithm over complex networks is proposed to detecting overlapping communities with a time complexity of O（nlog2（n））. The algorithm applies a new method for updating node and edge modularity based on the techniques of modularity clustering and graph computing. Balanced binary tree is used to index the modularity increment, and an overlapping community detection approach is provided based on the idea of modularity optimization to reduce the frequency of node analysis compared to traditional approaches. Experiments are conducted on real complex network big data, and the results show that the DOC algorithm can effectively detect overlapping communities with high accuracy, the normalized mutual information （NMI） can reach to 0.97 in large-scale LFR benchmark datasets, and the overlapping community detecting standard F-score value is averagely higher than 0.91. In addition, the runtime efficiency beats traditional approaches in complex network big data.

关 键 词：复杂网络 大数据 重叠社区检测 模块度 图计算 

分 类 号：TP393.08[自动化与计算机技术—计算机应用技术]