一种基于邻域系统密度差异度量的离群点检测算法  

Outlier detection algorithm based on neighborhood system density difference measurement

作　　者：杜旭升 于炯[1,2] 陈嘉颖 王跃飞[2] 蒲勇霖 叶乐乐 Du Xusheng;Yu Jiong;Chen Jiaying;Wang Yuefei;Pu Yonglin;Ye Lele(School of Software,Xinjiang University,Urumqi 830008,China;School of Information Science&Engineering,Xinjiang University,Urumqi 830008,China;School of Software,Xi’an Jiaotong University,Xi’an 710049,China)

机构地区：[1]新疆大学软件学院,乌鲁木齐830008 [2]新疆大学信息科学与工程学院,乌鲁木齐830008 [3]西安交通大学软件学院,西安710049

出　　处：《计算机应用研究》2020年第7期1969-1973,共5页Application Research of Computers

基　　金：国家自然科学基金资助项目(61862060,61462079,61562086,61562078)。

摘　　要：针对离群点检测算法LOF在高维离散分布数据集中检测精度较低及参数敏感性较高的问题,提出了基于邻域系统密度差异度量的离群点检测NSD(neighborhood system density difference)算法。相较于传统基于密度的离群点检测方法,NSD算法引入了截取距离的概念。首先计算数据集中对象在截取距离内的邻居点个数;其次计算对象的邻域系统密度;然后将对象的密度与它邻居的密度进行比较,判定目标对象与其邻居趋向于同一簇的程度;最后输出最可能是离群点的对象。将NSD算法与LOF、LDOF、CBOF算法在真实数据集与合成数据集中对比实验发现,NSD算法具有较高的检测准确率和执行效率以及较低的参数敏感性,证明了NSD算法是有效可行的。LOF is a famous algorithm for outlier detection,and it has lower detection accuracy and higher parameter sensitivity on high-dimensional discrete distribution datasets.Aiming at these problems,this paper proposed a neighborhood system density difference(NSD)algorithm based on density difference measurement of neighborhood systems.Compared with the traditional density-based methods,NSD algorithm proposed and introduced the concept of intercept distance.Firstly,it calculated the number of neighbors of an object within the intercept distance on dataset.Then,it computed the density of neighborhood system.After that,it estimated the degree of tending to the same cluster by comparing the density between the object and its neighbors.Finally,it output the objects which closed to outlier with maximum likelihood.Experiments with NSD,LOF,LDOF,CBOF algorithms carried out on the real-world dataset and synthetic dataset,show that the NSD algorithm performs with higher detection accuracy and execution efficiency,while with lower parameter sensitivity.

关 键 词：数据挖掘 离群点检测 基于密度 LOF LDOF CBOF 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]