核密度估计的聚类算法  

Clustering Algorithm with Kernel Density Estimation

作　　者：朱杰[1] 陈黎飞[2] 

机构地区：[1]中国西南电子技术研究所,成都610036 [2]福建师范大学数学与计算机科学学院,福州350117

出　　处：《模式识别与人工智能》2017年第5期439-447,共9页Pattern Recognition and Artificial Intelligence

基　　金：国家自然科学基金项目(No.61672157);福建省自然科学基金项目(No.2015J01238)资助~~

摘　　要：相似性度量是聚类分析的重要基础,如何有效衡量类属型符号间的相似性是相似性度量的一个难点.文中根据离散符号的核概率密度衡量符号间的相似性,与传统的简单符号匹配及符号频度估计方法不同,该相似性度量在核函数带宽的作用下,不再依赖同一属性上符号间独立性假设.随后建立类属型数据的贝叶斯聚类模型,定义基于似然的类属型对象-簇间相似性度量,给出基于模型的聚类算法.采用留一估计和最大似然估计,提出3种求解方法在聚类过程中动态确定最优的核带宽.实验表明,相比使用特征加权或简单匹配距离的聚类算法,文中算法可以获得更高的聚类精度,估计的核函数带宽在重要特征识别等应用中具有实际意义.Similarity measure is an important basis for clustering analysis. However, defining an efficient similarity measure for discrete symbols （categories） is difficult. In this paper, a method is proposed to measure the similarity between categories in terms of their kernel probability density. Different from the traditional simple-matching method or frequency-estimation method, under the action of the bandwidth for kernel functions, the proposed measure no longer depends on the assumption that categories on the same attribute are statistically independent. Then, a Bayesian clustering model is established based on kernel density estimation of categories, and a clustering algorithm is derived to optimize the clustering model using a likelihood-based object-to-cluster similarity measure. Finally, three data-driven approaches are proposed by leave-one-out estimation and maximum likelihood estimation to dynamically determine the optimal bandwidths in the kernel function for clustering. Experiments are conducted on real-world datasets and the results demonstrate that the proposed algorithm achieves higher clustering accuracy compared with the existing algorithms using a simple-matching distance measure or the attribute-weighting variants. The results also show that the bandwidth estimated by the proposed algorithm has practical significance in the applications, such as important feature identification.

关 键 词：类属型数据聚类 概率模型 相似性度量 核密度估计(KDE) 带宽估计 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]