基于余弦距离选取初始簇中心的文本聚类研究  

Research on text clustering for selecting initial cluster center based on Cosine distance

作　　者：王彬宇 刘文芬 胡学先 魏江宏 WANG Binyu;LIU Wenfen;HU Xuexian;WEI Jianghong(State Key Laboratory of Mathematical Engineering and Advanced Computing,Zhengzhou 450000,China;Guangxi Key Laboratory of Cryptography and Information Security,Guilin University of Electronic Technology,Guilin,Guangxi 541000,China)

机构地区：[1]数学工程与先进计算国家重点实验室,郑州450000 [2]桂林电子科技大学广西密码学与信息安全重点实验室,广西桂林541000

出　　处：《计算机工程与应用》2018年第10期11-18,共8页Computer Engineering and Applications

基　　金：国家自然科学基金(No.61502527;No.61702549)

摘　　要：文本聚类是文本信息进行有效组织、摘要和导航的重要手段,其中基于余弦相似度的K-means算法是最重要且使用最广泛的文本聚类算法之一。针对基于余弦相似度的K-means算法改进方案设计困难,且众多优异的基于欧氏距离的K-means改进方法无法适用的问题,对余弦相似度与欧氏距离的关系进行探讨,得到标准向量前提下二者的转化公式,并在此基础上定义一种与欧氏距离意义相近关系紧密的余弦距离,使原有基于欧氏距离的K-means改进方法可通过余弦距离迁移到基于余弦相似度的K-means算法中。在此基础上理论推导出余弦K-means算法及其拓展算法的簇内中心点计算方法,并进一步改进了聚类初始簇中心的选取方案,形成新的文本聚类算法MCSKM++。通过实验验证,该算法在迭代次数减少、运行时间缩短的同时,聚类精度得到提高。Text clustering is an important means for text information to be organized,abstracted and navigated effectively,in which K-means algorithm based on cosine similarity is one of the most widely used algorithms.Aiming at the problem that the K-means algorithm based on cosine similarity is difficult to be improved,and that many excellent K-means improvement methods based on Euclidean distance can not be applied,the relationship between cosine similarity and Euclidean distance is discussed,and the transformation formula of the two is obtained with standard vector.Thus,a definition of cosine distance is given,which is close to the Euclidean distance,so that the original improved K-means method based on Euclidean distance can be transformed into a cosine similarity K-means algorithm by cosine distance.On this basis,it is deduced the calculation method of cluster center points in cosine K-means algorithm,and the initial point selection scheme is further improved to form a new text clustering algorithm MCSKM++.The experimental results show that the algorithm can improve the clustering accuracy while the number of iterations is reduced and the running time is shortened.

关 键 词：文本聚类 K-MEANS算法 余弦相似度 余弦距离 初始点选取 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]