基于语义相似度的Web文档聚类算法  

Web document clustering algorithm based on semantic similarity

作　　者：李毅[1] 王浩[1] 杨静[1] 

机构地区：[1]合肥工业大学计算机与信息学院,安徽合肥230009

出　　处：《合肥工业大学学报（自然科学版）》2009年第12期1846-1850,共5页Journal of Hefei University of Technology：Natural Science

基　　金：安徽省自然科学基金资助项目(070412064);合肥工业大学科学研究发展基金资助项目(062101f)

摘　　要：文章提出基于语义相似度的Web文档聚类算法——WDCSS算法,依据文档关键词之间的相似度生成最小树,通过概率统计来确定最小树中相似度阈值,并对最小树中进行切割,同时对较小的子类进行划分合并。实验表明,WDCSS不仅能为具有各种不同聚类形状的数据集准确地分析出数据中存在的合理聚类和例外样本,而且避免了用户参数选择所造成聚类质量降低问题。A Web document clustering algorithm using semantic similarity（WDCSS） is presented in this paper. Firstly, the minimal spanning tree is obtained from the similarity of document key words. Secondly, the smallest similarity threshold is determined based on the analysis of probability and statistics. Finally, the minimal spanning tree is cut. Simultaneously, the subclasses are divided and merged. The experiment indicates that the WDCSS can not only accurately analyze the reasonable clusters and the exceptional samples from data sets with different cluster shapes, but it can also avoid the decreasing of the clustering quality influenced by the choice of users＇parameters.

关 键 词：WEB文档聚类 语义相似度 聚类算法 最小树 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]