基于隐含语义分析的微博话题发现方法  

Micro-blog topic detection method based on Latent Semantic Analysis

作　　者：马雯雯[1] 魏文晗[1] 邓一贵[1,2] 

机构地区：[1]重庆大学计算机学院,重庆400044 [2]重庆大学信息与网络管理中心,重庆400044

出　　处：《计算机工程与应用》2014年第1期96-100,共5页Computer Engineering and Applications

基　　金：重庆市自然科学基金(No.cstc2011jjA40023)

摘　　要：随着微博的大量普及和关注度的不断提高,微博热点话题发现已成为当前研究热点。针对于短文本、向量空间模型(VSM)文本表示方法存在高维度、稀疏,以及同义多义问题,导致难以准确度量文本相似度,提出一种基于隐含语义分析的两阶段聚类话题发现方法。引入话题热度的概念来选取具有一定关注度的微博文本,用隐含语义分析(LSA)对数据集进行建模;用层次聚类的CURE算法确定初始类中心;用K-means聚类得到热点话题的聚类结果。真实微博数据集的实验结果验证了该方法的有效性。As the large popularity of micro-blog and awareness continues to improve, hot topic of micro-blog detecting has become the current research focuses. For short texts, there exist high-dimension, sparse, synonymy and polysemy problems for Vector Space Model（VSM）text presentation, making it difficult to measure the similarity of the texts accu-rately. This paper presents a two-stage cluster based on Latent Semantic Analysis（LSA）topic detection approach. Firstly, the concept of hot topic is introduced to select micro-blogs with certain attention, using LSA to model the dataset. Then CURE algorithm of hierarchical clustering is employed to determine the initial centers. Finally, the hot topic clustering results are obtained through K-means clustering. Experimental results on real micro-blog dataset verify the validity of the method.

关 键 词：隐含语义分析 向量空间模型 话题发现 微博 两阶段聚类 LATENT SEMANTIC Analysis(LSA) Vector Space Model(VSM) 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]