微博文本聚类中特征扩展策略研究  

Feature extension of cluster analysis based on Microblog

作　　者：段旭磊 张仰森[1] 郭正斌[1] 

机构地区：[1]北京信息科技大学智能信息处理研究所,北京100192

出　　处：《计算机工程与应用》2017年第13期90-94,195,共6页Computer Engineering and Applications

基　　金：国家自然科学基金(No.61370139);北京市属高等学校创新团队建设与教师职业发展计划项目(No.IDHT20130519)

摘　　要：针对微博文本高维、稀疏的特点,比较基于同义词词林等外部知识库的文本扩展策略,利用Word2vec训练微博语料,并构建微博上下文相关词词表,通过种子词表和微博标签信息去扩展微博文本流中的关键词,最后提出了提取微博文本关键词及区分词向量中相似词和相关词的方法。实验结果证明,微博短文本经过Word2vec词向量相关词及微博标签扩展后,其聚类效果有了明显提高。Microblog has become the soil of information generated and spread today. But the information in the Microblog is different from the news Web page or blog information. In the Microblog, these characteristics, which the texts are highdimensional and sparse, bring great challenges to the Microblog text processing. According to the characteristics of Microblog, this paper compares the methods that the expansion strategy of short text based on How Net and Cilin, it proposes that using Word2 vec to train the corpus of Microblog, and constructs a related vocabulary words of the Microblog context,then uses the seed words and Microblog label information to expand Microblog text, and puts forward the methods of extracting Microblog text keywords and distinguishing the similar words and related words. Finally, the experiments show that by using the Word2 vec to extend Microblog is better, and the effect of cluster analysis for Microblog text has been significantly improved.

关 键 词：微博文本 高维稀疏 关键词提取 相似词 相关词 特征扩展 聚类 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]