基于文本频谱的中文文本聚类方法  

Text profiling-based Chinese text analysis and clustering

作　　者：周扬[1,2] 屈武斌[2] 卢一鸣[2] 张成岗[2] 杨毅[1] 

机构地区：[1]四川大学生命科学学院,生物资源与生态环境教育部重点实验室,成都610064 [2]军事医学科学院放射与辐射医学研究所,蛋白质组学国家重点实验室,北京100850

出　　处：《四川大学学报（自然科学版）》2012年第6期1386-1394,共9页Journal of Sichuan University(Natural Science Edition)

基　　金：国家自然科学基金项目(30971557;30971815;30900830;30900862)

摘　　要：本文提出了利用文本频谱进行中文文本轮廓分析的表征方式.该方法基于不同时代、体裁和领域的文本在文字使用方面具有偏好性的假说,以文本中单个字符为单位,通过文本频谱刻画方法统计所有单字符在文本中出现的频率,并使用刻画出的文本频谱对文本进行表征;利用频谱比对分析技术,可计算出任意文本间的距离,并以此距离为基础进行聚类分析.进一步的实验证实了该方法的有效性.In this paper, a Chinese text representation method by using text profiling approach was pres- ented. This method is based on the hypothesis that, texts in different eras, styles and fields have biases in the use of characters. Text profiling was construct by counting the frequency of each character in the text in character level, and use the constructed text profiling to present the whole text. In addition, the distance between the two given texts was calculated by using text profiling alignment method. Finally, an effective text clustering method was developed on the basis of the distance. The experimental results validated the efficiency of the method.

关 键 词：文本频谱 频谱比对 文本分析 文本聚类 

分 类 号：Q811[生物学—生物工程]