Keyword Extraction Based on tf/idf for Chinese News Document  

作　　者：LI Juanzi FAN Qi＇na ZHANG Kuo 

机构地区：[1]Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China

出　　处：《Wuhan University Journal of Natural Sciences》2007年第5期917-921,共5页武汉大学学报（自然科学英文版）

基　　金：Supported by the National Natural Science Foundation of China (90604025)

摘　　要：Keyword extraction is an important research topic of information retrieval. This paper gave the specification of keywords in Chinese news documents based on analyzing linguistic characteristics of news documents and then proposed a new keyword extraction method based on tf/idf with multi-strategies. The approach selected candidate keywords of uni-, hi- and tri-grams, and then defines the features according to their morphological characters and context information. Moreover, the paper proposed several strategies to amend the incomplete words gotten from the word segmentation and found unknown potential keywords in news documents. Experimental results show that our proposed method can significantly outperform the baseline method. We also applied it to retrospective event detection. Experimental results show that the accuracy and efficiency of news retrospective event detection can be significantly improved.Keyword extraction is an important research topic of information retrieval. This paper gave the specification of keywords in Chinese news documents based on analyzing linguistic characteristics of news documents and then proposed a new keyword extraction method based on tf/idf with multi-strategies. The approach selected candidate keywords of uni-, hi- and tri-grams, and then defines the features according to their morphological characters and context information. Moreover, the paper proposed several strategies to amend the incomplete words gotten from the word segmentation and found unknown potential keywords in news documents. Experimental results show that our proposed method can significantly outperform the baseline method. We also applied it to retrospective event detection. Experimental results show that the accuracy and efficiency of news retrospective event detection can be significantly improved.

关 键 词：keyword extraction keyphrase extraction news keyword 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]