多语料库中汉语四字格的切分和识别研究  

The Segmentation and Recognition of Four-Character Idioms in Multilingual Corpora

作　　者：徐润华[1] 曲维光[2] 陈小荷[3] 王东波[4] 

机构地区：[1]金陵科技学院人文学院,江苏南京210038 [2]南京师范大学计算机科学与技术学院,江苏南京210046 [3]南京师范大学文学院,江苏南京210097 [4]南京农业大学信息科学技术学院,江苏南京210095

出　　处：《中文信息学报》2013年第5期15-21,42,共8页Journal of Chinese Information Processing

基　　金：国家社会科学基金资助项目(07BYY050);国家自然科学基金资助项目(61272221);南京农业大学人文社会科学项目(SK 2013023)

摘　　要：汉语四字格的能产性和派生性极强,利用四字格模式创造出的新词数量在现代汉语词汇中一直呈上升趋势。该文将研究的目光投向分词语料库中的四字格,对语料库中的四字格进行了系统的分类和归纳,并对语料库内部和语料库之间的四字格切分不一致现象进行了详细的调查统计。最后,针对四字格的切分不一致数据引入条件随机场(CRF)模型,对多语料库中的汉语四字格进行识别实验,封闭测试和开放测试的识别精度均达到93%以上。The productive and derivative of four-character idioms are extremely high,the use of four-character pattern to create new words in the vocabulary of modern Chinese is still on the rise.This article looks into the eyes of the large number of four-character idioms in word-segmented corpora,and works on the four-character idioms in corpora for analysis and induction.Then this article works on the segmented comparison of four-character idioms both in single segmented corpora and between different segmented corpora.Finally,through the introduction of CRF statistical model,and take the results of segmented comparison of four-character idioms as training corpora,this article develops the research of the recognition of four-character idioms in corpora.Recognition results show the accuracy of four-character idioms can reach more than 93%in both closed test and open test.

关 键 词：四字格 分词语料库 切分不一致 CRF模型 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]