基于条件随机场的蒙古语词切分研究  

Research on Conditional Random Fields Based Mongolian Word Segmentation

作　　者：赵伟[1] 侯宏旭[1] 从伟[1] 宋美娜[1] 

机构地区：[1]内蒙古大学计算机学院,内蒙古呼和浩特010021

出　　处：《中文信息学报》2010年第5期31-35,84,共6页Journal of Chinese Information Processing

基　　金：973前期研究项目资助(2007CB316503)

摘　　要：词干和构形附加成分是蒙古语词的组成成分,在构形附加成分中包含着数、格、体、时等大量语法信息。利用这些语法信息有助于使用计算机对蒙古语进行有效处理。蒙古语词在结构上表现为一个整体,为了利用其中的语法信息需要识别出词干和各构形附加成分。通过分析蒙古语词的构形特点,提出一种有效的蒙古语词标注方法,并基于条件随机场模型构建了一个实用的蒙古语词切分系统。实验表明该系统的词切分准确率比现有蒙古语词切分系统的准确率有较大提高,达到了0.992。Etyma and morphological affix are the components of Mongolian words, which include lots of grammar information. Using this grammar information is helpful for effective processing Mongolian language. Mongolian words exhibit as a whole in the structure, and therefore, the detection of etyma and each morphological affix is necessary to capture this grammar information. By analyzing the characteristics of morphological construction of Mongolian words, this paper proposes an effective Mongolian word labeling method, and constructs a practical Mongolian word segmentation system based on conditional random fields model. Experiments show that the accuracy of segmentation has a significant improvement than current system, reaching an accuracy rate of 0. 992.

关 键 词：蒙古语 词切分 词干 构形附加成分 条件随机场 统计语言模型 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]