条件随机场与多层算法模型的实体自动识别  

Automatic entity identification based on CRF and multilevel algorithm model

作　　者：刘殷[1] 吕学强[1] 刘坤 

机构地区：[1]北京信息科技大学网络文化与数字传播北京市重点实验室,北京100101 [2]北京拓尔思信息技术股份有限公司,北京100101

出　　处：《计算机工程与应用》2016年第11期141-147,共7页Computer Engineering and Applications

基　　金：国家自然科学基金(No.61271304);北京市教委科技发展计划重点项目暨北京市自然科学基金B类重点项目(No.KZ201311232037);北京市属高等学校创新团队建设与教师职业发展计划项目(No.IDHT20130519)

摘　　要：实体自动识别技术是人们获取信息的有力手段,也是自然语言处理研究的关键技术之一。目前命名实体识别的研究较多,且已趋于成熟,而对汉语文本中的其他实体(名词性、代词性)研究较少。因此提出了一体化识别命名实体识别和名词性实体的方法,该方法将实体的汉字、分词、词性标注等信息引入条件随机场;再利用多层算法模型优化已经识别出的实体,以及召回未识别出的实体。在标准ACE语料库上进行实验,正确率达到75.56%,召回率达到72.52%。结果表明该方法对于实体识别问题是有效的。Automatic entity identification technology is a powerful means to get information, and also is one of the key technologies in NLP field. Most of the current researches are named entity identification, and the researches are nearly mature,but the research of other kinds of entity like nominal and pronominal entity mentions is little. A method to identify the named and nominal entity mentions automatically is proposed. An approach for a new means, which using probability features inside the Chinese character, segmentation, and POS tagging information about it into CRF, then multilevel algorithm model to improve the results and recall which is not identified, is revealed to identify the entity in the corpus. Evaluated experiments on ACE standard corpus are proposed that the accuracy is 75.56%, and the recall is 72.52%. The results prove that the method is effective in entity identification problem.

关 键 词：实体识别 条件随机场 分词 多层算法模型 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]