基于多特征知识的先秦典籍词性自动标注研究  

Researches of Automatic Part-of-speech Tagging for Pre-Qin Literature Based on Multi-feature Knowledge

作　　者：王东波[1,2] 黄水清[1,2] 何琳[1,2] 

机构地区：[1]南京农业大学信息科学技术学院,南京210095 [2]南京农业大学领域知识关联研究中心,南京210095

出　　处：《图书情报工作》2017年第12期64-70,共7页Library and Information Service

基　　金：国家社会科学基金重大项目"基于<汉学引得丛刊>的典籍知识库构建及人文计算研究"(项目编号:15ZDB127);国家社会科学基金青年项目"哈佛燕京学社汉学引得丛刊研究"(项目编号:12CTQ019)研究成果之一;南京农业大学人文社会科学基金项目(项目编号:SKPT2016001)

摘　　要：[目的 /意义]先秦典籍在古代典籍中的地位极为重要。本文提出对先秦典籍进行词性自动标注的解决方法,以便更加准确地挖掘先秦典籍中的潜在知识。[方法 /过程]通过条件随机场模型,结合统计方法确定组合特征模板,并最终得到针对先秦典籍的词性自动标注算法模型。[结果 /结论]在先秦典籍自动分词的整个流程基础上,得到简单特征模板、组合特征模板下的词性自动标注模型,基于组合特征模板的词性标注模型调和平均值F达到94.79%,具有较强的推广和应用价值。在构建词性自动标注模型的过程中,通过融入字词结构、词语拼音和字词长度的特征知识,使得模型的精确率和召回率得到有效提升。[Purpose/significance] The Pre-Qin literature plays an extremely important role in the whole ancient classics. In order to more accurately mine the deep knowledge from the Pre-Qin literature, the automatic part-of-speech tagging for Pre-Qin literature becomes the first assignment, and the paper presents the solving method. [Method/process] Based on conditional random fields model and combined feature template which is determined by the method of statistics, the paper finally finishes constructing the model of the automatic part-of-speech tagging for the Pre-Qin literature. [Result/conclusion] The part-of-speech tagging models based on simple feature template and combined feature template are obtained under the processing flow of part-of-speech for Pre-Qin literature. The F-measure of part-of-speech model reaches 94.79% which is able to promote and apply. In the course of constructing model, the precision rate and recall rate of segmentation model are effectively enhanced by merging the feature knowledge, such as word structure, phonetic spelling and word length.

关 键 词：词性标注 先秦古籍 条件随机场模型 特征模板 古文信息处理 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]