基于领域知识的增强约束词向量  

Constraint-enhanced Word Embedding Based on Domain Knowledge

作　　者：王恒升[1,2] 刘通 任晋 WANG Hengsheng;LIU Tong;REN Jin(College of Mechanical & Electrical Engineering, Central South University, Changsha, Hunan 410083, China;State Key Laboratory for High Performance Complex Manufacturing, Central South University, Changsha, Hunan 410083, China)

机构地区：[1]中南大学机电工程学院,湖南长沙410083 [2]中南大学高性能复杂制造国家重点实验室,湖南长沙410083

出　　处：《中文信息学报》2019年第4期37-47,共11页Journal of Chinese Information Processing

基　　金：国家973计划(2013CB035504)

摘　　要：词向量是一种词语的数字化的表达。基于神经网络模型,利用语料中词语之间的上下文关系这一约束条件,通过大量训练得到词向量。词向量在表达词的语义上的表现给人以无限的希望与想象空间,基于词向量的文本分类、人机对话、智能检索等得到了广泛的研究。该文针对校园信息查询的特定应用,建立了所涉及词语的分类本体,除了利用语料中词语上下文关系外,还将本体知识作为约束条件进行词向量的训练,增强了词向量的语义表达。基于skip-gram模型,采用多任务的神经网络训练方法,在自己收集的语料上训练得到了针对领域的词向量。实验表明,基于领域知识的增强约束词向量能够更准确地表达词的语义信息。For the design of a specific application of natural language based dialog system,i.e.campus information inquiry system,this paper proposes a method of improving word embedding for the expressiveness of semantic meanings.In addition to employing the word contexts in the training of word embedding,the domain specific knowledge is also introduced into the model training to enhance the expressiveness of word embedding.The knowledge about the application is organized into an ontology which was incorporated into word embedding through multi-task training of neural network model adapted from skip-gram,which is both a kind of constraint and a kind of enhancement to the word embedding.Experiments show the validness of the proposed embedding.

关 键 词：增强约束词向量 语义表达 本体知识 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]