基于朴素贝叶斯模型的单词语义相似度度量  

Word Semantic Similarity Measurement Based on Naïve Bayes Model

作　　者：王俊华[1,2,3] 左万利[1,2] 闫昭[1,2] 

机构地区：[1]吉林大学计算机科学与技术学院,长春130012 [2]符号计算与知识工程教育部重点实验室(吉林大学),长春130012 [3]长春工业大学计算机科学与工程学院,长春130012

出　　处：《计算机研究与发展》2015年第7期1499-1509,共11页Journal of Computer Research and Development

基　　金：国家自然科学基金项目(60973040);国家自然科学青年基金项目(60903098,61300148);吉林省重点科技攻关项目(20130206051GX);吉林省科技计划青年基金项目(20130522112JH)

摘　　要：单词语义相似度度量是自然语言处理领域的经典和热点问题.通过结合朴素贝叶斯模型和知识库,提出一个新颖的度量单词语义相似度度量途径.首先借助通用本体WordNet获取属性变量,然后使用统计和分段线性插值生成条件概率分布列,继而通过贝叶斯推理实现信息融合获得后验概率,并在此基础上量化单词语义相似度.主要贡献是定义了单词对距离和深度,并将朴素贝叶斯模型用于单词语义相似度度量.在基准数据集R＆G（65）上,对比算法评判结果与人类评判结果的相关度,采用5折交叉验证对算法进行分析,样本Pearson相关度达到0.912,比当前最优方法高出0.4%,比经典算法高出7%~13%;Spearman相关度达到0.873,比经典算法高出10%~20%;且算法的运行效率和经典算法相当.实验结果显示将朴素贝叶斯模型和知识库相结合解决单词语义相似度问题是合理有效的.Measuring semantic similarity between words is a classical and hot problem in nature language processing,the achievement of which has great impact on many applications such as word sense disambiguation,machine translation,ontology mapping,computational linguistics,etc.A novel approach is proposed to measure words semantic similarity by combining Nave Bayes model with knowledge base.To start,extract attribute variables based on WordNet;then,generate conditional probability distribution by statistics and piecewise linear interpolation technique;after that,obtain posteriori through Bayesian inference;at last,quantify word semantic similarity.The main contributions are definition of distance and depth between word pairs with small amount of computation and high degree of distinguishing the characteristics from words＇sense,and word semantic similarity measurement based on nave Bayesian model.On benchmark data set RG（65）,the experiment is conducted through 5-fold cross validation.The sample Pearson correlation between test results and human judgments is 0.912,with 0.4%improvement over existing best practice,and7%~13%improvement over classical methods.Spearman correlation between test results and human judgments is 0.873,with 10% ~20% improvement over classical methods.And the computational complexity of the method is as efficient as the classical methods,which indicates that integrating Nave Bayes model with knowledge base to measure word semantic similarity is reasonable and effective.

关 键 词：单词语义相似度 语义相似度 分段线性插值 朴素贝叶斯模型 WORDNET 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]