Enhancing Embedding-Based Chinese Word Similarity Evaluation with Concepts and Synonyms Knowledge  

作　　者：Fulian Yin Yanyan Wang Jianbo Liu Meiqi Ji 

机构地区：[1]Communication University of China,Beijing,100024,China

出　　处：《Computer Modeling in Engineering & Sciences》2020年第8期747-764,共18页工程与科学中的计算机建模（英文）

基　　金：This work is supported by the National Natural Science Foundation of China(No.61801440),the High-quality and Cutting-edge Disciplines Construction Project for Universities in Beijing(Internet Information,Communication University of China),State Key Laboratory of Media Convergence and Communication(Communication University of China),and the Fundamental Research Funds for the Central Universities.

摘　　要：Word similarity(WS)is a fundamental and critical task in natural language processing.Existing approaches to WS are mainly to calculate the similarity or relatedness of word pairs based on word embedding obtained by massive and high-quality corpus.However,it may suffer from poor performance for insufficient corpus in some specific fields,and cannot capture rich semantic and sentimental information.To address these above problems,we propose an enhancing embedding-based word similarity evaluation with character-word concepts and synonyms knowledge,namely EWS-CS model,which can provide extra semantic information to enhance word similarity evaluation.The core of our approach contains knowledge encoder and word encoder.In knowledge encoder,we incorporate the semantic knowledge extracted from knowledge resources,including character-word concepts,synonyms and sentiment lexicons,to obtain knowledge representation.Word encoder is to learn enhancing embedding-based word representation from pre-trained model and knowledge representation based on similarity task.Finally,compared with baseline models,the experiments on four similarity evaluation datasets validate the effectiveness of our EWS-CS model in WS task.

关 键 词：Word representation concepts and synonyms knowledge word similarity information security 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]