Encoding syntactic representations with a neural network for sentiment collocation extraction  

作　　者：Yanyan ZHAO Bing QIN Ting LIU 

机构地区：[1]Department of Media Technology and Art, Harbin Institute of Technology [2]Department of Computer Science and Technology, Harbin Institute of Technology

出　　处：《Science China(Information Sciences)》2017年第11期3-14,共12页中国科学（信息科学）（英文版）

基　　金：supported by National Basic Research Program of China (973 Program) (Grant No. 2014CB340506);National Natural Science Foundation of China (Grant Nos. 61632011, 61370164)

摘　　要：Sentiment collocation refers to the collocation of a target word and a polarity word. Sentiment collocation extraction aims to extract the targets and their modifying polarity words by analyzing the relation- ships between them. This can be regarded as a basic sentiment analysis task and is relevant in many practical applications. Previous studies relied mainly on the syntactic path, which is used ~to connect the target word and the polarity word. To deeply exploit the semantic information of the syntactic path, we propose two types of syntactic representation, namely, relation embedding and subtree embedding, to capture the latent semantic features. Relation embedding is used to represent the latent semantics between targets and their corresponding polarity words, and subtree embedding is used to explore the rich syntactic information for each word on the path. To combine the two types of syntactic representations, a neural network is constructed. We use a recur- sive neural network （RNN） to model the subtree embeddings, and then the subtree embedding and the word embedding are combined as the enhanced word representation for each word in the syntactic path. Finally, a convolutional neural network （CNN） is adopted to integrate the two types of syntactic representations to extract the sentiment collocations from reviews. Our experiments were conducted on six types of reviews, which included product domains （such as cameras and phones） and service domains （such as hotels and restaurants）. The experimental results show that our proposed method can accurately capture the latent semantic features hidden behind the syntactic paths that neither the common feature-based methods nor the syntactic-path-based method can handle, and, further, that it significantly outperforms numerous baselines and previous methods.Sentiment collocation refers to the collocation of a target word and a polarity word. Sentiment collocation extraction aims to extract the targets and their modifying polarity words by analyzing the relation- ships between them. This can be regarded as a basic sentiment analysis task and is relevant in many practical applications. Previous studies relied mainly on the syntactic path, which is used ~to connect the target word and the polarity word. To deeply exploit the semantic information of the syntactic path, we propose two types of syntactic representation, namely, relation embedding and subtree embedding, to capture the latent semantic features. Relation embedding is used to represent the latent semantics between targets and their corresponding polarity words, and subtree embedding is used to explore the rich syntactic information for each word on the path. To combine the two types of syntactic representations, a neural network is constructed. We use a recur- sive neural network （RNN） to model the subtree embeddings, and then the subtree embedding and the word embedding are combined as the enhanced word representation for each word in the syntactic path. Finally, a convolutional neural network （CNN） is adopted to integrate the two types of syntactic representations to extract the sentiment collocations from reviews. Our experiments were conducted on six types of reviews, which included product domains （such as cameras and phones） and service domains （such as hotels and restaurants）. The experimental results show that our proposed method can accurately capture the latent semantic features hidden behind the syntactic paths that neither the common feature-based methods nor the syntactic-path-based method can handle, and, further, that it significantly outperforms numerous baselines and previous methods.

关 键 词：sentiment collocation extraction sentiment analysis syntactic representation neural network re-cursive neural network （RNN） convolutional neural network （CNN） 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] H146.3[自动化与计算机技术—控制科学与工程]