基于CNN和LSTM的多通道注意力机制文本分类模型  

Multi-channel Attention Mechanism Text Classification Model Based on CNN and LSTM

作　　者：滕金保 孔韦韦 田乔鑫 王照乾 李龙[2,4] TENG Jinbao;KONG Weiwei;TIAN Qiaoxin;WANG Zhaoqian;LI Long(Xi’an University of Posts and Telecommunications,Xi’an 710121,China;Guilin University of Electronic Technology,Guilin,Guangxi 541004,China;Shaanxi Provincial Key Laboratory of Network Data Analysis and Intelligent Processing,Xi’an 710121,China;Guangxi Key Laboratory of Trusted Software,Guilin,Guangxi 541004,China)

机构地区：[1]西安邮电大学,西安710121 [2]桂林电子科技大学,广西桂林541004 [3]陕西省网络数据分析与智能处理重点实验室,西安710121 [4]广西可信软件重点实验室,广西桂林541004

出　　处：《计算机工程与应用》2021年第23期154-162,共9页Computer Engineering and Applications

基　　金：国家自然科学基金(61772396,61902296);陕西省自然科学基金(2018JM6047);广西可信软件重点实验室研究课题(KX202061)。

摘　　要：针对传统的卷积神经网络(ConvolutionalNeuralNetwork,CNN)和长短时记忆网络(LongShort-Term Memory,LSTM)在提取特征时无法体现每个词语在文本中重要程度的问题,提出一种基于CNN和LSTM的多通道注意力机制文本分类模型。使用CNN和LSTM提取文本局部信息和上下文特征;用多通道注意力机制(Attention)提取CNN和LSTM输出信息的注意力分值;将多通道注意力机制的输出信息进行融合,实现了有效提取文本特征的基础上将注意力集中在重要的词语上。在三个公开数据集上的实验结果表明,提出的模型相较于CNN、LSTM及其改进模型效果更好,可以有效提高文本分类的效果。Aiming at the problem that traditional Convolutional Neural Network(CNN)and Long Short-Term Memory(LSTM)can not reflect the importance of each word in the text when extracting features,this paper proposes a multi channel text classification model based on CNN and LSTM.Firstly,CNN and LSTM are used to extract the local informa-tion and context features of the text;secondly,multi-channel attention mechanism is used to extract the attention score of the output information of CNN and LSTM;finally,the output information of multi-channel attention mechanism is fused to achieve the effective extraction of text features and focus attention on important words.Experimental results on three public datasets show that the proposed model is better than CNN,LSTM and their improved models,and can effectively improve the effect of text classification.

关 键 词：文本分类 卷积神经网络(CNN) 长短时记忆网络(LSTM) 多通道注意力 特征融合 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]