基于注意力CNLSTM模型的新闻文本分类  

News Text Classification Based on CNLSTM Model with Attention Mechanism

作　　者：刘月[1] 翟东海[1] 任庆宁 LIU Yue;ZHAI Donghai;REN Qingning(School of Information Science and Technology,Southwest Jiaotong University,Chengdu 610097,China)

机构地区：[1]西南交通大学信息科学与技术学院

出　　处：《计算机工程》2019年第7期303-308,314,共7页Computer Engineering

基　　金：国家自然科学基金(61540060)

摘　　要：结合卷积神经网络(CNN)和嵌套长短期记忆网络(NLSTM)2种模型,基于注意力机制提出一个用于文本表示和分类的CNLSTM模型。采用CNN提取短语序列的特征表示,利用NLSTM学习文本的特征表示,引入注意力机制突出关键短语以优化特征提取的过程。在3个公开新闻数据集中进行性能测试,结果表明,该模型的分类准确率分别为96.87 %、95.43 %和97.58 %,其性能比baseline方法有显著提高。Combining Convolutional Neural Network (CNN) and Nested Long Short-Term Memory (NLSTM) models,this paper proposes a CNLSTM model for text representation and classification based on the attention mechanism.The model uses CNN to extract feature of phrase sequences,and then uses NLSTM to learn the representation of text features.By introducing attention mechanisms,the key phrases are highlighted to optimize feature extraction.Experiments on three published news data sets demonstrate that the classification accuracy of the model is 96.87 %,95.43 %,and 97.58 %,respectively,and its performance is significantly improved compared with the baseline methods.

关 键 词：卷积神经网络 特征表示 嵌套长短期记忆网络 注意力机制 文本分类 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]