Ext-ICAS:A Novel Self-Normalized Extractive Intra Cosine Attention Similarity Summarization  

作　　者：P.Sharmila C.Deisy S.Parthasarathy 

机构地区：[1]Deparment of Information Technology,Thiagarajar College of Engineering,Madurai,India [2]Deparment of Data Science,Thiagarajar College of Engineering,Madurai,India

出　　处：《Computer Systems Science & Engineering》2023年第4期377-393,共17页计算机系统科学与工程（英文）

摘　　要：With the continuous growth of online news articles,there arises the necessity for an efficient abstractive summarization technique for the problem of information overloading.Abstractive summarization is highly complex and requires a deeper understanding and proper reasoning to come up with its own summary outline.Abstractive summarization task is framed as seq2seq modeling.Existing seq2seq methods perform better on short sequences;however,for long sequences,the performance degrades due to high computation and hence a two-phase self-normalized deep neural document summarization model consisting of improvised extractive cosine normalization and seq2seq abstractive phases has been proposed in this paper.The novelty is to parallelize the sequence computation training by incorporating feed-forward,the self-normalized neural network in the Extractive phase using Intra Cosine Attention Similarity(Ext-ICAS)with sentence dependency position.Also,it does not require any normalization technique explicitly.Our proposed abstractive Bidirectional Long Short Term Memory(Bi-LSTM)encoder sequence model performs better than the Bidirectional Gated Recurrent Unit(Bi-GRU)encoder with minimum training loss and with fast convergence.The proposed model was evaluated on the Cable News Network(CNN)/Daily Mail dataset and an average rouge score of 0.435 was achieved also computational training in the extractive phase was reduced by 59%with an average number of similarity computations.

关 键 词：Abstractive summarization natural language processing sequence-tosequence learning(seq2seq) SELF-NORMALIZATION intra(self)attention 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]