DeBERTa-GRU: Sentiment Analysis for Large Language Model  

作　　者：Adel Assiri Abdu Gumaei Faisal Mehmood Touqeer Abbas Sami Ullah 

机构地区：[1]Department of Informatics for Business,College of Business,King Khalid University,Abha,61421,Saudi Arabia [2]Department of Computer Science,College of Computer Engineering and Sciences,Prince Sattam bin Abdulaziz University,Al-Kharj,11942,Saudi Arabia [3]School of Electrical and Information Engineering,Zhengzhou University,Zhengzhou,450001,China [4]Department of Computer Science and Technology,Beijing University of Chemical Technology,Beijing,100029,China [5]Department of Computer Science,Government College University Faisalabad,Faisalabad,Punjab,38000,Pakistan

出　　处：《Computers, Materials & Continua》2024年第6期4219-4236,共18页计算机、材料和连续体（英文）

摘　　要：Modern technological advancements have made social media an essential component of daily life.Social media allow individuals to share thoughts,emotions,and ideas.Sentiment analysis plays the function of evaluating whether the sentiment of the text is positive,negative,neutral,or any other personal emotion to understand the sentiment context of the text.Sentiment analysis is essential in business and society because it impacts strategic decision-making.Sentiment analysis involves challenges due to lexical variation,an unlabeled dataset,and text distance correlations.The execution time increases due to the sequential processing of the sequence models.However,the calculation times for the Transformer models are reduced because of the parallel processing.This study uses a hybrid deep learning strategy to combine the strengths of the Transformer and Sequence models while ignoring their limitations.In particular,the proposed model integrates the Decoding-enhanced with Bidirectional Encoder Representations from Transformers(BERT)attention(DeBERTa)and the Gated Recurrent Unit(GRU)for sentiment analysis.Using the Decoding-enhanced BERT technique,the words are mapped into a compact,semantic word embedding space,and the Gated Recurrent Unit model can capture the distance contextual semantics correctly.The proposed hybrid model achieves F1-scores of 97%on the Twitter Large Language Model(LLM)dataset,which is much higher than the performance of new techniques.

关 键 词：DeBERTa GRU Naive Bayes LSTM sentiment analysis large language model 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]