多特征融合的图文微博情感分析  

Multimedia sentiment analysis on microblog based on multi-feature fusion

作　　者：凌海彬 缪裕青 张万桢[3] 周明 武继刚 Ling Haibin;Miao Yuqing;Zhang Wanzhen;Zhou Ming;Wu Jigang(School of Computer Science&Information Security,Guilin University of Electronic Technology,Guilin Guangxi 541004,China;Key Laboratory of Image&Graphics Intelligent Processing,Guilin University of Electronic Technology,Guilin Guangxi 541004,China;Practice Teaching Department,Guilin University of Aerospace Technology,Guilin Guangxi 541004,China;Guilin Hivision Technology Company,Guilin Guangxi 541004,China;School of Computer Science&Technology,Guangdong University of Technology,Guangzhou 510006,China)

机构地区：[1]桂林电子科技大学计算机与信息安全学院,广西桂林541004 [2]桂林电子科技大学图像图形智能处理重点实验室,广西桂林541004 [3]桂林航天工业学院实践教学部,广西桂林541004 [4]桂林海威科技股份有限公司,广西桂林541004 [5]广东工业大学计算机科学与技术学院,广州510006

出　　处：《计算机应用研究》2020年第7期1935-1939,1951,共6页Application Research of Computers

基　　金：国家自然科学基金资助项目(61763007,61866007);广西自然科学基金联合资助项目(2018GXNSFAA138082);广西高校图像图形智能处理重点实验室资助项目(GIIP201706);桂林电子科技大学研究生教育创新计划基金资助项目(2017YJCX50)。

摘　　要：现有的微博情感分析方法已经注意到了微博文本与图片之间的互补作用,但较少注意用户情感表达的差异和微博内容中除文字之外的特征,为此提出一种多特征融合的图文微博情感分析方法。首先构建文本情感分类模型,将对情感具有很好指示作用的内容特征和用户特征与微博句子进行融合,然后构造了基于参数迁移和微调的图片情感分类模型。最后设计特征层和决策层融合的方法,将文本和图片情感分类模型进行融合。实验结果表明,内容特征和用户特征有效增强了模型捕捉情感语义的能力,并在多项性能指标上都取得了很好的效果,构建的图文情感分类模型和融合方法可获得更好的性能。Previous studies exploit the complementary effect between text and images in microblog sentiment analysis,but less focuse on some factors such as user personality and content characteristics.To solve this problem,this paper proposed an multimedia sentiment analysis on microblog based on multi-feature fusion method.Firstly it constructed a text sentiment classification model considering the user-based features and content-based features which had a good indication of emotions.Then it constructed an image model based on parameter transfer and fine-tuned.Finally,it designed fusion method of the early fusion and the late fusion.The experimental results show that user-based features and content-based features can enhance model ability of capturing emotion semantic,and the proposed model and fusion methods get higher accuracy on the real-world test dataset.

关 键 词：情感分析 微博 多特征融合 神经网络 图文融合 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]