多模态情感识别研究进展  

Research progress of multimodal emotion recognition

作　　者：何俊[1] 刘跃 何忠文[1] He Jun;Liu Yue;He Zhongwen(College of Information&Engineering,Nanchang University,Nanchang 330031,China)

机构地区：[1]南昌大学信息工程学院,南昌330031

出　　处：《计算机应用研究》2018年第11期3201-3205,共5页Application Research of Computers

基　　金：国家自然科学基金资助项目(61463034)

摘　　要：针对多模态情感特征提取与融合的技术难点,列举了目前应用较广的多模态情感识别数据库,介绍了面部表情和语音情感这两个模态的特征提取技术,重点阐述了多模态情感融合识别技术,主要对多模态情感特征融合策略和融合方法进行了综述,对不同算法下的识别效果进行了对比。最后,对多模态情感识别研究中存在的问题进行了探讨,并对未来的研究方向进行了展望。旨在为读者研究此方向建立系统的知识体系,借此推动与此相关问题的进展。For the difficulties of multimodal emotion feature extraction and fusion,this paper listed some widely-used datasets for multimodal emotion recognition,and the methods of feature extraction based on facial expression features and speech features.It mainly introduced the multimodal fusion technology,and stated some levels or types of fusion and methods of fusion and compared them.Finally,it explored potential issues and future research directions.The purpose is to develop a systematic knowledge system for readers to study multimodal emotion recognition and promotes the progress of the related issues.

关 键 词：情感识别 特征提取 多模态融合 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]