基于虚拟现实和动态加权决策融合的恐高情绪识别  被引量:3

Fear of Heights Emotion Recognition Based on Virtual Reality and Dynamic Weighted Decision Fusion

在线阅读下载全文

作  者:俞洋钊 何炳蔚[1] 白丽英[2] 张彧[3] 俞广杰 钟发炘 YU Yang-Zhao;HE Bing-Wei;BAI Li-Ying;ZHANG Yu;YU Guang-Jie;ZHONG Fa-Xin(School of Mechanical Engineering and Automation,Fuzhou University,Fuzhou 350116,China;School of Humanities and Social Sciences,Fuzhou University,Fuzhou 350116,China;School of Marxism,Fuzhou University,Fuzhou 350116,China)

机构地区:[1]福州大学机械工程及自动化学院,福州350116 [2]福州大学人文社会科学学院,福州350116 [3]福州大学马克思主义学院,福州350116

出  处:《计算机系统应用》2023年第7期35-46,共12页Computer Systems & Applications

基  金:国家科技特区创新资助项目(18-163-15-ZT-001-007-46);2020年福建省本科高校教育教学改革研究一般项目(FBJG20200199)。

摘  要:目前恐高情绪分类中的生理信号主要涉及脑电、心电、皮电等,考虑到脑电在采集和处理上的局限性以及多模态信号间的融合问题,提出一种基于6种外周生理信号的动态加权决策融合算法.首先,通过虚拟现实技术诱发被试不同程度的恐高情绪,同步记录心电、脉搏、肌电、皮电、皮温和呼吸这6种外周生理信号;其次,提取信号的统计特征和事件相关特征构建恐高情感数据集;再次,根据分类性能、模态和跨模态信息提出一种动态加权决策融合算法,从而对多模态信号进行有效整合以提高识别精度.最后,将实验结果与先前相关研究进行对比,同时在开源的WESAD情感数据集进行验证.结论表明,多模态外周生理信号有助于恐高情绪分类性能的提升,提出的动态加权决策融合算法显著提升了分类性能和模型鲁棒性.Currently,the physiological signals in the classification of acrophobia emotions mainly involve electroencephalogram(EEG),electrocardiogram(ECG),and skin electromyography(EMG).However,due to the limitations of EEG acquisition and processing as well as the fusion between multimodal signals,a dynamic weighted decision fusion algorithm based on six peripheral physiological signals is proposed.Firstly,the different levels of acrophobia are induced in the subjects through the virtual reality technology,while six peripheral physiological signals(ECG,BVP,EMG,EDA,SKT,and RESP)are recorded.Secondly,the statistical and event-related features of the signals are extracted to construct a dataset of acrophobia emotions.Thirdly,a dynamic weighted decision fusion algorithm is proposed according to the classification performance,modal,and cross-modal information,so as to effectively integrate multi-modal signals to improve the recognition precision.Finally,the experimental results are compared with previous relevant research,and then verified on the open-source WESAD emotion dataset.The conclusions show that multi-modal peripheral physiological signals are conducive to enhancing the classification performance of acrophobia emotions,and the proposed dynamic weighted decision fusion algorithm significantly improves both the classification performance and model robustness.

关 键 词:恐高症 虚拟现实 决策融合 多模态生理信号 情绪分类 

分 类 号:R749[医药卫生—神经病学与精神病学] TN911.7[医药卫生—临床医学] TP391.9[电子电信—通信与信息系统]

 

参考文献:

正在载入数据...

 

二级参考文献:

正在载入数据...

 

耦合文献:

正在载入数据...

 

引证文献:

正在载入数据...

 

二级引证文献:

正在载入数据...

 

同被引文献:

正在载入数据...

 

相关期刊文献:

正在载入数据...

相关的主题
相关的作者对象
相关的机构对象