VR教学中学习者多模情感计算研究  

Research on Multimodal Affective Computing of Learners in Education VR

作　　者：白占俊 司俊勇 付永华[1,2] BAI Zhanjun;SI Junyong;FU Yonghua(Zhengzhou University of Aeronautical,Zhengzhou 450015,China;Collaborative Innovation Center for Aviation Economy Development,Hennan Province,Zhengzhou 450015,China)

机构地区：[1]郑州航空工业管理学院,河南郑州450015 [2]航空经济发展河南省协同创新中心,河南郑州450015

出　　处：《河南科技》2023年第12期35-42,共8页Henan Science and Technology

基　　金：河南省教育厅人文社科项目“新时代大学生理想信念教育现状及策略研究”(2023-ZDJH-439);2023年郑州航院教育教学改革研究与实践项目“黄河文化融入高校课程思政教育体系研究与实践”(zhjy23-36);2023年度郑州航员研究生教育改革和发展研究“黄河文化精神融入研究生思政教学实践路径研究”(2023YJSJG04);河南省高等学校重点科研项目“多模态全场景富情感阅读情境关键技术研究”(23B520007)。

摘　　要：【目的】识别VR教学中学习者的学习情感,提升学习者学习效率、学习感知和思维能力,促进VR技术在教学中的高效应用。【方法】结合课堂教学特点,通过收集面部表情、语音、肢体动作等数据,实现多模数据融合的情感计算,确定最优情感计算模型。【结果】在多模数据融合模型中,赋予各种情感不同权重的模型整体输出的识别率要高于赋予各种模态不同权重的模型整体输出的识别率。【结论】多模数据融合的学习情感识别模型能有效计算出VR教学中学习者情感,为多模数据融合的情感计算提供有效的基础模型,研究基于多模数据融合情感计算技术,为VR教学中的情感计算提供可靠的技术路径。[Purposes]To identify the learning emotion of learners in VR teaching,improve their learning efficiency,learning perception and thinking ability,and promote the efficient application of VR technology in teaching.[Methods]Combined with the characteristics of classroom teaching,the data of facial expression,voice and body movement were collected to realize the multi-module data fusion of emotion calculation and determine the optimal emotion calculation model.[Findings]The multi-module data fusion learning emotion recognition model can effectively calculate the learner′s emotion in VR teaching,and provides an effective model basis for the multi-module data fusion emotion calculation.The research on the emotion calculation technology based on the multi-module data fusion provides a reliable technical path for the learning emotion calculation in VR teaching.[Conclusions]In the multi-module data fusion model,the recognition rate of different weights assigned to different emotions in the overall output of the model was higher than that assigned to different weights.

关 键 词：情感计算 VR教学 多模数据 学习情感 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]