在线学习行为多模态数据融合模型构建及实证  

Constructing and verifying a model of integrating multimodal data from online learning behaviors

作　　者：王丽英[1] 何云帆 田俊华[1] Liying Wang;Yunfan He;Junhua Tian

机构地区：[1]南京师范大学教育科学学院教育技术系,210097 [2]北京大学教育学院,100871

出　　处：《中国远程教育》2020年第6期22-30,51,76,共11页Chinese Journal of Distance Education

基　　金：全国教育科学“十三五”规划教育部重点课题“大学生在线学习者的情感感知模型建构研究”(项目编号:DIA170375)。

摘　　要：显性化测量与评估在线学习行为和情感状态是学习分析领域的研究热点。为克服单模态数据分析片面和多模态数据融合模糊等问题,全面感知和反馈在线学习过程状态,本研究构建了一种在线学习行为多模态数据融合模型。该模型利用自动化操作行为事件监听、表情识别、生理特征监测等原理,从行为、情绪和认知3个维度进行时序数据同步融合、分层递进诊断评估和统计聚类分析;考虑到对在线学习者具有较低的侵入性和干扰性,该模型在技术实现上采用分布式物联网技术和开放式Django Web服务器部署技术,形成学习过程状态数据的自动采集、分析、融合、评估和反馈等多层体系结构;应用该系统对MOOC环境下在线学习行为评测实验,讨论了本模型的准确性、易用性和有用性等问题。研究结果表明,本研究构建的模型能够为在线学习分析提供一种有效的技术解决方案,为同类研究可提供方法借鉴与技术实现参考。Explicit measurement and evaluation of online learning behaviors and affective status is a hot issue in learning analytics research. This study sets out to construct a model of integrating multimodal data from online learning behaviors with the aim of enabling a holistic perception of and feedback on online learning experience. Based on the principles of automatic action event listener, identification of emotions and monitoring of physiological characteristics, the proposed model implements synchronous integration of time series data, step-by-step progressive diagnostic assessment, and cluster analysis from the three dimensions of behavior, affect and cognition. To reduce intruding and interfering effects on online learners, the model adopts distributed Internet of Things and open Django Web server deployment technology, hence able to automatically collect, analyze, integrate and feedback on learning process data. The model is verified in the context of MOOCs and its accuracy, ease of use and usefulness are discussed.It is found to have the potential to be an effective solution to drawbacks inherent in traditional single-mode data analysis and multimodal data analysis.

关 键 词：多模态数据融合 在线学习 学习投入 行为监听 情感计算 心率监测 物联网技术 人工智能 

分 类 号：G434[文化科学—教育学]