MDNN:Predicting Student Engagement via Gaze Direction and Facial Expression in Collaborative Learning  

在线阅读下载全文

作  者:Yi Chen Jin Zhou Qianting Gao Jing Gao Wei Zhang 

机构地区:[1]School of Computer Science,Central China Normal University,Wuhan,430079,China [2]Computer Science,School of Science,Rensselaer Polytechnic Institute,Troy,12180,USA [3]National Engineering Laboratory of Educational Big Data Application Technology,Central China Normal University,Wuhan,430079,China

出  处:《Computer Modeling in Engineering & Sciences》2023年第7期381-401,共21页工程与科学中的计算机建模(英文)

基  金:supported by the National Natural Science Foundation of China (No.61977031);XPCC’s Plan for Tackling Key Scientific and Technological Problems in Key Fields (No.2021AB023-3).

摘  要:Prediction of students’engagement in aCollaborative Learning setting is essential to improve the quality of learning.Collaborative learning is a strategy of learning through groups or teams.When cooperative learning behavior occurs,each student in the group should participate in teaching activities.Researchers showed that students who are actively involved in a class gain more.Gaze behavior and facial expression are important nonverbal indicators to reveal engagement in collaborative learning environments.Previous studies require the wearing of sensor devices or eye tracker devices,which have cost barriers and technical interference for daily teaching practice.In this paper,student engagement is automatically analyzed based on computer vision.We tackle the problem of engagement in collaborative learning using a multi-modal deep neural network(MDNN).We combined facial expression and gaze direction as two individual components of MDNN to predict engagement levels in collaborative learning environments.Our multi-modal solution was evaluated in a real collaborative environment.The results show that the model can accurately predict students’performance in the collaborative learning environment.

关 键 词:ENGAGEMENT facial expression deep network GAZE 

分 类 号:TP18[自动化与计算机技术—控制理论与控制工程]

 

参考文献:

正在载入数据...

 

二级参考文献:

正在载入数据...

 

耦合文献:

正在载入数据...

 

引证文献:

正在载入数据...

 

二级引证文献:

正在载入数据...

 

同被引文献:

正在载入数据...

 

相关期刊文献:

正在载入数据...

相关的主题
相关的作者对象
相关的机构对象