如何开展“虚实融合+多模态感知交互”的智能实验?——以中学化学智能实验为例  

How to Carry out the Intelligent Experiment of“Virtual-Reality Fusion+Multi-modal Perceptual Interaction”--Taking the Intelligent Experiment in Middle School Chemistry as an Example

作　　者：徐治鹏 冯志全[2] 邱小彧 孙润元[2] XU Zhi-Peng;FENG Zhi-Quan;QIU Xiao-Yu;SUN Run-Yuan(Information Management Department,University of Jinan,Jinan,Shandong,China 250022;College of Information Science and Engineering,University of Jinan,Jinan,Shandong,China 250022;Quancheng Laboratory,Jinan,Shandong,China 250101)

机构地区：[1]济南大学信息管理处,山东济南250022 [2]济南大学信息科学与工程学院,山东济南250022 [3]泉城实验室,山东济南250101

出　　处：《现代教育技术》2024年第11期111-120,共10页Modern Educational Technology

基　　金：国家重点研发计划“多模态自然交互的虚实融合开放式实验教学环境”(项目编号:2018YFB1004900)资助。

摘　　要：现代信息技术的进步推动了虚拟仿真实验的发展,然而当前的虚拟仿真实验普遍缺乏实际操作感,且交互方式相对单一,不仅影响了学生的实验体验,而且不利于培养学生的动手能力。为此,文章首先参考虚实融合、多模态感知交互的相关研究成果,构建了“虚实融合+多模态感知交互”的智能实验模型,并设计了智能实验系统和流程以从技术上实现此模型。之后,为验证此模型的有效性,文章以钠与水的反应为实验内容,开展了“虚实融合+多模态感知交互”的中学化学智能实验。在此实验中,文章开发了中学化学智能实验原型系统,并通过对比实验比较了实验效果,结果发现:在相同的实验操作时间段内,无论是实验任务完成质量还是完成效率,使用原型系统的智能实验都优于使用NOBOOK在线仿真实验教学平台的仿真实验,参加智能实验的学生脑力负荷更小且更好地掌握了知识与操作技能。文章的研究可为虚实融合和多模态感知交互在智能实验教学中的融合应用提供理论指导,并可为人工智能赋能实验教学创新研究提供实践参考。The advancement of modern information technology has promoted the development of virtual simulation experiments.However,the current virtual simulation experiments generally lack the real operation sense,and the interaction mode is relatively simple,which not only affects students’experimental experience but also is not conducive to the cultivation of students’hands-on abilities.Therefore,this paper firstly constructed an intelligent experimental model of“Virtual-Reality Fusion+Multi-modal Perceptual Interaction”,by referring to the relevant research results of virtual-reality fusion and multi-modal perceptual interaction,and designed the intelligent experimental system and process to realize this model technically.Subsequently,in order to verify the effectiveness of this model,the paper took the reaction of sodium with water as the experimental content to carry out an intelligent experiment of“Virtual-Reality Fusion+Multi-modal Perceptual Interaction”in middle school chemistry.In this experiment,a prototype system for the intelligent experiment in middle school chemistry was developed,and the experimental effects were compared through comparative experiments.The results showed that within the same experimental operation time,whether the completion quality or the completion efficiency of experimental task,the intelligent experiment using the prototype system was superior to the simulation experiment using the NOBOOK online simulation experimental teaching platform,and students who participated in the intelligent experiment had a lower mental load and better mastered knowledge and operational skills.The research of this paper could provide theoretical guidance for the integrated application of virtual-reality fusion and multi-modal perceptual interaction in intelligent experimental teaching,and can offer practical reference for the empowerment of innovative research of experimental teaching by artificial intelligence.

关 键 词：虚实融合 多模态感知 自然交互 智能实验 中学化学 

分 类 号：G40-057[文化科学—教育学原理]