基于CA-YOLOv9网络的实时全景多尺度课堂行为识别  

Real-time Panoramic Multi-scale Classroom Behaviors Recognition Based on CA-YOLOv9 Network

作　　者：谭苏燕[1] 王祖煊 何高大[3] TAN Su-Yan;WANG Zu-Xuan;HE Gao-Da(School of Foreign Studies,Guangzhou University,Guangzhou,Guangdong,China 510006;School of Physics,South China Normal University,Guangzhou,Guangdong,China 510006;School of Foreign Studies,South China Agricultural University,Guangzhou,Guangdong,China 510642)

机构地区：[1]广州大学外国语学院,广东广州510006 [2]华南师范大学物理学院,广东广州510006 [3]华南农业大学外国语学院,广东广州510642

出　　处：《现代教育技术》2024年第7期123-130,共8页Modern Educational Technology

基　　金：国家社会科学基金项目“大学英语云平台学习者用户体验认知负荷研究”(项目编号:22BYY094);广东省哲学社会科学规划2023年度“外语专项”项目“教育生态学视域下‘一主三维’大学英语课程思政链研究”(项目编号:GD23WZXC01-13)资助。

摘　　要：随着人工智能的发展和“智慧课堂”概念的兴起,课堂行为智能化识别成为研究的热点。目前,国内外研究多采用数个学生或教室的局部影像,而对于学生人数密集、尺度变化范围大且存在大量物体遮挡的全景教室图像实时检测鲜有涉及。为此,文章基于YOLOv9网络,加入CA模块,构建了CA-YOLOv9网络;之后,通过结构分析实验、消融实验和对比实验,得到了CA-YOLOv9网络的最佳结构,并验证了其识别性能;最后,将训练好的CA-YOLOv9网络应用于全景多尺度课堂行为识别,证明了该网络能在不降低推理速度的同时提升检测精度,初步验证了该网络在智慧课堂中实时应用的可行性。文章的研究可为及时了解学生的学习状态和教师教学方法的有效性提供依据,有助于推动人工智能与教育教学的深度融合。With the development of artificial intelligence and the rise of“smart classroom”concept,the intelligent recognition of classroom behavior has become a research focus.At present,local images of several students or classrooms are mostly used in domestic and foreign studies,but the real-time detection of panoramic classroom images with densely populated students,a wide range of scale changes and a large number of object occlusions is rarely involved.Therefore,based on CA-YOLOv9 network,this paper added coordinate attention(CA)module,and constructed CA-YOLOv9 network.Then,the optimal structure of CA-YOLOv9 network was obtained through structural analysis experiment,ablation experimentand comparison experiment,and further verified its recognition property.Finally,the trained CA-YOLOv9 network was applied to panoramic multi-scale classroom behaviors recognition,proving that the network can improve the detection accuracy without decreasing the inference speed,and preliminarily verified the feasibility of the network’s real-time application in a smart classroom.The research of this paper could provide the basis for timely understanding students’learning status and the effectiveness of teachers’teaching methods,and help to promote the deep integration of artificial intelligence and education and teaching.

关 键 词：课堂行为 行为识别 实时全景 CA-YOLOv9网络 CA模块 

分 类 号：G40-057[文化科学—教育学原理]