课堂场景中手势交互体验设计研究  

Gesture Interactive Experience Design in Classroom Scene

作　　者：葛润 李淑江[1] GE Run;LI Shujiang(Qingdao University of Science and Technology,Shandong Qingdao 266000,China)

机构地区：[1]青岛科技大学,山东青岛266000

出　　处：《包装工程》2025年第6期277-285,共9页Packaging Engineering

基　　金：山东省高等学校哲学社会科学研究项目(2024ZSMS069)。

摘　　要：目的为开发符合用户需求的手势交互应用,以课堂场景为例,提出一种基于体验设计的手势-功能映射模型。方法使用HTA模型构建用户需求、软件操作和相应手势之间的联系,通过影子跟踪和深度访谈获取教师在课堂中的软件使用需求和期望,并将其转化为设计原则。通过绿野仙踪实验获取被试用户的意向手势,再根据使用频率提取特征手势,根据设计原则进行清洗和处理。通过OpenCV、Tkinter、Pyautogui等开源框架实现手势动作与功能定义的映射关系。最后,通过实验进行可用性测试,验证其有效性。结果建立了六项功能的手势映射;在课堂场景中,发现了三项数据增强的优化方向。结论结合用户行为、态度研究的手势映射模型能够有效提高手势交互的可用性,为手势交互设计师和开发人员提供了基于场景的路径参考。The work aims to develop a gesture interaction application that meets user needs,and propose a gesture-function mapping model based on experience design with classroom scenarios as an example.The HTA model was used to establish connections between user needs,software operations,and corresponding gestures,to obtain teachers'software usage needs and expectations in the classroom through shadow tracking and in-depth interviews,and transform them into design principles.Intentional gestures of subjects were obtained through Wizard of Oz experiments,and characteristic gestures were extracted according to usage frequency,cleaned,and processed according to design principles.The mapping relationship between gesture actions and functional definitions was implemented through open-source frameworks such as OpenCV,Tkinter,Pyautogui,etc.Finally,usability testing was conducted through experiments to verify its effectiveness.The gesture mapping for six functions was established.In the classroom scenario,three optimization directions for data enhancement were discovered.In conclusion,the gesture mapping model,which combines user behavior and attitude research,can effectively improve the usability of gesture interaction,providing a reference for gesture interaction designers and developers based on scenario-based gesture interaction paths.

关 键 词：用户体验 手势交互 课堂场景 教育技术 

分 类 号：TB472[一般工业技术—工业设计]