多种手势对应同一语义的柔性映射交互算法的研究  

Research on Flexible Mapping Algorithm of Multi-gestures to One Semantic

作　　者：冯志全[1] 乔宇 冯仕昌 周晓燕 徐涛[1] 杨晓晖 范雪 毕建平[3] FENG Zhi-quan;QIAO Yu;FENG Shi-chang;ZHOU Xiao-yan;XU Tao;YANG Xiao-hui;FAN Xue;BI Jian-ping(College of Information Science and Engineering,University of Jinan,Jinan,Shandong 250022,China;School of Information Science and Engineering,Xiamen University,Xiamen,Fujian 361005,China;Affiliated Hospital of Shandong Universityof Traditional Chinese Medicine,Jinan,Shandong 250011,China)

机构地区：[1]济南大学信息科学与工程学院,山东济南250022 [2]厦门大学信息学院智能科学与技术系,福建厦门361005 [3]山东中医药大学附属医院,山东济南250011

出　　处：《电子学报》2019年第8期1612-1617,共6页Acta Electronica Sinica

基　　金：国家重点研发计划(No.2018YFB1004901);国家自然科学基金(No.61472163,No.61603151);山东省重点研发计划(No.2017GGX10146)

摘　　要：针对智能交互界面中手势识别错误导致交互界面变化错误和手势不识别两个基本问题,本文设计并实现了基于手势交互的智能教学界面,该系统可以通过获取教师的手势信息与教师进行交互.主要创新点在于提出了多种手势对应同一语义的柔性映射交互算法.本文选取了14种自然交互手势,分析了对应同一语义的多种手势之间的共同特征.实验结果显示,该算法能够有效降低用户负荷.该算法已经用于一个基于手势交互的智能教学系统界面中.Aiming at the two basic problems,the error of interface inleraction caused by hand gesture recognition errors and gesture non-recognition error,the intelligent teaching interface based on gesture interaction is designed and implemented.And the system can interact with the teacher by obtaining the gesture information of the teacher.The main innovation of this paper is to propose a flexible mapping interaction algorithm with multiple gestures mapping to the one semantic.The paper selects fourteen kinds of natural interactive gesture,and analyzes the common characteristics of various gestures mapping to the one semantic.The experimental results show that the proposed algorithm can effectively reduce the users’burden.The algorithm has been used in an intelligent teaching system interface based on gesture interaction.

关 键 词：交互模型 自然用户界面 认知负担 基于手势的交互 人机交互 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]