虚拟实验环境中的自然手势交互  

Natural Gesture Interaction in Virtual Experiment Environment

作　　者：杨贤 张硕 何汉武[2] 吴悦明[2] YANG Xian;ZHANG Shuo;HE Hanwu;WU Yueming(School of Art and Design, Guangdong University of Technology, Guangzhou 510075, China;School of Electromechanical Engineering, Guangdong University of Technology,Guangzhou 510006, China)

机构地区：[1]广东工业大学艺术与设计学院,广州510075 [2]广东工业大学机电工程学院,广州510006

出　　处：《实验室研究与探索》2019年第3期90-94,共5页Research and Exploration In Laboratory

基　　金：国家重点研发计划项目(2018YFB1004902);广东省科技计划(2017By010110008);CPS重点实验室开放基金(2016B03031008)

摘　　要：自然人机交互强调以人为中心,注重交互方式的自然、和谐。相较以往人机交互技术来说,虚拟现实的交互技术在于实现从二维界面到三维虚拟空间的跨越,需要解决物理世界与虚拟世界的无缝交融。基于虚拟实验环境实现自然手势交互、虚拟环境的交互约束以及虚实数据的实时通信,主要包括:自然手势交互方面,主要利用了深度传感器、手势训练等技术;虚拟实验环境的交互约束方面,设计了虚拟旋转体与用户映射骨骼的交互捆绑约束及其虚实数据的实时通信。最后通过虚拟家居环境的自然手势交互进行实验论证。方案能够很好地运用于虚拟家居、体感游戏和实验教学等领域。Natural human-computer interaction (HCI) emphasizes human-centeredness, it pays attention to the naturalness, concordance, and the diversity of perception channels. Compared with the traditional HCI technology, the virtual reality interaction technology is to realize the leap from the two-dimensional interface to the three-dimensional virtual space, and it is necessary to solve the seamless integration of the physical world and the virtual world. This paper implements natural gesture interaction, interaction constraints of virtual environment and real-time communication between virtual and real data. It includes (1) natural gesture interaction, and (2) interactive constraint of virtual experiment environment. The former mainly uses techniques such as depth sensor and gesture training;and the interaction constraint between body mapping posture and virtual rotating body is realized based on improved quaternion algorithm. Finally, the experimental demonstration is carried out through the natural gesture interaction of the virtual environment.

关 键 词：虚拟实验 自然交互 手势训练 交互约束 

分 类 号：TP312[自动化与计算机技术—计算机软件与理论]