一种基于Kinect的虚拟现实姿态交互工具  

Posture Interaction Tool for Virtual Reality System Based on Kinect

作　　者：鲁明[1] 王真水[1] 田元[1] 李琳[1] 

机构地区：[1]合肥工业大学可视化与协同计算实验室,合肥230009

出　　处：《系统仿真学报》2013年第9期2124-2130,共7页Journal of System Simulation

基　　金：国家自然科学基金(61070124);高等学校博士学科点专项科研基金(20120111110003)

摘　　要：虚拟现实系统中大量使用人机交互技术。传统人机交互方式需要笨拙复杂的设备,基于视觉传感器的非接触式交互方案在弱光条件的虚拟现实环境下效果不佳。综合这些因素,面向虚拟现实环境,提出了一种基于Kinect的即插即用姿态交互工具。通过研究虚拟现实特点,将虚拟现实中适用的交互姿态分成两类:漫游控制类和场景交互类,分别设计出交互方案;使用有限状态自动机原理分割姿态,使用动态时间规整方法识别语义类姿态;通过研究变电站操作培训三维仿真系统和多面沉浸式虚拟现实环境两个应用案例,分析设计方案的可行性;最后设计实验,验证姿态识别准确率,对比方案的用户体验。Human computer interaction technology is used in virtual reality systems extensively. Awkward and complex devices are needed when employing traditional human computer interaction scheme. Non-contact interaction scheme based on vision sensors gets a bad performance in virtual reality systems with low-light condition. Taking all these factors, a plug and play posture interaction tool based on Kinect for virtual reality environment was proposed. By studying features of virtual reality, postures suitable for virtual reality were divided into two categories： Roaming Control and Scene Interaction, both provided with its own interaction scheme; finite-state machine was used to split postures, dynamic time warping was used to recognize semantic postures. By studying the two practical cases, the transformer substation operation training 3D simulation system and multi-orientation virtual environment, the feasibility of the schemes was analyzed. Finally, certain experiments were designed to verify the accurate ratio of nosture recomaition and comnare u.~er exnerienee het-aze^n th~,ce, hxua ~＂h^m,~c

关 键 词：虚拟现实 姿态交互设计 姿态识别 用户体验 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]