沉浸式态势感知中手势交互应用  

Gesture Interaction Application for Immersive Situation Perception

作　　者：陈娜 李文强 李彭伟[1] CHEN Na;LI Wenqiang;LI Pengwei(The 28th Research Institute of China Electronics Technology Group Corporation,Nanjing 210007,China)

机构地区：[1]中国电子科技集团公司第二十八研究所

出　　处：《指挥信息系统与技术》2019年第4期38-42,54,共6页Command Information System and Technology

基　　金：装备发展部“十三五”预研课题资助项目

摘　　要：为了增强对整体态势的掌控与理解能力,将真实人手引入,利用虚拟手与场景进行交互,自然高效地完成任务。根据人手的运动特性,采用基于惯性传感器的手部骨骼长度比例计算方法,基于运动学位置解算实现了手部运动跟踪。针对虚拟场景,识别典型的手部动作序列,设计了基于上下文语义理解的交互过程以及双手协同模式下的交互模型,并在场景中得到了应用验证,获得良好的用户体验。To enhance the ability to control and understand the overall situation,real human hands are introduced,and the virtual hands can be used to interact with the scene.Thus,the mission can be naturally and efficiently completed.According to the motion characteristics of human hands,a method of calculating hand bone length ratio based on the inertial sensors is adopted,and the hand motion tracking is realized based on calculating the kinematic position.Aimed at the virtual scene of situation,several typical hand motion sequences are identified.An interaction process based on contextual semantic understanding and an interaction model under the two-hand collaboration mode is designed.The application validation in a scene shows that the interaction can achieve a good user experience.

关 键 词：惯性传感器 运动跟踪 语义交互 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]