基于游标模型的沉浸式医学可视化非接触式手势交互方法  

Title Non-Contact Gesture Interaction Method Based on Cursor Model in Immersive Medical Visualization

作　　者：雷金树 王松[1] 朱东 吴亚东[1,2] Lei Jinshu;Wang Song;Zhu Dong;Wu Yadong(School of Computer Science and Technology,Southwest University of Science and Technology,Mianyang 621000;Sichuan Civil-military Integration Institute,Southwest University of Science and Technology,Mianyang 621000)

机构地区：[1]西南科技大学计算机科学与技术学院,绵阳621000 [2]西南科技大学四川省军民融合研究院,绵阳621000

出　　处：《计算机辅助设计与图形学学报》2019年第2期208-217,共10页Journal of Computer-Aided Design & Computer Graphics

基　　金：国家重点研究计划项目(2016QY04W0801);国防基础科研计划(JCKY2017404C004);四川省科技厅项目(2017TJPT0200;2017KZ0023;2017GZ0186);西南科技大学研究生创新基金(17ycx051);西南科技大学龙山人才计划(18lzx409;18lzxt13);四川省教育厅科技创新团队支持计划(18zd1102);四川省军民融合研究院开放基金(300015;18sxb030);四川省科技创新苗子工程资助项目(2018034)

摘　　要：在高度沉浸式的虚拟环境中,由于用户的整体视觉空间被渲染的可视化映射所覆盖,传统鼠标、键盘以及触控屏幕等交互方式无法直接应用到沉浸式环境下,大大影响了分析和理解3D医学数据的效率与准确性.为实现沉浸式虚拟环境下对3D医学数据的交互操作,提出一种基于游标模型的非接触式手势交互方法.首先借助游标模型快速确定手势状态,定义4种手势动作实现位移、缩放、旋转以及剖切4种医学可视化交互操作,并借助弹簧模型改善手势抖动问题;最后以HTC VIVE+Leap Motion构建沉浸式医学可视化系统,定义6项分析任务,对比鼠标、手柄等交互方式,从训练时间、完成时间、操作难度和用户反馈4个方面验证文中方法的有效性.In the highly immersive virtual environment,the user's overall visual space is covered by the rendered visual mapping,therefore the traditional interaction methods like mouse,keyboard,and touch screen cannot be directly applied to immersive environments,which affect the efficiency and accuracy of analysis and understanding 3D medical data.In order to realize the interactive operation of 3D medical data in immersive virtual environment,a non-contact gesture interaction method based on cursor model is proposed in this paper.Firstly,the cursor state is quickly determined by means of the cursor model,and four kinds of gesture actions are defined to realize four kinds of medical visualization interactive operations such as displacement,scaling,rotation and sectioning,and the gesture jitter problem is improved by the spring model.Finally,an immersive medical visualization system was constructed with HTC VIVE+Leap Motion,six analysis tasks were defined,and the mouse,the handle,and other interaction methods were compared to verify the effectiveness of the method in terms of training time,completion time,operation difficulty and user feedback.

关 键 词：沉浸医学可视化 非接触式手势交互 游标模型 HTC VIVE+Leap Motion 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]