融合多元触觉和沉浸式视觉的可移植VR软件框架  

An Adaptable VR Software Framework for Collaborative Multi-modal Haptic and Immersive Visual Display

作　　者：郭园 童倩倩 郑宇铠 王子琦 张玉茹[1,2] 王党校[1,2,3] Guo Yuan;Tong Qianqian;Zheng Yukai;Wang Ziqi;Zhang Yuru;Wang Dangxiao(State Key Laboratory of Virtual Reality Technology and Systems,Beihang University,Beijing 100191,China;Beijing Advanced Innovation Center for Biomedical Engineering,Beihang University,Beijing 100191,China;Peng Cheng Laboratory,Shenzhen 518055,China)

机构地区：[1]虚拟现实技术与系统国家重点实验室,北京航空航天大学,北京100191 [2]北京航空航天大学生物医学工程高精尖创新中心,北京100191 [3]鹏城实验室,深圳518055

出　　处：《系统仿真学报》2020年第7期1385-1392,共8页Journal of System Simulation

基　　金：国家重点研发计划(2017YFB 1002803)。

摘　　要：多元触觉和沉浸式视觉反馈的时空一致性配准以及现有VR软件框架中硬件设备的接入便捷性问题,制约了医疗、商务、娱乐等不同行业中视触觉融合场景的快速开发。为解决这一难题,提出融合多元触觉和沉浸式视觉的可移植VR软件框架,根据视触觉反馈精度要求的不同设计了双层和三层架构兼顾视觉渲染、触觉渲染、硬件控制的不同需求。实验结果表明该框架具有支持视-触融合同步反馈、硬件平台可移植、图形场景开发简便和交互场景可快速替换等特点,能够满足不同领域的交互应用需求。The spatiotemporal consistency of multi-modal haptic and immersive visual feedback,as well as the integration of hardware devices in the existing VR software framework,restricts the rapid development of visuo-haptic fusion scenarios in different industries such as medical,business,and entertainment.In order to tackle this problem,an adaptable VR software framework combining multi-modal haptic and immersive visual display is proposed.To meet the different requirements of visual rendering,haptic rendering and hardware control,the double-layer and three-layer architectures are devised according to the different precision requirements of visuo-haptic fusion feedback.Experimental results show that the framework has the characteristics of supporting the synchronous feedback of visuo-haptic fusion,the convenient integration of diverse haptic devices,the simplicity of scene development and the rapid replacement of interactive scene,and it can meet the requirements of different application fields.

关 键 词：虚拟现实 多元触觉 人机交互 视触觉融合 可移植软件框架 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]