虚拟现实多人多通道协同交互方法  

Multi-person and Multi-channel Collaborative Interaction Method for Virtual Reality

作　　者：张鑫磊 于佳慧 朱兆全 孙宇祥 周献中[1,2] ZHANG Xinlei;YU Jiahui;ZHU Zhaoquan;SUN Yuxiang;ZHOU Xianzhong(School of Engineering Management,Nanjing University,Nanjing 210093,China;Research Center for Novel Technology of Intelligent Equipment,Nanjing University,Nanjing 210093,China)

机构地区：[1]南京大学工程管理学院,南京210093 [2]南京大学智能装备新技术研究中心,南京210093

出　　处：《指挥与控制学报》2024年第3期319-330,共12页Journal of Command and Control

基　　金：国家自然科学基金(72394363,62306135);教育部青年基金(23YJC630156);江苏省青年基金(BK20230783);江苏省科研创新计划(KYCX23_0062)资助。

摘　　要：针对指挥与控制领域中虚拟现实系统在多用户交互和操作便利性等方面的挑战。分析多人多通道系统组成结构,提出一种多人多通道虚拟现实交互框架。引入一种集成手势、语音和眼动的多通道协同交互方法,基于客户端/服务器模式,实现异地多用户实时交互,并通过原型系统(虚拟沙盘系统)展示了多人多通道协同交互方法的应用潜力。对比实验表明,相较传统手持控制器,此技术在提升交互效率和用户舒适度方面具有优势。此外,网络同步测试表明其在多用户实时交互中的低延迟和低丢包率,验证了其实用性和有效性。As for the challenges in multi-person interaction and operational convenience within the command and control domain of virtual reality systems,the composition structure of multi-person,multi-channel systems is analyzed and a framework for multi-person,multi-channel virtual reality interaction is proposed.A multi-channel collaborative interaction method integrating gestures,voice,and eye movement into one is introduced.Based on a client/server model,real-time interaction among users in different locations are realized and the application potentials of multi-person,multi-channel collaborative interaction method are demonstrated by a virtual sandbox system.The comparative experiments show that,compared to traditional handheld controllers,this technology has superiority in improving interaction efficiency and user comfort.Additionally,network synchronization tests indicate its low latency and packet loss in multi-person real-time interaction,its practicality and effectiveness are verified.

关 键 词：虚拟现实 指挥控制 多人实时交互 多通道交互 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]