基于可见光逆反射通信的移动增强现实定向交互  

Directional Interaction for Mobile Augmented Reality Based on Visible Light Backscatter Communication

作　　者：李景聿 陈拓潮 李明哲 徐栩海 张铖 徐子晨 刘譞哲 黄罡 冯云[6] 许辰人 LI Jing-yu;CHEN Tuo-chao;LI Ming-zhe;XU Xu-hai;ZHANG Cheng;XU Zi-chen;LIU Xuan-zhe;HUANG Gang;FENG Yun;XU Chen-ren(School of Computer Science,Peking University,Beijing 100871,China;Paul G.Allen School of Computer Science and Engineering,University of Washington,Seattle,WA 98195,USA;Human-Computer Interaction Institute,Carnegie Mellon University,Pittsburgh,PA 15213,USA;Department of Information Science,Cornell University,Ithaca,NY 14853,USA;School of Mathematics and Computer Science,Nanchang University,Nanchang,Jiangxi 330031,China;Peking University Third Hospital,Beijing 100871,China)

机构地区：[1]北京大学计算机学院,北京100871 [2]华盛顿大学计算机科学与技术学院,美国西雅图98195 [3]卡内基梅隆大学人机交互研究所,美国匹兹堡15213 [4]康奈尔大学信息科学学院,美国伊萨卡14853 [5]南昌大学数学与计算机学院,江西南昌330031 [6]北京大学第三医院,北京100191

出　　处：《电子学报》2024年第11期3643-3656,共14页Acta Electronica Sinica

基　　金：国家自然科学基金(No.62022005,No.62061146001)。

摘　　要：移动增强现实应用中,用户频繁地与环境中不同的智能物体交互完成任务,其完成效率和用户体验由所采用的定向交互技术决定.然而,从交互手段上来说,现阶段定向交互依赖于Wi-Fi、BLE等无线技术,其信号全向传播的特点使其不能利用用户的空间环境(即位置和方向)来缩短互动时间,带来了不必要的时间成本;从交互界面上来说,现阶段基于视觉的界面存在可靠性低、扩展性低等问题,进一步限制了系统的通用性.本文介绍了RetroAR——基于可见光逆反射通信的定向交互系统.RetroAR利用了光的定向传播特性来保留用户的空间环境,并依靠逆反射通信实现用户与目标设备之间无连接的快速定向交互.系统实验表明,RetroAR最远可在4 m距离支持100°视角的交互,同时实现厘米级的六自由度(6-Degrees Of Freedom,6-DoF)三维跟踪.用户研究表明,与基于Wi-Fi的解决方案相比,RetroAR将非接触式控制的交互时间减少了2倍,并且具有更好的用户体验.RetroAR借助可见光逆反射通信来利用用户空间环境,保持交互过程中的直观性.用户可以“所指即所控”的方式与多个目标进行互动,实现类似自然交互的快速定向交互.In mobile augmented reality applications,users interact with smart objects in proximity to finish collabora⁃tion or interaction tasks,whose efficiency and user experience are determined by the underlying directional interaction tech⁃nology.However,current directional interaction technologies at this stage are inefficient.For interaction means,they rely on wireless technologies such as Wi-Fi and BLE,which propagates omni-directionally and thus cannot use the user's spa⁃tial context(i.e.,location and direction)to shorten the interaction time,bringing unnecessary effort.In terms of interaction interface,current vision-based interfaces suffer from low reliability and low scalability,which further limits the adaptability and efficiency of the system.To address this issue,we developed RetroAR:an optical-sensing solution that leverages visi⁃ble light backscatter communication to serve for directional interaction with intelligent objects on commodity smartphones.RetroAR exploits the directional propagation property of light to preserve the user's spatial context,which enables fast con⁃nection-free directional interaction between the user and the target devices.RetroAR instruments objects with custom retroreflective markers called ViTags.When users interact with these smart objects,these ViTags are used to communicate with the camera on the mobile reader by backscattering the flashlight beams.We first conducted a system evaluation which showed that RetroAR could work reliably at a distance up to 4 meters and a view angle up to 100 degrees,and is able to achieve 6-DoF 3D tracking with an error as low as 1 cm on translation and 4.7 degrees on rotation.To evaluate how our sys⁃tem performs in terms of interaction,we then conducted a user study with 12 participants,which demonstrated that RetroAR improves the interaction time of MAR contactless control by at least two times compared to Wi-Fi-based solutions.Ret⁃roAR utilizes the user's spatial environment with visible light backscatter communication to maintain t

关 键 词：移动增强现实 定向交互 所指即所控 可见光逆反射通信 聚合物分散液晶 

分 类 号：TP399[自动化与计算机技术—计算机应用技术] TN929[自动化与计算机技术—计算机科学与技术]