虚实融合场景中的深度感知研究综述  

Review of depth perception in virtual and real fusion environment

作　　者：平佳敏 刘越 翁冬冬[1,2,3] Ping Jiamin;Liu Yue;Weng Dongdong(Beijing Engineering Research Center of Mixed Reality and Advanced Display,Beijing 100081,China;School of Optics and Photonics,Beijing Institute of Technology,Beijing 100081,China;Advanced innovation Center for Future Visual Entertainment,Beijing Film Academy,Beijing 100088,China)

机构地区：[1]北京市混合现实与新型显示工程技术研究中心,北京100081 [2]北京理工大学光电学院,北京100081 [3]北京电影学院未来影像高精尖创新中心,北京100088

出　　处：《中国图象图形学报》2021年第6期1503-1520,共18页Journal of Image and Graphics

基　　金：国家重点研发计划项目(2018YFB1403901);国家自然科学基金项目(61960206007);广东省关键领域研究和发展项目(2019B010149001);111项目(B18005)。

摘　　要：混合现实系统可以提供虚拟信息和真实环境实时叠加的虚实融合场景,在教育培训、文物保护、军事仿真、装备制造、手术医疗和展览展示等领域具有十分广阔的应用前景。混合现实系统首先利用标定数据构建虚拟摄像机模型,然后根据头部跟踪结果和虚拟摄像机位置实时绘制虚拟内容并将其叠加在真实环境中,用户通过虚实融合场景中渲染的图形化线索和虚拟物体特征感知其深度信息,但存在用于指导虚实融合场景绘制的视觉规律和感知理论匮乏、图形化线索可提供的绝对深度信息缺失和虚拟物体的渲染维度和特征指标不足等问题。本文分析了面向虚实融合场景绘制渲染的视觉规律,从用户感知的角度出发,围绕虚实融合场景中图形化线索绘制和虚拟物体渲染等展开综述,并对虚实融合场景中深度感知的研究趋势和重点进行展望和预测。Mixed reality systems can provide virtual and real fusion environment,in which the virtual objects add to the real world in real time.Mixed reality systems have been widely used in education,training,heritage preservation,military simulation,equipment manufacturing,surgery,and exhibition.The mixed reality systems use the calibration data to build a virtual camera model,and then draw virtual content in real time based on the head tracking data and the position of the virtual camera.Finally,the virtual content is superimposed in the real environment.The user perceives the virtual object’s depth information according to the integration of graphical cues and virtual object rendering features in the virtual and real fusion environment.When the user observes the virtual-real fusion scene presented by the mixed reality system,the following processes are included:1)different distance information are converted into respective distance signals.The key role in this process is to present the virtual-real fusion scene through rendering technology.The user judges the distance on the basis of the inherent characteristics of the virtual object.2)The user recognizes other visual stimulus variables in the scene and converts respective distance signal into the final distance signal.The key role in this process is to provide cues of depth information in the virtual and real fusion scene.The user needs to use depth cues to determine the position of the object.3)They determine the distance relationship between the objects in the scene and convert the final distance signal into the corresponding indicated distance.The key role in this process is the visual law of the human eye when viewing the virtual and real scene.However,problems,such as the lack of visual principles and perception theories that can be used to guide the rendering of virtual and real fusion scenes,the lack of absolute depth information that the graphical clues can provide,and the lack of rendering features of virtual objects,are found.The study on the visual laws a

关 键 词：虚实融合场景 绘制渲染 深度感知 混合现实 视觉规律 深度线索 感知匹配 

分 类 号：TP37[自动化与计算机技术—计算机系统结构]