基于二维仿射变换的几何一致性虚实融合  

Virtual-real fusion with geometric consistency based on two-dimensional affine transformation

作　　者：滕嘉玮 赵岩[1] 张艾嘉 王世刚[1] 王晓坤[2] TENG Jiawei;ZHAO Yan;ZHANG Aijia;WANG Shigang;WANG Xiaokun(College of Communication Engineering,Jilin University,Changchun 130012,China;Aviation Combat Service College,Air Force Aviation University,Changchun 130022,China)

机构地区：[1]吉林大学通信工程学院,吉林长春130012 [2]空军航空大学航空作战勤务学院,吉林长春130022

出　　处：《光学精密工程》2022年第11期1374-1382,共9页Optics and Precision Engineering

基　　金：国家重点研发计划项目(No.2017YFB1002900);国家自然科学基金资助项目(No.61631009,No.61771220)。

摘　　要：几何一致性和光照一致性在虚拟物体叠加到真实场景中的真实感渲染中起着重要作用。为了构建立体相机的真实场景和虚拟场景的坐标测量系统,实现虚实融合过程中的几何一致性和光照一致性,提升虚实融合的真实感,提出了一种几何一致性虚实融合方法,利用从三维空间到二维空间的转换,详细计算虚拟对象与真实场景之间的几何关系,并应用二维仿射变换处理二维图像,以实现更精确的计算。最后,结合光照一致性估计,使用差分渲染法将虚拟对象准确地插入到真实场景中实现虚实融合。实验结果表明,虚拟物体可以完全按照尺寸和体积融合到真实场景中,融合后的几何一致性提升了15%以上,该方法为增强现实的应用奠定了基础。With the rapid development of three-dimentional technologies,geometric and illumination consistency play an important role in the realistic rendering of virtual objects superimposed on real scenes. In order to construct the coordinate measurement system of real and virtual scenes of a stereo camera,realize the geometric and illumination consistency in real fusion,and improve the realism of virtual-real fusion,a geometric consistency virtual-real fusion method was proposed. At transformation from three to two-dimensional space was used for detailed calculation of the geometric relationship between a virtual object and real scene. Following this,a two-dimensional affine transformation was applied to process the two-dimensional images for a more accurate calculation. Finally,combined with the illumination consistency estimation,the virtual object was accurately inserted into the real scene using the differential rendering method to realize virtual-real fusion. The experimental results show that the virtual object can be fused into the real scene completely in terms of size and volume. The geometric consistency after fusion is increased by more than 15%. This verifies the effectiveness of the method and lays a foundation for applications of augmented reality.

关 键 词：增强现实 虚实融合 几何一致性 光照一致性 差分渲染 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]