基于三维球面模型的全景视频实时拼接方法  

Real-Time Stitching Method of Panoramic Videos Based on Three-Dimensional Spherical Model

作　　者：宋聪聪 高策[1] 张艳超[1] 徐嘉兴 刘海波[2] Song Congcong;Gao Ce;Zhang Yanchao;Xu Jiaxing;Liu Haibo(Precision Instrument and Equipment R&D Center,Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,Jilin,China;Engineering Research Management Department,Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,Jilin,China)

机构地区：[1]中国科学院长春光学精密机械与物理研究所精密仪器与装备研发中心,吉林长春130033 [2]中国科学院长春光学精密机械与物理研究所工程科研管理处,吉林长春130033

出　　处：《光学学报》2023年第10期65-78,共14页Acta Optica Sinica

基　　金：国家自然科学基金(51675506)。

摘　　要：针对主流配准方法被用于周扫型光电预警系统的全景图像拼接适用性有限的问题,提出一种基于三维球面模型的全景视频实时拼接方法。首先,基于周扫型光电预警系统的工作模式进行三维空间的全景重建并构建三维球面模型;通过建模的方式对不同俯仰、方位角度下探测器采集图像的像素点空间位置进行定位。然后,基于三维球面模型搜索不同俯仰角度下重叠视场在三维空间内的最佳配准线,并推导出预警图像重叠区域的配准公式。最后,通过逐行的加权融合算法和图像矫直方式实现全景图像无缝拼接。与主流的5种配准方法进行对比,实验结果表明:该方法切实可行,具有较好的全景拼接效果,有效弥补主流配准方法的不足,即使对天空等特征不明显区域的全景拼接也具有较好的适用性与实时性,全面保证了全景视频成像的连续性与稳定性,对光电预警系统全景拼接任务具有重要的应用价值。Objective The photoelectric early warning system is equipped with infrared detectors of distinct wavebands,and with high detection sensitivity to the target temperature,it realizes real-time monitoring and early warning of suspicious targets in the air by means of continuous weekly scanning.The technology of image stitching is required for panoramic video imaging in photoelectric early warning systems,and image registration is the first step to determine the effect of panoramic imaging.Currently,the mainstream registration methods in the field of image stitching are based on template matching and feature matching.Nonetheless,when mainstream registration methods are applied to the panoramic image stitching of circumferential-scanning photoelectric early warning systems,numerous issues arise.The method based on template matching predominantly carries out registration according to the gray correlation of the image in the overlapping area.It is prone to the issue of incorrect matching when applied to the real-time stitching of panoramic videos,and the nonuniqueness of the registration between frames easily causes instability and discontinuity in panoramic video imaging.The method based on feature matching has high registration accuracy,and yet it is highly dependent on the extraction of the feature points of images.Nevertheless,the early warning areas are mostly simple backgrounds such as the sky and Gobi.The overlapping area is small,and the image features are not obvious,which easily leads to registration failure.Additionally,such algorithms have high computational complexity and generally cannot meet the real-time requirement.In view of the above shortcomings,we propose a new real-time stitching method for panoramic videos on the basis of a threedimensional spherical model.This method is feasible,with a good panoramic stitching effect,and can effectively compensate for the deficiencies in mainstream registration methods.It features good applicability and real-time performance even for panoramic stitching of areas

关 键 词：图像处理 全景拼接 三维球面模型 图像配准 光电预警系统 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]