基于深度学习的图像拼接算法研究综述  

Survey on image stitching algorithm based on deep learning

作　　者：杨利春 田彬 党建武[2] Yang Lichun;Tian Bin;Dang Jianwu(Key Laboratory of Optoelectronic Technology&Intelligent Control,Ministry of Education,Lanzhou Jiaotong University,Lanzhou 730070,Chin;School of Electronic&Information Enginee-ring,Lanzhou Jiaotong University,Lanzhou 730070,China)

机构地区：[1]兰州交通大学光电技术与智能控制教育部重点实验室,兰州730070 [2]兰州交通大学电子与信息工程学院,兰州730070

出　　处：《计算机应用研究》2024年第7期1930-1939,共10页Application Research of Computers

基　　金：国家自然科学基金资助项目(62067006);中央引导地方科技发展专项资金资助项目(YDZX20206200003492);甘肃省教育科技创新项目(2021jyjbgs-05);甘肃省知识产权计划资助项目(21ZSCQ013);2022年度中央引导地方科技发展资金资助项目(22ZY1QA002);教育部人文社会科学研究项目(21YJC880085)。

摘　　要：图像拼接是计算机视觉和计算机图形学中的一个重要分支,在三维成像等方面具有广泛的应用。相较于传统基于特征点检测的图像拼接框架,基于深度学习的图像拼接框架具有更强的场景泛化表现。目前虽然关于基于深度学习的图像拼接研究成果众多,但仍缺少相应研究的全面分析和总结。为了便于该领域后续工作的开展,梳理了该领域近10年的代表性成果。在对传统拼接方法与基于深度学习的图像拼接方法对比的基础上,从图像拼接研究领域中的单应性估计、图像拼接和图像矩形化三个子问题出发,进行了学习策略及模型架构设计、经典模型回顾、数据集等方面的整理与分析。总结了基于深度学习的图像拼接研究方法的一些特点和当前该领域的研究现状,并对未来研究前景进行了展望。Image stitching is an important branch in computer vision and computer graphics,and has a wide range of applications in 3D imaging and other aspects.Compared with the traditional image stitching framework based on feature point detection,the image stitching framework based on deep learning has stronger scene generalization performance.Although there are many research results on image stitching based on deep learning,there is still a lack of comprehensive analysis and summary of the corresponding research.In order to facilitate the subsequent work in this field,this paper sorted out the representative results in this field in the past 10 years.Based on the comparison between traditional stitching methods and deep learning-based image stitching methods,it collated and analysed the learning strategy and model architecture design,classical model review,and dataset from the three sub-problems of homography estimation,image stitching,and image rectangling in the research field of image stitching.It summarized some features of deep learning-based image stitching research methods and summarized the current research status in the field,and prospected the future research prospects.

关 键 词：单应性估计 图像拼接 图像矩形化 深度学习 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]