融合渐进式策略的轻量化特征点提取与匹配方法  

Lightweight method of feature point extraction and matching incorporating a progressive strategy

作　　者：杨潞霞 任佳乐 张红瑞 韩睿 崔耀文 马永杰[3] YANG Luxia;REN Jiale;ZHANG Hongrui;HAN Rui;CUI Yaowen;MA Yongjie(School of Computer Science and Technology,Taiyuan Normal University,Jinzhong 030619,China;Shanxi Provincial Key Laboratory of Intelligent Optimization Computing and Blockchain Technology Taiyuan Normal University,Jinzhong 030619,China;School of Physics and Electrical Engineering,Northwest Normal University,Lanzhou 730070,China)

机构地区：[1]太原师范学院计算机科学与技术学院,山西晋中030619 [2]太原师范学院智能优化计算与区块链技术山西省重点实验室,山西晋中030619 [3]西北师范大学物理与电子工程学院,甘肃兰州730070

出　　处：《液晶与显示》2024年第11期1544-1556,共13页Chinese Journal of Liquid Crystals and Displays

基　　金：国家自然科学基金(No.62066041);山西省重点研发计划(No.202102010101008);太原师范学院研究生创新项目(No.SYYJSYC-2392)。

摘　　要：针对基于SuperPoint网络的特征匹配方法在光照、姿态、角度等挑战下,特征点提取准确率低、计算参数量大的问题,提出了一种融合渐进式策略的轻量化特征点提取与匹配方法。首先,利用深度可分离卷积对SuperPoint网络进行结构调整,以降低模型参数计算量;其次,在特征提取部分搭建注意力模块增强网络在空间上的特征提取能力,并设计渐进式多尺度特征融合模块捕获目标细节,增强特征的表达能力;最后,利用SuperGlue算法对所得到的特征点进行匹配。在Hpatches数据集上进行实验分析,实验结果表明,所提算法在光照变换场景下匹配平均准确率(mAP)和特征点重复度(Rep)达到了86%和70%,在视角变换场景下mAP和Rep达到了78%和68%。所提算法不仅在特征匹配中表现出一定的优势,同时将其应用于视频拼接中也获得了较好的效果。To address the issues of the feature-matching method based on the SuperPoint network,such as low accuracy in feature-point extraction and high computational cost under challenges of lighting,pose and angles,a lightweight feature point extraction and matching method under a progressive strategy is put forward.Firstly,to reduce the model’s computational cost,the SuperPoint network is modified using depthwise separable convolution.Secondly,an attention module is built in the feature extraction part to strengthen the network’s spatial feature extraction capability.Also,a progressive multi-scale feature fusion module is designed to capture object details and boost feature representation capabilities.Finally,the obtained feature points are matched using the SuperGlue algorithm.Experimental analysis on the Hpatches dataset shows that the proposed algorithm achieves an average matching accuracy(mAP)of 86%and feature point repeatability(Rep)of 70%in illumination change scenarios,and mAP of 78%and Rep of 68%in viewpoint change scenarios.The proposed algorithm not only shows certain advantages in feature matching,but also achieves good results when applied to video stitching.

关 键 词：特征点提取 特征点匹配 轻量化 注意力机制 渐进式多尺度特征融合 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]