基于点特征匹配的电力多模态图像配准方法  

Power multi-modal image registration method based on point feature matching

作　　者：钟宇峰 林昊 林楠 汪铭峰 郭世晓 洪兆溪 孔麒 冯毅雄 ZHONG Yufeng;LIN Hao;LIN Nan;WANG Mingfeng;GUO Shixiao;HONG Zhaoxi;KONG Qi;FENG Yixiong(Hangzhou Power Supply Company,State Grid Zhejiang Electric Power Co.,Ltd.,Hangzhou 310000,China;School of Mechanical Engineering,Zhejiang University,Hangzhou 310027,China)

机构地区：[1]国网浙江省电力有限公司杭州供电公司,浙江杭州310000 [2]浙江大学机械工程学院,浙江杭州310027

出　　处：《工程设计学报》2024年第6期707-715,共9页Chinese Journal of Engineering Design

基　　金：浙江省重点研发计划资助项目(2022C01238,2021C01110);国网杭州供电公司群众性创新项目(5211HZ230015)。

摘　　要：电力设备的可见光图像与红外图像配准作为一种常见的多模态数据配准应用模式,在变电站巡检过程中具有重要的应用价值。但是,由于巡检机器人与人工捕捉的数据在分辨率、视角及光照条件上的差异,电力设备的可见光图像与红外图像的配准存在较大挑战。针对2种图像在特征层级存在同一性,提出了一种基于电力设备边缘点特征的尺度不变特征变换算法,通过构建双边特征描述符并将双边特征点之间的距离作为置信度约束,以减少可见光图像与红外图像的模态差异,最终实现变电站主配网关键设备多源异构图像数据的高精度配准。实验结果表明,所提出的方法对分辨率、视角变化具有良好的鲁棒性,在电力设备多模态图像的实际配准应用中表现出优异性能。研究结果为提升电力设备巡检的智能化和可靠性提供了理论支撑和工程实践指导。As a common application mode of multi-modal data registration,the registration of visible images and infrared images of power equipment has significant application value in substation inspection process.However,due to the differences in resolution,perspective and lighting conditions between data captured by inspection robots and humans,the registration of visible images and infrared images of power equipment faces considerable challenges.Aiming at the feature-level consistency between two types of images,a scale-invariant feature transform algorithm based on the power equipment edge point features was proposed.By constructing bilateral feature descriptors and incorporating the distance between bilateral feature points as a confidence constraint,the modal difference between visible images and infrared images was reduced,and the high-precision registration of multi-source heterogeneous image data of critical equipment for substation primary and secondary power distribution networks was achieved.The experimental results showed that the proposed method exhibited strong robustness against variations in resolution and perspective,delivering excellent performance in practical applications of multi-modal image registration for power equipment.The research results provide theoretical support and engineering guidance for enhancing the intelligence and reliability of power equipment inspection.

关 键 词：变电站巡检 多模态 图像配准 边缘点特征 尺度不变特征变换 

分 类 号：TH741[机械工程—光学工程] TP24[机械工程—仪器科学与技术]