基于多源图像融合的光伏面板缺陷检测  

Defect Detection of Photovoltaic Panel Based on Multisource Image Fusion

作　　者：闫号 戴佳佳 龚小溪 吴宇祥 汪俊[1] YAN Hao;DAI Jiajia;GONG Xiaoxi;WU Yuxiang;WANG Jun(College of Mechanical&Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210006,China)

机构地区：[1]南京航空航天大学机电学院,江苏南京210006

出　　处：《红外技术》2023年第5期488-497,共10页Infrared Technology

摘　　要：传统光伏面板缺陷检测任务以人工目视方法为主,存在效率低、精度差、成本高等问题。提出基于深度学习的融合光伏面板可见光图像与红外图像的缺陷检测网络,即多源图像融合网络(MultisourceFusionNetwork,MF-Net),实现光伏面板的缺陷检测。MF-Net以YOLOv3tiny为主干结构,并针对光伏面板缺陷特征进行网络结构改进。其中包括:在特征提取模块中增加网络深度并融入密集块结构,使得MF-Net能够融合更多高层语义信息的同时增强特征的选择;将双尺度检测增加为三尺度检测,以提高网络对不同尺寸缺陷的适用度。此外,提出自适应融合模块,使特征图融合过程中可以根据像素邻域信息自适应分配融合系数。实验结果表明,相比基于YOLOv3 tiny的融合网络,改进后的融合检测网络m AP提高7.41%;自适应融合模块使m AP进一步提升2.14%,且自适应融合模块能够有效提高特征的显著性;在与单一图像(仅有可见光图像或红外图像)的检测网络及其他融合图像检测网络的对比实验中,所提出的网络F1 score最高(F1=0.86)。This study proposed a multisource fusion network(MF-Net)that combines visible and infrared images for the inspection of a photovoltaic panel to achieve photovoltaic panel defect detection,defect clas-sification,and localization.The limitations of the traditional methods include low efficiency,low accuracy,and high cost.In this study,a defect detection network was designed based on the backbone of YOLOv3-tiny.Deep layers are added to the network,constituting a dense block structure to augment semantic information on fused feature maps.The detection scale of the network was extended to improve its applicability at different scales.In addition,an adaptive weight fusion strategy was proposed to achieve feature map fusion,where the fusion coefficients can be allocated according to the pixel neighborhood information.Compared with the backbone,the results show that the mAP of our network improved by 7.41%.The performance improves(by approximately 2.14%mAP)when the weighted fusion strategy is replaced with ours,and the significance of the features can be effectively improved.Relative to other networks,the proposed network that takes the fused images as the input has the highest performance in terms of the F1 score(F1=0.86).

关 键 词：光伏面板 图像融合 缺陷检测 可见光图像 红外图像 

分 类 号：TP181[自动化与计算机技术—控制理论与控制工程]