结合跨层特征融合与级联检测器的防震锤缺陷检测  

Combining cross-layer feature fusion with cascade detectors for anti-vibration hammer defects detection

作　　者：梁华刚[1] 赵慧霞 刘丽华 岳鹏 郑振宇 Liang Huagang;Zhao Huixia;Liu Lihua;Yue Peng;Zheng Zhenyu(School of Electronics and Control Engineering,Chang’an University,Xi’an 710064,China)

机构地区：[1]长安大学电子与控制工程学院,西安710064

出　　处：《中国图象图形学报》2023年第11期3485-3496,共12页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61973243);陕西省重点研发计划项目(2020ZDLGY09-03)。

摘　　要：目的防震锤可以减少输电线路的周期性震动以降低线路的疲劳损害,定期对防震锤进行巡检非常必要。针对目前无人机巡检输电线路所得航拍图像背景复杂,而种类较多、形状各异以及特性不一的防震锤在航拍图像中占据像素面积很小,导致防震锤检测过程中出现的检测精度低、无法确定缺陷类型等问题,提出了一种结合跨层特征融合和级联检测器的防震锤缺陷检测方法。方法本文使用无人机对防震锤部件巡检的航拍图像进行数据扩充建立防震锤缺陷检测数据集,并划分了4种缺陷类型,为研究提供了数据基础。首先,以VGG16(Visual Geometry Group 16-layer network)为基础对1、3、5层特征进行特征融合得到特征图,平衡了语义信息和空间特征;其次,使用3个级联检测器对目标进行分类定位,减小了交并比(intersection over union,IoU)阈值对网络性能的影响;最后,将非极大值抑制法替换为Soft-NMS(soft non-maximum suppression)算法,去除边界框保留了最佳结果。结果在自建数据集上验证网络模型对4种防震锤缺陷类型的检测效果,与现有基于深度学习的其他6种先进算法相比,本文算法的平均准确率比Fast R-CNN(fast region-based convolutional network)、Faster R-CNN、YOLOv4(you only look once version 4)分别提高了13.5%、3.4%、5.8%,比SSD300(single shot MultiBox detector 300)、YOLOv3、RetinaNet分别提高了9.5%、8.5%、8%。与Faster R-CNN相比,本文方法的误检率降低了5.61%,漏检率降低了3.01%。结论本文提出的防震锤缺陷检测方法对不同背景、不同光照、不同角度、不同尺度、不同种类和不同缺陷种类的防震锤均有较好的检测结果,不但可以更好地提取防震锤的特征,而且还能提高分类和位置预测网络的定位精度,从而有效提高了防震锤缺陷检测算法的准确率,在满足防震锤巡检工作实际检测要求的同时还具有较好的鲁棒性和有效性。Objective Anti-vibration hammers can reduce the periodic vibration of transmission lines to minimize line fatigue damage.Therefore,a regular inspection of these hammers is necessary.Previous studies on anti-vibration hammers for transmission lines have mostly focused on the identification or fault classification of anti-vibration hammers with only one case of deficiency.However,the detection methods for such small-scale targets are limited,and their leakage and false detection rates remain very high,which cannot guarantee the safe operation of transmission lines.Therefore,in view of the complex background of the aerial images obtained from the current unmanned aerial vehicle(UAV)inspection of transmis⁃sion lines,the different types,shapes,and characteristics of anti-vibration hammers occupying a small pixel area in these aerial images can lead to problems,such as inability to determine the types of defects and the low detection accuracy in the anti-vibration hammer detection process.In this paper,we propose an anti-shock hammer defect detection method based on cross-layer feature fusion and cascade detector.Method Given the lack of a public anti-vibration hammer dataset at home and abroad for targeted research,this paper takes the aerial images taken via the UAV inspection of anti-vibration hammer components as the original data and then expands the dataset by geometric and contrast transformation to ensure the equalization of the number of different types of anti-vibration hammers in the dataset and to establish an anti-vibration hammer defect detection dataset.The anti-vibration hammer defects are then refined and classified into four categories,namely,normal,corroded,broken,and collision,to serve as the data basis for the algorithm research designed in this paper.The anti-shock hammer defect detection algorithm is then designed.The proposed anti-shock hammer defect detec⁃tion method is mainly divided into two major parts,namely,the feature extraction network and classification location pre⁃diction networ

关 键 词：防震锤缺陷 深度学习 小尺度目标检测 跨层特征融合 级联检测器 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]