基于对抗修复网络的输送带表面缺陷检测  

Detection of surface defects on conveyor belts based on adversarial repair networks

作　　者：杨泽霖 杨立清[1] 郝斌[2] YANG Zelin;YANG Liqing;HAO Bin(School of Automation and Electrical Engineering,Inner Mongolia University of Science and Technology,Baotou 014010,China;School of Digital and Intelligent Industry(School of Cyber Science and Technology),Inner Mongolia University of Science and Technology,Baotou 014010,China)

机构地区：[1]内蒙古科技大学自动化与电气工程学院,内蒙古包头014010 [2]内蒙古科技大学数智产业学院(网络安全学院),内蒙古包头014010

出　　处：《工矿自动化》2024年第9期108-114,166,共8页Journal Of Mine Automation

基　　金：内蒙古自治区科技计划项目(2021GG0046,2021GG0048)。

摘　　要：针对输送带缺陷数据获取和标注困难、输送带工作场景中的不稳定因素和数据波动导致基于深度学习的输送带缺陷检测方法精度低的问题,提出了一种基于对抗修复网络的输送带表面缺陷检测模型。该模型主要由自编码器结构的生成器和马尔可夫判别器组成。在训练阶段,将模拟的输送带表面缺陷图像输入生成器,得到无模拟缺陷的重构图像,提升模型对未知缺陷的泛化能力;将原始无损输送带图像、重构图像和模拟的输送带表面缺陷图像输入马尔可夫判别器,通过残差块获得特征图,提高模型对于微小缺陷的检测能力。在检测阶段,将待测图像输入训练完的生成器得到重构图像,再通过训练完的马尔可夫判别器提取待测图像与重构图像的特征图,根据待测图像与重构图像特征图之间的均方误差和待测图像特征图最大值,计算异常分数并与设定的阈值进行比较,从而判断待测图像是否存在缺陷。实验结果表明,该模型的接收操作特征曲线下面积(ROC-AUC)达0.999,精确率-召回率曲线下面积(PR-AUC)达0.997,单张图像检测时间为13.51 ms,能准确定位不同类型缺陷位置。In response to the challenges of acquiring and labeling defect data on conveyor belts,as well as the low accuracy of deep learning-based conveyor belt defect detection methods due to unstable factors and data fluctuations in working environments,this study proposed a surface defect detection model based on adversarial repair networks.The model primarily consisted of a generator with an autoencoder structure and a Markov discriminator.During the training phase,simulated surface defect images of the conveyor belt were input into the generator to obtain reconstructed images without simulated defects,enhancing the model's ability to generalize to unknown defects.The original undamaged conveyor belt images,reconstructed images,and simulated surface defect images were input into the Markov discriminator,and feature maps were obtained through a residual network,improving the model's detection capability for subtle defects.In the detection phase,the test image was input into the trained generator to obtain the reconstructed image,and the trained Markov discriminator was used to extract feature maps from both the test image and the reconstructed image.The anomaly score was calculated based on the mean squared error between the feature maps of the test image and the reconstructed image,as well as the maximum value of the feature map of the test image,and compared with a set threshold to determine whether the test image contained defects.Experimental results showed that the area under the receiver operating characteristic curve(ROC-AUC)of this model reached 0.999,the area under the precision-recall curve(PR-AUC)reached 0.997,and the detection time for a single image was 13.51 ms,which could accurately locate the positions of different types of defects.

关 键 词：输送带表面缺陷检测 对抗修复网络 自编码器 生成器 马尔可夫判别器 

分 类 号：TD528[矿业工程—矿山机电] TD634