基于特征增强与Transformer的煤矿输送带异物检测  

Coal mine conveyor belt foreign object detection based on feature enhancement and Transformer

作　　者：高涵 赵培培 于正 肖涛 李肖利 李良先 GAO Han;ZHAO Peipei;YU Zheng;XIAO Tao;LI Xiaoli;LI Liangxian(School of Information and Control Engineering,China University of Mining and Technology,Xuzhou 221116,China;Changzhou Haitu Information Technology Co.,Changzhou 213000,China;Zhaogu No.2 Mine,Jiaozuo Coal Industry(Group)Xinxiang Energy Co.,Ltd.,Xinxiang 453633,China)

机构地区：[1]中国矿业大学信息与控制工程学院,江苏徐州221116 [2]常州海图信息科技股份有限公司,江苏常州213000 [3]焦作煤业(集团)新乡能源有限公司赵固二矿,河南新乡453633

出　　处：《煤炭科学技术》2024年第7期199-208,共10页Coal Science and Technology

基　　金：国家重点研发计划资助项目(2022YFC3004700)。

摘　　要：输送带是煤矿井下最重要的运输设备之一,在输送工作中会因锚杆、槽钢、大块矸石等异物混入造成输送带撕裂、落煤口阻塞等重大安全事故,严重影响运输效率,甚至威胁工人生命安全。为了解决现有输送带异物检测算法存在的对细长物体表征能力弱、弱语义特征提取能力差等问题,设计了一种基于低层级特征增强与Transformer机制的异物检测算法(Feature Enhancement and Transformer YOLO,FET–YOLO)。首先,针对现有检测网络难以提取细长物体特征的问题,引入可变形卷积以提升网络对细长异物的形状特性的适应性,并使用MobileViT模块增加图像中异物与背景的区分度,以提取出更符合细长异物的多样性特征,削弱背景噪声的干扰;其次,构建低层级特征增强模块(Low-Level Feature Enhancement Module,LFEM),提升异物弱语义特征在检测网络中的表达能力,以降低漏检、错检的概率;最后,引入鬼影混洗卷积(GSConv)减少因特征图尺寸变化造成的信息丢失,保证网络高效提取特征的同时,减少模型参数量。利用煤矿井下输送带工作视频制作训练集和验证集,并将提出的算法与现有的3种输送带检测算法对比,实验结果表明:所提出的算法可以更好的解决输送带异物目标检测中细长物体检测效果差、弱语义特征提取困难的问题,具有更高的检测精度、同时符合输送带检测场景对检测实时性的要求,对于分辨率大小为640×640的图像mAP@0.5可达0.875,mAP@0.5:0.95可达0.543,检测速度为75 fps。Conveyor belt is one of the most important transportation equipment in underground coal mines.Anchor rod,channel steel,large gangue,and other foreign objects that are mixed with the conveyor belt during conveying operations cause the belt to tear,clog the coal drop opening,and cause other serious safety incidents.They seriously affect the efficiency of transportation and even threaten the lives of workers.Aiming at the existing conveyor belt foreign object detection algorithm’s problems such as weak characterization of slender objects and poor weak semantic feature extraction,a foreign object detection algorithm based on low-level feature enhancement with Transformer is designed,notated as FET–YOLO.Firstly,to address the problem that existing detection networks have difficulty in extracting features of elongated objects,deformable convolution is introduced to enhance the network’s adaptability to the shape characteristics of elongated foreign objects,and the MobileViT module is used to increase the differentiation between the foreign objects and the background in the image,in order to extract features that are more consistent with the diversity of the elongated foreign objects and to weaken the interference of background noise.Secondly,constructing a low-level feature enhancement module LFEM,to improve the rep-resentation of weak semantic features of foreign objects in the detection network in order to reduce the probability of wrong detection.Fi-nally,the introduction of gsconv reduces the information loss due to changes in the size of the feature map and ensures that the network ex-tracts features efficiently while reducing the number of model parameters.The training set and validation set are produced by using the video of conveyor belt work in an underground coal mine.The proposed algorithm is compared to three other conveyor belt detection al-gorithms,and the experimental results show that the proposed algorithm can better solve the problems of poor detection of elongated ob-jects and difficulty in wea

关 键 词：异物检测 YOLOv7-tiny 鬼影混洗卷积 输送带 深度学习 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]