基于改进Mask R-CNN的刮板输送机铁质异物多目标检测  

Multi-object detection of iron foreign bodies in scraper conveyor based on improved Mask R-CNN

作　　者：史凌凯 耿毅德[2,3] 王宏伟 王洪利[2] SHI Lingkai;GENG Yide;WANG Hongwei;WANG Hongli(College of Safety and Emergency Management Engineering,Taiyuan University of Technology,Taiyuan 030024,China;Center of Shanxi Engineering Research for Coal Mine Intelligent Equipment,Taiyuan University of Technology,Taiyuan 030024,China;Postdoctoral Workstation,Shanxi Coking Coal Group Co.,Ltd.,Taiyuan 030024,China;College of Mechanical and Vehicle Engineering,Taiyuan University of Technology,Taiyuan 030024,China)

机构地区：[1]太原理工大学安全与应急管理工程学院,山西太原030024 [2]太原理工大学山西省煤矿智能装备工程研究中心,山西太原030024 [3]山西焦煤集团有限责任公司博士后工作站,山西太原030024 [4]太原理工大学机械与运载工程学院,山西太原030024

出　　处：《工矿自动化》2022年第10期55-61,共7页Journal Of Mine Automation

基　　金：山西省基础研究计划项目(202103021223123);山西省揭榜招标项目(20201101005)。

摘　　要：刮板输送机是煤矿井下的关键运输设备,铁质异物进入刮板输送机会引发磨损、断链等,甚至会造成停产、伤人等严重事故。现有刮板输送机异物识别方法存在对井下图像的适应性较差、无法区分异物类别与数量等问题。针对上述问题,提出了一种基于改进掩码区域卷积神经网络(Mask R-CNN)的刮板输送机铁质异物多目标检测方法。采用基于Laplace算子的图像增强算法对井下低照度、高粉尘环境下采集的图像进行预处理,对增强后的图像进行标注,制作数据集。采用Mask R-CNN模型的ResNet-50特征提取器获取铁质异物图像特征;采用特征金字塔网络进行特征融合,保证同时拥有高层的语义特征(如类别、属性等)和低层的轮廓特征(如颜色、轮廓、纹理等),以提高小尺度铁质异物识别精度;针对Mask R-CNN模型生成的锚点与待检测的铁质异物尺寸不对应的问题,对Mask R-CNN模型进行改进,采用k-meansⅡ聚类算法代替原来的锚点生成方案,通过遍历数据集中标注框的长宽信息得到聚类中心点,实现刮板输送机铁质异物多目标检测。实验结果表明,改进Mask R-CNN模型对单张图像的平均检测时间为0.732 s,与Mask R-CNN,YOLOv5相比,分别缩短0.093,0.002 s;平均精度为91.7%,与Mask R-CNN,YOLOv5相比,分别提高11.4%,2.9%。The scraper conveyor is the key transportation equipment in the coal mine. The iron foreign body entering the scraper conveyor will lead to wear and tear, chain breakage, and even cause serious accidents such as production stoppage and personal injury. The existing scraper conveyor foreign bodies identification method has the problems of poor adaptability to underground images and the incapability of distinguishing the types and quantities of foreign bodies. To solve the above problems, a multi-object detection method for iron foreign bodies in scraper conveyor based on improved mask region-convolutional neural network(Mask R-CNN) is proposed.The image enhancement algorithm based on the Laplace operator is used to preprocess the images collected under the environment of low illumination and high dust. The enhanced images are marked to make a data set. The ResNet-50 feature extractor of the Mask R-CNN model is used to obtain the image features of iron foreign bodies.The feature pyramid network is used for feature fusion to ensure both high-level semantic features(such as category, attribute, etc.) and low-level contour features(such as color, contour, texture, etc.), so as to improve the accuracy of small-scale iron foreign body identification. To solve the problem that the anchor point generated by the Mask R-CNN model does not correspond to the size of the iron foreign body to be detected, the Mask R-CNN model is improved. K-means Ⅱ clustering algorithm is used to replace the original anchor point generation scheme. The cluster center point is obtained by traversing the length and width information of the tag box in the data set, so as to achieve the multi-object detection of iron foreign bodies in the scraper conveyor. The experimental results show that the average detection time of the improved Mask R-CNN model is 0.732 s, which is shortened by 0.093 s and 0.002 s compared with Mask R-CNN and YOLOv5 respectively. The average precision is 91.7%, which is 11.4% and 2.9% higher than that of Mask R-CNN and YOLOv

关 键 词：刮板输送机 铁质异物 多目标检测 深度学习 Mask R-CNN k-meansⅡ聚类算法 

分 类 号：TD634.2[矿业工程—矿山机电]