采用改进YoloV4模型检测复杂环境下马铃薯  

Potato detection in complex environment based on improved YoloV4 model

作　　者：张兆国[1,2] 张振东 李加念 王海翼[1,2] 李彦彬 李东昊 Zhang ZhaoGuo;Zhang Zhendong;Li Jianian;Wang Haiyi;Li Yanbin;Li Donghao(Faculty of Modern Agricultural Engineering,Kunming University of Science and Technology,Kunming 650500,China;Yunnan Province University of Chinese Medicine Mechanization Research Center,Kunming 650500,China)

机构地区：[1]昆明理工大学现代农业工程学院,昆明650500 [2]云南省高校中药材机械化工程研究中心,昆明650500

出　　处：《农业工程学报》2021年第22期170-178,共9页Transactions of the Chinese Society of Agricultural Engineering

基　　金：云南省重大科技专项(2018ZC001);重庆市科研机构绩效激励引导专项(cstc2019jxj100002)。

摘　　要：为解决马铃薯联合收获机在作业过程中分级清选的问题,并在收获作业过程中实时监测评估收获状态,该研究提出一种在光照亮度变化大、土壤与薯块遮挡、机器振动以及尘土干扰等情况下对马玲薯进行识别检测并快速准确获取马铃薯数量以及损伤情况的机器学习模型。在卷积神经残差网络中引入轻量级注意力机制,改进YoloV4检测网络,并将YoloV4结构中的CSP-Darknet53网络替换为MobilenetV3网络,完成特征提取。试验结果表明,基于卷积神经网络的深度学习方法相比于传统Open-CV识别提高了马铃薯识别精度,相比于其他传统机器学习模型,MobilenetV3-YoloV4识别速度更快,马铃薯识别的全类平均准确率达到91.4%,在嵌入式设备上的传输速度为23.01帧/s,模型鲁棒性强,能够在各种环境下完成对正常马铃薯和机械损伤马铃薯的目标检测,可为马铃薯联合收获机智能清选以及智能收获提供技术支撑。Potatoes have been provided more guarantee for the national food security as the fourth largest food crop in China.However,the relatively low harvest efficiency and intelligence operation have been serious bottlenecks in the potato industry at present.It is necessary to real-time detect and evaluate the potato’s state during harvesting,particularly on the grading and cleaning treatment in a combine harvester.In this study,a machine learning model was proposed to quickly and accurately identify the number and damage of potatoes under the various working environments,such as light brightness,shielding of soil and potato blocks,machine vibration,and dust interference.A lightweight attention mechanism was also introduced into the convolutional neural residual network.The attention mechanism acted on the full connection layer was then added to the YoloV4 using the different weights of each channel.The original K-means aggregation was abandoned,due to the relatively consistent size of potatoes.Three output layers of YoloV4 were combined into a large output layer,where the cspdarknet53 was replaced by the mobile netv3 network structure to realize the feature extraction.As such,the MobilenetV3 presented an inverse residual structure with the deeply separable convolution blocks and linear bottlenecks.The amount of calculation and parameters were reduced to 1/4 of the original using the H-swish activation function instead of the swish function,thereby significantly improving the detection speed without loss of the recognition rate of the potato.Some operations were selected to process the collected images for the better generalization ability of the training model,including the horizontal flip,vertical flip,mirror image,and adding noise.Among them,there were 1296 images with high quality,322 images of mechanically damaged potatoes,and 231 images with disturbing for comparison.The collected image data set was used for the model training at the workstation,where the loss value of training set and test set were recorded.Sub

关 键 词：机器视觉 目标检测 深度学习 马铃薯 YoloV4 MobilenetV3 

分 类 号：S24[农业科学—农业电气化与自动化]