基于双线性注意力网络的农业灯诱害虫细粒度图像识别研究  

Research on Fine-Grained Image Recognition of Agricultural Light-Trap Pests Based on Bilinear Attention Network

作　　者：姚青[1] 姚波 吕军[1] 唐健[2] 冯晋 朱旭华 YAO Qing;YAO Bo;Lü Jun;TANG Jian;FENG Jin;ZHU XuHua(School of Information Science and Technology,Zhejiang Sci-Tech University,Hangzhou 310018;Rice Technology Research and Development Center,China National Rice Research Institute,Hangzhou 311401;Zhejiang Top Cloud-Agri Technology Co.,Ltd.,Hangzhou 310015)

机构地区：[1]浙江理工大学信息学院,杭州310018 [2]中国水稻研究所稻作技术研究与发展中心,杭州311401 [3]浙江省托普云农科技股份有限公司,杭州310015

出　　处：《中国农业科学》2021年第21期4562-4572,共11页Scientia Agricultura Sinica

基　　金：国家“863”计划(2013AA102402);浙江省公益性项目(LGN18C140007);浙江省自然科学基金(LY20C140008)。

摘　　要：【目的】智能虫情测报灯诱捕到的农业害虫因种类繁多、虫体姿态多样、鳞片脱落等原因造成有些害虫图像存在种间相似和种内差异的现象。为了提高农业灯诱害虫识别率,针对YOLOv4检测模型检测到且容易混淆的19种灯诱害虫,本文提出了基于双线性注意力网络的农业灯诱害虫细粒度图像识别模型。【方法】首先,根据灯诱害虫外观图像的相似性和检测误检的情况,将19种害虫分为6类;将所有害虫图像通过补边操作使得长宽相等,并缩放至统一尺寸224×224像素。为了提高模型的鲁棒性和泛化能力,对害虫图像进行镜像翻转、旋转180度、高斯噪声和均值滤波的数据增强,训练集、验证集和测试集样本量按照8﹕1﹕1比例划分。然后,针对6类19种农业灯诱害虫细粒度图像,建立了基于双线性注意力网络的农业灯诱害虫识别模型(bilinear-attention pest net,BAPest-net),模型包括双线性特征提取、注意力机制和分类识别3个模块;通过修改特征提取模块的下采样方式提高特征提取能力;添加注意力机制模块让整个模型更关注于局部细节的特征,将双线性结构中的上下两个注意力机制的输出进行外积运算增加细粒度特征的权重,提高识别的准确性和学习效率;模型优化器使用随机梯度下降法SGD,分类模块中使用全局平均池化,旨在对整个网络从结构上做正则化防止过拟合。最后,在同一个训练集训练VGG19、Densenet、ResNet50、BCNN和BAPest-net 5个模型,对6类相似的19种农业灯诱害虫进行识别,以精准率、Precision-Recall(PR)曲线和平均识别率作为模型的评价指标。【结果】BAPest-net对6类相似的19种农业灯诱害虫平均识别率最高,达到94.9%;BCNN次之,为90.2%;VGG19模型最低,为82.1%。BAPest-net识别的6类害虫中4类鳞翅目害虫的平均识别率均大于95%,表明该模型能较好地识别出鳞翅目害虫。测试结果中仍存在少�【Objective】Some agricultural pests trapped by the intelligent light traps show the intraspecies difference and interspecies similarity due to a variety of pest species,different pest poses and scale missing.To improve the identification rate of agricultural light-trap pests,a fine-grained image identification model of agricultural light-trap pests based on bilinear attention network(BAPest-net)was proposed to identify 19 pest species which were easily misjudged by YOLOv4 model.【Method】Firstly,according to the appearance similarity and false detection results,19 light-trap pest species were divided into 6 similar classes.All the pest images were processed to be equal in length and width through the edge-filling operation.Then,they were scaled to a uniform size of 224×224 pixels.In order to improve the robustness and generalization ability of model,the pest images were enhanced by mirror and flipping,rotation by 180 degrees,Gaussian noise,and mean filtering.The proportions of training set,validation set,and test set in samples are 80%,10%and 10%respectively.An agricultural light-trap pest identification model based on bilinear attention network(bilinear-attention pest net,BAPest-net)was developed to identify 19 pest species belong to 6 similar pest classes.The BAPest-net model consisted of three modules,which were a feature extraction module,an attention mechanism module and an identification module.The down-sampling step in the feature extraction module was post-handled to extract more features.The attention mechanism model could make the model focus on the local features,which could increase the identification rate and learning efficiency.The model optimizer used the stochastic gradient descent method,and the global average pooling was used in the classification module to avoid overfitting from the structure of the entire network.Finally,the five models,including VGG19,Densenet,ResNet50,bilinear model and BAPest-net,were training on the same training set and were used to test 19 light-trap pests in the 6

关 键 词：农业灯诱害虫 害虫识别 细粒度图像 双线性 注意力机制 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] S477[自动化与计算机技术—计算机科学与技术]