基于改进Mask R-CNN模型的工厂化养蚕蚕体识别与计数  

Identification and Counting of Silkworms in Factory Farm Using Improved Mask R-CNN Model

作　　者：何锐敏 郑可锋[2] 尉钦洋 张小斌[2] 张俊 朱怡航 赵懿滢 顾清[2] HE Ruimin;ZHENG Kefeng;WEI Qinyang;ZHANG Xiaobin;ZHANG Jun;ZHU Yihang;ZHAO Yiying;GU Qing(Shengzhou Mosang High-tech Co.,Ltd.,Shaoxing 312400,China;Institute of Digital Agriculture,Zhejiang Academy of Agricultural Sciences,Hangzhou 310021,China)

机构地区：[1]嵊州陌桑高科股份有限公司,浙江绍兴312400 [2]浙江省农业科学院数字农业研究所,浙江杭州310021

出　　处：《智慧农业（中英文）》2022年第2期163-173,共11页Smart Agriculture

基　　金：浙江省重点研发计划项目(2019C02001)。

摘　　要：精准饲喂是全龄人工饲料工厂化养蚕节本增效的核心技术之一,家蚕自动化识别与计数是实现精准饲喂的关键环节。本研究基于机器视觉系统获取工厂化养蚕过程中蚕在4龄和5龄期的数字图像,利用改进深度学习模型Mask R-CNN检测蚕体和残余饲料。通过在Mask R-CNN模型框架中加入像素重加权策略和边界框细调策略,从噪声数据中训练一个鲁棒性更好的目标检测模型,实现模型性能的优化,提高对蚕体和饲料边界的检测和分割能力。改进Mask R-CNN模型对蚕的检测和分割交并比阈值为0.5时的平均精度(Average Precision at IoU=0.5,AP50)分别为0.790和0.795,识别准确率为96.83%;对残余饲料的检测和分割AP50分别为0.641和0.653,识别准确率为87.71%。模型部署在NVIDIA Jetson AGX Xavier开发板上,单张图像平均检测时间为1.32 s,最长检测时间为2.05 s,运算速度可以满足养蚕盒单元在生产线上移动实时检测的要求。该研究为工厂化养蚕精准饲喂信息系统和投喂装置的研发提供了核心算法,可提高人工饲料的利用率,提升工厂化养蚕生产管理水平。Factory-like rearing of silkworm(Bombyx mori) using artificial diet for all instars is a brand-new rearing mode of silkworm.Accurate feeding is one of the core technologies to save cost and increase efficiency in factory silkworm rearing.Automatic identification and counting of silkworm play a key role to realize accurate feeding.In this study,a machine vision system was used to obtain digital images of silkworms during main instars,and an improved Mask R-CNN model was proposed to detect the silkworms and residual artificial diet.The original Mask R-CNN was improved using the noise data of annotations by adding a pixel reweighting strategy and a bounding box fine-tuning strategy to the model frame.A more robust model was trained to improve the detection and segmentation abilities of silkworm and residual feed.Three different data augmentation methods were used to expand the training dataset.The influences of silkworm instars,data augmentation,and the overlap between silkworms on the model performance were evaluated.Then the improved Mask R-CNN was used to detect silkworms and residual feed.The AP50(Average Precision at IoU=0.5) of the model for silkworm detection and segmentation were 0.790 and0.795,respectively,and the detection accuracy was 96.83%.The detection and segmentation AP50 of residual feed were 0.641and 0.653,respectively,and the detection accuracy was 87.71%.The model was deployed on the NVIDIA Jetson AGX Xavier development board with an average detection time of 1.32 s and a maximum detection time of 2.05 s for a image.The computational speed of the improved Mask R-CNN can meet the requirement of real-time detection of the moving unit of the silkworm box on the production line.The model trained by the fifth instar data showed a better performance on test data than the fourth instar model.The brightness enhancement method had the greatest contribution to the model performance as compared to the other data augmentation methods.The overlap between silkworms also negatively affected the performance of t

关 键 词：机器视觉系统 养蚕过程 蚕体 人工饲料 运算速度 信息系统 噪声数据 数字图像 

分 类 号：S126[农业科学—农业基础科学] TP18[自动化与计算机技术—控制理论与控制工程]