基于级联卷积神经网络的番茄花期识别检测方法  

Tomato florescence recognition and detection method based on cascaded neural network

作　　者：赵春江[1,2] 文朝武 林森 郭文忠[2] 龙洁花 Zhao Chunjiang;Wen Chaowu;Lin Sen;Guo Wenzhong;Long Jiehua(College of Information Science,Shanghai Ocean University,Shanghai 201306,China;Beijing Agricultural Intelligent Equipment Technology Research Center,Beijing 100097,China)

机构地区：[1]上海海洋大学信息学院,上海201306 [2]北京农业智能装备技术研究中心,北京100097

出　　处：《农业工程学报》2020年第24期143-152,共10页Transactions of the Chinese Society of Agricultural Engineering

基　　金：宁夏回族自治区重点(重大)研发计划项目(2019BBF02010);国家自然科学基金项目(31601794);北京市农林科学院青年基金(QNJJ202027)。

摘　　要：对作物花期状态的准确识别是温室作物授粉的前提。为提高花期识别的准确率,该研究以温室番茄为例,提出一种基于级联卷积神经网络的番茄花期识别检测方法。首先采用改进的基于特征金字塔花束提取神经网络(Flower Extraction Feature Pyramid Networks, FE-FPN)实现番茄花束的局部区域提取,并采用Prim最小生成树对提取的花束区域图像进行识别优先级排序,然后按序将其输入到改进的Yolov3网络,实现番茄花朵不同花期的精准辨识检测。在包含4类花期、共1600幅样本的番茄花束图像数据集上进行试验验证,本文方法对番茄不同花期的检测性能较好,平均检测精度达到了82.79%,平均单张检测时间为12.54 ms,各花期检测精度为花蕾期85.71%、全开期95.46%、谢花期62.66%、初果期88.34%;相比Mask R-CNN和空间金字塔池化网络(Spatial Pyramid Pooling Networks, SPP-Net),平均检测精度提高了3.67和2.39个百分点,而且识别错误率比基础Yolov3网络降低了1.25个百分点。最后,将本文所提方法部署到大型玻璃温室环境下番茄授粉机器人上进行实际验证,识别准确率为76.67%,除去漏提取花束准确率达85.18%。研究结果可为设施番茄授粉机器人的精准作业提供重要依据。Accurate identification of the flowering state of crops is a prerequisite for pollination of greenhouse crops.In order to improve the accuracy of the florescence recognition,this study proposes a method for recognition and detection the tomato florescence based on cascaded convolutional neural networks.Due to the complex growth environment of tomato flowers,the flowers present small and multi-target distributions,and the same bouquet has the characteristics of flowers of different flowering periods.A single network can realize the recognition of tomato bouquets,but it cannot simultaneously realize the accurate recognition of the flowers in the bouquets with multiple flowering periods,resulting in insufficient flower characteristic information.In response to these problems,this paper proposes a method of cascading two-level neural networks in hopes realize the research of precise identification of tomato flower blooming period,and explore a new identification method for the precise operation of tomato pollination robot.First,the improved Flower Extraction Feature Pyramid Networks(FE-FPN)is used to achieve the region extraction of tomato bouquets,and then the Prim minimum spanning tree is used to prioritize the flowering of the extracted bouquet pictures,and finally the sorted extracted bouquet pictures are input to the improved Yolov3 the network realizes accurate identification of the flowering state of tomato flowers.Shooting at 8:00 am,12:00 noon,and 6:00 pm,respectively,and experimented on a data set consisting of 1600 tomato bouquet images,which included bud stage,full opening stage,flowering stage and early fruiting stage respectively.The first cascade improved FE-FPN network used to perform multi-scale prediction and pixel extraction of tomato bouquets,the results indicated the average correct extraction rate is 98.11%,the over extraction rate is 3.56%,and the missing extraction rate is 5.42%.The second cascade network uses an improved multi-scale and multi-input Yolov3 neural network to accurately identify

关 键 词：识别 级联神经网络 小目标检测 授粉机器人 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]