基于改进FCN-8s的灵武长枣图像分割方法  

Image segmentation method for Lingwu long jujubes based on improved FCN-8s

作　　者：薛君蕊 王昱潭[1] 曲爱丽[1] 张加欣 邢振伟 魏海岩 孙浩伟 Xue Junrui;Wang Yutan;Qu Aili;Zhang Jiaxin;Xing Zhenwei;Wei Haiyan;Sun Haowei(School of Mechanical Engineering,Ningxia University,Yinchuan 750021,China)

机构地区：[1]宁夏大学机械工程学院,银川750021

出　　处：《农业工程学报》2021年第5期191-197,共7页Transactions of the Chinese Society of Agricultural Engineering

基　　金：国家自然科学基金(No.31660239)。

摘　　要：针对不同成熟度灵武长枣图像中多尺度长枣目标的分割问题,该研究提出了一种基于改进FCN-8s的灵武长枣图像分割方法。首先,建立包含不同成熟度灵武长枣图像的数据集。其次,提出一个多尺度特征提取模块,该模块以3×3卷积为主分支,增加1×1卷积和5×5深度可分离卷积作为辅助分支,以提取灵武长枣图像中的多尺度特征。然后,用多尺度特征提取模块替换FCN-8s中的3×3卷积,又对FCN-8s网络结构做了一定的改进,得到了改进FCN-8s。最后,在灵武长枣数据集上进行试验,结果表明,改进FCN-8s的枣类交并比、平均交并比、像素准确率、召回率和像素准确率、召回率的调和平均值F1分数分别达到了93.50%、96.41%、98.44%、97.86%和98.15%,比原FCN-8s的各项评价指标分别高出了11.31、6.20、1.51、5.21和3.14个百分点。网络参数量为5.37×10^(6),分割速度为16.20帧/s。改进FCN-8s满足了灵武长枣智能化采摘机器人对视觉识别系统的要求,为实现灵武长枣的智能化采摘提供了技术支持。Lingwu long jujube is commonly referred to as Chinese date,one of the special advantage fruits in Ningxia Hui Autonomous Region.Currently,image segmentation has widely been used to identify the ripeness of Lingwu long jujubes in modern agriculture.Traditional image segmentation can achieve better segmentation effects for the red part of Lingwu long jujubes,but not for the green part.Consequently,deep learning can contribute to multi-scale object segmentation for the jujubes with various ripeness.Besides,the improved network models can be expected to extract multi-scale features from the different sizes of objects in Lingwu long jujubes images.In the actual operation,a visual recognition system needs to meet the execution time of an actuator in a picking robot under a complex working environment.Correspondingly,the network model of image segmentation is required to be small,shallow,and high accuracy at a relatively low picking speed.In this study,an improved FCN-8 s was selected as the basic network for the image segmentation of Lingwu long jujubes with different ripeness.Firstly,the image dataset of Lingwu long jujubes was established,including 196 training and 46 test images.Since the initial resolution of collected images was 4000×3000,the resolution of 1280×960 was used for training,in order to improve the training efficiency.Then,a multi-scale feature extract module was proposed to extract features beyond 3×3 scale.Specifically,a 1×1 convolution and a 5×5 convolution were added into a single 3×3 standard convolution in FCN-8 s.A depth-wise separable convolution was applied to the 5×5 convolution to reduce parameters,considering that numerous parameters were introduced after adding two auxiliary branches.As such,the 3×3 standard convolution in FCN-8 s was replaced with the proposed module.Some improvements were made on FCN-8 s to reduce the parameters of the network for high efficiency.The 14 th and 15 th convolution layers were removed from the original FCN-8 s to maintain the segmentation accuracy,an

关 键 词：语义分割 图像识别 图像分类 FCN-8s 深度可分离卷积 灵武长枣图像 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]