Detection method for the cucumber robotic grasping pose in clutter scenarios via instance segmentation  

作　　者：Fan Zhang Zeyu Hou Jin Gao Junxiong Zhang Xue Deng 

机构地区：[1]College of Engineering,China Agricultural University,Beijing 100083,China

出　　处：《International Journal of Agricultural and Biological Engineering》2023年第6期215-225,共11页国际农业与生物工程学报（英文）

基　　金：supported by the Beijing Innovation Consortium of Agriculture Research System (BAIC12).

摘　　要：The application of robotic grasping for agricultural products pushes automation in agriculture-related industries.Cucumber,a common vegetable in greenhouses and supermarkets,often needs to be grasped from a cluttered scene.In order to realize efficient grasping in cluttered scenes,a fully automatic cucumber recognition,grasping,and palletizing robot system was constructed in this paper.The system adopted Yolact++deep learning network to segment cucumber instances.An early fusion method of F-RGBD was proposed,which increases the algorithm's discriminative ability for these appearance-similar cucumbers at different depths,and at different occlusion degrees.The results of the comparative experiment of the F-RGBD dataset and the common RGB dataset on Yolact++prove the positive effect of the F-RGBD fusion method.Its segmentation masks have higher quality,are more continuous,and are less false positive for prioritizing-grasping prediction.Based on the segmentation result,a 4D grab line prediction method was proposed for cucumber grasping.And the cucumber detection experiment in cluttered scenarios is carried out in the real world.The success rate is 93.67%and the average sorting time is 9.87 s.The effectiveness of the cucumber segmentation and grasping pose acquisition method is verified by experiments.

关 键 词：Clutter scenarios Cucumber grasp Convolutional neural network Instance segmentation 

分 类 号：S642.2[农业科学—蔬菜学] S2[农业科学—园艺学]