基于显著性特征的蝴蝶兰组培苗夹取点检测方法  

Pinch point extraction method for phalaenopsis tissue-cultured seedlings based on salient features

作　　者：苑朝 张鑫 王家豪 赵明雪 徐大伟 YUAN Chao;ZHANG Xin;WANG Jiahao;ZHAO Mingxue;XU Dawei(Department of Automation,North China Electric Power University,Baoding 071003,China)

机构地区：[1]华北电力大学自动化系,保定071000

出　　处：《农业工程学报》2023年第13期151-159,共9页Transactions of the Chinese Society of Agricultural Engineering

基　　金：国家自然科学基金联合基金项目重点支持项目(U21A20486);中央高校基本科研业务费专项资金资助(2022MS100)。

摘　　要：为了提高蝴蝶兰自动化快速繁育过程中组培苗夹取点视觉检测的适应性和效率,该研究提出了一种基于改进U2-Net显著性检测网络(MBU2-Net+)的组培苗夹取点定位方法。首先,通过显著性检测网络得到蝴蝶兰组培苗的显著性图像;然后,对显著性图像进行骨架提取,并经过形态学分析计算定位组培苗夹取点;最后,将夹取点位置数据发送给机械臂进行夹取。在图像显著性检测试验中,MBU2-Net+的平均绝对误差为0.002,最大F1分数为0.993,FPS(frames per second,每秒帧率)为33.99帧/s,模型权重大小为2.37 MB;在组培苗夹取试验中,4组共112颗苗的夹取点提取成功率为85.71%。为验证该研究的适应性,将其应用于各阶段组培苗以及部分虚拟两叶苗共11株种苗的夹取点提取,成功率为81.82%,使用该方法对不同时期的蝴蝶兰组培苗进行夹取点检测,具有较高的成功率。研究结果可为发展组培苗自动化快速繁育技术提供参考。Tissue culture rapid propagation cannot be reduced the production that is caused by environmental factors,compared with traditional flower cultivation.Since phalaenopsis flowers are very popular for their unique appearance,tissue culture rapid propagation can be expected to cultivate phalaenopsis for the high cultivation speed in industrial production.Current phalaenopsis rapid propagation cannot fully meet the large-scale production in recent years,due to the high repetition and labor consumption.Therefore,it is in high demand for automated phalaenopsis tissue-cultured seedlings'rapid propagation.Among them,image recognition can be used to detect the picking points of seedlings in the process of the robot arms.However,current algorithms of image recognition are only applicable to the specific growth stages,due to the differences in the image characteristics of seedlings at different stages.This study aims to improve the adaptability and efficiency of seedling grasping point detection.A seedling grasping point localization was also proposed using the improved U2-Net salient detection network(MBU2-Net+).A seedling grasping end effector was then designed.The overall steps of seedling grasping included visual detection,grasping point localization,and a robotic arm control module.Firstly,industrial cameras were used to capture the images of seedlings.The salient map of the seedlings was obtained after the MBU2-Net+salient detection network.Secondly,the salient map was processed by filtering,while the skeleton extraction was to extract the intersection points of the skeleton lines.Then,the intersection points were clustered using K Nearest Neighbours(KNN)to remove the salient outliers.The grasping angle was obtained to locate the seedling grasping point using morphological analysis after fitting the line using Random Sample Consensus(RANSAC).Finally,the grasping point location data was sent to the robotic arm for grasping.The salient detection experiment was carried out to compare MBU2-Net+with Res2Net-PoolNet,U2-Net,

关 键 词：图像识别 自动化 显著性特征 改进的U2-Net 蝴蝶兰组培苗 夹取点检测 

分 类 号：S24[农业科学—农业电气化与自动化]