用于机器人自动装配的长圆孔视觉分割定位算法  

Segmentation and location algorithm for oblong holes in robotic automatic assembly

作　　者：蒋潇 王松[1] 吴丹[1] JIANG Xiao;WANG Song;WU Dan(Department of Mechanical Engineering,Tsinghua University,Beijing 100084,China)

机构地区：[1]清华大学机械工程系,北京100084

出　　处：《清华大学学报（自然科学版）》2024年第10期1677-1685,共9页Journal of Tsinghua University(Science and Technology)

基　　金：国家自然科学基金面上项目(52375019)。

摘　　要：长圆孔应用于工业生产可以提高装配容错,增加装配调整量,但其难以解析描述的特点显著增加了工业应用中视觉检测定位算法的难度,限制了长圆孔在自动化装配结构中的应用。该文探索出一种具有鲁棒性的高精度长圆孔视觉分割定位算法,首先分析了长圆孔几何特征,将其描述为一种具有对称性、缺少简单解析表达的封闭图形;进而提出了一种基于语义分割网络和长圆孔区域退化的视觉分割定位算法,该算法结合深度学习和传统图像处理算法,首先构建YOLO和全卷积神经网络串联架构依次实现目标检测、感兴趣区域提取和语义分割,然后利用中轴变换骨架提取方法完成长圆形区域退化定位,有效避免了语义分割输出区域形状误差对定位精度的影响,最终得到了亚像素精度的精准检测结果。在某机器人自动装配系统中开展实验验证,得出所提算法具备精度高、鲁棒性好的特点,因此具有较广阔的工业应用前景。[Objective]Oblong holes are commonly used across various industries to improve fault tolerance and adjustment capabilities.However,their complex geometric characteristics pose significant challenges for vision detection and location algorithms in industrial applications,impacting their utilization in automatic assembly processes.[Methods]This research investigates a high-precision and robust vision segmentation and location algorithm tailored for oblong holes.First,the geometric features of oblong holes,which are symmetric but lack a simple analytical description,are analyzed.This complexity renders traditional imaging methods ineffective for accurate localization.The detection and segmentation of oblong hole features are conducted using a novel vision location algorithm that integrates deep learning with conventional image processing techniques.Specifically,the algorithm employs a sequential connection framework of YOLO and fully convolutional networks to achieve accurate localization.This framework first identifies the region of interest and then performs semantic segmentation.YOLO networks rapidly detect the region of interest,prioritizing areas where the oblong hole is prominently featured.Semantic segmentation is subsequently performed using fully convolutional networks.Afterward,a skeleton feature extraction method based on medial axis transformation is applied to precisely locate the oblong hole.This method effectively reduces the impact of shape errors from semantic segmentation,achieving subpixel accuracy.However,medial axis transformation may produce redundant lines owing to the presence of image artifacts,potentially leading to inaccuracies.To address this issue,principal component analysis is employed to approximate the center of the oblong hole,thereby minimizing errors.For further precision,a Hough transformation ellipse detection method is utilized to identify the central skeleton of the oblong hole,which is interpreted both as a line segment and a special ellipse.The center of this skeleton repres

关 键 词：视觉检测 长圆孔 自动装配 深度学习 

分 类 号：TP242.2[自动化与计算机技术—检测技术与自动化装置]