光流引导下机器人抓取目标物角点动态匹配  

Dynamic Matching of Target Corners in Robot Grasping Guided by Optical Flow

作　　者：吕栋阳 张磊[1,3] 张丹 姚兴田 苏波泳[1] LYU Dongyang;ZHANG Lei;ZHANG Dan;YAO Xingtian;SU Boyong(School of Mechanical Engineering,Nantong University,Nantong,Jiangsu 226019,China;School of Information Science and Intelligent Systems,Tokushima University,Tokushima 770-0855,Japan;Department of Mechanical Engineering,Lassonde School,York University,Toronto M3J 1P3,Canada)

机构地区：[1]南通大学机械工程学院,江苏南通226019 [2]德岛大学信息工程学院,日本德岛770-0855 [3]约克大学拉松德学院机械工程系,加拿大多伦多M3J 1P3

出　　处：《计算机工程与应用》2021年第6期200-206,共7页Computer Engineering and Applications

基　　金：江苏省产学研合作项目(BY2018208);2018年度江苏省政府留学奖学金。

摘　　要：针对目标物位姿在线估计中的特征点动态匹配问题,以木块作为实验对象,提出了一种光流引导的目标物角点动态匹配方法。使用Yolov2-tiny进行目标物识别,完成目标物定位与分类。在提取区域内完成Shi-Tomasi角点检测,采用LK(Lucas-Kanade)光流对角点跟踪的方法实现角点在相邻两帧图像中的初始匹配,针对光流跟踪中特征点的偏移问题,对跟踪点为中心的11×11邻域进行角点再提纯。实验证明该算法能在视频序列中对目标物角点实时动态地匹配,且角点匹配结果比SIFT和Harris-SIFT方法准确度更高,实时性更好。For the problem of feature points dynamic matching in online estimation of object pose,a dynamic matching method of target corners guided by optical flow is proposed,in which the wood block is used as the experimental object.Yolov2-tiny model is used to detect the object for location and classification.Shi-Tomasi algorithm is used to extract corners among the region of proposal.The LK optical flow algorithm is used for corner matching by tracking corners between two adjacent frames.For the problem of feature points migration during optical flow tracking,the corners are re-extracted in the 11×11 neighborhood centered on the tracking points.Experiments show that the algorithm can dynamically match the target corners in the video sequence in real time,and corner matching results are more accurate and real-time than SIFT and Harris-SIFT algorithm.

关 键 词：Yolov2-tiny Shi-Tomasi角点 LK光流 角点匹配 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]