融合Harris与SIFT算法的荔枝采摘点计算与立体匹配  

Computation of Picking Point of Litchi and Its Binocular Stereo Matching Based on Combined Algorithms of Harris and SIFT

作　　者：郭艾侠[1] 熊俊涛[1] 肖德琴[1] 邹湘军[2] 

机构地区：[1]华南农业大学数学与信息学院,广州510642 [2]华南农业大学工程学院,广州510642

出　　处：《农业机械学报》2015年第12期11-17,共7页Transactions of the Chinese Society for Agricultural Machinery

基　　金：广东省自然科学基金博士科研启动项目(2014A030310275;S2013040015381);国家星火计划资助项目(2014GA780057);广东省科技计划'三区'人才资助项目(2015A020224034)

摘　　要：为了满足荔枝收获机器人对整串果实采摘作业的需求,提出一种融合Harris与SIFT算法的荔枝采摘点计算与立体匹配方案。首先在已识别的荔枝结果母枝部位进行Harris角点检测,结合提取已识别荔枝果实区域质心与最小外接矩形等特征信息,进行采摘点二维像素坐标的计算。然后通过对比分析,提出对计算采摘点采用带约束条件基于余弦相似度的SIFT双目立体匹配,最后进行采摘点计算与双目立体匹配实验验证。结果表明,计算采摘点的匹配成功率可达89.55%,且该方法更能满足在结构复杂的结果母枝上采摘点计算的精度需求。A vision-based fruit-vegetable picking robot helps to improve picking efficiency by making full use of the information by which the target of harvest can be recognized and located. For harvesting robots,it is important and difficult to calculate and locate the picking point from the recognized main fruit bearing branch of litchi. Hence,calculation of picking point and its stereo match become the research focuses. To meet the needs of picking the whole litchi cluster for litchi picking robot,a scheme of combined algorithms of Harris and improved SIFT to compute picking point of litchi and achieve its stereo matching was proposed. Firstly,corner extraction from the main fruit bearing branch of litchi was carried out by Harris method,and the whole identified area of litchi fruits was taken as a big fruit,the feature information on ＂centroid＂and the maximal vertical coordinate vertex of the MBR（ Minimum bounding rectangle） of the big fruit（ denoted by Y） were then attained. Then,taking each Harris corner whose vertical coordinates were bigger than Y as the center of circle,all possible circles were computed and the center of circle whose circle area was the maximum was chosen as the pixel coordinate of picking point in original collected litchi image. Furthermore, the computed picking point was described with a characteristic vector of SIFT with 128 dimensions,and its binocular stereo matching based on cosine distance similarity of SIFT was also proposed. Theoretical analysis and experimental results show that the proposed scheme can satisfy the need of vision of litchi picking robot with successful matching rate of89. 55%,which means that the scheme can improve the computation precision of picking point from main fruit-bearing branch with complex construction.

关 键 词：荔枝收获机器人 立体匹配 HARRIS算法 SIFT算法 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]