基于三维重建的柑橘采摘机械臂避障研究与实验  

Research and Experiment on Obstacle Avoidance of Citrus Harvesting Robot Arm Based on 3D Reconstruction

作　　者：马冀桐 许洪斌 王毅[1,2] 刘艳平 熊龙烨[1] 王卓 何宇 MA Jitong;XU Hongbin;WANG Yi;LIU Yanping;XIONG Longye;WANG Zhuo;HE Yu(School of Mechanical Engineering,Chongqing University of Technology,Chongqing 400054,China;School of Mechanical Engineering,Chongqing University,Chongqing 400044,China)

机构地区：[1]重庆理工大学机械工程学院,重庆400054 [2]重庆大学机械工程学院,重庆400044

出　　处：《中国农业科技导报》2020年第7期90-98,共9页Journal of Agricultural Science and Technology

基　　金：重庆市重点产业共性关键技术创新专项(cstc2015zdcyztzx70003);重庆市基础科学与前沿技术研究一般项目(cstc2016jcyjA0444)。

摘　　要：利用机器人采摘柑橘果实需要解决机械臂运动过程中对障碍物的感知与避障问题。根据枝干的特征对枝干进行分段标记,使用深度学习Mask R-CNN神经网络进行训练、识别,然后与Kinect v2相机得到枝干障碍物关键点的三维信息进行重建。应用快速扩展随机树(rapidly-exploring random trees,RRT)的改进算法进行机械臂的避障运动规划。搭建了仿真及控制平台,并在实验室环境下通过课题组自行研制的柑橘收获机器人进行了验证,结果表明,样机避障成功率为90.7%,平均规划时间为1.5 s。上述结果为进一步进行实际环境采摘奠定了基础。In order to harvest citrus fruits smoothly,the problem of obstacle perception and obstacle avoidance needed to be resolved in the movement of the robot arm.In this paper,the branches were segmented according to the characteristics of the branches,and the deep learning Mask R-CNN neural network was used for training and recognition.Then,the three-dimensional information of the key points of the branch obstacles was obtained with the Kinect v2 camera for reconstruction.Improved algorithm of rapidly-exploring random trees(RRT)was used to plan the obstacle avoidance motion of the manipulator.The simulation and control platform was built,and the citrus harvesting robot developed by the research group was verified in the laboratory environment.The results showed that the successful rate of obstacle avoidance is was 90.7%and the average planning time was 1.5 s.This study laid a foundation for further practical environmental harvesting.

关 键 词：采摘 机器人 机械臂 避障 运动规划 

分 类 号：S24[农业科学—农业电气化与自动化]