融合毫米波雷达与机器视觉的田间道路视觉引导线提取  

Fusion of millimeter wave radar and machine vision for visual guide line extraction on field roads

作　　者：梁新成[1] 刘鹏 李云伍[1] 张志冬 陈欣 李法霖 LIANG Xincheng;LIU Peng;LI Yunwu;ZHANG Zhidong;CHEN Xin;LI Falin(College of Engineering and Technology,Southwest University,Chongqing 400715,China)

机构地区：[1]西南大学工程技术学院,重庆400715

出　　处：《农业工程学报》2023年第19期141-153,共13页Transactions of the Chinese Society of Agricultural Engineering

基　　金：贵州省科技计划项目(黔科合支撑[2021]一般171)。

摘　　要：针对传统机器视觉算法难以获取准确视觉引导线的问题,该研究提出了一种利用深度学习算法获取视觉引导线的方法,并将毫米波雷达探测的目标运动状态信息考虑到视觉引导线的提取中,以安全避开障碍物。首先通过数据预处理方法过滤部分雷达目标数据,再利用多目标跟踪算法过滤干扰数据并对动态目标持续跟踪,为后续数据融合提供准确的雷达目标数据。然后制作田间道路环境数据集,搭建基于Deeplabv3 plus的改进语义分割网络。继而利用时间戳对齐和基于最小二乘法的坐标变换实现毫米波雷达数据与视觉数据在时间与空间维度的同步。最后基于无动态目标状态信息和有动态目标状态信息两种情况提出了相应的视觉引导线提取策略,进行相关试验测试了视觉引导线提取方法的效果。相比于人工测量的真实道路中点,在无动态目标场景下提取的视觉引导线的平均误差为1.60~9.20像素;而在有动态目标的场景下,能够成功获取避障的视觉引导线。研究结果有助于提升丘陵山区农业机械的智能化水平。Field roads have been the most important transportation ways for commercial grain and agricultural products in hilly and mountainous regions in China.Especially,the youth labor can rapidly migrate from the rural to the urban areas against everincreasing urbanization.Current manual production cannot fully meet the large-scale and precision agriculture in recent years,owing to the protracted yield cycle and low rate of return.Therefore,it is urgent to implement the mechanization and intelligent agriculture for the national food security in hilly and mountainous regions.Among them,the autonomous and safe operation of intelligent machinery can be critical to navigate or circumvent obstacles on field roads.However,the conventional machine vision cannot accurately and rapidly construct the visual guidance lines in such terrains.In this study,the extraction was proposed to enhance the visual guidance and obstacle avoidance using millimeter-wave radar and vision fusion.The state information was also detected from the target objects on the field road.The specific steps were as follow.Preprocessing techniques were employed to filter the portion of the radar object data.A multi-target tracking was utilized to eliminate the interference data for the continuous tracking of dynamic objects.Accurate radar object data was then obtained for subsequent data fusion.A semantic segmentation network was created using Deeplabv3+,and then leveraged a dataset of the adjacent field roads.The millimeter-wave radar and vision data were synchronized in both time and space via the timestamp alignment and least squares-based coordinate transformation.Extraction approach was then established for the visual guidance lines,particularly for the scenarios where dynamic target state was both available and unavailable.A series of experiments were carried out to validate the extraction of visual guide line.The average errors of detection were ranged from 1.60 to 9.20 pixels at the real road midpoints in the scenes without dynamic targets.Moreover,the

关 键 词：雷达 机器视觉 田间道路 信息融合 视觉引导线 

分 类 号：TP273[自动化与计算机技术—检测技术与自动化装置] S229.1[自动化与计算机技术—控制科学与工程]