基于图像和点云融合的三维小目标检测方法  

3D small object detection method based on image and point cloud fusion

作　　者：郝佳 姚国英 周剑 王斯远 肖进胜[3] HAO Jia;YAO Guoying;ZHOU Jian;WANG Siyuan;XIAO Jinsheng(Troops 92942,Beijing 100161,China;State Key Laboratory of Information Engineering in Surveying,Mapping and Remote Sensing,Wuhan University,Wuhan 430072,China;School of Electronic Information,Wuhan University,Wuhan 430072,China)

机构地区：[1]92942部队,北京100161 [2]武汉大学测绘遥感信息工程国家重点实验室,湖北武汉430072 [3]武汉大学电子信息学院,湖北武汉430072

出　　处：《测绘通报》2025年第3期33-38,共6页Bulletin of Surveying and Mapping

基　　金：国家自然科学基金(42101448);2023年湖北省重大攻关项目(JD)(2023BAA02604)。

摘　　要：目标检测技术在人工智能、人脸识别、自动驾驶等关键领域发挥着至关重要的作用。三维点云目标检测,特别是对小目标的识别,仍然是技术发展中的一个难点。针对该问题,本文提出了一种新的三维检测网络,该网络融合了图像与点云数据,以显著提高三维小目标的检测精度。首先,利用YOLOv5进行精确的二维目标检测,并利用相机和激光雷达的坐标映射关系建立三维约束,从原始点云中提取出锥形感兴趣区域;然后,针对远处的点云小目标,提出了一种基于聚类优化的三维目标检测网络架构,将感兴趣区域的点云同时输入PointNet及聚类模块中,并对两者的检测结果进行融合判别,提升三维小目标检测精度。在KITTI数据集上的测试结果表明:与现有技术相比,本文算法在中等难度条件下,两种小目标物体的平均精度(AP)分别提升了15.94%、2.29%;在高难度条件下,分别提升了13.34%、2.86%。证明了本文算法在提升三维小目标检测精度方面的显著效果和实际应用潜力。Object detection technology plays a pivotal role in key fields such as artificial intelligence,facial recognition,and autonomous driving.3D point cloud object detection,especially for small objects,remains a significant challenge in technological development.To address this challenge,this paper proposes a novel 3D detection network that integrates image and point cloud data to significantly enhance the accuracy of 3D small object detection.The approach begins by leveraging Yolov5 for precise 2D object detection and establishing a 3D constraint using the coordinate mapping relationship between cameras and LiDAR to extract conical regions of interest from the raw point cloud data.Furthermore,to tackle the issue of detecting small objects in distant point clouds,a cluster-optimized 3D detection network architecture is introduced.This architecture simultaneously inputs the point clouds of the regions of interest into both the PointNet and clustering modules,and then fuses their detection results to improve the accuracy of 3D small object detection.Testing on the KITTI dataset shows that,compared to existing techniques,the proposed algorithm improves the average precision(AP)for two small object categories by 15.94%and 2.29%under moderate difficulty conditions,and by 13.34%and 2.86%under high difficulty conditions.These results underscore the significant impact and practical application potential of this algorithm in enhancing the accuracy of 3D small object detection.

关 键 词：三维目标检测 小目标 感兴趣区域 点云聚类 点云图像融合 

分 类 号：P237[天文地球—摄影测量与遥感]