基于可见光与红外热图像的行车环境复杂场景分割  

Complex Scene Segmentation Based on Visible and Thermal Images in Driving Environment

作　　者：陈武阳 赵于前[1,3,4] 阳春华 张帆[1,3] 余伶俐[1,3] 陈白帆 CHEN Wu-Yang;ZHAO Yu-Qian;YANG Chun-Hua;ZHANG Fan;YU Ling-Li;CHEN Bai-Fan(School of Automation,Central South University,Changsha 410083;School of Computer Science and Engineering,Cent-ral South University,Changsha 410083;Hunan Engineering&Technology Research Center of High Strength Fastener Intelligent Manufacturing,Changde 415701;Hunan Xiangjiang Artificial Intelligence Academy,Changsha 410005)

机构地区：[1]中南大学自动化学院,长沙410083 [2]中南大学计算机学院,长沙410083 [3]湖南省高强度坚固件智能制造工程技术研究中心,常德415701 [4]湖南湘江人工智能学院,长沙410005

出　　处：《自动化学报》2022年第2期460-469,共10页Acta Automatica Sinica

基　　金：国家自然科学基金(62076256);中南大学研究生校企联合创新项目(2021XQLH048)资助。

摘　　要：复杂场景分割是自动驾驶领域智能感知的重要任务,对稳定性和高效性都有较高的要求.由于一般的场景分割方法主要针对可见光图像,分割效果非常依赖于图像获取时的光线与气候条件,且大多数方法只关注分割性能,忽略了计算资源.本文提出一种基于可见光与红外热图像的轻量级双模分割网络(DMSNet),通过提取并融合两种模态图像的特征得到最终分割结果.考虑到不同模态特征空间存在较大差异,直接融合将降低对特征的利用率,本文提出了双路特征空间自适应(DPFSA)模块,该模块能够自动学习特征间的差异从而转换特征至同一空间.实验结果表明,本文方法提高了对不同模态图像的利用率,对光照变化有更强的鲁棒性,且以少量参数取得了较好的分割性能.Complex scene segmentation is an important task of intelligent perception in the field of autonomous driving,which has high requirements for stability and efficiency.Since general scene segmentation methods mainly focus on visible images,the segmentation result is highly dependent on the light and weather conditions at the time of image acquisition,and most methods only focus on segmentation performance and ignore computing resources.This paper proposes a lightweight dual model segmentation network(DMSNet)based on visible and thermal images,which can extract and fuse the features of the two modal images to obtain a final segmentation result.For large differences in the feature spaces of different modalities,direct fusion will reduce the utilization of features.This paper proposes a dual-path feature space adaptation(DPFSA)module,which can automatically learn the differences among features and convert them to the same space.The experimental results show that this method can better utilize the inherent information between different modal images.Moreover,the proposed method is more robust to illumination changes and can achieve good segmentation performance with only a small number of parameters.

关 键 词：场景分割 可见光图像 红外热图像 双模分割网络 双路特征空间自适应模块 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] U463.6[自动化与计算机技术—计算机科学与技术]