结合语义和多层特征融合的行人检测  

Combining Semantics With Multi-level Feature Fusion for Pedestrian Detection

作　　者：储珺[1] 束雯 周子博 缪君[1] 冷璐[1] CHU Jun;SHU Wen;ZHOU Zi-Bo;MIAO Jun;LENG Lu(Key Laboratory of Jiangxi Province for Image Processing and Pattern Recognition(Nanchang Hangkong University),Nanchang 330063)

机构地区：[1]江西省图像处理与模式识别重点实验室(南昌航空大学),南昌330063

出　　处：《自动化学报》2022年第1期282-291,共10页Acta Automatica Sinica

基　　金：国家自然科学基金(62162045,61866028);江西省重点研发计划项目(20192BBE50073);研究生创新基金(YC2018094)资助~~。

摘　　要：遮挡及背景中相似物干扰是行人检测准确率较低的主要原因.针对该问题,提出一种结合语义和多层特征融合(Combining semantics with multi-level feature fusion,CSMFF)的行人检测算法.首先,融合多个卷积层特征,并在融合层上添加语义分割,得到的语义特征与相应的卷积层连接作为行人位置的先验信息,增强行人和背景的辨别性.然后,在初步回归的基础上构建行人二次检测模块(Pedestrian secondary detection module,PSDM),进一步排除误检物体.实验结果表明,所提算法在数据集Caltech和CityPersons上漏检率(Miss rate,MR)为7.06%和11.2%.该算法对被遮挡的行人具有强鲁棒性,同时可方便地嵌入到其他检测框架.Occlusion and similar objects in the background typically degrade the accuracy of pedestrian detection.To solve the above problems,this paper proposes a pedestrian detection algorithm that combines semantics with multi-level feature fusion(CSMFF).Firstly,multi-convolutional-layer features are fused,and semantic segmentation is added to the fusion layer.The obtained semantic features are connected to the corresponding convolutional layers as the prior information of the pedestrian target location,which enhances the discrimination between pedestrian and background.Based on the preliminary regression,a pedestrian secondary detection module(PSDM)is constructed to further eliminate false positives.The experimental results show that the miss rates(MR)of the proposed algorithm on the datasets Caltech and CityPersons are 7.06%and 11.2%,respectively.The algorithm has strong robustness to occluded pedestrians,and can be easily embedded into other detection frameworks.

关 键 词：行人检测 语义分割 特征融合 遮挡 二次检测 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]