基于差分特征注意力机制的无锚框多光谱行人检测算法  

Anchor free multispectral pedestrian detection algorithm based on differential feature attention mechanism

作　　者：沈继锋[1] 刘岳 韦浩 左欣[3] 杨万扣[4] SHEN Jifeng;LIU Yue;WEI Hao;ZUO Xin;YANG Wankou(School of Electrical and Information Engineering,Jiangsu University,Zhenjiang 212013,China;China Electric Haikang Group Co.,Ltd.,Hangzhou 310000,China;School of Computer Science and Engineering,Jiangsu University of Science and Technology,Zhenjiang 212003,China;School of Automation,Southeast University,Nanjing 210003,China)

机构地区：[1]江苏大学电气信息工程学院,江苏镇江212013 [2]中电海康集团有限公司,浙江杭州310000 [3]江苏科技大学计算机学院,江苏镇江212003 [4]东南大学自动化学院,江苏南京210003

出　　处：《智能科学与技术学报》2021年第3期294-303,共10页Chinese Journal of Intelligent Science and Technology

基　　金：国家自然科学基金资助项目(No.61903164);江苏省自然科学基金资助项目(No.BK20191427)。

摘　　要：针对多光谱行人检测系统存在特征融合质量低、模型超参数多且锚框匹配算法复杂等问题,提出了一种基于差分特征注意力机制的无锚框多光谱行人检测算法。该算法首先采用差分特征感知融合方法挖掘多模态特征间的互补信息来优化通道特征;然后利用具有高效无锚框机制的CenterNet检测框架大大降低了模型计算复杂度,从而提升检测速度;最后引入差分特征注意力机制,改善特征融合质量,进一步提升检测精度。在KAIST、CVC14和FLIR这3个公开数据集上的实验结果表明,提出的算法和其他先进方法相比,能够同时有效提升检测精度和速度,具有较好的实际应用前景。Multispectral pedestrian detection system suffers with low feature fusion quality,high quantity of model hy-per-parameters and complex anchor matching algorithm.To deal with these problems,an anchor free multispectral pede-strian detection algorithm based on differential feature attention mechanism was proposed.Firstly,differential modality aware fusion was used to obtain the complementary information between different modalities to optimize the channel features.Secondly,the CenterNet detection framework with anchor free mechanism was adopted to greatly reduce the computational complexity of the model and thus improve the detection speed.Finally,differential feature guided attention mechanism was introduced to improve the quality of feature fusion and further enhance the detection accuracy.Experi-mental results on three open datasets,KAIST,CVC14 and FLIR,show that the proposed algorithm can effectively improve the detection accuracy and speed compared with the current advanced methods,and has a good practical application prospect.

关 键 词：多光谱行人检测 无锚框机制 CenterNet模型 注意力机制 

分 类 号：TP242[自动化与计算机技术—检测技术与自动化装置]