基于双重增强网络的跨模态行人重识别  

Cross-modality person re-identification based on dual enhancement network

作　　者：陈梦蝶 卢健[1] 张奇 CHEN Mengdie;LU Jian;ZHANG Qi(School of Electronics and Information,Xi′an Polytechnic University,Xi′an,Shaanxi 710600,China)

机构地区：[1]西安工程大学电子信息学院,陕西西安710600

出　　处：《光电子．激光》2024年第7期745-752,共8页Journal of Optoelectronics·Laser

基　　金：西安市碑林区应用技术研发(GX2007)资助项目。

摘　　要：针对异质样本差异、行人遮挡及背景干扰等造成的跨模态行人重识别(person re-identification, ReID)精度不高的问题,本文提出了一种基于通道与特征学习的双重增强网络(dual enhanced network, DEN)。首先从通道级出发,通过随机交换可见光通道来挖掘可见光与红外通道间的关系,增强模型对多模态样本变化的鲁棒性。其次从特征级出发,在模态共享网络前引入基于归一化的注意力模块(normalization-based attention module, NAM),通过惩罚贡献因子较小的权重来避免噪声对模态不变信息学习造成一定干扰。同时采用特征分离模块(feature separation module, FSM)来分离出身份相关特征与身份无关特征,有效提升了模型对异质样本的识别能力。最后联合难样本三元组和加权正则化损失对网络进行监督训练,从而约束行人特征学习。在RegDB数据集上,DEN的Rank1准确率和mAP分别达到了94.86%和90.10%的高水准。This paper proposes a dual enhanced network(DEN)based on channel and feature learning to address the problem of poor accuracy in cross-modality person re-identification(ReID)caused by heterogeneous sample differences,person occlusion,and background interference.At the channel level,visible channels are randomly swapped to explore the relationship between visible and infrared channels,enhancing the model′s robustness to multimodal sample changes.At the feature level,a normalization-based attention module(NAM)is introduced before module sharing network to avoid noise interference on modality-invariant information learning by punishing weights with smaller contribution factors,and a feature separation module(FSM)is used to separate identity-related features from identity-independent features,improving the model′s recognition ability for heterogeneous samples.Finally,the network is trained and supervised using hard sample triples and weighted regularization loss to constrain pedestrian feature learning.On the RegDB dataset,DEN achieves a high level of accuracy,with a Rank1 accuracy of 94.86%andmAPof 90.10%.

关 键 词：行人重识别(ReID) 跨模态 通道交换增强(CEA) 基于归一化的注意力模块(NAM) 特征分离模块(FSM) 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]