跨通道交互注意力机制驱动的双流网络跨模态行人重识别  

Cross-Modal Person Re-identification Driven by Cross-Channel Interactive Attention Mechanism in Dual-Stream Networks

作　　者：何磊 栗风永 秦川[2] HE Lei;LI Fengyong;QIN Chuan(College of Computer Science and Technology,Shanghai University of Electric Power,Shanghai 201306,China;School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China)

机构地区：[1]上海电力大学计算机科学与技术学院,上海201306 [2]上海理工大学光电信息与计算机工程学院,上海200093

出　　处：《应用科学学报》2024年第5期884-892,共9页Journal of Applied Sciences

基　　金：国家自然科学基金(No.U1936213);上海市自然科学基金(No.20ZR1421600)资助。

摘　　要：现有的跨模态行人重识别方法不能同时兼顾模态间与模态内的目标行人差异,很难提升检索准确度。为解决这一问题,引入跨通道交互的注意力机制,增强行人特征的鲁棒提取能力,有效抑制冗余特征的提取并获得更具辨别力的特征表达。进一步,联合异质中心三元组损失、三元组损失和身份损失进行监督学习,有效结合了行人特征的跨模态类间差异和类内差异。实验证明了所提方法的有效性。与7个已有的经典方法相比,所提方法在两个标准数据集RegDB与SYSU-MM01上都取得了较好的性能效果。Existing cross-modal person re-identification methods often fail to take into account the difference of target person between modes and within modes,making it difficult to further improve the retrieval accuracy.To solve this problem,this paper introduces the cross-channel interaction attention mechanism to enhance the robust extraction of person features,effectively suppresses the extraction of irrelevant features and achieves more discriminative feature expression.Furthermore,hetero-center triplet loss,triplet loss and identity loss are combined for supervised learning,effectively integrating the intermodal and intra-class differences in person features.Experimental results demonstrate the effectiveness of the proposed method,which outperforms seven existing methods on two standard datasets,RegDB and SYSU-MM01.

关 键 词：跨模态 行人重识别 卷积神经网络 注意力机制 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]