关键细粒度信息指导的多尺度遮挡行人重识别  

Multi-Scale Occluded Person Re-Identification Guided by Key Fine-Grained Information

作　　者：周玉 赵小锋 汪一 孙彦景 李松 ZHOU Yu;ZHAO Xiaofeng;WANG Yi;SUN Yanjing;LI Song(School of Information and Control Engineering,China University of Mining and Technology,Xuzhou 221116,China;Kewen College,Jiangsu Normal University,Xuzhou 221132,China;Xuzhou First Peoples Hospital,Xuzhou 221116,China)

机构地区：[1]中国矿业大学信息与控制工程学院,徐州221116 [2]江苏师范大学科文学院,徐州221132 [3]徐州市第一人民医院,徐州221116

出　　处：《电子与信息学报》2024年第6期2578-2586,共9页Journal of Electronics & Information Technology

基　　金：国家自然科学基金(62001475);江苏省自然科学基金(BK20200649)。

摘　　要：为了减轻背景和遮挡等干扰信息对行人身份重识别(ReID)准确率的影响以及充分利用细粒度和粗粒度信息之间的互补性,该文提出关键细粒度信息指导的多尺度遮挡行人重识别网络。首先,将图像划分为两种不同尺寸的重叠图像块,构建同时包含细粒度和粗粒度信息提取分支的多尺度识别网络,以更好模拟人类观察图像时的多尺度特性以及观察相邻区域时的连续性特性。然后,考虑到细粒度分支能够提取更多的图像细节信息且细粒度和粗粒度信息之间存在一定的共性与差异,进一步通过细粒度注意力模块实现细粒度信息对粗粒度信息学习分支的指导。其中,参与指导的细粒度信息是通过干扰信息剔除(IIE)模块滤除干扰信息后保留的关键信息。最后,通过双次差分获取与行人身份识别相关的关键信息,并通过标签和特征等多维度的联合监督,实现行人身份的预测。在多个公开的行人重识别数据库进行的大量实验证明了该算法的性能优越性以及其中各个模块的有效性和必要性。To reduce the influence of background and occlusion on the accuracy of pedestrian identity Re-IDentification(ReID)and make full use of the complementarity between fine-grained and coarse-grained information,a multi-scale occluded pedestrian ReID network guided by key fine-grained information is proposed.First,the image is divided into two types of overlapping patches with different sizes to better simulate the multi-scale characteristics of human observing images and the continuity characteristics of human observing adjacent regions,so a multi-scale recognition network containing both fine-grained and coarse-grained information extraction branches is constructed.Then,considering fine-grained information contains more details and there are similarities and differences between fine-grained and coarse-grained information,fine-grained attention module is further employed to realize the guide of the fine-grained branch to the coarse-grained branch.Among them,the fine-grained information is the key information retained after filtering out the interference information by the Interference Information Elimination(IIE)module.Finally,the key information related to pedestrian ReID is obtained by bivariate difference,and the prediction of pedestrian identity is realized by multi-dimensional joint supervision such as tags and features.Extensive experiments on several public pedestrian ReID databases prove the superiority of this algorithm and the effectiveness and necessity of each module.

关 键 词：遮挡行人重识别 多尺度 细粒度信息 粗粒度信息 干扰信息剔除 

分 类 号：TN911.73[电子电信—通信与信息系统] TP391.41[电子电信—信息与通信工程]