融合全局与局部特征的鞋印特征提取网络设计  

Design of Shoe Print Feature Extraction Network Integrating Global and Local Features

作　　者：辛一冉 唐云祁[1] 蔡能斌 Xin Yiran;Tang Yunqi;Cai Nengbin(School of Investigation,People’s Public Security University of China,Beijing 100038,China;Shanghai Key Laboratory of Crime Scene Evidence,Shanghai 200083,China)

机构地区：[1]中国人民公安大学侦查学院,北京100038 [2]上海市现场物证重点实验室,上海200083

出　　处：《激光与光电子学进展》2023年第6期152-161,共10页Laser & Optoelectronics Progress

基　　金：公安部技术研究计划项目(2020JSYJC21);中央高校基本科研业务费项目(2021JKF203);上海市现场物证重点实验室开放课题基金(2021XCWZK04)。

摘　　要：为进一步解决残缺、模糊鞋印的检索困难问题,设计一种使用全局与局部特征联合表达的特征提取网络.一方面,在全局特征分支上对多尺度的鞋印全局特征进行快速归一化加权融合,并对其所有输出分别计算损失;另一方面,在局部特征分支上利用分部特征提取(PCB)模块将鞋印特征图分为3个部分,分别提取3个部分的局部特征并计算其损失.在训练阶段,将全局特征分支与局部特征分支的所有损失相加进行联合表达;在测试阶段,将两分支拼接后的输出直接展平作为待检索鞋印的描述符,并将其与样本库鞋印描述符的余弦距离作为相似性评分.实验结果表明,所提方法大幅降低模型的参数量及计算成本,并在CSS-200、CS-Database和FID-300这3个鞋印数据集上取得较高的准确率,且在CSS-200和CS-Database(Dust)数据集上的top1%取得较好的准确率,分别为94.5%和95.45%.A feature extraction network using global and local features is designed to tackle the issue of retrieving incomplete and fuzzy shoe prints.The global features of the multiscale shoe print are normalized and weighted,and the losses of all their outputs are calculated;moreover,the partbased Conv baseline(PCB)module is used to divide the shoe print feature map into three parts,extract the local features of the three parts,and calculate their losses.During the training phase,all of the global feature branch and local feature branch losses are added to express them collectively.The output of the two branches after splicing is directly flattened as the shoe print descriptor to be retrieved in the test phase,and the cosine distance between it and the descriptor of the sample library shoe print is used as the similarity score.The experimental results show that the proposed method significantly reduces the parameter quantity and calculation cost of the model,and achieves high accuracy on the three shoe print data sets of CSS-200,CS Database,and FID-300.Furthermore,it achieves decent accuracy on the top1%of the CSS-200 and CS Database(Dust)datasets,which are 94.5%and 95.45%,respectively.

关 键 词：图像处理 深度学习 鞋印检索 低质量鞋印 特征融合 EfficientNet 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]