A Hand Features Based Fusion Recognition Network with Enhancing Multi-Modal Correlation  

作　　者：Wei Wu Yuan Zhang Yunpeng Li Chuanyang Li YanHao 

机构地区：[1]School of Information Engineering,Shenyang University,Shenyang,110044,China

出　　处：《Computer Modeling in Engineering & Sciences》2024年第7期537-555,共19页工程与科学中的计算机建模（英文）

基　　金：funded by the National Natural Science Foundation of China(61991413);the China Postdoctoral Science Foundation(2019M651142);the Natural Science Foundation of Liaoning Province(2021-KF-12-07);the Natural Science Foundations of Liaoning Province(2023-MS-322).

摘　　要：Fusing hand-based features in multi-modal biometric recognition enhances anti-spoofing capabilities.Additionally,it leverages inter-modal correlation to enhance recognition performance.Concurrently,the robustness and recognition performance of the system can be enhanced through judiciously leveraging the correlation among multimodal features.Nevertheless,two issues persist in multi-modal feature fusion recognition:Firstly,the enhancement of recognition performance in fusion recognition has not comprehensively considered the inter-modality correlations among distinct modalities.Secondly,during modal fusion,improper weight selection diminishes the salience of crucial modal features,thereby diminishing the overall recognition performance.To address these two issues,we introduce an enhanced DenseNet multimodal recognition network founded on feature-level fusion.The information from the three modalities is fused akin to RGB,and the input network augments the correlation between modes through channel correlation.Within the enhanced DenseNet network,the Efficient Channel Attention Network(ECA-Net)dynamically adjusts the weight of each channel to amplify the salience of crucial information in each modal feature.Depthwise separable convolution markedly reduces the training parameters and further enhances the feature correlation.Experimental evaluations were conducted on four multimodal databases,comprising six unimodal databases,including multispectral palmprint and palm vein databases from the Chinese Academy of Sciences.The Equal Error Rates(EER)values were 0.0149%,0.0150%,0.0099%,and 0.0050%,correspondingly.In comparison to other network methods for palmprint,palm vein,and finger vein fusion recognition,this approach substantially enhances recognition performance,rendering it suitable for high-security environments with practical applicability.The experiments in this article utilized amodest sample database comprising 200 individuals.The subsequent phase involves preparing for the extension of the method to larger data

关 键 词：BIOMETRICS MULTI-MODAL CORRELATION deep learning feature-level fusion 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]