Source Camera Identification Algorithm Based on Multi-Scale Feature Fusion  

作　　者：Jianfeng Lu Caijin Li Xiangye Huang Chen Cui Mahmoud Emam 

机构地区：[1]School of Computer Science and Technology,Hangzhou Dianzi University,Hangzhou,310018,China [2]Shangyu Institute of Science and Engineering,Hangzhou Dianzi University,Shaoxing,312300,China [3]Key Laboratory of Public Security Information Application Based on Big-Data Architecture,Ministry of Public Security,Zhejiang Police College,Hangzhou,310000,China [4]Faculty of Artificial Intelligence,Menoufia University,Shebin El-Koom,32511,Egypt

出　　处：《Computers, Materials & Continua》2024年第8期3047-3065,共19页计算机、材料和连续体（英文）

基　　金：This work was funded by the National Natural Science Foundation of China(Grant No.62172132);Public Welfare Technology Research Project of Zhejiang Province(Grant No.LGF21F020014);the Opening Project of Key Laboratory of Public Security Information Application Based on Big-Data Architecture,Ministry of Public Security of Zhejiang Police College(Grant No.2021DSJSYS002).

摘　　要：The widespread availability of digital multimedia data has led to a new challenge in digital forensics.Traditional source camera identification algorithms usually rely on various traces in the capturing process.However,these traces have become increasingly difficult to extract due to wide availability of various image processing algorithms.Convolutional Neural Networks(CNN)-based algorithms have demonstrated good discriminative capabilities for different brands and even different models of camera devices.However,their performances is not ideal in case of distinguishing between individual devices of the same model,because cameras of the same model typically use the same optical lens,image sensor,and image processing algorithms,that result in minimal overall differences.In this paper,we propose a camera forensics algorithm based on multi-scale feature fusion to address these issues.The proposed algorithm extracts different local features from feature maps of different scales and then fuses them to obtain a comprehensive feature representation.This representation is then fed into a subsequent camera fingerprint classification network.Building upon the Swin-T network,we utilize Transformer Blocks and Graph Convolutional Network(GCN)modules to fuse multi-scale features from different stages of the backbone network.Furthermore,we conduct experiments on established datasets to demonstrate the feasibility and effectiveness of the proposed approach.

关 键 词：Source camera identification camera forensics convolutional neural network feature fusion transformer block graph convolutional network 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]