IIN-FFD:Intra-Inter Network for Face Forgery Detection  

作　　者：Qihua Zhou Zhili Zhou Zhipeng Bao Weina Niu Yuling Liu 

机构地区：[1]School of Software,Nanjing University of Information Science and Technology,Nanjing 210044,China [2]Institute of Artificial Intelligence,Guangzhou University,Guangzhou 510006,China [3]School of Computer Science,University of Electronic Science and Technology of China,Chengdu 611731,Sichuan,China [4]School of Computer Science,Hunan University,Changsha 410082,Hunan,China

出　　处：《Tsinghua Science and Technology》2024年第6期1839-1850,共12页清华大学学报自然科学版（英文版）

摘　　要：Since different kinds of face forgeries leave similar forgery traces in videos,learning the common features from different kinds of forged faces would achieve promising generalization ability of forgery detection.Therefore,to accurately detect known forgeries while ensuring high generalization ability of detecting unknown forgeries,we propose an intra-inter network(IIN)for face forgery detection(FFD)in videos with continual learning.The proposed IIN mainly consists of three modules,i.e.,intra-module,inter-module,and forged trace masking module(FTMM).Specifically,the intra-module is trained for each kind of face forgeries by supervised learning to extract special features,while the inter-module is trained by self-supervised learning to extract the common features.As a result,the common and special features of the different forgeries are decoupled by the two feature learning modules,and then the decoupled common features can be utlized to achieve high generalization ability for FFD.Moreover,the FTMM is deployed for contrastive learning to further improve detection accuracy.The experimental results on FaceForensic++dataset demonstrate that the proposed IIN outperforms the state-of-the-arts in FFD.Also,the generalization ability of the IIN verified on DFDC and Celeb-DF datasets demonstrates that the proposed IIN significantly improves the generalization ability for FFD.

关 键 词：deep learning information security image classfication neural networks face forgery face forgery detection 

分 类 号：TP393.08[自动化与计算机技术—计算机应用技术]