Customized Convolutional Neural Network for Accurate Detection of Deep Fake Images in Video Collections  

作　　者：Dmitry Gura Bo Dong Duaa Mehiar Nidal Al Said 

机构地区：[1]Department of Cadastre and Geoengineering,Kuban State Technological University,Krasnodar,350072,Russian Federation [2]Department of Geodesy,Kuban State Agrarian University,Krasnodar,350072,Russian Federation [3]School of Innovation and Entrepreneurship,Liaoning University,Liaoning,110031,China [4]Department of IT,Middle East University,Amman,11831,Jordan [5]College of Mass Communication,Ajman University,P.O Box 346,Ajman,United Arab Emirates

出　　处：《Computers, Materials & Continua》2024年第5期1995-2014,共20页计算机、材料和连续体（英文）

基　　金：Science and Technology Funds from the Liaoning Education Department(Serial Number:LJKZ0104).

摘　　要：The motivation for this study is that the quality of deep fakes is constantly improving,which leads to the need to develop new methods for their detection.The proposed Customized Convolutional Neural Network method involves extracting structured data from video frames using facial landmark detection,which is then used as input to the CNN.The customized Convolutional Neural Network method is the date augmented-based CNN model to generate‘fake data’or‘fake images’.This study was carried out using Python and its libraries.We used 242 films from the dataset gathered by the Deep Fake Detection Challenge,of which 199 were made up and the remaining 53 were real.Ten seconds were allotted for each video.There were 318 videos used in all,199 of which were fake and 119 of which were real.Our proposedmethod achieved a testing accuracy of 91.47%,loss of 0.342,and AUC score of 0.92,outperforming two alternative approaches,CNN and MLP-CNN.Furthermore,our method succeeded in greater accuracy than contemporary models such as XceptionNet,Meso-4,EfficientNet-BO,MesoInception-4,VGG-16,and DST-Net.The novelty of this investigation is the development of a new Convolutional Neural Network(CNN)learning model that can accurately detect deep fake face photos.

关 键 词：Deep fake detection video analysis convolutional neural network machine learning video dataset collection facial landmark prediction accuracy models 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TP183[自动化与计算机技术—计算机科学与技术]