A Deepfake Detection Algorithm Based on Fourier Transform of Biological Signal  被引量:1

在线阅读下载全文

作  者:Yin Ni Wu Zeng Peng Xia Guang Stanley Yang Ruochen Tan 

机构地区:[1]School of Electrical and Electronic Engineering,Wuhan Polytechnic University,Wuhan,430023,China [2]School of Mathematics and Computer Science,Wuhan Polytechnic University,Wuhan,430048,China [3]Paul G.Allen School of Computer Science and Engineering,University ofWashington,Seattle,WA,98195,USA [4]School of Computer Science and Engineering,University of California,SanDiego,CA,92093,USA

出  处:《Computers, Materials & Continua》2024年第6期5295-5312,共18页计算机、材料和连续体(英文)

基  金:supported by the National Nature Science Foundation of China(Grant Number:61962010).

摘  要:Deepfake-generated fake faces,commonly utilized in identity-related activities such as political propaganda,celebrity impersonations,evidence forgery,and familiar fraud,pose new societal threats.Although current deepfake generators strive for high realism in visual effects,they do not replicate biometric signals indicative of cardiac activity.Addressing this gap,many researchers have developed detection methods focusing on biometric characteristics.These methods utilize classification networks to analyze both temporal and spectral domain features of the remote photoplethysmography(rPPG)signal,resulting in high detection accuracy.However,in the spectral analysis,existing approaches often only consider the power spectral density and neglect the amplitude spectrum—both crucial for assessing cardiac activity.We introduce a novel method that extracts rPPG signals from multiple regions of interest through remote photoplethysmography and processes them using Fast Fourier Transform(FFT).The resultant time-frequency domain signal samples are organized into matrices to create Matrix Visualization Heatmaps(MVHM),which are then utilized to train an image classification network.Additionally,we explored various combinations of time-frequency domain representations of rPPG signals and the impact of attention mechanisms.Our experimental results show that our algorithm achieves a remarkable detection accuracy of 99.22%in identifying fake videos,significantly outperforming mainstream algorithms and demonstrating the effectiveness of Fourier Transform and attention mechanisms in detecting fake faces.

关 键 词:Deepfake detector remote photoplethysmography fast fourier transform spatial attention mechanism 

分 类 号:TP18[自动化与计算机技术—控制理论与控制工程]

 

参考文献:

正在载入数据...

 

二级参考文献:

正在载入数据...

 

耦合文献:

正在载入数据...

 

引证文献:

正在载入数据...

 

二级引证文献:

正在载入数据...

 

同被引文献:

正在载入数据...

 

相关期刊文献:

正在载入数据...

相关的主题
相关的作者对象
相关的机构对象