Generalized Deepfake Detection Algorithm Based on Inconsistency Between Inner and Outer Faces

Gao, Jie;Concas, Sara;Orru', Giulia;Feng, Xiaoyi;Marcialis, Gian Luca;Roli, Fabio

2024-01-01

---

Abstract

Deepfake refers to using artificial intelligence (AI) and machine learning techniques to create compelling and realistic media content, such as videos, images, or recordings, that appear real but are fake. The most common form of deepfake involves using deep neural networks to replace or superimpose faces in existing videos or images on top of other people’s faces. While this technology can be used for various benign purposes, such as filmmaking or online education, it can also be used maliciously to spread misinformation by creating fake videos or images. Based on the classic deepfake generation process, this paper explores the Inconsistency between inner and outer faces in fake content to find synthetic defects and proposes a general deepfake detection algorithm. Experimental results show that our proposed method has certain advantages, especially regarding cross-method detection performance.