Notable Deepfake Websites

From Antispoofing Wiki

A number of web platforms, which provide their algorithms for free, contribute to a rapid increase of deepfake media and challenge liveness detection.

Deepfakes: Brief History

The first deepfake-like technology appeared in 1997 when the Video Rewrite tool was presented. It was based on automatic phoneme labeling that allowed matching an already existing footage to a new soundtrack. The tool was successfully applied to alter a few bits from a John Kennedy’s speech.


McCullouch and Pitts were at the forefront of AI development
McCullouch and Pitts were at the forefront of AI development


Prior to that, Artificial Neural Networks (ANNs) — envisioned in 1943 by McCullouch and Pitts — had a resurge in the 1980s when metal–oxide–semiconductors (MOS) and complementary MOS (CMOS) were introduced: they provided more computational power. Besides, a number of research facilities ventured in developing ANNs after a series of works, including John Hopefiled’s paper, were published on that topic.



In 2006, deep learning was established as a primary method for training Artificial Intelligence (AI). And in 2014 Generative Adversarial Network (GAN) was introduced by Ian Goodfellow et al. The proposed architecture could automatically generate images, videos and audios. Shortly afterwards, various GAN iterations became open-source. In 2017, a GAN-based face-swapping tool was used to create fake pornographic materials by a Reddit user nicknamed Deepfake.




Consequently, a diverse number of applications and websites made deepfake technology accessible to common users. Among them are MyHeritage, DeepFaceLab, SteosVoice, and others. While most of them focus on entertainment or practical application — such as old footage restoration — others can be used for unscrupulous purposes.


Deepfake Websites: Technical Details

To produce a highly realistic deepfake image, the following elements are employed:

Architecture

The core elements of a GAN system include:

  • Noise signals.
  • Image generator, which creates images from random noises.
  • Discriminator that decides whether an image is authentic or artificial.

Since generator and discriminator are set to rival each other, the process becomes generative and adversarial at the same time. A training phase precedes image generation, during which a large amount of real samples is fed to the network.



This is just a basic framework. A GAN architecture may differ and comprise extra elements, depending on its model: Deep Convolutional GAN (DCGAN), Cycle-GAN, Information Maximizing Generative Adversarial Network (InfoGAN), and others.

Quality-ensuring components

To make an image realistic, various components are applied: bilinear up/downsampling operations, tuned hyperparameters, mixing regularization that provides minute control over created images, while using two random latent codes, Fréchet inception distance (FID) and Precision and Recall (P&R) metrics to ensure image quality analysis, adaptive instance normalization (AdaIN), etc.

Stochastic details — such as facial hair, freckles, eyeglasses, wrinkles — can be realized through spatially-varying pseudorandom numbers generation. For example, StyleGAN achieves this effect by adding per-pixel noise after each convolution.


Deepfake Photo Generators

There’s a constellation of web platforms capable of producing eminently realistic fake images. They are used for various purposes: from education to creating fictional characters and assembling training deepfake datasets.

This Person Does Not Exist (TPDE)

This Person Doesn’t Exist was launched by Phillip Want, who created the website for demonstration purposes. His initial goal was to attract a group of experts to research AI-related issues. However, the website was made available to the broad public to raise awareness concerning dangers posed by deepfake media.



The face generator is powered by Nvidia’s StyleGAN, while being visited by 15,845 unique people daily. It has also spawned a number of clones dedicated to cats, rentals, job applicant resumes, vocabulary, and so on.


Generated Photos

Generated Photos is a commercial website, which allows generating and customizing nonexistent faces. It has a minimalistic toolkit, which enables users to tweak facial expression, skin tone, hair color and length, gender, head positioning, etc.


Masque.ai

Masque.ai is a service with a limited set of options: it allows selecting age, gender and race. It is powered by StyleGAN 2. Unlike TPDE’s pictures, Masque.ai protects its licensable images with a watermark.

Ganvatar

Founded in 2020, Ganvatar serves to synthesize images that can be used as game assets, realistic avatars for social media, modeling longitudinal medical imagery, or as pictures with ‘super-resolution’. Three parameters — age, gender, emotion — can be personalized.


Deepfake Photo Contests

A few competitions were launched to discover promising solutions for detecting fake imagery.

Which Face Is Real?

This competition was established in 2019 by two authors Jevin West and Carl Bergstrom to help regular people detect falsified imagery. Among all else, WFIR’s website provides a guideline on how to detect GAN-generated photos. Forgery indicators include image blobs, bizarre backgrounds, facial asymmetry, crooked eyeglasses, smudged-looking hair, etc.


Human or AI?

Human or AI was a gamified challenge, which welcomed users to try and guess real photos from fabricated ones. It comprised two datasets released by Nvidia with authentic and fake pictures. Currently, the website is inactive.


YouTube Channels

YouTube's community also focuses on the problem and several channels explore the deepfake technology.

Ctrl Shift Face

Ctrl Shift Face is a channel dedicated to digital facial manipulations, breakdowns of deepfake visual effects, as well as ‘prank’ videos where lead actors from a certain movie are replaced with the others. Among all else, the channel demonstrates that high-quality CGI effects can be done with the open-source code.


EZRyderX47

EZRyderX47 is a channel launched by a Canadian self-taught deepfake creator. The channel’s leitmotif is the ‘movie remixes’ with the original actors undergoing facial editing.


BabyZone

BabyZone is another channel that, along with gameplay walkthroughs, uploads remixes of movies and video game trailers/cut scenes. The videos are created with the help of DeepFaceLab 2.0 used for training and character modeling.

Derpfakes

Derpfakes or James Southgate, is a professional visual effects artist, who allegedly contributes to the Deep Voodoo studio. (Founded by T. Parker and M. Stone.) His channel offers a variety of entertaining videos and deepfake production tutorials.

Tero Karras FI

Tero Karras FI is a researcher working at Nvidia Research. His channel demonstrates capabilities of style-based GAN architectures.


Dr. Fakenstein

Dr. Fakenstein (Peter White) is a self-taught AI artist from New Zealand. He creates deepfakes on a computer assembled from spare parts that were originally used for Bitcoin mining. His channel focuses on entertainment.

Birbfakes

Birbfakes is a minor YouTube channel that features videos made with face swapping. It’s unspecified which ANN is used for that.


Other Notable Bloggers

Apart from YouTube, deepfakes are also widely used on other social media.

Azusa Gakuyuki

Azusa Gakuyuki is a Japanese male blogger, who gained online recognition after posing himself as a 20-year-old female, while being 50-year-old at that time. He orchestrated the hoax with the FaceSwap application


Detecting Deepfakes & Spoofing Online

Several initiatives exist — such as CT2PA or CAI — to confront deepfake proliferation. One of such initiatives is FotoForensics.com, which is a nonprofit organization dedicated to detecting and exposing fake imagery. It’s based on a concept of another free service errorlevelanalysis.com created in 2010 (discontinued), where users could submit pictures for evaluation with the Error level analysis (ELA).

References

  1. Video Rewrite: Driving Visual Speech with Audio
  2. A logical calculus of the ideas immanent in nervous activity
  3. Analog VLSI implementation of neural systems
  4. Hopfield network
  5. A Concise History of Neural Networks
  6. A fast learning algorithm for deep belief nets
  7. Representation of the first GAN architecture
  8. Generative Adversarial Nets
  9. Color Restoration for Photos with MyHeritage In Color™
  10. "Deep Fakes" using Generative Adversarial Networks (GAN)
  11. A Style-Based Generator Architecture for Generative Adversarial Networks
  12. Analyzing and Improving the Image Quality of StyleGAN
  13. This Person Doesn’t Exist
  14. This-person-does-not-exist.com ThisPersonDoesNotExist - Random AI Generated Photos of Fake Persons
  15. This Rental Does Not Exist
  16. This resume does not exist
  17. This Word Does Not Exist
  18. Deepfake image generated at This Cat Doesn’t Exist
  19. FAQ Generated Photos
  20. Masque.ai
  21. Ganvatar
  22. Which Face Is Real? Seeing through the illusions of a fabricated world
  23. "Calling Bullshit. The Art of Scepticism in a Data-Driven World" by Jevin D. West, Carl T. Bergstrom
  24. Human or AI
  25. Human Or AI. Can you guess which image is of a real person vs AI?
  26. Ctrl Shift Face on YouTube
  27. EZRyderX47 on YouTube
  28. Robert Downey Jr. in a Back to the Future deepfake remix on YouTube
  29. BabyZone on YouTube
  30. DeepFaceLab 2.0 on GitHub
  31. James Southgate. Biography on IMDb
  32. Tero Karras FI on YouTube
  33. Production-Level Facial Performance Capture Using Deep Convolutional Neural Networks
  34. Dr. Fakenstein on YouTube
  35. Birbfakes on YouTube
  36. Face swapping by Birbfakes applied to a Jennifer Lawrence’s speech
  37. Azusa Gakuyuki on Twitter
  38. Young Female Social Media Influencer Outs Herself as 50-Year-Old MAN
  39. FotoForensics.com
  40. Errorlevelanalysis.com
  41. Error level analysis (ELA)