Deepfake Detection Software: Types and Practical Application

From Antispoofing Wiki

Deepfake Detection: A Brief History

The rise of synthetic media has naturally caused a demand for reliable deepfake detection tools, some of which show rather impressive results.

Deepfake detection technology allows prompt recognition of a piece of fabricated media with high accuracy. Distinguishing fake footage, photo or audio from authentic media is also necessary, as it helps to tackle the so-called liar’s dividend.

Deepfake detection had been an essential technology ever since deepfakes came into existence in the 1990s. However, when the first specimen appeared on Reddit platform in 2017, they caused increased concern. The falsified media were labeled a "calamity" and caused numerous concerns among the researchers, as well as among people who believed they could be potential deepfake targets.



Currently, a number of deepfake detection tools exist, ranging in sophistication, accuracy rates and their accessibility to common users. One of the core ideas behind these tools is to provide a reliable detection technique to both experts and regular people so that deepfake threats such as mass-disinformation can be excluded.

Deepfake Detection Usage: Positive & Negative Aspects

A fake speech by US president Kennedy is the first known example of Deepfakes created using Video Rewrite tool
The first known deepfake tool Video Rewrite was applied to a Kennedy’s speech


Broad availability of deepfake detection tools has raised opposing opinions in the expert community. A roundtable was held by Partnership on AI and nonprofit organization Witness to outline benefits and possible downsides of proliferating this technology.

The negative aspects include:

  • Hacking. While having first-hand access to a deepfake detection tool, fraudsters can learn to bypass and fool it. This can be achieved via reverse engineering, trial and error, code tampering, and other practices. In the past, a similar concern was raised in regard to passive liveness detection systems.
  • Limited availability. While proliferating a "home-use" anti-deepfake tool would be easy in the "Global North" — Europe, North America, and other regions — it would be hindered in less developed countries. Poor tech-literacy and limited access to the internet are among the main obstacles.
  • Trust issues. Regular users may discard detection results due to poor understanding of how the technology works. User’s overconfidence can also be a hurdle.
  • Lack of generalization. The deepfake detection solutions are trained on different datasets that contain videos and images from various sources: YouTube, Facebook, studio shots, surveillance cameras, and so on. Thus, a solution trained on a certain dataset may fail when facing data from a completely different source.
  • Privilege issues. If a deepfake detection tool becomes a privilege of the political authorities, it will automatically lose its legitimacy. Legal attempts at depriving journalists, fact-checkers, activists, as well as regular users of such technologies are also seen as a vital threat.
  • Insufficient infrastructure. The roundtable mentions an incident when the detector dubbed Deepfake-o-meter was made public for the first time. The number of requests was so big, it promptly crashed the servers.



However, a number of positive aspects were also outlined:

  • Increased awareness. A simple and publicly available detector can prevent the spread of deepfakes and cheapfakes. In turn, this will hinder some unscrupulous practices: disinformation, slander, opinions manipulation, and so on.
  • Standardization. Cooperative efforts can lead to establishing universal guidelines, rules, and standards in media. This environment will make it much harder for deepfakes to appear and circulate.
  • Access for specialists. Journalists, whistleblowers, and fact-checkers can access more advanced digital forensic systems exclusively, which can help filter out malicious actors.

These positive aspects are part of the 6 key points to "responsible AI" and "information integrity" proposed by the roundtable.


Software & Online Platforms for Deepfake Detection

In a response to the growing deepfake menace, a cohort of publicly available detectors were designed by various companies and startups.

Sensity

Sensity is an online platform dedicated to deepfake detection. It seeks to improve detection aspects such as remote KYC, face recognition, manual document check, as well as revealing media altered with deep learning and AI.

It allows uploading files in multiple formats — MP4, JPEG, TIFF — which then undergo a scanning procedure. According to the company, Sensity takes one second to reveal a forgery with an accuracy of 98.1%. Face swapping is mentioned as one of the targeted fraud techniques.

It is mentioned that the system can successfully tackle dating website scams, identity concealing, falsified IDs, and other types of fraud performed, among all else, with the help of the Generative Adversarial Networks (GANs).


Deepware Scanner

Deepware Scanner is an open-source forensic tool. Deepware had been researching deepfakes since 2018, developing methods to detect them. Deepware Scanner is unique as it is deliberately tested on multiple data sources, including organic and live videos.

The scanner is based on EfficientNet-B7 — a model of the convolution neural network architecture, which is based on uniform scaling of all CNN dimensions. In turn, this provides higher accuracy and general cost-efficiency.

Its primary training dataset is the CFDC dataset, which contains 120,000 consented videos. The test datasets included 4chan Real, MrDeepFakes, Celeb-DF YouTube, and others.



Authors behind Deepware Scanner state that community support is inescapable in tackling deepfakes. Hence, the project remains open-source and welcomes researchers.


Microsoft Video Authenticator

The deepfake detection tool dubbed Microsoft Video Authenticator was developed as part of the Microsoft Defending Democracy Program, which strives to prevent the spread of disinformation.

It is capable of analyzing both static images and videos in real-time mode. In the case of the video materials, it can spot blending boundary and subtle fading or grayscale elements. These are the 'clues' typically left by a deepfake and virtually invisible to the naked eye.

Video Authenticator was trained on Face Forensic++ and tested on the CFDC dataset. Test results and accuracy of the solution, however, were not disclosed. Moreover, Microsoft mentions that an effective technology would not be sufficient alone, and proposed several auxiliary initiatives such as NewsGuard.


DeepDetector & DeepfakeProof from DuckDuckGoose

DeepDetector and DeepfakeProof are designed for detecting digital forgeries. While the former is meant for the corporate domain, the latter is a free-to-use browser plugin for everyone.

Deepfake Detector has its own API and is available in two iterations: an online platform and a standalone application. Meanwhile, DeepfakeProof is installed as a browser extension. It scans every website visited by a user, alerting them if any fabricated media is present.

Deepfake-o-Meter

Deepfake-o-meter is an online deepfake detection platform, which allows:

  • Analyzing suspicious video files.
  • Wrapping individual algorithms for running them on various servers.
  • Comparing various algorithms and their effectiveness on a single input.

A video can be uploaded via a URL link or as a file with a maximum size of 50 MB. To detect fake media, it employs Xception, ClassNSeg, EfficientNet-B3, CNNDetection, spatial pyramid pooling, mesoscopic image properties analysis, and other techniques.


Reality Defender

Reality Defender is a deepfake detection utility designed by the AI Foundation. It is meant for both commercial usage as a fraud prevention tool and for noncommercial purposes such as disinformation tackling, investigations, and so on. Initially, Reality Defender was conceived as a non-partisan tool to maintain ethical and truth standards. (Especially during presidential elections).

References

  1. The Liar’s Dividend: The Impact of Deepfakes and Fake News on Politician Support and Trust in Media
  2. A Reddit User Starts 'Deepfake'
  3. The World Needs Deepfake Experts to Stem This Chaos
  4. Video Rewrite: Driving Visual Speech with Audio
  5. John F. Kennedy on timeforkids.com
  6. How to Share the Tools to Spot Deepfakes (Without Breaking Them)
  7. Partnership on AI
  8. Witness helps people use video and technology to protect and defend human rights
  9. Gabon Runs on Auto-Pilot as President Ali Bongo Remains in Saudi Hospital Due to 'Fatigue'
  10. Opinions manipulation: media, power and gossip
  11. Deep Fake Detection Challenge To Culminate in Vancouver
  12. Forensic Deepfake Detection
  13. How to Detect a Deepfake Online: Image Forensics and Analysis of Deepfake Videos
  14. Deepware on github.com
  15. Deepware scanner test results
  16. Microsoft Defending Democracy Program
  17. FaceForensics++: Learning to Detect Manipulated Facial Images
  18. NewsGuard
  19. New Steps to Combat Disinformation
  20. DeepDetector and DeepfakeProof
  21. Deepfake-o-meter
  22. Reality Defender Can Protect Us From Deep Fakes Using AI
  23. DeepFake-o-meter: An Open Platform for DeepFake Detection
  24. Reality Defender. Enterprise-Grade Deepfake Detection Platform