©commons.wikimedia.org/wiki/File:Sw-face-swap

There are already several ways deepfakes are being misused to cause distress and harm. As this technology evolves and becomes more accessible to users, it is important to include in this guide to deepfakes some of the ways it can be misused.

Deepfakes have been used in cases of cyberbullying to deliberately mock, taunt, or inflict public embarrassment on victims. The novel appearance of these images may distract from the real issue that they can be used to bully or harass children and young people.

Deepfakes can be used to create incriminating, embarrassing, or suggestive material. Some deepfakes are so good that it becomes difficult to distinguish between them and the real thing. Convincing other people that an embarrassing or abusive image is fake can create additional layers of vulnerability and distress. These images can then be used to extort money or additional ‘real’ images.

Additionally, deepfakes can be used to create so-called ‘revenge porn’. This is a form of image-based sexual abuse as retaliation or vengeance typically associated with the end of a relationship or not agreeing to a sexual relationship with the perpetrator.

Despite common usage of the term ‘revenge porn’, particularly in the media, INEQE Safeguarding Group believes that this terminology is inappropriate and misleading. We propose that this type of misuse of deepfakes comes under the umbrella term of ‘image-based sexual abuse’. Some research shows that victims do not like the term ‘revenge porn’ as it implies they must have done something to deserve retaliation.

In the past, deepfakes were often used to create pornographic materials of famous women. With the tech becoming more accessible to use, non-famous people are increasingly becoming victims too.

Deepfakes can also be used as a form of homophobic abuse, in which a person is depicted in gay pornography. This could then be used to ‘out’ the person or as an attempt to ‘destroy their reputation.’ For young people struggling with their sexual orientation, being depicted in any sexualised deepfakes may be particularly distressing.

There have been cases where images of children have been harvested and used to generate sexualised deepfakes. The realistic depiction of a victim engaging in a sex act can damage a child’s wellbeing and mental health. We know that deepfake software can be used to remove clothing from victims digitally. In some cases, there are commercial services where users can pay to have images professionally manipulated.

It is important that parents, carers, and safeguarding professionals are aware of the risks of this form of (non-contact) sexual abuse. In some cases, victims themselves may be unaware that their images have been harvested and misused to create deepfakes.

While many children and young people may be aware of and understand how images can be manipulated in this way, others may not. It is important to speak to them about the issue of deepfakes and how they can be misused.

Deepfakes can vary in their quality and professionalism. Some will be quite obviously fake. For others, it can be tricky to spot whether they are real or not. Here are some tell-tale signs to look out for: