Last Updated on 19th November 2021
We have all had that ‘wow’ moment when something we thought possible only in the imagination of sci-fi writers suddenly exists at our fingertips! Just when we think we have seen everything technology has to offer, something new comes along.
You may have seen some comedy gold, where celebrities, friends or relatives have had their faces manipulated to sing, dance, or even tell jokes. When deepfakes are used here, they are unlikely to cause serious harm.
These moments can stop us in our tracks and make us wonder whatever next. At the INEQE Safeguarding Group, we think the next big thing could very well be deepfakes. The big question is should you be worried?
This article brings you the latest research on deepfakes and explains how they can be misused. Read all the way to the bottom to find out how you can protect the children in your care as this technology evolves.


The Harmful Side of Deepfakes
There are already several ways deepfakes are being misused to cause distress and harm. As this technology evolves and becomes more accessible to users, it is important to understand how it can be misused.
Bullying
Deepfakes have been used in cases of cyberbullying to deliberately mock, taunt or inflict public embarrassment on victims. The novel appearance of these images may distract from the real issue that they can be used to bully or harass children and young people.
Extortion and Exploitation
Deepfakes can be used to create incriminating, embarrassing or suggestive material. Some deepfakes are so good that it becomes difficult to distinguish between them and the real thing. Convincing other people that an embarrassing or abusive image is fake can create additional layers of vulnerability and distress. These images can then be used to extort money or additional ‘real’ images.
Image-Based Sexual Abuse
There have been cases where images of children have been harvested and used to generate sexualised deepfakes. The realistic depiction of a victim engaging in a sex act can damage a child’s wellbeing and mental health. We know that deepfake software can be used to remove clothing from victims digitally, and in some cases, there are commercial services where users can pay to have images professionally manipulated.
It is important that parents, carers, and safeguarding professionals are aware of the risks of this form of (non-contact) sexual abuse. In some cases, victims themselves may be unaware that their images have been harvested and misused to create deepfakes.
While many young people may be aware of and understand how images can be manipulated in this way, others may not. It is important to speak to them about the issue of deepfakes and how they can be misused.
Join our Safeguarding Hub Newsletter Network
Members of our network receive weekly updates on the trends, risks and threats to children and young people online.