Daily Safeguarding News - Safer Schools NI

AI chatbot Chai encourages underage sex, suicide and murder

A Times investigation has found that an AI chatbot platform called Chai, which is used by millions of people is encouraging underage sex, suicide and murder.
Apple and Google have removed the apps from their stores following this investigation.
Chai allows users to create personalised chatbots for role play and has one million active monthly users.
Some chatbots have been created by users for people to interact with, for example “Chef Ramsay” details suicide methods and “Molly (the girl you babysit)” identifies as 12 and tries to seduce the user.
Members of the public reported having tried to report the content, but it remained online.
Chai Research responded to the investigation, stating they have taken steps to improve their AI and make it safer for users.
The Times tested the app again and whilst the bots were more resistant to toxic conversations, there was still harmful content being generated.
For more, please visit the Times website.

According to the NSPCC, mental and emotional health and wellbeing was the top reason children contacted Childline in 2022-23.
The NSPCC are calling on the government to commit to funding and delivering mental health support teams across schools and colleges in order to reach those needing help.
The Department for Health and Social Care has promised to invest an additional £2.3 billion a year into mental health services by 2024.
Dr Lade Smith, president of The Royal College of Psychiatrists, reported: “The public mental health emergency is real. It is having a devastating effect on the lives of thousands of people, particularly children and young people.”
For further support, Childline can be contacted via childline.org.uk or calling 0800 11 11.
For more, please visit the ITV News website.

These new features are designed to lean into younger audience trends, including birthday shout-outs, selfie videos for notes, and new group interaction options.
Instagram is also working on new music features that are designed to enhance creative expression in the app.
Other features in testing include “Crews” for more private Story sharing, and a new trivia game within Instagram live-streams.
The new features are designed to enhance the platform’s appeal with users aged between 16 and 25, to try and encourage engagement within the app, as opposed to drifting to TikTok.
For more, please visit the Social Media Today website.