The internet continues to offer opportunities for learning and connection, however the rapid advancement of AI has introduced new and deeply concerning threats. One of the most pressing is AI-driven sextortion – where criminals use technology to manipulate, blackmail, and exploit children online.
Schools are now facing an urgent challenge – how to protect students in a landscape where online risks evolve faster than the systems designed to prevent them.
The scale of the issue
Recent research from child safeguarding technology company Qoria highlights the growing severity of the problem in UK schools:
- 38% of schools report the criminal exploitation of students as a frequent safeguarding issue
- 65% of schools regularly deal with cases of students possessing, sharing, or requesting nude content
- Snapchat is the most commonly used social media platform for these exchanges, with 49% of cases involving the app
- Children as young as eight (21%) and 11 (58%) have been found sharing nude images online
- 64% of teachers lack the necessary training, knowledge, and time to address the risks posed by AI-generated explicit content and online exploitation.
- An overwhelming 91% of teachers are deeply concerned about AI’s role in exploitation and grooming, particularly with the rise of AI-powered nudification apps.
Meanwhile, external reports echo these findings. The Internet Watch Foundation (IWF) has reported a 19% rise in sexual extortion cases in 2024 compared to the previous year, with cases involving 14- and 15-year-olds increasing by 25%. This is not a problem on the horizon – it is already here, and it is escalating.
Why schools are struggling
Despite widespread concern, schools are often underprepared to deal with this new wave of digital threats. Many educators feel they are constantly playing catch-up, facing gaps in training and awareness, with limited time and resources.
The psychological toll on students and staff is significant, particularly with the emergence of deepfake technology, which means that even children who have never shared an image of themselves could become victims of sextortion.
If teachers and safeguarding leads are expected to act as first responders to these challenges, they need better support, training, and tools to do so effectively.
What needs to change?
The NSPCC has already raised concerns that current UK laws are failing to protect children from sexual exploitation on messaging apps, with encrypted platforms such as WhatsApp making it easier for predators to operate undetected. Stronger protections within the Online Safety Act are needed, but schools cannot afford to wait for legislative change before taking action.
To address these challenges, a proactive and multi-layered response is essential. Schools, policymakers, and safeguarding professionals must work together to create meaningful change, including:
- Creating dedicated AI working parties within schools to coordinate policies, training, and response strategies while supporting staff affected by deepfake bullying and defamation.
- Implementing comprehensive digital monitoring and advanced filtering systems, such as those provided by Smoothwall, the UK arm of Qoria, to detect AI-generated risks, coded language, and explicit content in real-time.
- Providing regular professional development for staff on current digital threats, intervention strategies, and use of monitoring tools, moving beyond passive “eyes and ears” observation – as important as this is.
- Establishing centralised online safety hubs and regular workshops to educate parents about AI risks beyond just screen time concerns, enabling them to protect children at home.
- Proactively deploying student wellbeing check-in tools and age-appropriate education and awareness programs starting from ages 8-10, given evidence that explicit content exposure begins this early.
A call to action
The rise of AI-driven sextortion is not a distant threat – it is happening now, in classrooms and communities across the UK. Schools must be given the tools and resources to address this crisis head-on. With the right training, policies, and technology in place, we can work together to ensure that young people remain protected in an increasingly digital world. Because when it comes to safeguarding, keeping pace is no longer enough – we must stay ahead.
