References

Children's Commissioner. ‘A lot of it is actually just abuse’. 2023. www.childrenscommissioner.gov.uk/report/a-lot-of-it-is-actually-just-abuse-young-people-and-pornography (accessed 22 January 2025)

Internet Watch Foundation. What has changed in the AI CSAM landscape?. 2024. www.iwf.org.uk/media/drufozvi/iwf-ai-csam-report_update-public-jul24v12.pdf (accessed 22 January 2025)

Internet Watch Foundation. Report Remove: Helps young people under-18 in the UK to confidentially report sexual images and videos of themselves and remove them from the internet. 2025. www.iwf.org.uk/our-technology/report-remove (accessed 22 January 2025)

The rise of AI and deepfake child abuse

02 January 2025
Volume 2 · Issue 1

Abstract

The explosion of social media use over the last decade has brought with it a failure of society to either predict the threats that the phenomenon would unleash into the lives of our children and young people, or to offer them any kind of protection against its harms. Big business drove its rapid development, many waxed lyrical about its power for good and little heed was given to the safeguarding and wellbeing of children.

 

The explosion of social media use over the last decade has brought with it a failure of society to either predict the threats that the phenomenon would unleash into the lives of our children and young people, or to offer them any kind of protection against its harms. Big business drove its rapid development, many waxed lyrical about its power for good and little heed was given to the safeguarding and wellbeing of children.

We are now scrambling to catch up in the face of social media's clear impact on children's mental health and wellbeing. The evidence is mounting, but here are just two recent examples:

It is argued that there is a place for social media and that there are benefits for children, many of whom are more likely to socialise and communicate with friends online than in real life. On the other hand, it is possible that social media will be looked upon in years to come as one of the biggest mistakes of the 21st century, giving a voice as it has to extremist, racist and misogynist views.

Register now to continue reading

Thank you for visiting Journal of Child Health and reading some of our peer-reviewed resources for children’s health professionals. To read more, please register today. You’ll enjoy the following great benefits:

What's included

  • Limited access to our clinical or professional articles

  • New content and clinical newsletter updates each month