In a concerning development highlighting the emerging challenges of artificial intelligence technology, police are investigating allegations that a teenage student at a south-western Sydney high school used AI to create and distribute inappropriate synthetic images of fellow students.
The incident, which came to light in early January, has prompted swift action from educational authorities and law enforcement. Campbelltown City Police Area Command launched an investigation on January 6 following reports of the distribution of AI-generated explicit images through fake social media accounts.
A NSW Department of Education spokesperson confirmed they are collaborating closely with police on the investigation, emphasising that such behaviour would not be tolerated within the education system. “Our highest priority is to ensure our students feel safe,” the spokesperson stated, adding that affected students are receiving ongoing wellbeing support.
NSW education minister Prue Car condemned the incident as “abhorrent,” while noting that the school’s leadership team, particularly the deputy principal, acted promptly upon discovering the situation. “Our priority is making sure that all the affected students are OK and that they are OK to return [to school] on day one, term one,” Car said.
The investigation has drawn in multiple agencies, with NSW Police working alongside the eSafety Commissioner and the Department of Education. The matter has been formally referred to the eSafety Commissioner for further investigation.
To protect the privacy of those affected, authorities have not publicly identified the school or any students involved in the incident. The Department of Education indicated that decisions regarding the accused student’s future involvement in the school would prioritise student safety.
The incident underscores growing concerns about the misuse of AI technology, particularly in educational settings. As AI tools become more sophisticated and accessible, educators and authorities face new challenges in maintaining student safety and privacy in the digital age.
Law enforcement officials confirmed the investigation is ongoing, with police continuing to work with educational authorities to address the situation.