What's happened
Australia's eSafety Commissioner has urged schools to report incidents of deepfake technology misuse, particularly involving 'nudify' apps. Reports of image-based abuse among minors have surged, with a significant impact on young girls. The rise of generative AI tools has exacerbated the issue, prompting calls for stricter regulations and awareness in educational settings.
What's behind the headline?
Key Issues Surrounding Deepfake Technology
- Rapid Proliferation: The rise of user-friendly deepfake creation tools has made it easier for minors to create and share harmful content.
- Targeting Vulnerable Groups: Reports indicate that four out of five incidents involve young girls, highlighting a concerning trend of gendered abuse.
- Lack of Reporting: eSafety Commissioner Julie Inman Grant emphasized that the reported figures likely underestimate the actual prevalence of these incidents.
- Educational Impact: Schools are urged to take proactive measures in educating students about the risks associated with deepfake technology and the importance of reporting incidents.
- Regulatory Response: The Australian government is under pressure to implement stricter regulations to protect minors from the harms of digital abuse, particularly as generative AI tools become more prevalent.
What the papers say
According to Emma Brancatisano from SBS, the eSafety Commissioner has highlighted the alarming rise in reports of digitally altered images, stating, "We suspect what is being reported to us is not the whole picture." This sentiment is echoed by criminology professor Asher Flynn, who noted that the normalization of deepfake content creation is concerning. In contrast, YouTube has faced criticism for its exemption from the under-16s social media ban, with Josh Butler from The Guardian reporting that Inman Grant has called for a reevaluation of this exemption due to the platform's potential risks for young users. The debate continues as stakeholders push for clearer regulations and accountability from tech companies.
How we got here
The Australian eSafety Commission has noted a dramatic increase in reports of digitally altered intimate images among minors, particularly affecting young girls. This surge is attributed to the accessibility of 'nudify' apps and the proliferation of deepfake technology, prompting calls for schools to adhere to reporting obligations.
Go deeper
- What are 'nudify' apps and how do they work?
- How can schools better protect students from digital abuse?
- What regulations are being proposed to address this issue?
More on these topics
-
Australia, officially known as the Commonwealth of Australia, is a sovereign country comprising the mainland of the Australian continent, the island of Tasmania, and numerous smaller islands.
-
YouTube is an American online video-sharing platform headquartered in San Bruno, California. Three former PayPal employees—Chad Hurley, Steve Chen, and Jawed Karim—created the service in February 2005.
-
Anika Shay Wells (born 11 August 1985) is an Australian politician. She is currently Minister for Communications and Minister for Sport in the Albanese government, having previously served as Minister for Aged Care from 2022 to 2025. She is a member of...