Schools in the US Struggle To Address AI Deepfakes

The rapid evolution of fake AI-generated images and videos is reportedly prompting schools and legislators in America to confront new challenges while trying to forge protective policies.

At a Glance

Deepfake technology is posing real threats to the integrity of school systems.
Schools are implementing crisis plans to address potential AI-related incidents.
Legislators aim to criminalize malicious uses of AI-generated media.
Efforts are underway to enhance the detection and prevention of deepfakes.

Deepfakes Impact School Settings

Deepfake technology, which can convincingly manipulate images and videos, is reportedly emerging as a significant threat to school environments. Schools are under pressure as students misuse AI to harass peers through explicit, racist, violent, or otherwise inappropriate content. These manipulations not only affect the student body but also place educators in challenging positions, creating unsafe digital environments that compromise academic integrity. Addressing these issues requires thorough investigation alongside law enforcement while providing necessary support to affected students.

Proactive Policy Development

Schools across the country are under pressure to develop crisis plans to address deepfake incidents. These plans not only focus on prevention but also on preparedness to quickly respond to potential challenges involving AI-generated content. Recognizing this need, some school districts are enacting policies to preemptively address the misuse of AI technologies. For instance, they are collaborating with local authorities to assess necessary measures and promote awareness among students and parents.

“Incidents in other Southern California districts prompted us to take proactive measures. Given the rapid emergence of AI and its potential misuse, we drafted a comprehensive policy to ensure our district is prepared to address any future issues involving deep fakes or inappropriate AI-generated content,” said Patrick Gittisriboongul of the Lynwood Unified School District near Los Angeles.

Schools are actively seeking guidance on how to handle deepfake incidents effectively. Educators are focusing on the importance of crisis management and the inclusion of AI-generated content in their safety protocols. Such measures are crucial in maintaining a secure learning environment and preserving the integrity of educational institutions.

Legal and Legislative Action

Amid growing concerns, lawmakers are moving to criminalize AI-generated child abuse and other malicious uses of deepfakes. These legal steps underline the threat that AI-generated media poses. Legislators are working alongside educational institutions to ensure there are stringent measures in place to deter harmful uses of technology. Despite this, challenges persist, as founder and managing director of the Opportunity Labs nonprofit research organization Andrew Buher notes there is still no technology that can effectively combat threats from these types of AI tools.

Still, efforts are underway, even outside the U.S. For instance, Al Akhawayn University in Morocco is reportedly “leveraging a hybrid detection model” using recognition algorithms and blockchain technology to bolster deepfake detection accuracy. This approach aims to ensure the authenticity of digital content by using blockchain as an immutable ledger.

Meanwhile, in the U.S., the NSA and associated federal agencies released a report last year advising on deepfakes and the dangers they pose on a larger scale. Candice Rockell Gerstner from the NSA noted, “The tools and techniques for manipulating authentic multimedia are not new, but the ease and scale with which cyber actors are using these techniques are. This creates a new set of challenges to national security.” She emphasized the importance of entities and employees learning to detect deepfakes and respond to them appropriately.

To protect both reputations and data integrity, schools are working to develop technologically advanced solutions and policies. While advancements in AI offer promising applications, they also bring an urgent need for vigilance and robust protective strategies to prevent potential misuse.