AI-Enhanced Phishing Puts Student Safety and Digital Trust at Risk
Beyond cybercriminals’ use of AI to perpetrate more attacks faster, schools also face the growing challenges of AI misuse among students, which is a safety crisis. Bad actors have weaponized generative AI tools against peers and staff alike, producing realistic images, videos and voice clones. As AI adoption grows, so does the frequency of students reporting deepfake, nonconsensual imagery within their school communities.
More than 85% of teachers and students reported using AI in the 2024–2025 school year, according to research from the Center for Democracy and Teaching. While AI offers meaningful benefits in modern learning, schools must also address AI’s threats to students’ well-being. Solutions that are easily integrated into platforms like Microsoft 365 and Google Workspace, and leverage AI’s capabilities to detect abnormal patterns, will allow school to build the buffers needed to improve protection. Protecting families’ trust in educational institutions remains just as important: A safety net that alleviates parents’ concerns as their students navigate digital landscapes is just as important as safety-related benchmarks.
We can’t just cross our fingers and hope for the best. Each of these efforts requires a three-pronged response, focusing on updates to policy, understanding online behaviors, and up-to-date staff and student training. If acceptable use policies don’t expressly define the misuse of synthetic or fabricated media and content, for example, districts may be legally and operationally vulnerable when bad actors strike.
Teachers must also do their part to ensure that students understand how AI-generated content can cause permanent damage in the real world and that reputations can suffer irreparable harm. School leaders must navigate the complex legal, emotional and operational consequences that result. Yet, intrusive monitoring or punitive overreach achieves little in such scenarios. As districts update policies, define behavioral expectations around synthetic media and integrate AI literacy into curricula, they start to achieve clarity on a path forward. No matter the enemy, the primary goal remains: Preserve schools as safe, transparent environments, where technology empowers rather than harms.
READ MORE: How to ensure your AI tools are secure.
Hackers Gain New Entry to Online K–12 Tools
In a recent campaign targeting the higher education space, attackers compromised accounts and distributed disturbing content through Google Classroom and Google Forms. Because the activity originated within familiar platforms, it bypassed many conventional perimeter defenses.
AI-automated phishing emails now have a 54% click-through rate, compared with just 12% for standard phishing, according to the Microsoft Digital Defense Report 2025. By mimicking tone and context, AI-enhanced lures are 4.5 times more effective than what was once possible.
Attackers are no longer required to break in from outside. Instead, they operate freely within collaboration environments, impersonating administrators, sharing files and automating personalized, AI-enhanced phishing at scale. K–12 districts remain especially attractive as targets due to the high volume of student data and accounts, as well as their high-trust cultures. Bad actors now rely on AI to realistically blend in with normal, everyday K–12 activities.
Turning to security systems that can detect patterns in shared files or conversations provides IT teams with actionable insights before threats affect students, but establishing adequate protections in the face of AI-enabled phishing is, of course, more complicated than that. For protection to be truly effective in schools operating primarily within Google and Microsoft environments, security solutions must live inside the ecosystems where learning happens.
SUBSCRIBE: Sign up to get the latest EdTech content delivered to your inbox weekly.
