When used responsibly, these capabilities provide educators with another source of information; however, they should never replace professional judgment. “In education, trust is foundational,” says Matt Jubelirer, general manager for education marketing at Microsoft. “Schools should never have to choose between innovation and responsibility.”
That balance is especially important when schools use AI for student monitoring or analytics. Jubelirer says Microsoft’s goal is “to help teachers identify opportunities for student support, personalize learning experiences and reduce administrative burden while ensuring that people remain at the center of decision-making.”
Balancing AI Use, Privacy and Trust
Building trust around the use of AI requires clear communication. Educators, students and families should know how AI is used, what information it collects, the safeguards in place and when human review is required. Microsoft’s approach to AI in education is guided by three principles: human-centered design, transparency and educator control, and privacy and security by default.
Jubelirer says that Microsoft implements safeguards such as “content filtering, dynamic blocklists for inappropriate prompts and additional protections designed to help ensure AI interactions remain safe, age-appropriate and relevant for educational settings.” Within Teams for Education, features such as Expected AI Use and Restricted Mode allow educators to communicate assignment-level expectations and lets both administrators and educators manage student access to AI capabilities, he says.
However, technology safeguards are only one part of responsible implementation.
Sarah Thomas, founder of EduMatch, advises, “Before adopting any AI-driven monitoring or analytics tool, schools should know what data they collect and who will be able to see it.” Personally identifiable information should be taken seriously, and districts should have a data privacy agreement with any tool that could potentially touch student and staff data.
DIVE DEEPER: Data governance helps K–12 schools safeguard student data.
Schools must look beyond a vendor’s general privacy statement and determine what data enters the system, who has access, whether it is stored or shared, and what happens to it when the district stops using the product.
Jubelirer emphasizes three considerations for institutions thinking about adopting or implementing AI: governance of use, governance of data and governance of risk and oversight. He adds, “Effective frameworks provide practical guidance for use, ensure responsible data management and privacy, and enable ongoing risk oversight as technology and institutional needs continue to evolve.”
These considerations should be addressed before implementation. Schools must define appropriate uses, establish accountability, create reporting procedures and regularly review whether the technology continues to serve its educational purpose.
Jubelirer emphasizes the need for “clear expectations, transparency about how AI systems are used, professional learning for educators and policies that prioritize responsible use.” Educators, students and families should also have opportunities to ask questions and contribute to decisions about how these systems are used.
