Implications of using artificial intelligence in educational systems

Artificial intelligence systems in the education process collect a wide range of personal and professional data. Data about students is particularly sensitive, including academic performance, learning habits, and patterns of behaviour in the digital environment. In addition, artificial intelligence processes data about teachers, administrative staff, researchers, and external collaborators. Any unauthorised access to this data can violate privacy, professional integrity, and trust in the institution.

Compliance with the European Act on Artificial Intelligence and the GDPR

According to the European Act on Artificial Intelligence, systems that affect access to education or student assessment are classified as high-risk, which imposes obligations on institutions to:

• Actively manage security risks.
• Ensure the cyber resilience of the system.
• Document security measures and verification.
• Provide human oversight in key decisions.
• Fully comply with the GDPR in the protection of personal data.

The aim is to preserve the rights, safety, and well-being of all stakeholders in the academic community.

Reflective question

• What security measures and procedures are already implemented in your educational environment, and how would you improve them to ensure that the application of artificial intelligence remains safe and reliable?