1.3b. What risks and ethical considerations arise from AI and technology use in education, childcare and children’s social care? These may include bias, stereotyping, data privacy, intellectual property rights and safeguarding.

Background

The rapid integration of AI and digital tools into learning and care environments offers opportunities for personalised support and innovation, but it also raises questions about safety and ethics, and the reliability of information. At the same time, online harms, from misinformation to reinforcing stereotypes, are prevalent. This underscores the need for robust digital literacy skills that allows learners to navigate digital spaces safely. It is essential to understand how these factors interact, and their implications for teaching, learning and safeguarding, to make sure that education and care systems prepare children and young people for a digital future while protecting their wellbeing.

AI is beginning to influence practice across schools, further education and skills, early years, and social care settings. It offers potential benefits such as personalised learning, administrative efficiency, and enhanced safeguarding. However, we need to understand more about how education providers and social care settings are using AI, and what factors enable or hinder its effective implementation.

Next steps

Get in touch with [email protected]

Related UKRI funded projects


  • CHAILD - Children's Agency In the age of AI: Leveraging InterDisciplinarity

    In today's rapidly changing digital world, children's lives are intricately intertwined with Artificial Intelligence (AI) systems, permeating their experiences through various platforms like connected toys, apps, voice a...

    Funded by: UKRI CRCRM

    Lead research organisation: University of Oxford

    Why might this be relevant?

    The project specifically addresses the risks and ethical considerations of AI in education and childcare, focusing on children's agency and algorithmic autonomy.

  • Towards Embedding Responsible AI in the School System: Co-Creation with Young People

    Recent advances in Generative Artificial Intelligence (GenAI) have the potential to transform education, from reactive tweaks in assessment practices to fundamental philosophical debates about what we should value in the...

    Funded by: AHRC

    Lead research organisation: University of Edinburgh

    Why might this be relevant?

    The project focuses on embedding responsible AI in the school system by co-creating with young people, addressing accountability, accuracy, and inclusion in education.

  • GRASPING DATA: Co-creating Physicalizations to Empower Young Children to Interact with, Understand, and Benefit from Their Personal Data

    Grasping Data will change how we think about children and their personal data. We go beyond current emphases on privacy and protection by co-creating cutting-edge, child-centred tools and pedagogies with young children, ...

    Funded by: UKRI CRCRM

    Lead research organisation: University of Edinburgh

    Why might this be relevant?

    The project empowers young children to interact with and understand their personal data, which is partially relevant to the risks and ethical considerations of AI in education and childcare.

  • Equal Education: e-learning lockdown solution

    Equal Education is a social enterprise that provides tuition for children in the care system and those with special education needs and disabilities. There are currently almost 80,000 children in the care system in Engla...

    Funded by: Innovate UK

    Lead research organisation: EQUAL EDUCATION LIMITED

  • Supporting the use of digital media in research with children and young people

    This project will create an online resource about using digital media in research with children and young people. The resource will give guidance and support to researchers who wish to use digital media in their work. It...

    Funded by: ESRC

    Lead research organisation: University of Edinburgh

  • Enabling a Responsible AI Ecosystem

    Problem Space: There is now a broad base of research in AI ethics, policy and law that can inform and guide efforts to construct a Responsible AI (R-AI) ecosystem, but three gaps must be bridged before this is achieved: ...

    Funded by: AHRC

    Lead research organisation: University of Edinburgh

  • Fair-AIEd: Participatory design approaches to creating ethical AI for international education and development

    Warning of a global "learning crisis" in education, the World Bank recently claimed that without learning, education will fail to deliver on its promise to eliminate extreme poverty and create opportunity and p...

    Funded by: UKRI FLF

    Lead research organisation: University of Oxford

  • Adolescence, digital technology and mental health care: exploring opportunity and harm.

    This work will pave the way for a substantial programme of research focused on the relevance of adolescents' digital technology use to consultations about mental health. We will explore both opportunities and harms posed...

    Funded by: SPF

    Lead research organisation: University of Bristol

  • Ensuring the benefits of AI in healthcare for all: Designing a Sustainable Platform for Public and Professional Stakeholder Engagement

    Japan and the UK are both investing heavily in national programmes to accelerate the implementation of AI in healthcare delivery (1,2,3). The perceived benefits of this technology include increased efficiacy and cutting ...

    Funded by: FIC

    Lead research organisation: University of Oxford