Which harmful online uses of AI are likely to increase? What could be the impact of AI-generated content on attitudes, beliefs, behaviours or psychological wellbeing?

Background

Although there is already material evidence on the types of serious harms individuals encounter online, there still remain a number of emerging harms, where the evidence base is still yet to mature (e.g. epilepsy trolling, online animal abuse). SOH would like to close this significant gap in understanding the impact of encountering different types of serious harms online and understanding the best approaches to measuring the impact of the Online Safety legislation.

SOH highlights the importance of Media Literacy in the digital age and asks for further studies to uncover barriers to engagement as well as the effectiveness of DSIT programmes. This issue closely relates to Counter-Disinformation interventions, which requires evidence for its effect on bystanders, topic specific disinformation and what tools can be used to combat this issue.

Research on Safety Technology would greatly develop SOH’s understanding of the relationship that DSIT online safety objectives have with the technology market today. A primary focus lands on improving Age Assurance (AA) measures. This includes ensuring transparency and assessing opportunities for the sector.

Next steps

If you are keen to register your interest in working and connecting with DSIT Digital Technology and Telecoms Group and/or submitting evidence, then please complete the DSIT-ARI Evidence survey - https://dsit.qualtrics.com/jfe/form/SV_cDfmK2OukVAnirs.
Please view full details: https://www.gov.uk/government/publications/department-for-science-innovation-and-technology-areas-of-research-interest/dsit-areas-of-research-interest-2024

Source

This question was published as part of the set of ARIs in this document:

DSIT Areas of Research Interest 2024 GOV UK

Related UKRI funded projects


  • Safe Internet surfing with an intelligent child-centred shield against harmful content

    The Internet provides high exposure to malicious content with direct impact on children's safety. Illicit, violent and pornographic material to name a few. The Internet is also an enabler for cyber victimisation such as ...

    Funded by: Innovate UK

    Lead research organisation: UNIVERSITY OF WOLVERHAMPTON

    Why might this be relevant?

    Addresses harmful online uses of AI and impact on psychological wellbeing.

  • Boosting Societal Adaptation and Mental Health in a Rapidly Digitalising, Post-Pandemic Europe

    BACKGROUND: Adolescents are at particularly high risk for digital technology overuse, including in response to the COVID pandemic, and are therefore vulnerable for its potential harmful effects on mental health. Problema...

    Funded by: Horizon Europe Guarantee

    Lead research organisation: UNIVERSITY OF CAMBRIDGE

    Why might this be relevant?

    Partially relevant as it focuses on mental health effects of digitalization, not specifically on harmful online uses of AI.

  • Boosting Societal Adaptation and Mental Health in a Rapidly Digitalising, Post-Pandemic Europe (BOOTSTRAP)

    Project summary BACKGROUND: Adolescents are at particularly high risk for digital technology overuse, including in response to the COVID pandemic, and are therefore vulnerable for its potential harmful effects on mental ...

    Funded by: Horizon Europe Guarantee

    Lead research organisation: UNIVERSITY OF HERTFORDSHIRE

    Why might this be relevant?

    Partially addresses harmful effects of digitalization on mental health.

  • Integrating user experience data into image algorithms to mitigate online harm

    The culmination of decades of academic research and commercial application, this proposal offers a step change on how algorithms account for the end user experience. Images hold within them varying degrees of emotional '...

    Funded by: Innovate UK

    Lead research organisation: RHIZOMETRIC DESIGN LIMITED

  • Rethinking Media Literacy and Digital Skills in Europe (REMEDIS)

    Over the past decade, we have witnessed major transformations in access to digital media platforms in Europe. However, navigating this digitally mediated world can be challenging as it requires operational, social, conte...

    Funded by: AHRC

    Lead research organisation: London School of Economics and Political Science

  • Well-being in the digital world: an ethical matrix

    Lately, the internet has been connected to states of ill-being: they distract users from their purposes by instilling habits and goals that have not been deliberately chosen, spread mis- and disinformation which ultimate...

    Funded by: Horizon Europe Guarantee

    Lead research organisation: University of Oxford

  • AGENCY: Assuring Citizen Agency in a World with Complex Online Harms

    The online world is a curious but uncertain world. It enriches many facets of life but at the same time exposes citizens to a variety of threats that may cause harm to them, their loved ones and to wider society. Many of...

    Funded by: SPF

    Lead research organisation: University of Birmingham

  • Equally Safe Online

    We address the timely topic of online gender-based violence (GBV): Almost 1 in every 2 women and non-binary people (46%) reported experiencing online abuse since the beginning of COVID-19 (Glitch report, 2020). Our aim i...

    Funded by: EPSRC

    Lead research organisation: Heriot-Watt University

    Why might this be relevant?

    Partially relevant as it addresses online abuse but not specifically harmful uses of AI.

  • An innovative, AI-driven application that helps users assess/action information pollution for social media content.

    Sway is a UK-based social media safety technology SME with a core project team of Mike Bennett (CEO and serial entrepreneur), Daniela Fernandez (CXO and entrepreneur) and Alan Simpson (CTO and digital transformation stra...

    Funded by: Innovate UK

    Lead research organisation: SWAY AS LIMITED

Similar ARIs from other organisations