Which risks from AI are the most urgent to mitigate?

Background

In the National AI Strategy, the government made commitments to enrich our understanding of AI as it impacts the economy and society more broadly. Additionally, we recently launched a steering board chaired by the heads of both the government analysis and scientific functions, to ensure cohesive cross government approaches to understanding AI impacts. An overview of the high-level questions we are asking in this regard are outlined in the section below. (https://www.gov.uk/government/publications/national-aistrategy)

Some priority work we are currently developing to meet these commitments include:

An analysis of the AI White Paper consultation to feed into the formal consultation response. This will allow us to take on feedback from the public and various key players in sectors across the economy, and better tailor policy interventions to support strategic AI aims.

Establishing the AI Safety Institute to advance the world’s knowledge of AI safety by carefully examining, evaluating, and testing new frontier AI systems. The Institute will conduct fundamental research on how to keep people safe in the face of fast and unpredictable progress in AI, improving our understanding of the capabilities and risks of AI systems.

A monitoring and evaluation framework for AI regulatory interventions in tandem with the AI regulatory white paper. This will develop our understanding of key metrics to monitor with regards to Ai governance and ecosystem impacts.

Research into the AI sector and supply. Updating the AI Sector Study to establish a consistent and comparable set of economic indicators for the AI sector in terms of producers and suppliers. This study helps us to best understand where the AI sector needs support, to grow sovereign capability of the UK in AI, in alignment with strategic priorities.

The development of a cross-economy national AI risk register. Developed in tandem with a responsibility register that garnered cross Whitehall agreement on which departments hold which risks with regards to AI. The risk register will provide a single source of truth on AI risks which regulators, government departments, and external groups can use to prioritise further action.

Further research into Compute and the best ways to leverage compute to support the AI sector. This will be key to informing our response to the future of compute review, and maximising the £1 billion+ investments in state-of-the-art compute.

Next steps

If you are keen to register your interest in working and connecting with DSIT Digital Technology and Telecoms Group and/or submitting evidence, then please complete the DSIT-ARI Evidence survey - https://dsit.qualtrics.com/jfe/form/SV_cDfmK2OukVAnirs.
Please view full details: https://www.gov.uk/government/publications/department-for-science-innovation-and-technology-areas-of-research-interest/dsit-areas-of-research-interest-2024

Related UKRI funded projects


  • Weaving an AI Safety Net for UK and Canada

    In response to the increasing international recognition of the harms arising from the deployment of artificial intelligence (AI)  systems and the emergent establishment of AI Safety Institutes in multiple countries,...

    Funded by: AHRC

    Lead research organisation: University of Sheffield

    Why might this be relevant?

    The project aims to synthesize knowledge about AI-related harms and propose an expanded framework of AI Safety, aligning with the question on mitigating risks from AI.

  • ENFIELD: European Lighthouse to Manifest Trustworthy and Green AI

    ENFIELD will create a unique European Centre of Excellence that excels the fundamental research in the scientific pillars of Adaptive, Green, Human-Centric, and Trustworthy AI that are new, strategic and of paramount imp...

    Funded by: Horizon Europe Guarantee

    Lead research organisation: UNIVERSITY OF NOTTINGHAM

    Why might this be relevant?

    Partially relevant as it focuses on Trustworthy AI, but does not specifically address urgent risks.

  • AI UK: Creating an International Ecosystem for Responsible AI Research and Innovation

    Artificial Intelligence (AI) can have dramatic effects on industrial sectors and societies (e.g., Generative AI, facial recognition, autonomous vehicles). AI UK will pioneer a reflective, inclusive approach to responsibl...

    Funded by: EPSRC

    Lead research organisation: University of Southampton

    Why might this be relevant?

    Partially relevant as it focuses on creating an international ecosystem for responsible AI research, but does not specifically address urgent risks in AI.

  • Seclea Platform - Responsible AI Tools for Everyone

    Artificial Intelligence has the potential to improve our lives with rapid, personalised and assistive services. It presents risks of negative effects on both society and individual citizens. Recent debacles have showed t...

    Funded by: Innovate UK

    Lead research organisation: SECLEA LTD

    Why might this be relevant?

    Partially addresses the risks associated with AI and focuses on responsible AI tools for everyone.

  • Turing AI Fellowship: Adaptive, Robust, and Resilient AI Systems for the FuturE

    The Office for Artificial Intelligence (AI) estimates that AI could add £232 billion to the UK economy by 2030, increasing productivity in some industries by 30%. However, to be truly transformational, the integrat...

    Funded by: EPSRC

    Lead research organisation: King's College London

    Why might this be relevant?

    The project focuses on creating adaptive, robust, and resilient AI systems, which are relevant to mitigating risks in AI.

  • ELIAS: European Lighthouse of AI for Sustainability

    We live in a crucial historical moment, with tremendous challenges ahead, from climate change to the energy crisis. ELIAS emerges from the belief that AI will be a key discipline to help us tackle these challenges. At th...

    Funded by: Horizon Europe Guarantee

    Lead research organisation: THE UNIVERSITY OF MANCHESTER

  • AI^2: Assurance and Insurance for Artificial Intelligence

    AI is rapidly reshaping the way we work and live. Tailoring state-of-the-art solutions was only possible for those companies with AI research labs or individuals with deep technical knowledge of how the technology works....

    Funded by: EPSRC

    Lead research organisation: UNIVERSITY OF EDINBURGH

  • Responsible AI for Long-term Trustworthy Autonomous Systems (RAILS): Integrating Responsible AI and Socio-legal Governance

    Society is seeing enormous growth in the development and implementation of autonomous systems, which can offer significant benefits to citizens, communities, and businesses. The potential for improvements in societal wel...

    Funded by: SPF

    Lead research organisation: University of Oxford

  • Public value mapping for AI

    As the momentum behind AI builds, discussions about “Responsible AI” and “AI for good” are being taken increasingly seriously. We are seeing new governance structures and policy priorities. And yet we know little about c...

    Funded by: ESRC

    Lead research organisation: University College London

  • BridgeAI - Sector Capabilities ATI Direct Award

    BridgeAI is a major new initiative at the Turing, funded by Innovate UK, that is aimed at accelerating the adoption of AI (Artificial Intelligence) technologies in sectors with high growth potential across the UK includi...

    Funded by: Innovate UK

    Lead research organisation: THE ALAN TURING INSTITUTE