What evaluation methods are appropriate for comparing reputation and influence impacts across programmes?

Background

IRIA aims to build an evidence base useful for monitoring the effectiveness of UK international research collaboration, determining the value-for-money of international R&I interventions and comparing the UK with other countries. We support a wide range of programmes as well as building an evidence base that can be used for new interventions. This includes government plans to protect and support UK science, research, technology and innovation (SRTI) sectors, should association to Horizon Europe on fair and appropriate terms not be possible.
We are interested in assessing the value delivered from infrastructure which supports research and innovation, such as laboratories or institution headquarters. An example of this is the project to relocate the European Centre for Medium-Range Weather Forecasts (ECMWF) to the University of Readings’ campus.

Science diplomacy is a strategic goal of UK research and innovation collaboration. Analysing the impact of R&I on the UK’s overseas reputation and influence on other actors requires operationalised definitions, metrics which can be tracked over time and evaluative methods that allow interventions to be compared. Where data exists to track outcomes contributing to reputation and influence, such metrics should be adopted. However, there may be a need for new or additional data collection. For example, to address the following questions:

Next steps

If you are keen to register your interest in working and connecting with DSIT Science, Innovation, and Research Directorate, and/or submitting evidence, then please complete the DSIT-ARI Evidence survey - https://dsit.qualtrics.com/jfe/form/SV_cDfmK2OukVAnirs

Link to ARI Document : https://www.gov.uk/government/publications/department-for-science-innovation-and-technology-areas-of-research-interest/dsit-areas-of-research-interest-2024

Related UKRI funded projects


  • Understanding the relative valuations of research impact: Applying best-worst scaling experiments to survey the public & biomedical/health researchers

    Research Councils "encourage researchers to consider the potential contribution that their research can make to the economy and society from the outset, and the resources required to carry out appropriate and projec...

    Funded by: MRC

    Lead research organisation: King's College London

    Why might this be relevant?

    This project focuses on evaluating the relative valuations of research impact, which aligns with the question about evaluation methods for comparing reputation and influence impacts.

  • Novel method for tracking the translation processes that lead to impact from Biomedical research - A pilot study

    The MRC Economic Impact call states that "The MRC wishes to understand better the link between research and wider economic and societal impacts, and to use this understanding to improve strategies for the future sup...

    Funded by: MRC

    Lead research organisation: University of Sussex

    Why might this be relevant?

    While this project focuses on tracking translation processes leading to impact from biomedical research, it partially addresses the question by exploring how research processes can be improved to enhance impact.

  • IAA Proposal

    OBJECTIVE 1: To strengthen interaction between NERC-funded science and the user community, primarily businesses, to accelerate and amplify the impact of NERC science. The approach taken will work alongside the Objective...

    Funded by: NERC

    Lead research organisation: University of Cambridge

    Why might this be relevant?

    This project aims to strengthen interaction between NERC-funded science and the user community to accelerate impact, partially relevant to the question about evaluation methods for comparing reputation and influence impacts.

  • Global - The Bristol Global Engagement Network

    The University of Bristol is an international powerhouse of learning, discovery and enterprise. Its vision is of a university whose excellence is acknowledged locally, nationally and globally. International collaboration...

    Funded by: EPSRC

    Lead research organisation: University of Bristol

  • AHRC Impact Acceleration Account at Queen's University Belfast

    Queen's University Belfast's AHRC Impact Acceleration Account proposal is informed by best practice identified as past and current IAA holders from ESRC, STFC and EPSRC, as well as the MRC CIC. It builds on, and compleme...

    Funded by: AHRC

    Lead research organisation: Queen's University Belfast

  • The University of Manchester UKRI AHRC Impact Acceleration Account

    The overall strategic aim of our AHRC IAA, is to support the University's vision, ambitions, and priorities in relation to KE, impact and innovation, in the domains covered by the AHRC remit, ensuring that the university...

    Funded by: AHRC

    Lead research organisation: University of Manchester

  • The impact of impact: How research value is created and assessed in the UK, US and Australia

    Context and aims As universities become bound up in a public role as drivers of economic prosperity, there has been a global policy shift towards measuring the value and benefit of publicly funded research. Governments ...

    Funded by: ESRC

    Lead research organisation: King's College London