Deconstructing impact: A framework for impact evaluation in grant applications

Lai Ma · Rachael Agnew

13 citations0/0 files storedScience and Public Policy

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

scientometrics and bibliometrics research Research, Science, and Academia Evaluation and Performance Assessment

Abstract

Abstract Impact assessments in grant applications can be biased, random, or inconsistent. One reason is that there is not a framework to assist the review process. To develop fair and transparent evaluative criteria, it is necessary to understand what kinds of outcome and impact can reasonably be achieved and expected. Using content analysis, 100 UK Research Excellence Framework (REF) 2014 impact case studies were analysed based on the definition of the output, outcome, and impact in the logic model. The analysis shows that (1) outcomes and medium-term impacts, not long-term impacts, are reported in the case studies, (2) impacts can be categorised as use and experience based, and (3) there is a need to recognise the creation and co-creation of impacts. A framework for impact evaluation in grant applications has been developed. In this framework, the criteria for evaluating impact statements focus on process-oriented impacts and that ‘impacts’ can be outputs, outcomes, and medium-term impacts.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 13 citations exist upstream.

References

2015The Metric Tide: Independent Review of the Role of Metrics in Research Assessment and Management 2013Assessment, evaluations, and definitions of research impact: A review 2011Introducing 'productive interactions' in social impact assessment 2020Gaming the Metrics 2011‘Impact’ in the proposals for the UK's Research Excellence Framework: Shifting the boundaries of academic autonomy 2016Artifice or integrity in the marketization of research impact? Investigating the moral economy of (pathways to) impact statements within research funding proposals in the UK and Australia 2011Tracing 'productive interactions' to identify social impacts: an example from the social sciences 2019From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact

Cited by

2022What makes or breaks competitive research proposals? A mixed-methods analysis of research grant evaluation reports

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.