assessing for impact from research - amazon s3 · assessing for impact from research steven hill...

Assessing for impact from research

Steven Hill

Head of Research Policy

Researchfish Strategy of Impact

16 November 2017

Follow us on Twitter at

@HEFCE

@stevenhill

Measurement, assessment and evaluation of research impact is an increasing area of activity within universities.

This has largely been driven by externally imposed summative assessment processes.

There are opportunities to use the evidence that is being collected for different purposes: to understand the processes of research, knowledge exchange and impact in near real-time and use that insight to make adjustments to maximise impact.

To achieve this we need to focus on improving real-time evidence capture, data-linking and interoperability. Closed datasets are a potential barrier to this.

Why assess research impact?

Advocacy Accountability

Analysis Allocation

Morgan Jones M and Grant J (2013) Making the grade: methodologies for assessing and evidencing research impact. Dean et al. (Eds) (2013) 7 Essays on Impact. DESCRIBE Project Report for Jisc. University of Exeter. https://www.exeter.ac.uk/media/universityofexeter/research/ourresearchexcellence/describeproject/pdfs/2013_06_04_7_Essays_on_Impact_FINAL.pdf

Advocacy Accountability

Analysis Allocation

Advocacy Accountability

Analysis Allocation

0.0

20.0

40.0

60.0

80.0

100.0

120.0

140.0

160.0

English Universities in receipt of QR

2014-15 total QR funding (£M)

Advocacy Accountability

Analysis Allocation

0.0

20.0

40.0

60.0

80.0

100.0

120.0

140.0

160.0

English Universities in receipt of QR

2014-15 total QR funding (£M)

Advocacy Accountability

Analysis Allocation

0.0

20.0

40.0

60.0

80.0

100.0

120.0

140.0

160.0

English Universities in receipt of QR

2014-15 total QR funding (£M)

Advocacy Accountability

Analysis Allocation

Advocacy Accountability

Analysis Allocation

Advocacy Accountability

Analysis Allocation

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Impact Case Study

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Impact Case StudyOutcomes database

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Near real-timefeedback

Why assess research impact?

Advocacy Accountability

Analysis Allocation

Adjustment

Morgan Jones M and Grant J (2013) Making the grade: methodologies for assessing and evidencing research impact. Dean et al. (Eds) (2013) 7 Essays on Impact. DESCRIBE Project Report for Jisc. University of Exeter. https://www.exeter.ac.uk/media/universityofexeter/research/ourresearchexcellence/describeproject/pdfs/2013_06_04_7_Essays_on_Impact_FINAL.pdf

Impact assessment for adjustment needs…

• Near real-time data collection and analysis

https://theodi.org/blog/where-are-the-uks-most-active-tech-innovation-cities

http://www.picklejarcommunications.com/wp-content/uploads/2017/11/Full-map-with-labels.pdf

Impact assessment for adjustment needs…

• Near real-time data collection and analysis

• Better linking of data sources

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Impact Case StudyOutcomes database

Inputs

Research, knowledge exchange and impact processes Academic impacts

Societal impacts

PeopleInfrastructureKnowledgeMoney

Evidence

Evaluation

Impact Case StudyOutcomes database

Health and life sciences

Physical sciences and engineering

Social Sciences

Arts and humanities 2206 links between funded research

projects and impact case studies

Impact assessment for adjustment needs…

• Near real-time data collection and analysis

• Better linking of data sources

• Inter-operability and open data

Measurement, assessment and evaluation of research impact is an increasing area of activity within universities.

This has largely been driven by externally imposed summative assessment processes.

There are opportunities to use the evidence that is being collected for different purposes: to understand the processes of research, knowledge exchange and impact in near real-time and use that insight to make adjustments to maximise impact.

To achieve this we need to focus on improving real-time evidence capture, data-linking and interoperability. Closed datasets are a potential barrier to this.