![Page 1: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/1.jpg)
What Works Centre for Local
Economic Growth
10th April 2015
![Page 2: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/2.jpg)
The Partners
![Page 3: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/3.jpg)
What Works Centre work programme
![Page 4: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/4.jpg)
• Identify key policy interventions with sufficient evidence to properly assess effectiveness
– Employment training– Business advice and mentoring– Sports & cultural events & facilities– Access to Finance– Estate Renewal– Broadband– R&D (collaboration; grants; tax incentives)– Transport (by mode)– Apprenticeships– Enterprise Zones
• Undertake systematic ranking reviews (with initial focus on robust quantitative evidence)• Assure the findings are accessible to our users and disseminate them through our networks
Work programme
![Page 5: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/5.jpg)
Our remit
![Page 6: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/6.jpg)
Methodology
![Page 7: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/7.jpg)
How to use this evidence
![Page 8: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/8.jpg)
How to evaluate
![Page 9: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/9.jpg)
Using and producing evidence to inform policy
Katrina Hann, Head of ResearchRichard Waggott, Principal Researcher
10th April 2015
![Page 10: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/10.jpg)
About New Economy
• Research, strategy and policy for Greater Manchester
• Core Cities research and development hub
• Partnership with What Works Centre for Local
Economic Growth
![Page 11: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/11.jpg)
Agenda
• What do we mean by evidence-based policy?
• Uses of evidence in the development of policy
• Good practice in developing evidence led policy
• Discussion and questions
![Page 12: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/12.jpg)
‘This Government expects more of policy makers. More new ideas, more willingness to question inherited ways of doing things, better use of evidence and research in policy making and better focus on policies that will deliver long term goals’
Modernising Government, 1999
‘in the absence of perfect evidence, it is still essential that policy makers gather the most useful information available in the short term, as they—and we—move toward an evidence-driven future’
US National Economic Council
‘As we continue to improve and reform public services at a time when finances are tight, it is more important than ever that taxpayers’ money is spent in the most effective way, helping to ensure that policy decisions and professional practice are based upon robust evidence of what works to deliver value for money and better outcomes for all’
What Works Network Year 1 review
Evidence based policy making
![Page 13: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/13.jpg)
Evidence base
What works
Copy, purchase, commission, learn from
What might work
Test, pilot, adapt, borrow, rethink
What doesn’t work
Avoid, stop, challenge,
decommission
Why we should engage with evidence
![Page 14: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/14.jpg)
Current practice
based on…
Habit Politics Procurement
Vested interestsExpediency Cost
Why we don’t engage with evidence
![Page 15: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/15.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 16: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/16.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 17: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/17.jpg)
Case study: Public expenditure analysis
![Page 18: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/18.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 19: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/19.jpg)
Case Study: Complex Dependency
![Page 20: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/20.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 21: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/21.jpg)
Contextual conditions
Key policy conditions
Rationale Inputs Activities
Intended Outcomes
Outputs
Intended Impacts
Programme Objectives
Project:
![Page 22: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/22.jpg)
Contextual conditionsOpportunity to secure the presence of the life sciences sector around the Alderley Park site and across the wider area.
Key policy conditionsJoint objective of Greater Manchester and Cheshire and Warrington LEPs to secure the long term sustainability of the site
RationaleSmall life sciences firms need incubation funding and follow-on venture capital to maximise growth
InputsLGF fundingPrivate sector match funding
ActivitiesIncubation fund establishedVenture Capital fund establishedRedevelopment of Alderley Park
Intended Outcomes• Jobs
created/safeguarded at Alderley Park
• GVA created• Staff employed by
recipients of fundOutputsNumber. of:Incubation fund investmentsSpin-outs accommodatedVC fund investmentsLoans repaid
Intended Impacts• Growth in local life
sciences sector and supply chain
• Increased prosperity of the GM and Cheshire area
Programme Objectives• Ensure the long term future of the life sciences sector on the
Alderley Park site• Creation and safeguarding of businesses and jobs
Project: Life Sciences Fund
![Page 23: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/23.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 24: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/24.jpg)
Why adopt a CBA approach?
• Localities can use Cost Benefit Analysis to deliver:
• Informed decision-making
• Cost-effective decision-making
• Equitable decision-making
It also hardwires the use and development of robust-evidence into decision-making
![Page 25: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/25.jpg)
• Fiscal• Social• Economic
Costs
Benefits
All additional costs needed to deliver project
Fiscal Economic Social
Case Study: Cost Benefit Analysis
![Page 26: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/26.jpg)
LocalAuthority NHS
DWP (AME)Police
WorkProgramme
PrimesRSLs
CJS (exclPolice)
Proactive Costs
Reactive Cost Savings
£-
£100,000
£200,000
£300,000
£400,000
£500,000
£600,000
£700,000
£800,000
£900,000
£1,000,000
£
Case Study: Family Intervention Project
![Page 27: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/27.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 28: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/28.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 29: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/29.jpg)
Evidence Based Policy Development Process
Define high level problem, outcomes and spend
Define the cohort
Design New Delivery Model
CBA using modelled assumptions
Test at a scale commensurate with the risk
Evaluation to collect actual data
Track actuals to inform reinvestment
![Page 30: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/30.jpg)
Good Practice in Developing Evidence Led Policy1. Create demand before creating evidence
2. Evidence should be used to drive strategic priorities rather than solely to comply with externally imposed requirements
3. Development of evidence is a key tool for stakeholder engagement
4. Internal and external challenge is central to establishing if evidence is ‘good enough’
5. Care should be taken with the presentation of evidence to avoid misinterpretation
6. There should be a willingness to take on board negative findings to prevent evidence production becoming a box ticking exercise
7. Evidence needs to be mobilised and acted upon not only produced
8. Using evidence is a process not a one-off
![Page 31: How to use and produce evidence to inform policy](https://reader036.vdocuments.site/reader036/viewer/2022081514/58edc6871a28ab87578b477f/html5/thumbnails/31.jpg)
Next steps
• Linking What Works outputs with CBA model
• Greater Manchester case study launched in June
• More events across country to disseminate findings