Download - Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference
![Page 1: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/1.jpg)
Evaluation and Organisational Change: Managing Complexity-
Guiding Solutions
anzea 2013 Conference 22–24 July 2013
Alexandra Park, Epsom, Auckland
Michael Blewden and Sarah GreenawayTe Pou o te Whakaaro Nui
![Page 2: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/2.jpg)
Session Overview and Purpose• Background to Te Pou
• Introduce the change embarked on
• Evaluative tools/processes used
• Reflect on utility and value, progress and challenges
![Page 3: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/3.jpg)
Te Pou
• NGO funded by MoH through Health Workforce NZ
• Workforce/service development support
• Mental health, addictions, and disability sectors
![Page 4: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/4.jpg)
Community development
Workforce development
Organisational development
System development
Policy development
![Page 5: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/5.jpg)
![Page 6: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/6.jpg)
Historically Opportunity
Research and Evaluation Programme
Outcomes Information Programme
Workforce Development Programme
Integrated/coordinated delivery
Collaborative approach
Organisational focus
Responsiveness (need, priorities, context, readiness)
Strengths-based/capacity building/ sustained outcomes
Ability to demonstrate success
![Page 7: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/7.jpg)
This way of working became known as the:
Support Effective Practice (SEP) approach
![Page 8: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/8.jpg)
Client management
approach
Engagement
Partnering
Understanding
Agreement Planning /Develop
Delivery
Review
![Page 9: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/9.jpg)
Simple Complex
Partners need and context (e.g. readiness or capacity for change, priorities)
Coexistence Communication Cooperation Co-ordination and Collaboration Partnership
Self Reliance SharedInformation
SharedResources
SharedWork
SharedResponsibility
e.g. information dissemination
e.g. training programme
e.g. service redesign, comprehensive change strategy
![Page 10: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/10.jpg)
![Page 11: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/11.jpg)
Problem/Need Causes and Contributing Factors
Consequences Opportunity
What is the evidence?
Nature and extent
For whom?
History?
Future projections?
Why does problem/need occur?
Are some causes more important or influential?
Are there known casual pathways?
Is anything already known about what is/isn’t effective in response?
What are the consequences of problem/need?
Who is affected – directly and indirectly
What opportunities are presented?
Why are these worth pursuing?
What benefits will be delivered?
Understanding the need
Funnell, S., & Rogers, P. (2011). Purposeful Program Theory. Jossey-Bass, San Francisco, CA
![Page 12: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/12.jpg)
Situational Analysis Issue Causes Consequences Opportunities
Stakeholder engagement
Relationships and engagement often ‘individual’ rather than ‘organisational’
Necessary leaders/leadership not engaged
Services not always delivered efficiently or strategically (e.g. when ready, in right order)
Engagement that builds leadership, commitment and ownership
Delivery more coordinated, needs based, timely, project managed
![Page 13: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/13.jpg)
Community/Society
Organisation
Team
Individual
Work practices
Outcomes for service
users
Factors impacting effective practice
![Page 14: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/14.jpg)
Enhanced services
Enhanced service/workforce development strategy
Enhanced service/workforce development approach
Clarifying the programme theory
Least ability to attribute outcomes to Te Pou
Greatest ability to attribute outcomes to
Te Pou
Enhanced service/workforce development interventions
Enhanced outcomes for service users
More about our practice
More about our partnerships
![Page 15: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/15.jpg)
![Page 16: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/16.jpg)
Planning, evaluation, monitoring framework
How much did we do?
WHAT Outputs (Quantity)
How well did we do it?
HOW and WHY Process (Quality)
Is anyone better off?
RESULT Outcomes (Success)
![Page 17: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/17.jpg)
Focus and scope of evaluation
Te Pou programmes
Outcomes Impact
Planning, development and delivery of service
and workforce development
Sector engagement
and participation
Improved outcomes for service
users
Service development
Quality
effective services
Sphere of Control
Sphere of Influence
Sphere of Interest
‘What’/’how well’ ‘What’/’how well’ ‘Is anyone better off?’
![Page 18: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/18.jpg)
Utility and value• Tools and models- translation devices - engagement/communication- shared understanding - connecting to the evidence
• Emergence of evaluative thinking, outcomes focus, critical engagement
![Page 19: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/19.jpg)
Implementation• SEP implemented in a variety of forms
- formalised MoU - complex service change- co-ordination of work at service level - NGO district or regional level development- planning and delivery of training
![Page 20: Evaluation and Organisational Change: Managing Complexity-Guiding Solutions anzea 2013 Conference](https://reader035.vdocuments.site/reader035/viewer/2022070423/56816756550346895ddc0f77/html5/thumbnails/20.jpg)
Challenges/Issues• Environment of constant change
• Conceptual understanding to operational responses
• Strategic developments vs day to day needs