DEM 329 Seminar in Strategic Planning Strategy Evaluation

A Report by: ESPERANZA S. EVORA

Submitted to: Dr. Amalia Paje

Strategy-Based EvaluationKnowledge Building and Lessons Learnt From

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based Evaluation

distinctively? Why is Strategy-based Evaluation important

for MENA? How can EvalMENA.org support SBE-ITIG and

vice versa? The way to Barbados 2013

Background

In Jan 2012, the Board of IDEAS approved a proposal to establish a Thematic Interest Group on Strategy-based Evaluation (SBE-ITIG)

SBE-ITIG’s mission is to promote all kinds of evaluation that are linked to strategy, and to develop both the concept and practices through mutual dialogue amongst practitioners from all schools of evaluation

EvalMENA.org (through the IDRC funded project “Mainstreaming Evaluation Theory and Practice in the MENA” has generously offered to host the first SBE-ITIG meeting

Establish shared understanding on the what Strategy-based Evaluation is all about

Pave the way towards reviewing global literature on Strategy-based Evaluation and lessons learnt

Initiate the discussion on how EvalMENA.org and SBE-ITIG would work together for the benefit of the concept and the region

Discuss steps needed and milestones towards the coming IDEAS assembly 2013

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based Evaluation

distinctively? Why is Strategy-based Evaluation important

for MENA? How can EvalMENA.org support SBE-ITIG and

vice versa? The way to Barbados 2013

What is strategy?

In its simplest definition, strategy is about where an organization is headed and how it intends to get there.

It also can be defined as a forward-looking plan for a defined future.

Mintzberg defined it as systematic patterns of organizational behavior that determine:

- Overall direction,- How the organization’s work is carried out, and- Where it is carried out

Strategy as the focus of…

M A N A G E M E N T

Strategy distinctions

Intended Strategy Realized Strategy Nonstrategic change Strategic change

– Change in position– Change in perspective

What is evaluation?

Evaluation is the process of determining the merit, worth and value of things, and evaluations are the products of that process.

(Scriven, 1991, p. 1)

Units of evaluation

The word EVALUAND refers to the unit that has been evaluated such as …

Projects Programs Products Policies Personnel

And recently… S T R A T E G Y

Strategy as the focus of…

E V A L U A T I O N

So…

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based Evaluation

distinctively? Why is Strategy-based Evaluation important

for MENA? How can EvalMENA.org support SBE-ITIG and

vice versa? The way to Barbados 2013

The term ‘Strategy-based Evaluation’ refers to …

“All evaluation schools of thought that have strategy as their point of departure”

It covers various evaluation schools of thought emerged from private, public and tertiary sectors …

Results-Based Management (RBM) Managing for Development Results (MfDR) Performance Management Balanced Scorecards Strategy Management Outcome Harvesting …

A high-level Strategy-based Evaluation process is meant to answer basic strategy/performance questions

Managing

Strategic

Initiatives

Measuring the

Strategy

Managing Strategic Reviews

Mapping the

Strategy

How to bridge

performance gap?

How to measure success?

How to utilize

information in decision making?

How to get there?

Cascading the

strategy

How to ensure

alignment?

Ensure proper ownership/ accountability structure

Ensure two-way communication channels

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based

Evaluation distinctively? Why is Strategy-based Evaluation important

for MENA? How can EvalMENA.org support SBE-ITIG and

vice versa? The way to Barbados 2013

A set of characteristics distinguish Strategy-based Evaluation from other evaluation schools …

Ownership and Main Drivers for Change

Values Driving the Concept and the Practice

The Main Area of Focus

Process Systemization

Process Custodianship and Governance

Strategy-based Evaluation is owned, promoted and managed as an internal process …

Ownership and Main

Drivers for Change

Values Driving the

Concept and the Practice

The Main Area of Focus

Process Systemizatio

n

Process Custodianshi

p and Governance

Usually it is internally owned, promoted and managed

In many cases, promoted, owned, and influenced by a third party (i.e. donors, … and others) agenda

Project/ Program-

based Evaluation

Strategy-Based

Evaluation

Accountability is heavily acknowledged, yet systematic learning and alignment is a major component.

Since it is usually performed by a third party, it does not necessarily support translating lessons learnt into management practices.

Strategy-based Evaluation is driven by both accountability and learning as the main values

Project/ Program-

based Evaluation

Strategy-Based

Evaluation

Ownership and Main

Drivers for Change

Values Driving the

Concept and the Practice

The Main Area of Focus

Process Systemizatio

n

Process Custodianshi

p and Governance

Focuses on the quality of data reported and on the evidence such data provide through the analysis.

Focuses on the management process and the utilization of the data in ensuring organizational learning and alignment.

Strategy-based Evaluation processes focus on the strategy execution and on decision making

Project/ Program-

based Evaluation

Strategy-Based

Evaluation

Ownership and Main

Drivers for Change

Values Driving the

Concept and the Practice

The Main Area of Focus

Process Systemizatio

n

Process Custodianshi

p and Governance

It is a systemic framework; it stems from the core strategic processes of organizations.

It is not only the nerve system of an organization but also its heart and brain.

Evaluation studies are vertical assessments. This does not support systematic recurrence very much.

Projects and programs may not necessarily be tied into well defined integrated strategic contexts.

Strategy-based Evaluation is not a one-off task, it is the system that organizations operate …

Project/ Program-

based Evaluation

Strategy-Based

Evaluation

Ownership and Main

Drivers for Change

Values Driving the

Concept and the Practice

The Main Area of Focus

Process Systemizatio

n

Process Custodianshi

p and Governance

The body responsible for the function is usually an independent body, in most cases detached from operations.

A strategy or performance management body manages the entire process.

It undertakes three important roles, those of architect, process owner, and integrator.

Strategy-based Evaluation is owned, promoted and managed from within …

Project/ Program-

based Evaluation

Strategy-Based

Evaluation

Ownership and Main

Drivers for Change

Values Driving the

Concept and the Practice

The Main Area of Focus

Process Systemizatio

n

Process Custodianshi

p and Governance

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based Evaluation

distinctively? Why is Strategy-based Evaluation

important for MENA? How can EvalMENA.org support SBE-ITIG and

vice versa? The way to Barbados 2013

Current and future demand within the region for mature strategy-based evaluation systems

The continuous efforts for medium and long-term country/ sector-level strategies for growth.

Future demand for strategy-based evaluation is expected to emerge.

Supported by international trends …

Institutional learning is more appreciated than before in the development aid field

While acknowledging the ownership of the partner countries over the development results - Paris Declaration/ Accra Agenda for Action

The emerging trends towards moving from studies to streams in evaluation

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based Evaluation

distinctively? Why is Strategy-based Evaluation important for

MENA? How can EvalMENA.org support SBE-ITIG

and vice versa? The way to Barbados 2013

We believe a constructive partnership between EvalMENA.org and SBE-ITIG is needed and is possible

EvalMENA.org SBE-ITIG

Capacity Building … Bring expertise to

the region Capacity building

and systems’ development

Show-case the region’s experience

Lessons Learnt … Participate in the

open dialogue on the topic

Provide a platform for SBE application

Participate in IDEAS events as part of the SBE panel

Agenda Background and objective On Strategy and Evaluation What do we mean by Strategy-based

Evaluation? Why to address Strategy-based Evaluation

distinctively? Why is Strategy-based Evaluation important for

MENA? How can EvalMENA.org support SBE-ITIG and

vice versa? The way to Barbados 2013

SBE-specialized panels are to be organized in the coming IDEAS assembly 2013, and possibly others

Roadmap/timelines

Main research themes

Review/assessment taskforce, responsible for setting the research criteria and approving the research applications

Research publication/dissemination