mega trends, macro reflections, mesoresponses and ... · services evaluation, research, management,...

MEGA TRENDS, MACRO

2010/05/03MEGA TRENDS, MACRO REFLECTIONS, MESO RESPONSES AND MICRO

ADAPTATIONS

MEGA TRENDS, MACROREFLECTIONS, MESO RESPONSESAND MICRO ADAPTATIONSSOME REFLECTIONS ON THE CANADIANCREDENTIALING INITIATIVE

AGENDA

1. The Mega Trend

2. Macro Reflections


ADAPTATIONS

3. Meso Responses and Micro Adaptations

– The case of Rambøll Management Consulting

4. The Future of PDP

THE MEGA TREND


ADAPTATIONS

Certification at all

01

03


ADAPTATIONS

Certification at all levels

01Organizational accreditation (Joint Commission, ENQA)

02Process certification (ISO 9001)

03Skills certification (EUROPASS02

MACRO REFLECTION. THE CES’ PROFESSIONAL DESIGNATIONS PROGRAM

“Any new path needs a brave soul to engage in it, not fully aware of

what to expect, but confident of where it's leading. In the case of

professional designation in the field of program evaluation, the

community of evaluators in Canada is that brave soul. CES will be

the first organization in the world to offer a Credentialed Evaluator


ADAPTATIONS

the first organization in the world to offer a Credentialed Evaluator

professional designation!”

Francois Dumaine, President of the Canadian Evaluation Society

Source: CES website

The CES’ professional designations 05

01

03

06

05

04


ADAPTATIONS

The CES’ professional designations program

01A designation policy

02A set of professional standards for program evaluation

03A defined set of competencies

04An independent body administering and ascertaining the credentials

05No formal written/oral examination

06No levels of evaluation competency

02

THREE CRUCIAL QUESTIONS FOR THE PDP

1. Outside In: Will the Credentialed Evaluator (CE) become a marketable quality differentiator in and - perhaps more importantly from the author’s perspective - outside Canada?

2. Inside Out - meso: Can the CE scheme be used strategically to develop competencies among evaluation


ADAPTATIONS

strategically to develop competencies among evaluation consultants?

3. Inside Out- Micro: Can the CE scheme be used to advance career and document skills for the individual consultants?

MESO RESPONSES AND MICROADAPTATIONS

“Knowledge is only valuable when it is between the ears of consultants and applied to clients’

problems”


ADAPTATIONS

Ted Hall, McKinsey

Source: Bartlett, 2000:6

KNOWLEDGE MANAGEMENT


ADAPTATIONS

”Knowledge Management is the intentional process that links the organization’s existing knowledge

capacity (the sum of our knowledge baseand human capabilities) with future services (knowledge application).”

In essence knowledge management is about how an organization:

1. Develops knowledge;2. Shares knowledge;3. Captures knowledge;4. Reduces risks of losing knowledge;5. Creates value from knowledge.

THE CASE OF RAMBØLLMANAGEMENT CONSULTING

“In the post-industrial era the success of a corporation lies more in its intellectual and systems capabilities than in its physical assets.

The capacity to manage human intellect – and to convert it into useful products and services – is fast becoming the critical executive

skill of the age”


ADAPTATIONS

skill of the age”

Source: Quinn, Anderson & Finkelstein, 1998:182

MANAGING THE PROFESSIONAL INTELLECTSOURCE: QUINN, ANDERSON & FINKELSTEIN, 1998

Capability Level

Self-motivated creativity

Qualifications

Care Why


ADAPTATIONS

Systems understanding

Advanced skills

Cognitive knowledge

Know Why

Know How

Know What

RAMBØLL MANAGEMENT CONSULTING – FACTSHEET

Facts, 2009

Ownership Owned by Ramboll (9000 employees), which in turn is owned by the Ramboll Foundation

Scope Management consulting to public sector clients

Services Evaluation, Research, Management, HRD, IT consulting

Operations in Denmark, Germany, Sweden, Norway, Finland

Net project revenue Approx. CAD 57 million


ADAPTATIONS

Net project revenue, evaluations Approx CAD 14,5 million (25% of turnover)

Full Time Staff 420

# of evaluations per year 250+ mainly in social, education, employment, health and business & industry

# of consultants involved in evaluations on regular basis

130

Annual turnover of staff 23%

Type of consultancy Talent factory. Majority of new recruits come to Ramboll directly from university

Human capital 98% with Master’s Degree or above

ELEMENTS IN QUALITY MANAGEMENT WITHIN EVALUATION SERVICES

InputCapability Development Program

Knowledge access*Concept base

Career incentives to deliver quality

ProcessQuality Assurance Tool (PEQUAT)


ADAPTATIONS

Quality Assurance Tool (PEQUAT)Quality and risk review

OutputQuality Assurance Tool (PEQUAT)Independent quality assurance

OutcomeMonitoring client satisfaction

Monitoring evaluation utilization**

The Rambøll’ Evaluation Capability 05

01

03

06

05

04


ADAPTATIONS

The Rambøll’ Evaluation CapabilityDevelopment Program

01A designation policy

02A set of professional standards for program evaluation

03A defined set of competencies

04An independent body administering and ascertaining the credentials

05Testing and review of track record

06Levels of evaluation capability

02

Evaluation Capability 04

01

03

06

05

04

07


ADAPTATIONS

Evaluation Capability Development Program

01ensuring capabilities aresufficent at all levels

02Clear criteria for climbing the capability ladder

03Track record of excellence is what counts

04High Impact LearningApproach

05All training aligned withcapability levels

06Pre- and post testing of capabilities at each level

07CDP linked to individualdevelopment plans

02

THE EVALUATION CAPABILITY DEVELOPMENTPROGRAM

CapabilityLevel

Thought Leader

Qualifications

Know All

CertificationRequirement

All below + Publication


ADAPTATIONS

Evaluation Expert

Evaluation Specialist

EvaluationPractitioner

Know Why

Know How

Know What

Elite EvaluationEducation

Advanced EvaluationEducation

Evaluation Education

CAPABILITY CRITERIA

Capability level

ThoughtLeader

PD/PL onevaluationprojects

At least 20

Meets qualitystandards

All projectswhere

involved

Conceptdevelopment

At least 2

Peer reviewedarticles

At least 4

Papers/Articles

At least 4

Education

RMEEE, RMAE, RMEE

Active in externalnetwork

+

Active in RMES

+

Practicalexperience

800 HRS +


ADAPTATIONS

EvaluationExpert

EvaluationSpecialist

EvaluationPractitioner

At least 15

At least 5

-

All projectswherePD/PL

All projectswherePD/PL

On one’sown work

At least 1

-

-

-

-

-

At least 3

-

-

RMEEE, RMAE, RMEE

RMAE, RMEE

RMEE

+

-

-

+

+

+

800 HRS +

800 HRS +

800 HRS +

INDEPENDENT QUALITY ASSURANCE

• PEQUAT can be used as self-

assessment tool for project

manager

• Continuous quality and risk

management 70%

80%

90%

100%

Degree of compliance

Overall score


ADAPTATIONS

management

• Quality assurance by an

evaluation expert, not engaged

in the project, at the three

critical stages of the projects.

• Structured feedback to project

manager

10%

20%

30%

40%

50%

60%

70%

Design Tendering Structuring Collecting Analysing Judging Reporting Utilising Closing

Degree of compliance

Project Manager Quality Assurer

MANAGING KNOWLEDGE OUTPUTS – PEQUAT


ADAPTATIONS

THE FUTURE OF CES’ PROFESSIONAL DESIGNATIONS PROGRAM


ADAPTATIONS

QUESTIONS AND POSSIBLE ANSWERS

Outside In: Will the Credentialed Evaluator become a marketable quality differentiator in and outside Canada?

• Yes, most likely in Canada but internationally only if partnerships with other evaluation societies are established.

Inside Out - meso: Can the CE scheme be used strategically to develop competencies among staff?


ADAPTATIONS

strategically to develop competencies among staff?

• Only to some extent. The CE qualifying criteria are not differentiated which makes it more amenable as a quality marker for branding purposes, than to intentionally develop human resources.

Inside Out – Micro: Can the CE scheme be used to advance career and document skills for the individuals?

• Yes, it can be used to document skills but is less likely to be useful to advance one’s career once higher levels of professional intellect is reached.

THANK YOU!

Dr. Steffen Bohni Nielsen

D 3397 8103

M 2948 8103


ADAPTATIONS

M 2948 8103

[email protected]

© All materials in this presentation is the property Rambøll Management Consulting and must only be used with written permission

mega trends, macro reflections, mesoresponses and ... · services evaluation, research, management,...

Documents