CCCB Evaluation Toolkit: Overview and Update on

Progress

Angela Moore, MPH2009 NCCCP & NPCR Collaborative

MeetingApril 16, 2009

An Outline…

Why do we need an evaluation toolkit?What is an evaluation toolkit?How is it being developed?Where are we now?What are our next steps?

Why do we need a toolkit?

Call to Action

CCCB Funding Opportunity AnnouncementsCCCB Strategic PlanNACDD Evaluation WorkshopsNational Comprehensive Cancer Control Evaluation Framework

3. Communication

4. Technical Assistance and

Training

Programs and Activities

Focused Across the Cancer Continuum(per CCC

Framework)

Evaluation Plan Review

To abstract information on what

programs are evaluating and where they need additional

guidance

Specific Tasks for each Activity

Performance Measures Pilot

To develop and pilot performance

measures for CCC programs

Outputs

Evaluation Toolkit/Primer

Menu of Outcomes

Uniform Performance

Measures/ Indicators

Descriptive analysis of content of

programs’ cancer plans

Identified training needs and provide effective training and

TA to programs

Short-term Outcomes (<1 year)

Intermediate Outcomes(1-3 years)

Enhanced program capacity

for --planning

--evaluation--program

improvement

Sustained implementation of

CCC activities

CCC Conceptual Framework Specific to Current Evaluation Tasks

Cancer Plan IndexTo describe plans to know how to provide better guidance to

programs

Improved effectiveness of

cancer prevention and control

practice

Established performance management system that

drives fiscal decision making and accountability

and that stimulates program improvement

Ultimate Outcomes

(beyond 3 years)

B1b

C

1c

A

1a

Review of Evaluation Plans

Review of CCC evaluation plans was conducted to assess the status of evaluation expertise.

In 2008, a total of 40 CCC programs submitted evaluation plans that underwent descriptive and content analyses.

What did we learn?

Evaluation plans are in various stages of development– majority of evaluation plans address some but

not all of evaluation components specified in FOA

– many of the evaluation plans do not state the focus of the evaluation

Opportunity for technical assistance– CCCB should provide guidance and resources

around evaluation planning—a toolkit on evaluation!

Review of evaluation resources

Identification of resources external and internal to CDC – CDC & External Evaluation

Resources_granteecopy.xls

Conducted a cursory review

10 common elements

Common elements mapped to CDC Framework for Program Evaluation

Informed the development of our toolkit

What did we learn?

What is an evaluation toolkit?

What it is

A resource to help all CCCB programs effectively plan for and implement evaluations

It is a document that will provide programs with guidance on CDC expectations with respect to evaluation.

It is informed by:

• an understanding of what the programs currently know and an understanding of existing evaluation resources

• stakeholder input

What it isn’t

Document that encompasses all current evaluation theories, approaches, and applications

A prescription for conducting CCC evaluation

Proposed Content

Toolkit OverviewEvaluation Primer Program Specific Evaluation Guidance– Review of program purpose & grantee

evaluation requirements– Practical evaluation guidance based on CDC

Framework

Tools & TemplatesFor Further Study

How is it being developed?

Core steps for development

Gathering stakeholder input – Core CDC-RTI workgroup– Program Advisory workgroup

Development of content based on CDC eval framework

Pilot testing

Core steps for dissemination

In-service for CCCB Program Consultants

Disseminate to program directors

Training

Plan for future evaluations to inform expansion/enhancements/modifications

Where are we now?

So far…

Review existing documents:

•CCC Evaluation Plan Review

•Review of Existing Resources

Gather stakeholder input from DCPC and DCPC program staff (Winter 2009)

Convening CDC-RTI core workgroup

What are our next steps?

Proposed Timeline

Draft Toolkit Outline (Winter 2009)

Draft Toolkit Sections (Winter/Spring 2009)

Pilot Toolkit Sections with DCPC programs (Summer 2009)

Finalize Toolkit (Fall/Winter 2009)

Questions?

Thoughts?