Natasha M. Jamison, MPH, CHESHealth Scientist, Epidemiology Branch

Office on Smoking and Health

TM

Utility of Key Outcome Indicators: Future Directions

National Conference on Tobacco or HealthOctober 25, 2007

Utility of Key Outcome Indicators: Multiple Perspectives

Aggregate state data from OSH’s Chronicle

States’ use in evaluation planning

Future directions

Goal

Come up with a limited number of Indicators that OSH could track longitudinally

Represent “the national picture” regarding progress towards meeting long-term goals

Provide data for modeling impacts of funding overall and specific interventions to improve program and policy

Assist OSH in responding to PART, GPRA, and other “accountability-type” requests

Purpose

Track progress in tobacco prevention and control nationally and across states

– Not intended to direct State evaluation efforts

– Not intended to measure progress toward every outcome across all NTCP goals

Select indicators that can provide an accurate representation of the “state of tobacco control” across the country

Does NOT Supplant State-Specific Use of Key Outcomes Indicators

States should still select appropriate Key Outcome Indicators to evaluate their own programs

Methods

All 120 Key Outcome Indicators were ranked by:

– Strength of evaluation evidence

– Overall quality

– Accepted practice

– Resources

Worked closely with OSH’s Program Services Branch (PSB)

– Actively involved in Planning Committee

– Mapped State activities to OSH logic models

 Looked at Chronicle data

.

Methods, cont’d

Convened meeting of OSH Leadership and Senior Scientists

Participants reviewed information on each candidate Indicator, and considered:

– NTCP Goals

– Current State activities

– Known Best Practices

– Existing and potential Data Sources

Methods, cont’d

Group endorsed a proposed list of “Core” Indicators

This list was disseminated to all OSH staff and feedback was solicited

All information was synthesized into the current list of OSH Core Indicators

Draft Core Indicators — Initiation Short term

– Proportion of students who would ever wear or use something with a tobacco company name or picture [KOI #1.6.3]

– Level of support for increasing excise taxes on tobacco products [1.6.5]

– Proportion of schools or school districts reporting the implementation of 100% tobacco-free policies [1.7.1]

– Proportion of jurisdictions with policies that require retail licenses to sell tobacco products [1.8.2]

– Changes in state tobacco control laws that preempt stronger local tobacco control laws [1.8.7]

– Extent and type of retail tobacco advertising and promotions [1.9.1]

– Number and type of MSA violations by tobacco companies [1.9.10]

Draft Core Indicators — Initiation Intermediate

– Proportion of young people who are susceptible never-smokers [1.10.5]

– Proportion of successful attempts to purchase tobacco products by young people [1.11.1]

– Amount of tobacco product excise taxes [1.12.1]

Draft Core Indicators — Initiation Long term

– Proportion of young people who report never having tried a cigarette [1.13.2]

– Prevalence of tobacco use among young people [1.14.1]

– Prevalence of any tobacco product use other than cigarettes or smokeless tobacco among middle and high school students. [1.14.1]

– Prevalence of tobacco use among young adults [1.14.1]

Draft Core Indicators — Secondhand Smoke

Short term– Level of support for creating tobacco-free policies

in public places and workplaces [KOI #2.3.7]– Proportion of jurisdictions with public policies

for tobacco-free workplaces and other indoor and outdoor places [2.4.1]

– Proportion of the population that works in environments with tobacco-free policies [2.4.3]

– Proportion of the population reporting voluntary tobacco-free home or vehicle policies [2.4.4]

– Proportion of schools or school districts reporting the implementation of 100% tobacco-free policies [2.4.5]

– Changes in state tobacco control laws that preempt stronger local tobacco control laws [2.4.6]

Draft Core Indicators — Secondhand Smoke

Intermediate– Perceived compliance with tobacco-free

policies in workplaces [2.6.1]

Long term – Proportion of the population reporting

exposure to secondhand smoke in the workplace [2.7.1]

– Proportion of the population reporting exposure to secondhand smoke at home or in vehicles [2.7.3]

– Proportion of nonsmokers reporting overall exposure to SHS [2.7.5]

– Per capita consumption of tobacco products [2.8.1]

Draft Core Indicators — Cessation

Short term– Number of callers to quitlines [KOI #3.7.1] – Level of support for increasing excise taxes on

tobacco products [3.8.5] – Proportion of private and public insurance

purchasers and payers that reimburse for tobacco cessation services [3.10.1]

Draft Core Indicators — Cessation

Intermediate– Proportion of adult smokers who have made a

quit attempt [3.11.1] – Proportion of young smokers who have made

a quit attempt [3.11.2] – Proportion of adult smokers who have made a

quit attempt using proven cessation methods [3.11.3]

– Amount of tobacco product excise taxes [3.12.1]

Draft Core Indicators — Cessation

Long term– Proportion of [adult and young] smokers who

have sustained abstinence from tobacco use [3.13.1]

– Smoking prevalence [3.14.1]

– Prevalence of use of any tobacco product other than cigarettes or smokeless tobacco [3.14.1]

– Per capita consumption of tobacco products [3.14.4]

Current Activities

Assuring that measures for KOIs and CIs exist on standard data sources (ATS, YTS, CPS-TUS, etc.)

Developing new measurement methods for non-standard Indicators, as needed

Finalizing OSH Core Indicators, including those not on published KOI list

Next steps

Developing process to maintain and update KOI book

Incorporate evolving Core Indicators into OSH program and evaluation support plans

Continue providing KOI technical assistance to States

Natasha M. Jamison, MPH, CHESHealth Scientist, Epidemiology Branch

Office on Smoking and Health

TM

National Conference on Tobacco or Health October 25, 2007

Utility of Key Outcome Indicators: Future Directions