Reporting Results -Reporting Results -Audiences and UsesAudiences and Uses

Effectiveness Evaluation Workshop

Victoria, November 7, 2002

Tom Niemann, Ministry of Forests

Why report? BC’s forest policy development

Results based code Tenure policy Land use planning

Why report? BC’s forest policy development Market access

information on SFM certification

Why report? BC’s forest policy development Market access Public’s keen interest in SFM

environment jobs recreation

Why report? BC’s forest policy development Market access Public’s keen interest in SFM Federal commitments

Montreal Process C&I CCFM C&I National Forest Strategy

Why report? BC’s forest policy development Market access Public’s keen interest in SFM Federal commitments

One set of indicators? Report once for all?

What Audiences? Policy makers

JMC JSC Cabinet

What Audiences? Policy makers Industry audiences

workers, shareholders buyers, consumers certification auditors

What Audiences? Policy makers Industry audiences Public (BC and international)

individuals (well informed and not) media communities (PAGs, local government) NGOs

What Audiences? Policy makers Industry audiences Public (BC and international) Agencies

Forest Practices Board BC Timber Sales federal

Policy makers Industry audiences Public (BC and international) Agencies

Some indicators can serve several.Different reports!

What Audiences?

Reporting Issues?

Inform? or Persuade?

Reporting Issues?

Inform? Support dialogue on SFM

Balanced, credible Good news and bad news Avoid bias in:

selection of indicators assessment of indicators presentation of results

Reporting Issues?

Inform? or Persuade? Support change in

policy programs for monitoring, research… opinions

Methods and data are IMPECCABLE! Results are JUST SUPER!

May backfire

Reporting Issues?

Inform? or Persuade? Scale

FMU, province, nation, global Values, monitoring methods vary with scale

TSAs, TFLs: 10,000 ha - 14,800,000 ha

“Rolling up” data often does not work Ecosystems cross administrative borders,

so TEAM UP!

Reporting Issues?

Inform? or Persuade? Scale Time period

Trends are more important than state Choice of reporting period can change

apparent trend Forecasts

Time period

time

aspect

Time period

time

aspect

Time period

time

aspect

Time period

time

aspect ?

Reporting Issues?

Inform? or Persuade? Scale Time period Only a few evaluations per year

Values change over time FPC 1995, 2002 CCFM C&I 1995, 2003

Can we assess SFM?

Reporting Issues?

Inform? or Persuade? Scale Time period Only a few evaluations per year Thresholds

scientific, public, political often difficult or unknown What if only 1 of 6 evaluations > threshold?

Reporting Issues?

Inform? or Persuade? Scale Time period Only a few evaluations per year Thresholds Uncertainty and Risk

When do we know policy needs to change? Accountability (“blame”)

Summary

Reporting is not simple Effectiveness evaluations can inform

a variety of reports We have to look for synergies,

a.k.a. cost savings Co-operation will help us make

progress towards SFM…..

Blank slide

Sustainable forest management

Management to maintain and enhance the long-term health of forest ecosystems, while providing ecological, economic, social, and cultural opportunities for the benefit of present and future generations. Canadian Council of Forest Ministers, 1992

Montreal Process criteria

1. Conservation of biological diversity

2. Maintenance of productive capacity of forest ecosystems

3. Maintenance of forest ecosystem health and vitality

4. Conservation and maintenance of soil and water resources

5. Maintenance of forest contribution to global carbon cycles

6. Maintenance and enhancement of long-term multiple socio-economic benefits to meet the needs of societies

7. Legal, institutional and economic framework for forest conservation and sustainable management

Example: MP Indicators1.1 Ecosystem diversity

Extent of area by forest type relative to total forest area Extent of area by forest type and by age class or

successional stage Extent of forest type in protected area categories (IUCN or

other) Extent of area by forest type in protected areas defined by

age class or successsional stage Fragmentation of forest types

1.2 Species diversity (2 indicators)

1.3 Genetic diversity (2 indicators)

Canadian (CCFM) criteria

1. Conservation of biological diversity

2. Maintenance and enhancement of forest ecosystem condition and productivity

3. Conservation of soil and water

4. Forest ecosystem contribution to global ecological cycles

5. Multiple benefits to society

6. Accepting society’s responsibility for sustainable development

Example: CCFM Indicators1.1 Ecosystem diversity

% and extent, in area, of forest types relative to historical condition and to total forest area

% and extent of area by forest type and age class 1.1.3 area, % and representativeness of forest

types in protected areas level of fragmentation and connectedness of

forest ecosystem components.

1.2 Species diversity (3 indicators)

1.3 Genetic diversity (1 indicator)

Canadian (CCFM) C&I documents

Defining SFM (CCFM C&I) - 1995

C&I of SFM, Progress to date - 1997 C&I of SFM, Technical report - 1997

First national report on C&I - 2000(62 of 83 indicators)

Technical Challenges

understanding data sources data standards data quality clear definitions sampling designs trend detection analytical tools efficient processes

consistent reporting accessibility of

information security of proprietary

data qualitative changes

over time archiving information

Administrative Challenges

commitment budget reductions staff workloads

partnerships management cycle

Political Challenges

commitment process scope / jurisdiction potential for impact

Management Cycle

Plan

Set Objectives

ImplementEvaluate

Monitor

Adjust

Management Cycle

Plan

Set Objectives

ImplementEvaluate

Monitor

Adjust

Presentation policy makers, public, agencies

relevant to values/issues credible, comprehensive indicators clear, concise language

people with little time clear design to help find parts of interest

domestic and international Canadian values clear links to international work

Top-down and bottom-upGeneralities Sustainable

forestmanagement

Goal Vision

Maintainbiodiversity

Principle Wisdom

Ecosystemdiversity

Criterion Knowledge

Old growth Indicator Information

Specifics CarmanahGiant

Observation Data