smart evaluation: incorporating evaluation in program design, & showing contractors the benefits...

28
Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance Systems Development

Upload: nelson-dorsey

Post on 27-Dec-2015

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Smart Evaluation:Incorporating Evaluation in Program Design, &

Showing Contractors the Benefits

Kathy GreelyProgram Manager, PA Home EnergyPerformance Systems Development

Page 2: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

PA Home Energy• HPwES and ESQH• Infrastructure Development

– More auditors/raters– Dual RESNET/BPI certification

• Financing & Incentives– Keystone HELP loans– Performance-based (WPP)

• Consumer Marketing– Benefits of whole-house approach– Contractor differentiation– ENERGY STAR link

www.pahomeenergy.org

Page 3: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Starting from Zero

August '07

October '07

February '08April '0

8May '08

August '08

October '08

December '08March '09

May '09

September '09

December '09March '10

0

20

40

60

80

100

120

140

160

RESNET/BPI Certified Individuals in PA(through PA Home Energy)

RESNET - Certified Raters

BPI - Certified Building Analysts

Service Providers

Nu

mb

er

of

Ind

ivid

uals

Page 4: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Home Performance with ENERGY STAR

• Whole house energy improvement process– Diagnostic Audit– Report to the customer

• Modeled savings (optional)

– Installation– Test out

Page 5: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Growth in Reported JobsHome Performance with ENERGY STAR• 623 audits, plus• 172 completed home performance jobs

HomeWorks (Lisbet Searle-White)

Page 6: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Program Features• Young (< 3 years)• Relatively low budget• Not utility funded, but may be• Wide geographic range

Page 7: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

More Program Features

• Performance-based incentives (limited territory)– Based on modeled savings, trued up to bills– Little money to incent reporting otherwise

• Emphasis on billing data– Benchmarking– Disaggregation (true up/improvement opportunities)

• No evaluation funds, but some built in features

Page 8: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Training• Focus on trainees who can succeed

Page 9: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Evaluation: Customer Feedback

Page 10: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Obtaining Utility Bills?

Page 11: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Obtaining Utility Bills?

Page 12: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

File Review, by Contractor

• Savings:– Too low?– Unrealistically high?

• Whole-house scope?• Combustion testing?

Page 13: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Field QA: Front-Line Evaluation

What are we looking for?Home performance jobs:• Heath & Safety issues• Combustion Safety compliance• Infiltration verification• Installation inspection• Missed opportunities

Common problem areas• CAZ depressurization• Ducts outside the envelope

Page 14: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Getting Contractors to Report

• Balance reporting quality and quantity– Too much information means less reporting

• Competition valuable

AWARDS

Page 15: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Deep SaversHome Performance with ENERGY STAR:• Rhett Major, Billeck Home, 71% savings

• GSHP• Air sealing• Insulation• Windows• Ventilation

Page 16: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Getting Contractors to Report

• Reporting must be easy (especially with small/variable incentives)

• Reporting must be useful to contractor– Customer feedback, file management, tracking

• Paper/fax/email to on-line reporting– Less suffering, greater results– Benefit to participants

Page 18: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Green Energy Compass is …

• An online benchmarking and tracking tool for single-family residential homes

• Sold as Software-As-A-Service, meaning there is nothing to download or install and the application is always up to date (free to PAHE)

• Designed to support the entire residential energy retrofit process

Page 19: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Useful to Contractors for…

• Client education and benchmarking (pre-audit)

• Disaggregation for model true-up (audit)• Feedback to clients (post HP)• File management (audit/HP/test-out)• Program reporting (value, not burden)

Page 20: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Green Energy Compass

Green Energy Compass provides a central hub for collecting and

disbursing information to all interested parties including contractors, programs, and

financial institutions

Page 21: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Green Energy Compass answers your questions

How much $ could I save?

How does this home compare to

similar homes?How much did I actually save?

How is this home using

energy?

How can I keep track of all my documents?

Can this home qualify for an energy

efficient loan?

Page 22: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Energy Usage ReportHow does

home compare to

national average?

What is biggest use of energy in home?

What is costing the

most for energy?

How much can the homeowner

spend on improvements?

What is biggest use of energy in the home?

Model true-up

info

Page 23: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Peer Comparison ReportTotal Energy comparison yields first

level analysis.

But comparison of end use shows

that totals were masking a heating

improvement opportunity.

Page 24: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Improvement SummaryBasic

information about the audit and test-out

Files from contractor to

support program QA

List of improvements and proposed

savings

Three stage process to

capture information

Free notes allow easy communication

between contractor and program

Page 25: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Configure Energy Savings Report

The type of report controls what inputs are required

Easily set the baseline period based on actual meter data

Page 26: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Energy Savings Report

Page 27: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Dashboard – Peer comparison for Contractors

Page 28: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance

Thank you!

Kathy Greelywww.pahomeenergy.org(814) [email protected]