best practices in low-income programming jackie berger aci home performance conference may 6, 2015
TRANSCRIPT
![Page 1: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/1.jpg)
Best Practices In Low-Income Programming
Jackie Berger
ACI Home Performance ConferenceMay 6, 2015
![Page 2: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/2.jpg)
Presentation Outline
• Program Goals• Management• Eligibility and Targeting• Services• Energy Education• Service Delivery• Data Management• Quality Control• Evaluation
2
![Page 3: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/3.jpg)
GOALS
3
![Page 4: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/4.jpg)
Program GoalsOptions• Energy savings• Benefit cost ratio• Greenhouse gas emissions• Bill impacts• Reduce ratepayer subsidy• Number of homes served• Amount spent per home or in the program year• Targeting need (elderly, disabled, children, energy burden)• Innovative usage reduction measures• Innovative program delivery systems
4
![Page 5: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/5.jpg)
Program GoalsAdvantages & Disadvantages
• Energy Savings– Advantages: sets concrete standards of
measurement for program and contractor.– Disadvantages:
• Particular level of savings may be difficult reach depending on condition of customer homes and budget constraints.
• Time lag to estimate impacts based on billing data.
5
![Page 6: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/6.jpg)
Program GoalsAdvantages & Disadvantages
• Cost-Effectiveness– Advantages:
• Concrete• Justifiable
– Disadvantages: • Which formula – TRC, Utility, Societal…• Difficulty and controversy in measuring benefits – health
impacts, environmental, etc.
6
![Page 7: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/7.jpg)
Program GoalsAdvantages & Disadvantages• Reduce ratepayer subsidy
– Advantages: if achieved, the program will result in cost-effective savings for the ratepayers.
– Disadvantages: if all benefits go to the ratepayers, there may be less motivation for customers to participate in energy reduction strategies.
7
![Page 8: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/8.jpg)
Program GoalsAdvantages & Disadvantages• Number of homes served
– Advantages: ensure that benefits are distributed to a minimum number of customers
– Disadvantages: • With a set budget, places limits on the level of services
that a household can receive.• What benefit is achieved?
8
![Page 9: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/9.jpg)
Program GoalsAdvantages & Disadvantages• Amount spent per home
– Advantages: ensure that a certain number of homes can be served within the allocated budget.
– Disadvantages: • May not allow enough flexibility to address homes with
severe problems.• May be leaving savings opportunities unaddressed.
9
![Page 10: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/10.jpg)
Program GoalsAdvantages & Disadvantages• Serve high need customers
– Advantages: provides benefits to those who may suffer most from unaffordable energy bills.
– Disadvantages: may not provide the most cost-effective program if these are not the highest energy users.
10
![Page 11: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/11.jpg)
Program GoalsAdvantages & Disadvantages• Innovative usage reduction measures• Innovative program delivery systems
– Advantages: • Allows for testing of these new measures and systems that may
prove to be cost-effective in the long-run.• May lead to more effective program.
– Disadvantages: • Due the to learning curve, program may not be as cost-effective.• Need opportunity to pilot test.
11
![Page 12: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/12.jpg)
Program GoalsBest Practices• Relates to program’s mission• Concrete
– Save X ccf/kWh on average per home served– Reach 1.25 benefit-cost ratio– Reduce ratepayer burden by 5%
• Measurable– Plan for how you are going to measure
• Challenging, but achievable– Based on past results or other benchmark
12
![Page 13: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/13.jpg)
MANAGEMENT
13
![Page 14: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/14.jpg)
Program ManagementOptions• Public Utility Commission• State• Team of Utilities• Individual Utility• 3rd Party Administrator
14
![Page 15: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/15.jpg)
Program ManagementAdvantages & Disadvantages• Centralized program – PUC or State
– Advantages• Customers across the state receive equivalent benefits.• Utilities may work together to develop best practices for combined
approach.• May be greater opportunity for joint delivery across electric/gas
utilities.
– Disadvantages• Utilities may not have the same program commitment and
involvement.• May lose utility-specific customer knowledge.
15
![Page 16: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/16.jpg)
Program ManagementExamples• Pennsylvania: Each utility manages its
own usage reduction program.• New Jersey: Utilities work together on
joint program.• Ohio: Electric Partnership Program
managed by the state.
16
![Page 17: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/17.jpg)
Program ManagementBest Practices• Opportunities
– What is there to gain from each option?
• Capabilities– Which organization is best positioned to manage?
• Constraints– What staffing or resource constraints are faced?
17
![Page 18: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/18.jpg)
ELIGIBILITY TARGETING
18
![Page 19: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/19.jpg)
Eligibility and TargetingOptions• Income level
– Usually150% or 200% of Federal Poverty Level
• Home Ownership• Usage Guidelines• Participation in payment assistance program• Payment-troubled customers• Vulnerable households (young children, elderly,
disabled)
19
![Page 20: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/20.jpg)
Eligibility and Targeting Advantages & Disadvantages• Income level
– Advantages: more restrictive income limits mean that those with the least ability to pay their bills receive services.
– Disadvantages: more restrictive income limits may mean that the highest use customers are may not be served.
20
![Page 21: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/21.jpg)
Eligibility and Targeting Advantages & Disadvantages• Home Ownership
– Advantages: • Home owners may be more likely to remain in home and
see benefits over time.• Landlord permission is not needed.
– Disadvantages: some needy households are not served.
21
![Page 22: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/22.jpg)
Eligibility and Targeting Advantages & Disadvantages• Usage
– Advantages: • Usually results in greatest energy savings.• Utilities can develop lists.
– Disadvantages: • May not focus on needs due to other characteristics –
vulnerability, burden, other.• Conditions in highest usage homes may prevent major
measures.
22
![Page 23: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/23.jpg)
Eligibility and Targeting Advantages & Disadvantages• Participation in bill payment
assistance programs– Advantages: reductions in usage result in reduction
in subsidies that burden the ratepayers.– Disadvantages:
• Other needy customers not served.• May be less incentive for participants to take energy-
saving actions.
23
![Page 24: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/24.jpg)
Eligibility and Targeting Advantages & Disadvantages• Payment troubled customers
– Advantages: • May increase bill payment coverage rates.• Customers may be motivated to reduce usage.• Utility can target customers who express need for assistance.• WAP agency can target customers who received LIHEAP.
– Disadvantages: • May not result in greatest usage reduction.• Some households may be better served with energy
assistance (low usage, lowest income.)
24
![Page 25: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/25.jpg)
Eligibility and Targeting Advantages & Disadvantages• Vulnerable households (young children,
elderly, disabled)– Advantages:
• Reduce energy usage for those who are sensitive to temperature extremes.
• Nonprofit agency can prioritize these households for service delivery.
– Disadvantages: • May not result in greatest usage reduction.• May restrict opportunity to coordinate with utility
programs.25
![Page 26: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/26.jpg)
Eligibility and Targeting Examples
• PGW – one contractor initially targeted highest users, but found too many barriers in home.
• PGW – good savings with very high usage customers.
• OH REACH – additional services delivered to customers with health problems.
• NJ Comfort Partners & PPL – customers at subsidy limit can benefit.
26
![Page 27: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/27.jpg)
Eligibility and Targeting Best Practices• Review goals• Assess other available programs
–May try to reach population that is not served by other programs
• Revisit over time–After several years, may need to revise
pre-treatment usage guideline down
27
![Page 28: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/28.jpg)
SERVICES
28
![Page 29: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/29.jpg)
ServicesOptions• Comprehensive – maximize savings
per home• Cost threshold / $ limit per household• Minimal – increase number of
households served• Varied, depending on energy usage
29
![Page 30: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/30.jpg)
ServicesAdvantages & Disadvantages• Comprehensive
– Advantages• Maximize usage reduction for homes served.• Minimize administrative expenses as a percentage of
total costs.• Reduce need for another program to return to home.
– Disadvantages• Fewer homes may be served.
30
![Page 31: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/31.jpg)
ServicesAdvantages & Disadvantages• Cost threshold
– Advantages• Serve a greater number of households.• Ensure that a minimum number of households are served.
– Disadvantages• Does not take individual household circumstances into account.• May spend too little in some homes and too much in others.• May spend more than what is cost-effective in some homes.
31
![Page 32: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/32.jpg)
ServicesAdvantages & Disadvantages• Minimal
– Advantages• Increase number of households served.
– Disadvantages• Customers may not receive significant savings.• Administrative costs are duplicated when other programs
return to serve the household.
32
![Page 33: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/33.jpg)
ServicesVary By Customer Usage• Advantages
– Service level is targeted to need.• Disadvantages
– Households are not treated equally.
33
![Page 34: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/34.jpg)
ServicesExample• CO Energy Efficiency Programs
– Full cost– Low cost in home– Kit with postcard– Kit sent to list
• PPL WRAP• Full cost• Water heating• Baseload
34
![Page 35: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/35.jpg)
ServicesBest Practices• Review goals• Research program models• Pilot test• Evaluate• Re-visit
35
![Page 36: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/36.jpg)
ENERGY EDUCATION
36
![Page 37: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/37.jpg)
Energy EducationOptions• Partnership between
program/educator and customer• Understanding the energy bills• Energy use and costs around the home• Customer goals for usage reduction• Customer action plan• Follow-up
37
![Page 38: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/38.jpg)
Energy EducationAdvantages & Disadvantages• Partnership between program
/educator and customer– Advantages: if successful, customer has more
motivation to take steps to reduce energy usage.– Disadvantages: takes skilled and dedicated auditor
to make it work.
38
![Page 39: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/39.jpg)
Energy EducationAdvantages & Disadvantages• Understanding the energy bills• Energy use and costs around the home
– Advantages• If the customer understands how to read the bill and determine when
usage is decreasing, it provides positive re-enforcement for energy-saving actions.
• Allows customer to make decisions about energy usage based on the costs of those uses.
– Disadvantages• Requires auditor with good communication skills.• Increases length of audit.
39
![Page 40: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/40.jpg)
Energy EducationAdvantages & Disadvantages• Customer goals for usage reduction• Customer action plan
– Advantages• Provides motivation for customer to reduce energy usage• Provides direction for customer.
– Disadvantages• Some customers will not be interested.• Auditors must be skillful and willing to take the time
required.
40
![Page 41: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/41.jpg)
Energy EducationExamples• NJ Comfort Partners
–Energy education notebook–2 hours allocated
• PECO– Energy education in home– Monthly follow-up letters
41
![Page 42: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/42.jpg)
Energy EducationBest Practices• Assess capabilities• Provide training• Perform quality control• Evaluate• Refine• Re-train
42
![Page 43: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/43.jpg)
SERVICE DELIVERY ORGANIZATIONS
43
![Page 44: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/44.jpg)
Service Delivery Options• Private contractors• Weatherization agencies• Community Action Agencies• Other nonprofit• Mix of the above groups
44
![Page 45: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/45.jpg)
Service Delivery Advantages & Disadvantages• Private contractors
– Advantages• Cash flow management• Data management capabilities• Ability to hire additional staff
– Disadvantages• May have less knowledge/experience with other public
programs• May be too focused on profit
45
![Page 46: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/46.jpg)
Service Delivery Advantages & Disadvantages• Weatherization agencies• Community Action Agencies• Other nonprofit
– Advantages: • Ability to provide joint service delivery of multiple
utility programs and/or WAP.• WAP agencies already have consistent policies and
procedures that can be implemented in utility program.
– Disadvantages: may not have experience with contract work.
46
![Page 47: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/47.jpg)
Service DeliveryExample• NJ CP, PGW – private contractors• PPL – combination • UGI – WAP agencies
47
![Page 48: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/48.jpg)
Service DeliveryBest Practices• Review goals• Assess capabilities and experience• Assess operating environment• Hold accountable• Re-visit
48
![Page 49: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/49.jpg)
DATA MANAGEMENT
49
![Page 50: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/50.jpg)
Data ManagementOptions• Paper data collection
– Data collected on paper at the customer’s home– Data entered by contractor after the visit
• Computerized data collection– Customer data loaded into software– Data entered in laptop or tablet while in the
customer’s home– Data uploaded to data management system
50
![Page 51: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/51.jpg)
Data ManagementAdvantages & Disadvantages• Computerized data collection
– Advantages• Auditor can have customer data (including usage)
available on site.• Data entry is not necessary following the visit.• Software can calculate cost-effectiveness based on
customer usage and other characteristics.• Auditor can print report for customer on site.
– Disadvantages• Computer can interview with customer relationship.• Data can be lost.• Providers may be resistant.
51
![Page 52: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/52.jpg)
Data ManagementBest Practices• Assess data needs
–Management –Operations–Evaluation
• Assess capabilities and experience• Assess operating environment• Perform cost-benefit analysis• Provide training
52
![Page 53: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/53.jpg)
QUALITY CONTROL
53
![Page 54: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/54.jpg)
Quality ControlOptions• Internal/External
– State or utility personnel – Third party inspectors
• Sampling– What percent of jobs should be inspected?
• Targeting– Equal/random inspection of each contractor– Focus on contractors who have shown problems in the past
54
![Page 55: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/55.jpg)
Quality ControlAdvantages & Disadvantages• External quality control
– Advantages• More time may be devoted to quality control.• May have more systematic procedures for quality
control.• May be more objective.
– Disadvantages• May be more expensive.• Inspectors may not have good understanding of program
design and procedures.
55
![Page 56: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/56.jpg)
Quality ControlBest Practices• Assess provider capabilities and
experience• Develop systematic procedures• Collect and review data• Re-visit based on findings
56
![Page 57: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/57.jpg)
EVALUATION
57
![Page 58: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/58.jpg)
EvaluationOptions
• Internal/External– Conducted by state/utility– Conducted by third party evaluator
• Impact– Energy usage– Bill payment– Environmental– Economic
• Process– Efficiency/effectiveness of program– On-site observation and inspections of completed jobs– Why is the program achieving the outcomes
58
![Page 59: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/59.jpg)
EvaluationAdvantages & Disadvantages• External
– Advantages• More time may be devoted to evaluation.• Evaluation expertise.• May have more systematic procedures for evaluation.• May be more objective / less biased.
– Disadvantages• More expensive.• May not have an understanding of the program and
components.
59
![Page 60: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/60.jpg)
EvaluationBest Practices• Assess information needs• Design evaluation • Use results to improve performance
– Policies and procedures– Systems and tools– Training– Quality Control
60
![Page 61: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/61.jpg)
Performance MeasurementSteps
61
Program Statistics
Refine
Pilot Changes
Quality Control
Hold Contractors Accountable
Assess Inputs and Outputs
Assess Inspection Results
Assess Energy Savings
![Page 62: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/62.jpg)
SUMMARY
62
![Page 63: Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015](https://reader031.vdocuments.site/reader031/viewer/2022032311/56649db15503460f94aa043b/html5/thumbnails/63.jpg)
SummaryRecommendations• Identify and prioritize goals• Recognize unique characteristics of
environment– Geography/weather– Political/social– Resources
• Review program models• Pilot test before implementing• Evaluate and improve 63