nepal - assessing the social impact of rural energy services alternative energy promotion center
DESCRIPTION
Insert relevant PwC graphic in this space. Nepal - Assessing the Social Impact of Rural Energy Services Alternative Energy Promotion Center. Monitoring and Evaluation Framework. November 2009. *connectedthinking. Pwc. Table of Contents. Section. Page. - PowerPoint PPT PresentationTRANSCRIPT
Slide 1November 2009
Draft Report
Alternative Energy Promotion Center
Monitoring and Evaluation Framework
Pwc
*connectedthinking
November 2009
Draft Report
Familiarisation and sensitisation
Proposed M&E framework
*
November 2009
Draft Report
9:30:9:45 - Introduction and Objective of the Workshop, Dr. N.P. Chaulagain
9:45-9:50 - Inauguration of the Workshop, Honorable Minister, Thakur Sharma
9:50-10:20 - Overview of M&E framework for AEPC, RakeshJha, PwC
10:10-10:50 -Remarks: By all program officials
10:50-11:00 - Vote of Thanks and Closing of the session, Dr. N.P. Chaulagain
11:00-11:15 - Tea Break
13:00-14:00 - Lunch Break
14:00-15:00 - MIRMS: Manual Data Entry and upload provisions for all renewable technologies, Mr Manoj Mania, PwC
15:00-15:45 - MIRMS: MIS reporting, Mr Manoj Mania, PwC
151:450-16:00 - Tea/ Coffee break
*
November 2009
Draft Report
11:00-11:15 - Tea/ Coffee break
11:15-12:45 - Training and live run contd…Mr. Manoj Mania, PwC
12:00 – 13:00 - Concluding remarks and vote of thanks, AEPC
13:00-14:00 - Lunch
*
November 2009
Draft Report
Context
Low electricity access in Nepal – 35% total; Urban- 85%; Rural – 30%
Low per capita electricity consumption – 76 unit
Cost of grid connection not feasible at all places – Renewable can play a major role
Grid extension in majority of villages not viable - poor financial condition of NEA
Electrification target under the Water national Plan , 2005
Source: NEA Annual Report, FY 2008 -09
Total MW
HH served by Alternative Energy
2007
700
35%
8%
2%
2017
2035
50%
12%
3%
2027
4000
75%
20%
5%
November 2009
Draft Report
Context
Nepal endowed with huge potential in hydropower (>40,000 MW) and other Renewable energy sources.
Increasing investment in hydropower – GoN, donors
*
November 2009
Draft Report
Diverse programmes – Anecdotal evidence of positive impact but little systematic quantification of results on the ground
WB funded study on ‘Assessing the Social Impact of Rural Energy Services’ – Oct 2008 -Sep, 2009
Systematic M&E framework to assess the development impact of MH schemes
Update the business plan for AEPC
M&E Framework
November 2009
Draft Report
Explicit commitment to track contribution to global indicators e.g. MDGs
Ensuring accountability
Demonstrating results against money spent - Demanded by govt., donors, NGOs
Ultimately results on the ground matter - not implementation progress
Just in case: How M&E helps ME?
Motivates by seeing the difference it makes for people
Learn from experience: Build on success and learn from failures…
Incentives for better performance…?
*
November 2009
Draft Report
Section 1 – development of M&E framework
*
November 2009
Draft Report
*
Familiarization of the context and the program by the project team
Review of policies, regulations and impact studies
Interaction with REDP, ESAP and AEPC officials
Field Visit
Section 2 – Familiarization and Sensitization
Focus Group Discussion at Dhunne Khola Micro Hydro site
*
November 2009
Draft Report
Organized a sensitization workshop at the outset of the project
DAY 1: November 18, 2008
Introduction and Context
Developing the Monitoring Framework for AEPC
The Role of Evaluation
DAY 2: November 19, 2008
M&E framework for Assessing the Social Impacts of Rural Energy Services
Monitoring: Key Performance Indicators
Sensitization workshop at AEPC
*
November 2009
Draft Report
Section 3 – Review of existing M&E framework
*
November 2009
Draft Report
M&E diagnostic review - ESAP
Quarterly reports are sent to AEPC with detail work plan based on the results of the survey.
Each installation is surveyed after a month of installation by the LPO and the promoter.
Technical evaluation – after 3 to 4 months by the LPO and RRESC staff.
Mid term review of the annual work plan to check whether program objectives are met.
Evaluation of LPOs by RRESC
The field technical coordinator from the RRESC office submits progress reports to AEPC by the 12th of every month – based on pre-defined formats
Section 3 – Review of existing M&E framework
*
November 2009
Draft Report
Existing
Manual calculation of formula fields in few formats
Project monitoring report captured only status of completion of activity
Proposed
Captures targets for each measurable indicator and helps evaluation
System calculates formula based on dependent fields
System would capture date of completion to highlight delay in implementation, if any
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Existing
Client server mode visible to select group of people within AEPC office(max 8 to 10 users) – local installations required
Absence of integrated information system - separate databases
Targets not reflected in MIS
KPIs not linked to performance management of business units
Requires design change in system for meeting any future requirements
Static reports with no feature to compare and perform trend analysis
Proposed
Web based system – information available to all users at any location having internet connection
Integrated AEPC database -warehousing periodic information for analysis and evaluation in the system itself
Target driven system for measuring performance every month
Dynamic system to incorporate any future requirements
Multiple ways of viewing data and conducting analysis
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Primary reporting interface for meeting all the reporting requirements of the management(financial, technical, operational, projects, community participation, capacity building)
Eliminate the burden of disparate electronic and paper based data collection requirements
Provide the top management specific information about the programs and its business units at a glance.
Enabling the management to drive strategy by evaluating performance against the KPIs.
Protect the confidentiality , availability and integrity of data
Section 5 – Development of MIRMS
MIRMS - what it offers
November 2009
Draft Report
*
Using existing computer infrastructure of AEPC server for hosting the system on the internet
Utilising existing manpower and computer infrastructure at the field level
Supplements existing information base of AEPC to enhance decision making abilities
Integration with REDP and ESAP databases for information consolidation
Existing formats have been retained and new formats designed and aligned to the KPIs in the proposed M&E framework
Reduction of work load on M&E staff by leveraging the information for performing evaluation and meeting top managements reporting requirements
MIRMS – leveraging existing capability of AEPC
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Comprehensive MIS formats designed to facilitate regular review of project activities for all RETs
Structured and unified formats for ease in data gathering
Mapping of data fields to existing transactional system
Yearly / Monthly Targets to be set in the system to compare progress towards achieving outputs
Flexibility in reporting and analyzing the data
Trend analysis
Comparative analysis
Dynamic reporting system with no static reports – user can extract reports in desired format at any given point of time from any location
MIS - Design and Reporting
*
November 2009
Draft Report
*
MIRMS will interface with existing systems either through on-line or off-line mode and extract information
User friendly screens provided for mapping and uploading of external data source to MIRMS
Information extracted either on monthly or trimesterly basis depending on availability of information
MIRMS – Mapping with existing database of AEPC
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Existing AEPC server
SQL server database
Developed on a 3-tier web technology framework comprising of java technology integrated with MS SQL server
Leveraged industry best practices for designing and developing a scalable system
Creation of a centralized database repository
MIS formats designed for all programs
Development of MIRMS
*
November 2009
Draft Report
*
November 2009
Draft Report
The proposed M&E framework is aimed to:
Align and design to meet AEPC’s vision, mission and strategic priorities.
Use M&E as a strategic planning tool.
Optimise the existing set up
Establish a drill down feature for analysis of information
Generate MIS reports at every level
Section 5 – Proposed M&E framework
Top Management, Programme Managers
Field based operation
November 2009
Draft Report
Need based MIRMS
Monthly monitoring of operational data is done by the field staff responsible for the respective functions.
Trimesterly monitoring of performance parameters - by the district heads or monitoring officers of respective programs
The top management reviews the program and strategic parameters on a monthly, quarterly or yearly basis to take decisions and decide the policy level interventions.
Section 5 – Proposed M&E framework
Advantages of MIRMS
November 2009
Draft Report
To evaluate the performance of the project against defined objective/target
Facilitate review and comparison across project/ location.
Useful for setting performance targets and efficient assessment.
Input indicator
mostly the programme fund support, contribution in kind and technical assistance by community and awareness generation programmes
Output Indicators
mostly the number of projects/systems installed, capacity enhancement of the target beneficiaries and the community mobilization process.
show the benefits accruing to the community through the awareness generation and mobilization process.
Outcome Indicators
indicators that mostly are a measure of the affordability, operational efficiency and reliability of the MH programs.
Section 5 – Proposed M&E framework
*
November 2009
Draft Report
No. of MH projects commissioned
Installed capacity of MH
Progress against projects schedule*
No. of enterprises with access to MH
Value of proposed equity by the community (equivalent to labour and cash amount) vis-a-vis actual contribution
% of community facilities with access to other RETs
% of community facilities with access to MH
Percentage of Complaints resolved (consumer level) in stipulated time period
Power availability*
Collection efficiency*
M&E Framework
November 2009
Draft Report
Achievement of Gasifier installations
Total subsidy allocation
Utilization of Funds
% Systems functioning during verification
System performance in ICS
System performance in Gasifiers
M&E Framework
November 2009
Draft Report
% subsidy disbursement
System performance for ISPS, SHS & PVPS
% of complaints resolved in stipulated time period
Section 5 – Proposed M&E framework
M&E Framework
November 2009
Draft Report
*
November 2009
Draft Report
Pwc
*
November 2009
Draft Report
Monthly MIS Reporting
MH Project Monitoring
Performance Review through Dashboards
*
November 2009
Draft Report
*
November 2009
Draft Report
File uploads – mapped to existing AEPC databases
Manual Entry – data entry screens
Periodicity of data capture
Monthly
Trimesterly
Annually
Data captured at different levels of the organization depending on data availability
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
MIS Reporting
Dynamic reporting engine supporting multiple ways of viewing data and conducting analysis
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Tracks project schedules and assists program managers to take corrective measures
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Single window for top management to evaluate performance through KPIs
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Program Dashboards
Single view of performance data in graphical form to different levels of user
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
*
November 2009
Draft Report
Snapshot of dashboards
The dashboards would facilitate the Program Mangers and M&E staff to monitor project development
designed to provide specific information about the performance of each component of the programme and present critical measurable parameters of each program at a glance.
The dashboards would provide a graphical display of the overall performance of the programs on key performance parameters like achievement of programme objectives, community reach, financial performance, etc.
The dashboards can be generated starting from the zonal level to individual level dashboards for each project/[programme
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
How to migrate to MIRMS
Form a core group of people for taking ownership of MIRMS and formulating strategies for information
Identify at least one district form each region for testing and roll out
Run this parallel to the existing M&E arrangement
Develop a team of ToT
Handholding of people engaged in M&E by ToTs
Use of operation manual
Periodic review of the system – frequency of monitoring on the higher side in the beginning
Assess performance of the M&E team and MIRMS
Take appropriate measures as per requirement – training, modification in MIRMS
Section 6 – Process flow for MIS Reporting and Evaluation
Pwc
November 2009
Draft Report
Emphasis on decentralized
Draft Report
Alternative Energy Promotion Center
Monitoring and Evaluation Framework
Pwc
*connectedthinking
November 2009
Draft Report
Familiarisation and sensitisation
Proposed M&E framework
*
November 2009
Draft Report
9:30:9:45 - Introduction and Objective of the Workshop, Dr. N.P. Chaulagain
9:45-9:50 - Inauguration of the Workshop, Honorable Minister, Thakur Sharma
9:50-10:20 - Overview of M&E framework for AEPC, RakeshJha, PwC
10:10-10:50 -Remarks: By all program officials
10:50-11:00 - Vote of Thanks and Closing of the session, Dr. N.P. Chaulagain
11:00-11:15 - Tea Break
13:00-14:00 - Lunch Break
14:00-15:00 - MIRMS: Manual Data Entry and upload provisions for all renewable technologies, Mr Manoj Mania, PwC
15:00-15:45 - MIRMS: MIS reporting, Mr Manoj Mania, PwC
151:450-16:00 - Tea/ Coffee break
*
November 2009
Draft Report
11:00-11:15 - Tea/ Coffee break
11:15-12:45 - Training and live run contd…Mr. Manoj Mania, PwC
12:00 – 13:00 - Concluding remarks and vote of thanks, AEPC
13:00-14:00 - Lunch
*
November 2009
Draft Report
Context
Low electricity access in Nepal – 35% total; Urban- 85%; Rural – 30%
Low per capita electricity consumption – 76 unit
Cost of grid connection not feasible at all places – Renewable can play a major role
Grid extension in majority of villages not viable - poor financial condition of NEA
Electrification target under the Water national Plan , 2005
Source: NEA Annual Report, FY 2008 -09
Total MW
HH served by Alternative Energy
2007
700
35%
8%
2%
2017
2035
50%
12%
3%
2027
4000
75%
20%
5%
November 2009
Draft Report
Context
Nepal endowed with huge potential in hydropower (>40,000 MW) and other Renewable energy sources.
Increasing investment in hydropower – GoN, donors
*
November 2009
Draft Report
Diverse programmes – Anecdotal evidence of positive impact but little systematic quantification of results on the ground
WB funded study on ‘Assessing the Social Impact of Rural Energy Services’ – Oct 2008 -Sep, 2009
Systematic M&E framework to assess the development impact of MH schemes
Update the business plan for AEPC
M&E Framework
November 2009
Draft Report
Explicit commitment to track contribution to global indicators e.g. MDGs
Ensuring accountability
Demonstrating results against money spent - Demanded by govt., donors, NGOs
Ultimately results on the ground matter - not implementation progress
Just in case: How M&E helps ME?
Motivates by seeing the difference it makes for people
Learn from experience: Build on success and learn from failures…
Incentives for better performance…?
*
November 2009
Draft Report
Section 1 – development of M&E framework
*
November 2009
Draft Report
*
Familiarization of the context and the program by the project team
Review of policies, regulations and impact studies
Interaction with REDP, ESAP and AEPC officials
Field Visit
Section 2 – Familiarization and Sensitization
Focus Group Discussion at Dhunne Khola Micro Hydro site
*
November 2009
Draft Report
Organized a sensitization workshop at the outset of the project
DAY 1: November 18, 2008
Introduction and Context
Developing the Monitoring Framework for AEPC
The Role of Evaluation
DAY 2: November 19, 2008
M&E framework for Assessing the Social Impacts of Rural Energy Services
Monitoring: Key Performance Indicators
Sensitization workshop at AEPC
*
November 2009
Draft Report
Section 3 – Review of existing M&E framework
*
November 2009
Draft Report
M&E diagnostic review - ESAP
Quarterly reports are sent to AEPC with detail work plan based on the results of the survey.
Each installation is surveyed after a month of installation by the LPO and the promoter.
Technical evaluation – after 3 to 4 months by the LPO and RRESC staff.
Mid term review of the annual work plan to check whether program objectives are met.
Evaluation of LPOs by RRESC
The field technical coordinator from the RRESC office submits progress reports to AEPC by the 12th of every month – based on pre-defined formats
Section 3 – Review of existing M&E framework
*
November 2009
Draft Report
Existing
Manual calculation of formula fields in few formats
Project monitoring report captured only status of completion of activity
Proposed
Captures targets for each measurable indicator and helps evaluation
System calculates formula based on dependent fields
System would capture date of completion to highlight delay in implementation, if any
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Existing
Client server mode visible to select group of people within AEPC office(max 8 to 10 users) – local installations required
Absence of integrated information system - separate databases
Targets not reflected in MIS
KPIs not linked to performance management of business units
Requires design change in system for meeting any future requirements
Static reports with no feature to compare and perform trend analysis
Proposed
Web based system – information available to all users at any location having internet connection
Integrated AEPC database -warehousing periodic information for analysis and evaluation in the system itself
Target driven system for measuring performance every month
Dynamic system to incorporate any future requirements
Multiple ways of viewing data and conducting analysis
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Primary reporting interface for meeting all the reporting requirements of the management(financial, technical, operational, projects, community participation, capacity building)
Eliminate the burden of disparate electronic and paper based data collection requirements
Provide the top management specific information about the programs and its business units at a glance.
Enabling the management to drive strategy by evaluating performance against the KPIs.
Protect the confidentiality , availability and integrity of data
Section 5 – Development of MIRMS
MIRMS - what it offers
November 2009
Draft Report
*
Using existing computer infrastructure of AEPC server for hosting the system on the internet
Utilising existing manpower and computer infrastructure at the field level
Supplements existing information base of AEPC to enhance decision making abilities
Integration with REDP and ESAP databases for information consolidation
Existing formats have been retained and new formats designed and aligned to the KPIs in the proposed M&E framework
Reduction of work load on M&E staff by leveraging the information for performing evaluation and meeting top managements reporting requirements
MIRMS – leveraging existing capability of AEPC
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Comprehensive MIS formats designed to facilitate regular review of project activities for all RETs
Structured and unified formats for ease in data gathering
Mapping of data fields to existing transactional system
Yearly / Monthly Targets to be set in the system to compare progress towards achieving outputs
Flexibility in reporting and analyzing the data
Trend analysis
Comparative analysis
Dynamic reporting system with no static reports – user can extract reports in desired format at any given point of time from any location
MIS - Design and Reporting
*
November 2009
Draft Report
*
MIRMS will interface with existing systems either through on-line or off-line mode and extract information
User friendly screens provided for mapping and uploading of external data source to MIRMS
Information extracted either on monthly or trimesterly basis depending on availability of information
MIRMS – Mapping with existing database of AEPC
Section 5 – Development of MIRMS
*
November 2009
Draft Report
Existing AEPC server
SQL server database
Developed on a 3-tier web technology framework comprising of java technology integrated with MS SQL server
Leveraged industry best practices for designing and developing a scalable system
Creation of a centralized database repository
MIS formats designed for all programs
Development of MIRMS
*
November 2009
Draft Report
*
November 2009
Draft Report
The proposed M&E framework is aimed to:
Align and design to meet AEPC’s vision, mission and strategic priorities.
Use M&E as a strategic planning tool.
Optimise the existing set up
Establish a drill down feature for analysis of information
Generate MIS reports at every level
Section 5 – Proposed M&E framework
Top Management, Programme Managers
Field based operation
November 2009
Draft Report
Need based MIRMS
Monthly monitoring of operational data is done by the field staff responsible for the respective functions.
Trimesterly monitoring of performance parameters - by the district heads or monitoring officers of respective programs
The top management reviews the program and strategic parameters on a monthly, quarterly or yearly basis to take decisions and decide the policy level interventions.
Section 5 – Proposed M&E framework
Advantages of MIRMS
November 2009
Draft Report
To evaluate the performance of the project against defined objective/target
Facilitate review and comparison across project/ location.
Useful for setting performance targets and efficient assessment.
Input indicator
mostly the programme fund support, contribution in kind and technical assistance by community and awareness generation programmes
Output Indicators
mostly the number of projects/systems installed, capacity enhancement of the target beneficiaries and the community mobilization process.
show the benefits accruing to the community through the awareness generation and mobilization process.
Outcome Indicators
indicators that mostly are a measure of the affordability, operational efficiency and reliability of the MH programs.
Section 5 – Proposed M&E framework
*
November 2009
Draft Report
No. of MH projects commissioned
Installed capacity of MH
Progress against projects schedule*
No. of enterprises with access to MH
Value of proposed equity by the community (equivalent to labour and cash amount) vis-a-vis actual contribution
% of community facilities with access to other RETs
% of community facilities with access to MH
Percentage of Complaints resolved (consumer level) in stipulated time period
Power availability*
Collection efficiency*
M&E Framework
November 2009
Draft Report
Achievement of Gasifier installations
Total subsidy allocation
Utilization of Funds
% Systems functioning during verification
System performance in ICS
System performance in Gasifiers
M&E Framework
November 2009
Draft Report
% subsidy disbursement
System performance for ISPS, SHS & PVPS
% of complaints resolved in stipulated time period
Section 5 – Proposed M&E framework
M&E Framework
November 2009
Draft Report
*
November 2009
Draft Report
Pwc
*
November 2009
Draft Report
Monthly MIS Reporting
MH Project Monitoring
Performance Review through Dashboards
*
November 2009
Draft Report
*
November 2009
Draft Report
File uploads – mapped to existing AEPC databases
Manual Entry – data entry screens
Periodicity of data capture
Monthly
Trimesterly
Annually
Data captured at different levels of the organization depending on data availability
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
MIS Reporting
Dynamic reporting engine supporting multiple ways of viewing data and conducting analysis
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Tracks project schedules and assists program managers to take corrective measures
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Single window for top management to evaluate performance through KPIs
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
Program Dashboards
Single view of performance data in graphical form to different levels of user
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
*
November 2009
Draft Report
Snapshot of dashboards
The dashboards would facilitate the Program Mangers and M&E staff to monitor project development
designed to provide specific information about the performance of each component of the programme and present critical measurable parameters of each program at a glance.
The dashboards would provide a graphical display of the overall performance of the programs on key performance parameters like achievement of programme objectives, community reach, financial performance, etc.
The dashboards can be generated starting from the zonal level to individual level dashboards for each project/[programme
Section 6 – Process flow for MIS Reporting and Evaluation
*
November 2009
Draft Report
How to migrate to MIRMS
Form a core group of people for taking ownership of MIRMS and formulating strategies for information
Identify at least one district form each region for testing and roll out
Run this parallel to the existing M&E arrangement
Develop a team of ToT
Handholding of people engaged in M&E by ToTs
Use of operation manual
Periodic review of the system – frequency of monitoring on the higher side in the beginning
Assess performance of the M&E team and MIRMS
Take appropriate measures as per requirement – training, modification in MIRMS
Section 6 – Process flow for MIS Reporting and Evaluation
Pwc
November 2009
Draft Report
Emphasis on decentralized