9th KENYA NATIONAL M&E CONFERENCE
Geo-Enabling initiative for Monitoring and Supervision (GEMS)
Benard Mitto | 18th May, 2021
Offered by the World Bank’s Fragility, Conflict and Violence Group in cooperation with GOSTSupported by the Korea Trust Fund for Economic and Peacebuilding Transitions
GEMS capacity-building provided by the FCV Group, Operations Support Unit (GTFOS). For questions, contact Bernhard Metz ([email protected])
Remote Supervision through Geospatial Tools: Getting Eyes on the Ground
Example: Fadama III project,
operating in Borno State, Northeast Nigeria
Refugee / IDP camp
Conflict Hotspot
Mafa Water Point Fully Functional
City of Mafa | Mafa LGA | Borno State | 3,560 beneficiaries
Site Inspection Protocol
Inspected: Funke Mgwale | June 6, 2017 | 9:20 am-Sample-
Observations:• The water point has been completed and is intact• Utilization by the local community is high
Northeast Nigeria:Joint UN-WB HDP Stabilization Mission
Remote SensingThrough SatelliteImagery
The GEMS Method: Systematic Real-Time Field Data Collectionthrough Smartphones
‘Plugging In’Spatial Data From Various Sources
?
The “Rocket Science,” “Pocket Science,” and “Socket Science”
Overcoming access limitations and
capacity constraints
Operational Planning / Programming Implementation Support / M&E Supervision / Impact Evaluation
• Simple and versatile for customized real-time M&E• Focus on capacity-building among clients & Bank staff• Examples: GEMS initiative implemented with 450
projects in 45 countries. Vast use in C-19 response• Caveats: Counterparts on the ground required
Digital real-time M&E via mobile ICT
• Access to reliable data in inaccessible areas• Examples: Remote supervision of the reconstruction
of Konna Port in Central Mali; DNAs in Iraq & Yemen• Caveats: Technical limitations and often high cost;
legal & reputational risks for use of drones in FCV
Remote sensing via satellites (& UAVs/drones)
• Complements ICT for fiduciary in in high-risk contexts• Global TPM Review available to TTLs since Feb. 2020• Examples: Multi-year use for fiduciary and procurement
monitoring, in Afghanistan, Cameroon, Iraq, Yemen, etc.• Caveats: High costs and often complex contracting
Third-Party Monitoring/Execution (TPM/E)
• Identification of large-scale patterns and tensions• Examples: Social Media Monitoring of ops impact in
DRC; mobility analyses via call detail records in Haiti• Caveats: Often limited data access & representative-
ness; high costs and reliance on external firms
Big Data analysis and Artificial Intelligence
• Collection of quick feedback from local communities• Examples: Iterative Beneficiary Monitoring (IBM) in Sahel;
remote poverty surveys in Somalia, South Sudan, etc.• Caveats: Often complex rollout and potential sampling
issues given reliance on beneficiary phone numbers
Phone-based beneficiary surveys
• Databases for enhanced programming & coordination• Transparency tool and baseline for impact evaluation • Examples: Granular mapping of >100,000 sub-project
implementation sites in 20 countries in AFR via GEMS• Caveats: Reliance on local stakeholders to collect data
Geo-mapping of activities and portfolios
GEMS+ & ICT4FCV: Applied Technology Solutions for FCV and the COVID response
Core of support directly provided by GEMS to clients Support provided GEMS through cooperation with internal and external partners
GEMS systematically builds client capacity in the creation of customized digital M&E systems. This is based on the use of cost-free open source tools and hand-held devices (smartphones/tablets) to collect granular geo-tagged data that automatically feeds into interactive dashboards and web maps.
The aim is to contribute to effective planning, real-time M&E, remote supervision, accountable TPM & geo-mapping of projects and provide Data Integrity along the project cycle.
The ‘Pocket Science’: Definition of the GEMS method
The used platform KoBoToolbox: • Combines all relevant data related to operations, components, and field activities. • Centralizes all collected data in one integrated system, connected to the M&E framework.• Provides data in various formats incl. tables, text, photos, videos, audio, and maps.• Allows for systematic recording of project indicators and survey responses to strengthen
project planning implementation, risk assessments, and coordination across operations.• Enables Bank Teams to directly access project data from PIUs in real-time.
Mirror your data in real-time across stakeholders
All-in-one cost-free open source tool: KoBo Toolbox – what it does
https://www.youtube.com/watch?v=4PNtT51h3CQ
Why KoBoToolbox: Cost-free, Open Source, User-Friendly, Flexible
• Fully free accounts, app, server space
• Everything Open Source
• Data protected & flexible use of servers –follows EU’s General Data Protection Regulation – GDPR
• Simple interface – easy to learn
• Quick and flexible form creation
• Ownership by clients & easy to scale
• Data and forms easy to share
• Large user Community (hum & dev)
The GEMS Method: Cheap, Readily Implemented, Scalable, Sustainable
Enter project data
-Sample-
Photo: Impression from geo-enabling training for the South Sudan Local Governance and Service Delivery Project PIU
• Simple and free technology (ODK)
• Customized data collection forms
• No internet/networkconnection needed
• Automatic integration of data in centralized MIS or M&E system
• Automatic mapping of interventions
• Easy to scale across portfolio/partners
➢ Simple & low-cost ICT for M&E
➢ Building Capacity with clients for sustainable use
GEMS Platform: Multi-use Tool for M&E, Supervision, & Communications
• Remote supervision of implementation
• Enhanced transparencyand accountability
• Structured monitoring of survey data
• Real-time tracking of safeguards compliance
• Coordination across projects and partners
• Communication and citizen engagement
• Automatic integration in centralized M&E system and geo-mapping
➢ Simple & low-cost ICT for improving M&E
➢ Capacity-building for flexible application
Example of successful application – Azerbaijan Rural Investment Project – see map tool: http://azrip.net/maps/index.htmll
• No use of GEMS for monitoring of the disease itself or any surveillance of individuals
• Operational planning, M&E and remote supervision amidst travel and access restrictions:
• Digital monitoring platforms across components, projects, programs and sectors.
• Structured geo-mapping and recording of baseline data on service infrastructure (e.g. health clinics)
• Remote supervision of a variety of activities (e.g. infrastructure construction, health trainings).
• Real-time tracking of equipment stocks/delivery (e.g. through barcode recording).
• Monitoring of social protection activities (e.g. LIPW/THIMO, psychosocial support).
• Beneficiary or multi-stakeholder engagement (e.g. perception/feedback surveys).
• Real-time monitoring of compliance with environmental and social safeguards/ESF.
Examples for Leveraging GEMS as Part of the COVID-19 Response
Remote Training: 10 Hours interactive Training-of-Trainers Workshops
• Same contents as in-country trainings, but condensed
• Offered to CMU/GP/Project Focal Points (FPs) and clients
• Training delivered remotely over 8-10 hours, split into 2-3 days with days in between and “homework” assignments
• Training to cover all the technical skills needed for FPs to create and administrate customized digital monitoring systems
➢ GEMS team supports FPs in finding the best ways of deploying system based on local conditions and sector needs
➢ System is deployed with FPs leading the content aspects and take full ownership of the system
For further information, just type gems/ in your WBG intranet browser, see here for our intranet site (https://gems) or contact the GEMS team at the FCV Group ([email protected])
The FCV Group’s Geo-Enabling initiative for Monitoring and Supervision (GEMS)
For further information, just type gems/ in your WBG intranet browser, see here for our intranet site (https://gems) or contact the GEMS team at the FCV Group ([email protected])
Building local capacity
in digital data collection and analysis with simple
and free open-source tools
The Core GEMS Team, based in 12 countries
The GEMS initiative
is supported by the
Korea Trust Fund
for Economic and Peacebuilding Transitions (KTF)
Overview of the session
• 10 min: Introduction to GEMS• 10 min: Use Cases from the field • 5 min: Q&A and applications to your project
Project Planning
Beneficiary Surveys
Baseline Data Collection
Results Framework Indicators
Impact Evaluation
Environmental and Social Safeguards Monitoring
Verifying TPM Activities“monitor-the-monitors”
Remote Project Supervision
Possible Uses of GEMS for Clients and the WBG / Partners
Project Teams & Clients WB Country Teams / Partners
Portfolio Mapping & Coordination
Citizen Feedback / Communications
Project Progress Monitoring
Real-time Tracking of Missions and Security IssuesReal-time Tracking of Service Delivery
Citizen Engagement / GRM
Icons provided by Freepik from www.flaticon.com
Systematic Mapping & Creation of Databases on Sub-Projects at Activity Level
Over 60,000 sub-project locations in 20 countries in AFR mapped via GEMS
Example: Togo
Example: Madagascar
Example: DRC
Examples of GEMS
Use in the Field In Niger, GEMS helps to plan and
supervise infrastructure investments for refugees, internally displaced
people and host communities
Project Planning and Preparation
In Uganda, a multisectoral nutrition project uses GEMS to track vital school feeding and deworming activities to prevent stunting
Project Progress Monitoring
In Afghanistan, GEMS has helped track the distribution of seeds to over 280,000 farmers across the country,
as part as a COVID emergency project
Remote Supervision in Conflict Contexts
In the DRC, detailed data on 25,000+ schools was collected via GEMS in 3 months, changing the perspective of
the Ministry of Education
Infrastructure Mapping & Coordination
In Haiti, GEMS allowed to closely monitor the provision of livelihood
support to 40,000 vulnerable people during the COVID-19 pandemic
Real-time Tracking of Service Delivery
In Myanmar, GEMS helps manage environmental and social risks and
safeguards during implementation of a nation-wide electrification project
Real-Time Risk Management
In Azerbaijan, GEMS supported a country-wide Community-Driven
Development project to establish a digital Citizen Engagement platform
Communications and Citizen Engagement
GEMS Example: Kenya – addressing data gaps in NEDI
GEMS Coverage
Dashboards, Infographics, SMS & Calls
WB Mission planning & project synergies
13 Projects
350+ sites
10 countiesChallenges
Solutions
▪ Existing data and information gaps
▪ Fragmented data collection
approaches / paper-based
▪ Use of innovative tools for real-time
data capture e.g., GEMS, Soc. Media
▪ Establishment of Remote Supervision
task team
▪ Strengthening of Environmental
and Social Safeguards monitoring
▪ Lack of granulated data within
NEDI portfolio / synergies
▪ Common access and utilization of data
by TTLs and Counterpart
Future ▪ More training of counterparts &
strengthening M&E platforms
▪ Implementing findings of the remote
supervision task team
NEDI Progress Dashboard
• Construction/renovation of PHLs to ultra-modern health laboratory blocks.
• Equipping PHLs with modern medical facilities• Training staff on disease control and operational research
GEMS Example: Kenya – East Africa Public Health Laboratory Networking
GeneXpert for TB and RT-PCR for Covid-19 screening equipment
Construction and equipping of public health laboratories and incinerators
GEMS Example: Kenya – Citizen Participation
The growing Community behind KoBo Toolbox
GEMS: More transparency and accuracy (fewer fake cats) for better development decisions