USAID JALIN MERLA PLAN, JUNE 4, 2018
1
THE USAID JALIN PROJECT MONITORING, EVALUATION, RESEARCH, LEARNING, AND ADAPTATION PLAN
June 4, 2018
USAID JALIN MERLA PLAN, JUNE 4, 2018
1
This document is made possible by the support of the American people through the United States Agency for International Development (USAID). The contents of this document are the sole responsibility of DAI and do not necessarily reflect the views of USAID or the United States Government.
USAID JALIN MERLA PLAN, JUNE 4, 2018
ii
TABLE OF CONTENTS
Acronyms ............................................................................................................................................... iii
Executive Summary ............................................................................................................................ 1
Context ................................................................................................................................................. 1
MERLA Approach and Project-Level Results ........................................................................ 1
Introduction ............................................................................................................................................ 3
Jalin Theory of Change and Results Framework ...................................................................... 3
Theory of Change ............................................................................................................................. 3
Results Framework .......................................................................................................................... 4
MERLA Approach ................................................................................................................................. 6
Methods for Understanding the Effectiveness of Project Management ..................... 6
Evaluating Plausible MNH Impact of Local Solutions ........................................................ 7
Approach to Assessing Systemic Change ............................................................................... 8
MERLA Implementation .................................................................................................................... 9
Planning, Managing, and Documenting How Performance Data is Collected and Used in Ongoing Activity Management ................................................................................... 9
Monitoring ....................................................................................................................................................... 9
Evaluation ....................................................................................................................................................... 10
Research ......................................................................................................................................................... 10
Learning and Adapting ............................................................................................................................... 11
Complexity-Aware Monitoring ............................................................................................................... 13
The Developmental Evaluation ............................................................................................................... 15
Intentional contemplation ......................................................................................................................... 15
Tracking Inputs and Outputs of Activities and Achievement of Outcomes over the Life of the Contract .............................................................................................................. 15
Facilitating the Flow of Information Within Jalin ............................................................. 15
Communicating learning ............................................................................................................ 16
Data Quality .................................................................................................................................... 16
Reporting .......................................................................................................................................... 18
MERLA Activities Planned for Year 1 ................................................................................... 19
Indicators and Targets..................................................................................................................... 19
Limitations of Data ....................................................................................................................... 19
Appendices ........................................................................................................................................... 20
Appendix 1. Jalin Indicator Performance Tracking Table ................................................. 21
Appendix 2: Performance Indicator Reference Sheets (PIRS) ........................................ 28
AppendIx 3. Prof Ackmal Taher’s presentation .................................................................... 63
iii USAID JALIN MERLA PLAN, JUNE 4, 2018
ACRONYMS
AIPI Akademi Ilmu Pengetahuan Indonesia (Indonesian Academy of Sciences) EMNC Every Mother and Newborn Counts GOI Government of Indonesia IPTT Indicator Performance Tracking Table KM Knowledge Management MAB Multistakeholder Advisory Body MMR Maternal Mortality Ratio M&E Monitoring and Evaluation MERLA Monitoring, Evaluation, Research, Learning, and Adaptation MNH Maternal and Newborn Health NMR Newborn Mortality Ratio PIRS Performance Indicator Reference Sheet SDG Sustainable Development Goals TAMIS Technical and Administrative Management Information System TOC Theory of Change UHC Universal Health Coverage USAID United States Agency for International Development
1 USAID JALIN MERLA PLAN, JUNE 4, 2018
EXECUTIVE SUMMARY
CONTEXT
Indonesia has enjoyed significant development and economic growth over the past 20 years. However, maternal mortality ratios remain higher in Indonesia than in most other countries in the region, and newborn mortality is unusually high for a middle-income country. New approaches are required to support Indonesia meet its health sector development goals. The stage for these new approaches has been set with strong political commitment from the Government of Indonesia (GOI) as stated in the recently issued Presidential Decree on the implementation of Sustainable Development Goals1 (SDGs) from 2017 and on the Minimum Standard of Services2 (Standar Pelayanan Minimal 2018). Recently, many policies have also been launched to realize health sector development including the Implementation of Universal Health Coverage (Jaminan Kesehatan Nasional 2014), the Healthy Indonesia Program (Program Indonesia Sehat 20153) with its three pillars and its household-approach (Program Indonesia Sehat-Pendekatan Keluarga 2016); the universal delivery care4 (Jampersal 2011) and its updated scheme since 2015; and the minimal service standard for health5 (Standar Pelayanan Minimal Bidang Kesehatan 2016).
Furthermore, economic growth in Indonesia is creating opportunities to leverage resources and technical assistance from the private sector and engage multistakeholder actors – the GOI, the private sector, and civil society – to join and strengthen the maternal and newborn health (MNH) Movement to reduce mortality and achieve national MNH SDGs.
The United States Agency for International Development (USAID) Jalin Project (hereafter referred to as “Jalin” or “the Project”) will support the MNH Movement by working with multistakeholder actors to advocate for a culture of evidence-based approaches and provide tailored technical assistance to strengthen partnerships that co-invest in sustainable and scalable MNH solutions.
MERLA APPROACH AND PROJECT-LEVEL RESULTS
Jalin’s approach to Monitoring, Evaluation, Research, Learning, and Adaptation (MERLA) is comprised of four core operating modalities:
Continued learning and adaptation informed by evidence. Evidence Utilization. Proving concepts. Leveraging impact for scale.
1 Peraturan Presiden Republik Indonesia no. 59 tahun 2017: Pelaksanaan Pencapaian Tujuan Pembangunan Berkelanjutan. 2 Peraturan Pemerintah Republik Indonesia no. 2 tahun 2018: Standar Pelayanan Minimal. 3 Keputusan Menteri Kesehatan Republik Indonesia No. HK.02.02/MENKES/52/2015: Rencana Strategis Kementerian Kesehatan Tahun 2015-2019. 4 Peraturan Menteri Kesehatan Republik Indonesia no. 61 tahun 2017: Petunjuk Teknis Penggunaan Dana Alokasi Khusus Non Fisik Bidang Kesehatan Tahun
Anggaran 2018. 5 Peraturan Menteri Kesehatan Republik Indonesia no. 43 tahun 2016: Standar Pelayanan Minimal Bidang Kesehatan.
USAID JALIN MERLA PLAN, JUNE 4, 2018 2
These four operating modalities link together to address the following medium-term (three- to five-year) outcomes:
MNH evidence disseminated through appropriate knowledge management (KM) channels; Partnerships implementing solutions or advocacy; Multistakeholder actors engaged through the partnership process; Timely, quality, need-driven technical assistance provided; and Total value of catalytic funds provided (to support the incubation and implementation of
local solutions) disaggregated by source.
Achievement of these five outcomes will result in:
Multistakeholder actors demanding and utilizing MNH evidence; Multistakeholder actors actively co-investing to improve MNH outcomes; GOI integrating MNH evidence into programming that targets the poorest and most
vulnerable; GOI and private sector providers delivering quality MNH evidence-informed programming
that reaches the poorest and most vulnerable; Communication channels using MNH evidence and priorities to increase public awareness; Multistakeholder actors adopting and influencing evidence-based system changes; and More Indonesians utilizing MNH evidence-informed clinical and non-clinical services.
Successful achievement of these outcomes will strengthen the MNH Movement in Indonesia and therefore contribute to national goals to reduce maternal and newborn mortality and catalyze investment to improve essential maternal and newborn services for the poorest and most vulnerable.
While this MERLA Plan includes approaches and metrics to measure the above objectives and goals, Jalin understands that the specific causal relationships between objectives will not always be predictable. Consequently, Jalin will use the most appropriate tools to assess and communicate progress.
USAID JALIN MERLA PLAN, JUNE 4, 2018 3
INTRODUCTION
The Jalin MERLA Plan describes approaches and activities for monitoring progress against targets and using research and learning to inform adaptive management to ensure those targets are met. It serves as a management tool that:
Provides a framework for the MERLA system that will enable the systematic collection, aggregation, analysis, and process for interpretation of data that support evidence- and performance-informed decision-making;
Identifies the core indicators to be used to assess the fixed components of Jalin progress towards achieving planned results and impacts;
Describes the main data tools, sources, and methods used to collect data; Describes roles and responsibilities associated with M&E; Defines data quality assurance measures and data management procedures to provide
transparency and ensure data quality; Aligns with USAID’s strategies and processes; and Facilitates consultation and discussion with USAID, key stakeholders, and consortia
partners.
The Plan includes four major sections:
A description of the Jalin MERLA approach which describes the practices and processes that Jalin will design and implement to measure progress;
Details of how Jalin will collect, store, monitor, analyze and learn from data; The Jalin Theory of Change (TOC) and Results Framework which present expected life-of-
Project outcomes to be captured through MERLA activities; and Indicators and quarterly, annual, and life-of-Project targets organized by component and
presented in an Indicator Performance Tracking Table (IPTT) and detailed in Performance Indicator Reference Sheets (PIRS).
JALIN THEORY OF CHANGE AND RESULTS FRAMEWORK
THEORY OF CHANGE
If MNH evidence is available and compellingly communicated, and if influential multistakeholder actors are engaged and properly incentivized across the health system using market forces, then constructive and inclusive partnerships, solutions, and advocacy can flourish…and these efforts can spur an MNH Movement that contributes to reducing maternal and newborn mortality in Indonesia, specifically for the poorest and most vulnerable.
To help pave the way for those partnerships, solutions, and advocacy to thrive in a way that changes current behaviors in a sustainable way, Jalin will support: 1) institutions instrumental in generating evidence to shape policy decisions, and 2) local actors to identify ways that they can collectively improve MNH outcomes by co-investing in local solutions (inclusive of the private sector, this will mean identifying opportunities where there are MNH outcomes as well as market incentives).
To ensure systems changes are sustained Jalin will: 1) facilitate and provide technical assistance to partners and counterparts as they co-create, co-invest, and co-own local solutions during and beyond the life of the Project, 2) engage the “whole of market” have a more complete view of
USAID JALIN MERLA PLAN, JUNE 4, 2018 4
MNH challenges and possible solutions that can be supported by domestic resource mobilization, and 3) adopt a collaborative approach to problem definition informed by evidence.
Jalin’s TOC is premised on several key assumptions:
There is a need and a market for robust and compelling evidence that informs decision making and galvanizes interest in and a sense of urgency around MNH;
The whole of market has an interest in and a collective willingness to support MNH solutions;
The diversity of actors, perspectives, and interests represented by the whole of market will leverage resources, ideas, networks, and partnerships that will break through barriers to progress and incentivize action beyond what USAID alone can support; and
Increased attention to MNH by existing and new actors will draw more attention to important issues, shift public perception of the severity of the crisis, and therefore change policy and behavior.
To help catalyze the MNH Movement, Jalin will:
Foster a culture of learning and adaptation; Advocate for a whole of market approach through co-creation, technical assistance, and
catalytic financing; Support local institutions to collect, analyze, use, and disseminate evidence to inform
programming, policy making, and advocacy; and Strengthen national and subnational partnerships to identify, design, invest in, implement,
and scale local MNH solutions.
RESULTS FRAMEWORK
Together with USAID, Jalin developed a Results Framework (Figure 1) that guides programming to address MNH challenges and serves as a tool to monitor, measure, and report on Project-supported achievements. Jalin will regularly assess the relevance of the Framework and revise it, as appropriate, in collaboration with USAID, Indonesian counterparts, and Social Impact (Jalin’s Developmental Evaluation partner).
5 USAID JALIN MERLA PLAN, JUNE 4, 2018
Figure 1: Jalin Results Framework
Reduce Maternal and Newborn Mortality (5-10 years)
MNH Movement Takes Hold (5-10 years)
Behaviors and Processes Evolve Across Health Systems (3-5 years)
Component 1: Partnership process managed to generate, implement, evaluate, and scale successful local solutions and utilize critical evidence to result in sustainable MNH impact
Component 1.1: MNH Evidence Available and Compellingly Communicated
3-5 year metrics:
• Increased capacity of AIPI to conduct MNH knowledge management• MNH evidence disseminated (Op Eds, peer-review articles submitted for publication, policy briefs
published, evidence dissemination events held)Process Steps:• Conduct EMNC activity across selected districts
• Mobilize MNH KM Strategy with appropriate local partners• Synthesize MNH evidence from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions,
GOI, etc.)
Component 1.2: Constructive and inclusive partnerships, solutions, and advocacy developed
3-5 year metrics:
• Partnerships implementing solutions or advocacy• Multi-stakeholder actors engaged through the partnerships processProcess Steps:
• Engage influential multi-stakeholder actors• Define problem statements for co-creation efforts
• Deploy co-creation approaches to develop evidence-driven solutions and advocacy• Prioritize partnerships, solutions, advocacy for impact• Build local capacity to use a facilitative/co-creation approach
• Monitor and learn from local partnerships, solutions, and advocacy
Component 2: TA deployed effectively to support impact at scale 3-5 year metrics: • Timely, quality, need-driven TA provided
Process Steps:• Provision of specialized TA for local solutions • Provision of responsive TA to the GOI
• Monitor TA with feedback survey
Component 3: Catalytic financing efficiently disbursed to support the incubation and implementation of local solutions
3-5 year metrics:• Total value of funds provided disaggregated by source
Process Steps:• Finance local solutions
• Jalin provides financing in a timely manner
JALIN GOAL:Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to
improve essential maternal and newborn services reaching the poorest and most vulnerable
USAID Jalin Results Framework
• Multi-stakeholder actors demand and utilize MNH evidence;• Multi-stakeholder actors actively co-invest to improve MNH outcomes• GOI integrates MNH evidence into programming that targets the poorest and
most vulnerable; • GOI and private sector providers deliver quality MNH evidence-informed
programming that reaches the poorest and most vulnerable;
• Communication channels use MNH evidence and priorities to increase public awareness;
• Multi-stakeholder actors adopt and influence evidence-based system changes; • More Indonesians utilize MNH evidence-informed clinical and non-clinical
services
6 USAID JALIN MERLA PLAN, JUNE 4, 2018
MERLA APPROACH
Jalin’s MERLA approach is comprised of four core operating modalities.
1) Doing MNH differently. Whole of market approach characterized by co-creation that supports co-design of and co-investment in local solutions, and co-learning that informs adaptive programming to maximize impact and potential for scale.
2) Evidence Utilization. Link co-created solutions to evidence-based TOCs that are reviewed and revised by key national and subnational stakeholders that are informed by implementation, monitoring, and learning activities, and adapted as necessary.
3) Proving concepts. Local solutions that demonstrate a plausible causal relationship to the reduction in maternal mortality ratio (MMR) and newborn mortality rates (NMR).
4) Scale for impact. Proven concepts that have potential for scale and are be attractive to investors to ensure sustainable.
Figure 2: Jalin MERLA in Action
Jalin will use evidence to facilitate co-creation and partner engagement activities to define and update MNH priorities, design and implement locally-relevant solutions, and collect and analyze learning that contributes to a foundation of knowledge for ongoing innovative programming. Jalin will manage and share knowledge with partners as they implement catalytic solutions. Through this process, Jalin will achieve its Expected Results: 1) manage partnerships which generate, implement, evaluate, and scale successful local solutions and utilize critical evidence to result in sustainable MNH impact, which has two sub-components; 2) deploy effective technical assistance to support impact at scale, and 3) to disburse catalytic financing efficiently.
In alignment with the USAID/Indonesia Country Development Cooperation Strategy 2014–2019, the MERLA Plan integrates collaborating, learning, and adapting mechanisms and an innovative co-creation methodology to monitor and evaluate Jalin’s progress and performance, align evidence generation with intentional learning, and scale promising local solutions. The Plan serves as a KM framework for the utilization of evidence collected from Project activities – such as the Evidence Summit, Every Mother and Newborn Counts (EMNC) survey, co-creation activities, implementation of local solutions – to re-evaluate and refine whole of market approaches to reduce maternal and newborn mortality in Indonesia.
METHODS FOR UNDERSTANDING THE EFFECTIVENESS OF PROJECT MANAGEMENT
USAID’s commitment to a co-creative whole of market approach requires that Jalin adopt a “fixed” and “variable” management structure to accommodate what the Project can reasonably control as fixed activities – collecting and synthesizing evidence to support co-creation of local solutions, for
Doing MNH Differently
Evidence Utilization
Defining Critical
Pathways
Proving Concepts
Demonstrating impacts on
maternal and newborn mortality
Scale for Impact
Leverage and replicate success.
USAID JALIN MERLA PLAN, JUNE 4, 2018 7
example – yet remain ready to respond to opportunities that emerge through co-creation activities or targeted partnerships.
Jalin will conduct activities to address the seven outcomes listed under the heading in the Results Framework titled ‘Behaviors and Processes to Evolve Across 3-5 years’ and the metrics and processes listed in the components. Jalin will describe progress towards these outcomes in routine reporting which addresses the effectiveness of Jalin’s implementation and management. Note that Year 1 MERLA Plan indicator targets are exclusively focused on “fixed,” or known activities.
EVALUATING PLAUSIBLE MNH IMPACT OF LOCAL SOLUTIONS
The “variable” approach refers to managing, measuring, and communicating activities associated with the whole of market and targeted partnerships that implement MNH solutions and conduct advocacy campaigns. At this time, the partners, objectives, and metrics of these activities are unknown and will be elucidated later in Year 1 (described in further detail below within our approaches to addressing systemic change) and included, as appropriate, in the Year 2 MERLA Plan. Indicators associated with these “variable” activities will be designed to evaluate if solutions are leading to the achievement of results in the six Technical Focus Areas and the abovementioned four core operating modalities.
Jalin will engage key stakeholders to assess the assumptions of proposed local MNH interventions that may vary from province to province and between urban and rural areas, thus allowing for areas of inquiry through research and adaptation through implementation. The development of solution-specific TOC may include discussions with beneficiaries and key stakeholders, and reviews of research evidence supporting the TOC.1
Jalin will ensure that solution-specific TOCs clearly to improved MNH. Solution-specific assumptions must inform TOCs that reflect what is locally feasible given a range of externalities including existing human resources, infrastructure (health and otherwise), and other barriers and facilitating factors that may contribute to success. While the solution-specific TOCs outlined below describe a number of components, USAID Jalin will not require the multistakeholder partners to develop all components of the solution-specific TOCs in advance of implementation.
Jalin will use the following checklist to assess their plausible causal pathways to scale and sustainability:2
1) Is the TOC approach defined? a) Is a definition of TOC given by the authors? b) Do the authors explain their reasons for using this approach?
2) Is the TOC development process described? 3) Are the methods used to develop the solution-specific TOC, such as stakeholder meetings
and interviews, document reviews, program observation, existing conceptual frameworks or published research, described?
4) Where stakeholders are involved, is it clear how many stakeholders participated, what their role is in relation to the intervention, how they were consulted (e.g. number of interviews, focus groups, TOC workshops) and the extent to which the consultations were participatory?
5) Is the method used to compile the data into a TOC described? (including how disagreements between stakeholders were resolved)
USAID JALIN MERLA PLAN, JUNE 4, 2018 8
6) Is the extent to which stakeholders were able to validate the resultant solution-specific TOC and were owners of the final product described?
7) Does the resultant solution-specific TOC (or a summary thereof) include: a) The long-term outcome or impact of the intervention; b) The anticipated short and medium-term outcomes and the process of change; c) The intervention components which happen at different stages of the pathway; d) The context of the intervention; e) Assumptions about how change would occur; and f) Additional TOC elements such as indicators, supporting research evidence,
beneficiaries, actors in the context, sphere of influence, sustainability, and timelines where relevant?
8) Is the process of intervention development from the solution-specific TOC described? a) Are the methods of how interventions were refined from the solution-specific TOC to
something which can be implemented described? (For example, further stakeholder workshops, interviews, systematic literature reviews)
9) Is the way in which the solution-specific TOC was used to develop and implement the evaluation described? a) Are evaluation research questions generated from the solution-specific TOC? b) Is the role of solution-specific TOC in the design, plan or conduct of the evaluation
clear? c) Do the supporting documents describe the extent to which the key elements described
in the solution-specific TOC were measured in the evaluation (i.e. impact, short and medium-term outcomes and the process of change, context, assumptions and the intervention)?
d) Do the supporting document describe whether and how process indicators were used to improve the quality of the intervention?
e) Is the role of the solution-specific TOC in the analysis of the results of the evaluation clear?
f) Is the role of solution-specific TOC in the interpretation of the results of the evaluation described (including the breakdown of the program theory, unanticipated outcomes and the strength and direction of causal relationships)?
APPROACH TO ASSESSING SYSTEMIC CHANGE
The GOI, notably the Ministry of Health and National Development Planning Agency, has included MNH in their five-year development goals reflecting their commitment to the Millennium Development Goals and the SDGs. In 2013, the Akademi Ilmu Pengetahuan Indonesia (Indonesian Academy of Sciences, AIPI) and the United States National Academy of Sciences evaluated the quality and consistency of data in order to inform policy.3 This has since been followed up with the USAID-funded Evidence Summit which identified priorities for maternal and newborn health and research gaps.4 While the evidence base is limited, the priorities, gaps, and recommendations can be linked to the Pathway to Survival conceptual framework.5 USAID Jalin will tie its advocacy of solutions to the public and private sectors to nationally identified and policies and priorities and link the findings from this project to the Pathway to Survival so that it can be linked to systems-level impact. Each activity of USAID Jalin will be assessed through the MERLA processes described in the following sections to determine if it is in line with national objectives and if it is leading or has potential to lead to systems-level impact with additional advocacy. When appropriate, Jalin may assist in the development of return-on-investment analyses that could be used to demonstrate value to private sector providers that may be more responsive to different incentives.
USAID JALIN MERLA PLAN, JUNE 4, 2018 9
Though not explicitly a year-one MERLA activity, Jalin will review methodologies to assess and integrate the findings from the broad range of solutions expected to be implemented so that they can be categorized and prioritized for their potential impact on maternal and newborn health, if scaled. Jalin will present options for methodologies to USAID during the Project Year 2 period.
MERLA IMPLEMENTATION
PLANNING, MANAGING, AND DOCUMENTING HOW PERFORMANCE DATA IS COLLECTED AND USED IN ONGOING ACTIVITY MANAGEMENT
Led by the MERLA Director, Evidence Utilization Specialist, Knowledge Management Specialist, EMNC Specialist, and Monitoring and Evaluation (M&E) Specialist, Jalin will plan for, monitor, evaluate, research, learn, and adapt according to Project performance, including local solutions, to ensure that evidence is gathered, analyzed, and used to inform strategies, approaches, partnerships, and activities that contribute to plausible pathways to improved MNH, scalability of local solutions and sustainability of program impact.
MONITORING
Monitoring is essential for developing the evidence base for the expansive group of stakeholders that Jalin intends to work with. Using data on planning, design, service delivery, outputs, and, when possible, outcomes, Jalin will synthesize metrics and milestones to understand and report on progress at the national and subnational levels.
The performance indicators (and associated PIRS) presented in Annex I and 2 will be used to assess performance, and will include geospatial data, as appropriate. The M&E Specialist will be responsible for ensuring data is complete, accurate, and relevant, and is collected and stored securely. To do so, s/he will develop standardized data collection tools and detailed guidelines to ensure that all Jalin staff and partners understand and know how to use them. The M&E Specialist will conduct regular field visits and training sessions on a range of data quality assurance approaches and tools including, but not limited to:
In-person, paper-based, and electronic feedback forms (using tools such as SurveyMonkey) to directly engage key informants;
Standardized data collection forms to record observations will be developed and used; Standardized meeting and field-visit report forms will be developed; and
All Project data will be stored in Jalin’s Technical and Administrative Management Information System (TAMIS), a proven cost-effective online management information system that supports real-time collection and analysis of data that informs management decisions, collaboration, planning, reporting and communication. Once data is entered into TAMIS, the system automatically produces standardized summary views helping staff monitor progress. Importantly, TAMIS helps mitigate remote management challenges by allowing users in dispersed geographic locations to share data efficiently and transparently.
MNH is equally affected by the quality of health systems-related clinical care and socio-cultural factors. Economic prosperity, gender roles and women’s empowerment, human rights, and community mobilization are also extremely important causal elements.6 Recognizing this, Jalin will collect data on more distal contributing factors to provide a clearer picture of the MNH context,
USAID JALIN MERLA PLAN, JUNE 4, 2018 10
writ large, in Indonesia. To do this, Jalin will work closely with USAID and Social Impact to design Complexity-Aware monitoring approaches that will help collect quality contextual data.
EVALUATION
Effective monitoring and analysis will help Jalin evaluate the relevance, effectiveness, efficiency, and sustainability of activities. Below is an illustrative list of evaluation questions that will be informed and updated by consultation with USAID, the GOI, and other partners.
Relevance: To what extent are Jalin’s objectives and methods still appropriate to the improvement of maternal and newborn outcomes?
Effectiveness: What are the major factors that have contributed to or prevented progress to date?
Efficiency: Are project resources being used efficiently or could the same results have been achieved with fewer resources or alternative approaches?
Sustainability: To what extent is the program bringing about sustainable changes? To what extent are the approaches being integrated into GOI systems, and/or have government buy-in to continue their operation beyond the life of the program? What are the key risks longer-term sustainability and what can be done to reduce these risks over the remainder of the program?
RESEARCH
While indicators and milestones will measure progress of activities against intended outputs and outcomes they will not, in the main, be as effective in revealing challenges to improving MNH and therefore in identifying opportunities for local solutions. For the latter, targeted research will be more useful. Indeed, USAID-supported programming that preceded Jalin, has already identified important evidence gaps that will inform Jalin’s research agenda.4 Additionally, needs and priorities will emerge during Jalin implementation that will inform complementary research topics for which the Project will develop and support specific research methodologies.4
Under the leadership of the MERLA Director, Jalin will work with institutes of higher education, research institutes, and experts to design and conduct studies on priority MNH topics. Jalin will also identify and work with a pool of MNH experts from which it can draw from for short-term technical expertise. Jalin’s Evidence Utilization Specialist will be responsible for establishing and keeping the pool of experts interacting creatively to ensure that they benefit from each other, are informed by evidence communicated by Jalin, and contribute, as appropriate, to co-creation activities and local solutions. S/he will also oversee all Jalin-supported research, manage technical assistance for research, as needed, and work closely with the Communication Specialist to disseminate findings to a broad audience, including Jalin staff and partners implementing local solutions. Jalin’s Communication Plan has identified activities and tools to reach its key audience through research findings when appropriate.
Jalin has a contractual obligation to publish six (6) peer-reviewed articles during the life of the Project. It is important to note that Jalin will upload all Project-related documents to the Development Experience Clearinghouse upon USAID written approval It is also important to note that Jalin will follow the highest ethical standards vis-à-vis all data collection, storage, and reporting including, but not limited to, obtaining clearance from U.S.-based and Indonesian ethical review boards, and informed consent from study participants
USAID JALIN MERLA PLAN, JUNE 4, 2018 11
LEARNING AND ADAPTING
Strategic collaboration, learning, and adaptive management link together all components of Jalin to maximize achievement of expected results.7 Jalin’s learning agenda includes a set of questions consistent with the Project’s Results Framework that address critical knowledge gaps that impede informed management decisions and therefore help to 1) ensure relevance of the Project’s TOC and Results Framework, 2) foster adaptation of activities as evidence emerges, 3) identify and focus on solutions that contribute to short- and long-term priorities.
How can Jalin engage and influence multistakeholder actors to adopt evidence to create MNH change in Indonesia?
How can Jalin better synthesize and share evidence to strengthen the MNH Movement?
Jalin will use co-creation and learning from partnerships, solutions, and advocacy efforts to answer these questions and will work with local stakeholders, specifically KM partners, to package and disseminate findings appropriately to reach target audiences. In other words, Jalin will design learning approaches to ensure that knowledge gained is knowledge used to improve programming continuously, maximize and accelerate uptake, and achieve desired outcomes.
Through frequent consultation with key project partners, Jalin will better understand their evidence needs and points and therefore be able to synthesize and share research, MERLA and other data that is relevant to them. In this way Jalin will make evidence accessible and informative to the whole of market through standard reporting, infographics, slide decks, other project materials, and advocacy campaigns. USAID guidance and best practice recommends the following learning agenda:8,9
1) Set the context by asking stakeholders “how does Jalin fit into the bigger picture?”; 2) Review/clarify the TOC; 3) Develop and prioritize learning questions; 4) Plan for and implement learning activities; 5) Facilitate studies and analyses; and 6) Act on findings and share evidence.
Jalin will use the following methods, as appropriate, to implement the learning agenda and facilitate an environment for adaptive management:10-12
Conduct situational analyses of the national and subnational implementation context; Work with KM partners to conduct internal and partner group discussion sessions
focusing on solutions and lessons learned; Review performance data from local partnerships and solutions and incorporate regular
feedback loops with key stakeholders before, during, and after implementation; Conduct literature reviews relevant to local solutions; Conduct performance and impact evaluations; Share knowledge with national and subnational institutions and experts [e.g. GOI,
Multistakeholder Advisory Body (MAB), KM partners, World Bank, other USAID MNH partners – Maternal and Child Survival Project, Health Finance and Governance project];
Convene regular staff meetings to review activities and identify points of success, failure, barriers, and facilitation; and
Design and implement Complexity-Aware monitoring approaches and tools to better understand causal linkages between inputs and outcomes.
USAID JALIN MERLA PLAN, JUNE 4, 2018 12
The table below provides an illustrative set of questions associated with specific Jalin activities the answers to which will inform adaptive management.
Table 1: Illustrative Questions for Activities and Learning
Activity Number
Activity Illustrative Learning Questions
NA Cross-cutting and systemic change questions
Are actors within the system changing their mindset about use of evidence? What groups does this occur for? Are actors in the system taking on new roles? If so, how are their roles changing? Why are actors taking up new roles? What can we learn from their motivations? Are there lessons for how we might incentivize or work with others to take on new roles? Are actors within the system leading more effectively on communicating evidence? How is the flow of information changing? How is the communication and/or are interactions of actors changing? Is there a presence of new or unexpected relationships? How are these forming? Are actors in the system adopting, replicating, or taking ownership of co-created solutions? Are actors within the system incorporating co-creation into their own work? What groups does this occur for? Are actors in the system taking on new roles? If so, how are their roles changing? Why are actors taking up new roles? What can we learn from their motivations? Are there lessons for how we might incentivize or work with others to take on new roles? Are actors within the system leading on the implementation of solutions? Is the flow of financial resources changing? How is the flow of information changing? Are actors organizing into new networks or teams? What are these networks and teams doing? Is there a presence of new or unexpected relationships? How are these forming? What strategies are most successful at influencing mindsets about evidence and co-creation? What patterns can be observed across groups? What can we learn about why strategies resonate with some groups but not others? What combination of learning, experiencing, and practicing is most effective? What is strengthening the connections between some actors and not others? Is there a shift in their perceptions, incentives, or something else entirely? How can this observation be used to strengthen other relationships? What aspects of the system enable the diffusion of practices? What aspects of the system impede the diffusion of practices? What is stimulating changes in financial flows? How does this feed into changes in other parts of the system? How can changes in financial flows be further incentivized? Where does the momentum for institutional change come from? Is evidence and learning being shared across the system?
1.1.1 Conduct Every Mother and Newborn Counts Across Select Districts
What is maternal and newborn mortality in select districts? How can mortality be effectively and efficiently measured to generate evidence to guide solutions?
1.1.2 Build knowledge management capacity for MNH with knowledge management partners
How are knowledge management partners engaging with the evidence to share with other stakeholders? How are stakeholders engaging with knowledge management partners to guide evidence generation, packaging, and dissemination? How can Jalin foster KM leadership and capacity of knowledge management partners as part of the MNH Movement?
1.1.3. Synthesize evidence relevant to MNH from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, Indonesian government, etc.) and global sources
How can evidence be efficiently and effectively synthesized? What does the evidence indicate to guide solution development and prioritization? What gaps remain in the evidence? How can Jalin foster addressing evidence gaps? How can evidence be packaged and disseminated to be compelling for stakeholders to understand and take action?
1.2.1. Engage influential multistakeholder actors
Who are influential MNH actors? Are potential influential stakeholders not yet engaged? How can Jalin engage stakeholders? What compels stakeholders to take and sustain MNH actions?
1.2.2. Define problem statements for co-creation efforts
What is the key evidence (see 1.1.3) to guide problem definition? Who should be involved in problem definition? What is the appropriate balance between national and sub-national problem definition? How can Jalin streamline and scale problem definition?
1.2.3. Deploy co-creation approaches to develop evidence-driven solutions and advocacy
What co-creation approaches are most effective to guide evidence-driven solutions and advocacy? What’s the right approach to introduce co-creation? Are there differences in co-creation to foster solutions vs advocacy? (NB informed by 1.2.1 and 1.2.2)
1.2.4 Prioritize partnerships, solutions, advocacy for impact
Are Jalin’s prioritization criteria effective?
USAID JALIN MERLA PLAN, JUNE 4, 2018 13
Activity Number
Activity Illustrative Learning Questions
1.2.5 Build local capacity to use a facilitative/co-creation approach
How can Jalin increase not only multistakeholder actors involved in, but leading co-creation?
1.2.6 Monitor and learn from local partnerships, solutions, and advocacy
How do mini-MERLAs generate evidence? How can Jalin foster and share evidence across stakeholders, partnerships, and solutions to further the MNH Movement?
2.1 and 2.2
Provision of specialized TA for local solutions; and Provision of responsive TA to the GOI
Is Jalin TA fit to purpose? What types of TA are more effective? What types of TA are in higher demand?
2.3 Monitor TA with feedback survey
Has Jalin TA resulted in changes for partnerships, solutions, and advocacy efforts, how?
3.1 Finance local solutions What types of local solutions garner more investment? Does initial Jalin catalytic investment drive uptake or further investment?
3.2 Jalin provides financing in a timely manner
How can Jalin provide clear guidance to local partners to streamline reporting and accountability? Are there internal processes Jalin can change to facilitate timely payment?
COMPLEXITY-AWARE MONITORING
Jalin will work closely with USAID and Social Impact to develop Complexity-Aware monitoring approaches and tools to measure non-linear, difficult to quantify activity outcomes to inform programming, and better understand systems change.13 Complexity-Aware methodologies are grounded in iterative analysis of multiple qualitative and quantitative data points that help deconstruct causal input-outcome relationships in what USAID calls simple, complicated, chaotic, and complex situations. Jalin will support activities within all four categories and will use Complexity-Aware monitoring tools accordingly, including:13
1) Sentinel Indicators†; 2) Stakeholder Feedback; 3) Process Monitoring of Impacts; 4) Most Significant Change; and 5) Outcome Harvesting.
The table below identifies activities as linked to key results from the Jalin Results Framework where causal linkages are less linear, or a single methodology or measurement is inadequate and therefore requires Complexity-Aware monitoring.
† Sentinel indicators could serve as proxy indicators that communicate the “essence of the process of change affecting a broad area of interest and
which is also easily communicated”. Unfortunately, this indicator does not provide complete information and basing a judgement of progress on a sentinel indicator may lead to inaccurate conclusions.
USAID JALIN MERLA PLAN, JUNE 4, 2018 14
Table 2: Activities, Results, and Challenges to Linear Causality
Activity Result Challenges to Linear Causality Activity 1.1.2 Build knowledge management capacity for MNH with knowledge management partners
Activity 1.1.3 Synthesize evidence relevant to MNH from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, GOI, etc.) and global sources
Activity 1.2.2 Define problem statements for co-creation efforts
Activity 1.2.3 Deploy co-creation approaches to develop evidence-driven solutions and advocacy
Multistakeholder actors demand and utilize MNH evidence;
Due to the diversity of actors, and to date limited understanding of how evidence is demanded and utilized, Complexity-Aware methodologies are relevant. E.g. how are MOHA authorities at local levels demanding and using evidence; how are traditional providers e.g. IBI (the midwife association) demanding and utilizing evidence, and how is the private sector (EY investments in health for example) demanding and utilizing evidence.
Activity 3.1 Finance local solutions
Multistakeholder actors actively co-invest to improve MNH outcomes
Due to the diversity of the types of partnerships and potential investments (e.g. direct investment from MOHA; access to credit or other financial facility; direct investment by foundations or the private sector in partnership solutions; or changes in BPJS policies increasing resources for services) this outcome is not linear, or easily quantified by a single indicator or measurement methodology.
Evidence generation, synthesis, and use across the activities below.
Activity 1.1.1 Conduct Every Mother and Newborn Counts Across Select Districts
Activity 1.1.2 Build knowledge management capacity for MNH with knowledge management partners
Activity 1.1.3 Synthesize evidence relevant to MNH from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, GOI, etc.) and global sources
Activity 1.2.2 Define problem statements for co-creation efforts
Activity 1.2.3 Deploy co-creation approaches to develop evidence-driven solutions and advocacy
Activity 1.2.4 Prioritize partnerships, solutions, advocacy for impact
Indonesia integrates MNH evidence into programming that targets the poorest and most vulnerable. Multistakeholder actors adopt and influence evidence-based system changes. More Indonesians utilize MNH evidence-informed clinical and non-clinical services
Opportunities for integrating MNH evidence are not limited to a single type of actor or solution. Therefore, it is important to capture how MNH evidence is generated and applied from activities like the EMNC as well as other knowledge management and evidence synthesis efforts. This evidence integration could take the form of policy changes, partnership investments, etc.
Jalin will collect and enter into TAMIS all Complexity-Aware data gathered throughout the life of the Project to ensure that it contributes to and complements more traditional M&E analysis presented in Quarterly and Annual Reports, presentations, and other communication outlets.
USAID JALIN MERLA PLAN, JUNE 4, 2018 15
Jalin understands that new evidence-based knowledge gained from Jalin-supported activities and those of other sources (e.g. The Health Finance and Governance Project, World Bank programming, and GOI datasets) may require revision or adaptation of the Complexity-Aware approach. As noted above, Jain will work with USAID and Social Impact to ensure that regular review and revision of approaches is responsive to new learning.
THE DEVELOPMENTAL EVALUATION
Jalin is committed to working closely with and supporting, to the extent appropriate, Social Impact as it implements the Developmental Evaluation of USAID Jalin Project in Indonesia. While the nuances of this working relationship will be determined in the second quarter of 2018 (and assessed and adapted regularly), Jalin understands that it remains responsible for all MERLA-related activities. Jalin also understands and embraces the opportunity to learn from the Developmental Evaluation as it assesses Jalin’s MERLA approach and activities, identifies opportunities for improvement, and collaborates and learns with Jalin to ensure positive MNH outcomes.
INTENTIONAL CONTEMPLATION
Jalin will schedule routine points for pause and reflection, allowing for the program team to review project goals, reassess challenges facing the project, and barriers and facilitators to change. Using Jalin’s if/then statement from the TOC and the Results Framework as a guide, the Jalin team will document learning to identify potential refinements and adjustments. For changes, the MERLA team will provide memos to the file and to the appropriate unit within Jalin to provide the background for the course correction, the agreed-to action based on evidence, timelines for the changes, and expected results.
Jalin will identify and create opportunities for pause and reflections internally as well as with partners throughout the course of the project. For example, internal after-action reviews related to major events and activities as well as Jalin annual meetings with USAID/Indonesia to pause and reflect, with the intention of course correction if required.
TRACKING INPUTS AND OUTPUTS OF ACTIVITIES AND ACHIEVEMENT OF OUTCOMES OVER THE LIFE OF THE CONTRACT
Jalin MERLA approaches require regular assessment of successes and challenges that reveal relevant and actionable opportunities for improving all aspects of Project management, including support to local solutions. The MERLA Director is responsible for ensuring the quality, utility, documentation, and shared learning of assessments – such as data analysis, document reviews, field visits, and discussions – that may direct Jalin to:16
Focus on opportunities that require smaller investments but may lead to greater impact;
Ensure that Jalin or partner staff are held accountable for action items and activities; End non- or low-performing investments; and
Recognize successes (and failures), effective partnerships, or compelling advocacy.
FACILITATING THE FLOW OF INFORMATION WITHIN JALIN
USAID JALIN MERLA PLAN, JUNE 4, 2018 16
Through frequent consultation, Jalin will identify areas of particular interest to key project stakeholders to ensure that we synthesize data from M&E and research relevant to them. As Jalin aims to use its knowledge to feed into the Indonesian MNH Movement, the M&E and research data must be accessible and informative to a wide audience, ranging from academics, government staff, the media, and the population at large. To do this there must also be clear communication within the Jalin team as well to be sure all members of staff have access to and understanding of the data in order to use and share it appropriately.
The MERLA Director will have overall responsibility for sharing information on a routine basis both within the Jalin team and to external stakeholders. Following consultation with Jalin senior staff, the MERLA Director will consider the following sharing mechanisms:
Email groups for sharing specific information; Using the Microsoft Teams platform to create discussion groups; Holding routine meetings to share findings and elicit feedback; and Other methods as appropriate.
The Evidence Utilization Specialist and the Knowledge Management Specialist will each have the responsibility to consider the above-mentioned and other tools to share information internal to the project and externally to other partners. In addition, the MERLA team will connect through other technical and administrative teams in Jalin to expand dissemination of information.
COMMUNICATING LEARNING
The communication of learning will be informed by the KM Strategy and Communications Strategy documents that are still in process and being informed by to-be-completed Evidence Summit Assessment and Scoping activity that was conducted in collaboration with USAID/Washington. Jalin will use the KM Strategy and Communication/Dissemination Plan to provide the guidelines for internal and external learning activities.
DATA QUALITY
The MERLA Director will conduct monthly reviews of all M&E data to ensure completeness, accuracy, and relevance to Jalin and local solutions goals and objectives. The Director will also conduct spot-checks remotely via phone or Skype, and in situ during field visits to Jalin Regional Offices, and partner offices and events. For spot-checks, data collected for specific, pre-determined indicators (and the documents supporting the data) will be thoroughly reviewed using tailored assessment tools. Findings from the monthly reviews and spot-checks will be consolidated and reported to ensure it informs management decisions. Note that all salient data quality review results will also be included and regular reporting to USAID, Social Impact, and others, as appropriate.
Jalin will also support an external Data Quality Assessment as directed by USAID. However, it is DAI Global, LLC (DAI) best practice to secure the services of an M&E expert through the Home Office to conduct a comprehensive review of all data management policies, processes, and activities no later than the end of Project Year 2. Jalin therefore plans to and has budgeted for this assistance to take place during the first half of 2019. The process for this DAI-led review is presented below.
USAID JALIN MERLA PLAN, JUNE 4, 2018 17
Note that data quality procedures and more details on data collection will be included in the Data Management Plan.
Table 3: DQA Processes
DQA Process Steps Actions 1. Prepare the DQA team.
Identify members of Jalin staff that will conduct field-level DQAs; Train staff for collecting data using standard forms;
2. Develop the approach and schedule
Prepare the calendar for DQAs;
The MERLA Director and MERLA Specialist will provide guidance on the objectives and process to those involved in DQAs;
3. Identify the indicators to be included in the review
Conduct DQAs on all core indicators for USAID;
Conduct DQAs on indicators with suspected issues;
Conduct DQAs on indicators for important areas;
4. Categorize indicators
Categorize indicators into outcome and output indicators and develop DQA tools that assess the data collection systems for both;
5. Conduct staff meetings to review DQAs
The MERLA Director and the MERLA Specialist will explain the purpose and process for conducting the DQA, explain the standards for each indicator, and identify issues that require follow-up or special attention;
6. Schedule DQA sessions with implementing partners
Have discussions with local partners on the DQA process and collect information from them on the data and potential issues;
7. Complete the DQA checklist for each indicator
To what extent does the data collected meet the standards of: o Validity o Integrity o Precision o Reliability o Timeliness
Does data collection process align with indicator definition(s)?
Is data appropriately transferred from the field to first level of aggregation, second level and so forth?
Does a random sample of data collected centrally align with that found in the field office?
8. Debrief on main findings to implementing partner office
Clarify any outstanding issues
Provide initial verbal report back on key findings of DQA
9. Write up DQA report, recommendations and action points for improvement
Identify all areas that need attention
Make clear and actionable recommendations
Agree a timeline with implementing partner for implementation of recommendations
USAID JALIN MERLA PLAN, JUNE 4, 2018 18
REPORTING
However, the two reports below delineate two ways we will regularly consolidate and report on data collected from project activities:
Jalin will report regularly to USAID, the GOI and others, as appropriate to ensure learning associated with progress towards supporting the MNH Movement, national or subnational systems change, new evidence generated and synthesized, effective partnerships, and promising local solutions.
Quarterly Reports document progress against the Work Plan and performance indicators. Staff contributions to Quarterly Reports will be sent to the MERLA Director two weeks after the end of each quarter.
Annual Reports review the Project’s yearly progress and highlight achievements, summarizing the information already captured in Quarterly Reports, including measurement of progress against Work Plan activities and performance indicator targets, as well as lessons learned and best practices identified. Staff contributions to Quarterly Reports will be sent to the MERLA Director two weeks after the end of the Work Plan year.
All Jalin reports submitted to USAID will be in accordance with contract requirements, adhere to Jalin’s Branding Implementation and Marking Plan, and will contain at a minimum:
1) Summary of progress on activities against deliverables and/or completion thereof, (with specific mention of gender-related results, if possible);
2) Performance indicator results; 3) Activity location data (submitted twice annually as part of 2nd Quarterly Progress Report
and the Annual Progress Report); 4) The status of resolving problems described in previous report; 5) New problems encountered since previous report; 6) Any other developments or events which have the potential to significantly affect the
performance or progress toward targets; 7) Proposed solutions to outstanding and new problems; 8) Plans for the next quarter, including international travel plan in accordance with USAID
Acquisition Regulation 752.7032; 9) Success stories to highlight Jalin’s impact; 10) At least 15 high-resolution photos that visually convey the story of the project’s activities
and impact; and 11) A copy of publications and media produced over the quarter including papers, studies,
reports, marketing materials and information products used to showcase the project’s work (fact sheets, videos, info graphics, etc.) and any other note-worthy materials developed with Jalin.
USAID JALIN MERLA PLAN, JUNE 4, 2018 19
MERLA ACTIVITIES PLANNED FOR YEAR 1
Key cross-cutting MERLA processes for Year 1 will focus on developing data collection, evidence synthesis, KM, and internal and external learning systems. Planned activities fall largely under Component 1.1: MNH Evidence Compellingly Communicated and Component 1.2: Constructive and inclusive partnerships, solutions, and advocacy developed.
INDICATORS AND TARGETS
A detailed description of indicators determined in collaboration with USAID and derived from the Results Framework are listed in Appendix 1. Specific disaggregation (including sex) and baseline estimates (if available), and quarterly, annual, and life-of-Program targets for each indicator are presented in the IPTT. Jalin understands that these targets will very likely change as the Project implements and learns from research and local solutions. Noe that because co-creation processes that will determine details of local solutions have not been conducted to date, associated indicators and targets are not yet included in this Plan. As soon as local solutions have been designed and approved by USAID, Jalin will update the Results Framework and IPTT.
LIMITATIONS OF DATA
This MERLA Plan is intended to ensure that data collected informs the development of national and subnational Jalin-supported activities, notably local solutions. However, indicator data may not fully reflect the diversity of approaches and activities that contribute to improved MNH. While Jalin activities will be designed to support evidence-based design, implementation, and monitoring of local solutions that, if scaled and sustained, may plausibly reduce mortality, Jalin cannot predict which combination of partnerships and activities, whether Jalin-supported or not, will result in positive MNH outcomes. Attribution of impact will be a MERLA and reporting challenge throughout implementation and therefore Jalin will work closely with USAID and Social Impact to design and adapt MERLA approaches and tools to ensure accurate attribution data is collected and informs transparent reporting to all stakeholders.
Table 4: Key MERLA Activities
Activity Output 2018 Timeline Finalize MERLA Plan Final and approved MERLA Plan April Finalize Data Management Plan Final and approved Data Management
Plan April
Develop data collection forms and organization of online and offline databases for MERLA using TAMIS and other tools
Data forms developed; databases developed
January–June
Develop and finalize data quality assessment tools Data quality assessment tools created June Draft a research plan with clearly identified research priorities guided by evidence.
Research plan developed July–September
Develop data-sharing agreement templates for Jalin and local partners to use
Data-sharing template created By end of May
Develop and implement a training program for Jalin staff to understand the overall JALIN MERLA Plan.
Training program developed Completed by mid-June
Develop plan for data sharing across Jalin working areas to facilitate communication and encourage adoption of best practices
Plan developed July–September
USAID JALIN MERLA PLAN, JUNE 4, 2018 20
APPENDICES
21 USAID JALIN MERLA PLAN, JUNE 4, 2018
APPENDIX 1. JALIN INDICATOR PERFORMANCE TRACKING TABLE
Jalin # USAID # Indicators Type Data Disaggregated Sources of data (BL; annually)
Baseline Year 1 Year 2 Year 3 Year 4 Year 5
Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn services reaching the poorest and most vulnerable
High Level (HL)-1
Maternal Mortality Ratio
Impact Age National Data Sources
HL-1.1 Maternal Mortality as reported in EMNC Studies
Impact Age and District EMNC Studies
HL- 2 Neonatal Mortality Rate
Impact Sex National Data Sources
HL-2.1 Neonatal Mortality as reported in the EMNC Studies
Impact Sex and District EMNC Studies
MNH Movement Takes Hold
Behaviors and Processes Evolve Across Health Systems
HL-3 STIR-11 Number of innovations supported through USG assistance with demonstrated uptake by the public and/or private sector
Outcome Sector; Technical Focus Area; Province
Program Documents
0 12
USAID JALIN MERLA PLAN, JUNE 4, 2018 22
Component 1: Partnership process managed to generate, implement, evaluate, and scale successful local solutions and utilize critical evidence to result in sustainable MNH impact
Component 1.1: MNH Evidence Available and Compellingly Communicated
1.1. STIR-12 Number of peer-reviewed scientific publications resulting from USG support to research and implementation programs
Outcome Journal Publication
0 2 2 1
Activity 1.1.1 Conduct EMNC activity across selected districts
1.1.1.a EMNC Activity conducted
Milestone Province, District Program Documents.
0 2.5 5 2
1.1.1.b EMNC results reported and communicated
Milestone Province, District, media type
Program Documents.
0 Yes Yes Yes Yes Yes
Activity 1.1.2 Build Knowledge Management capacity for MNH (knowledge management partners)
1.1.2.a Assessment of AIPI Evidence Summit
Milestone Assessment Report
Yes
1.1.2.b MNH KM Strategy in Place (updated every 24 months)
Milestone KM Strategy Yes
Activity 1.1.3 Synthesize MNH evidence from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, GOI, etc.)
1.1.3.a MNH evidence disseminated (Op Eds, peer-review articles submitted for publication, policy briefs published, evidence dissemination events held) (Note 1.1 is a subset of 1.1.3.a)
Output Publication or Event Type; Technical Focus Area; Province
Program Documents
0 8 12 12 12 12
USAID JALIN MERLA PLAN, JUNE 4, 2018 23
1.1.3.b Synthesize latest MNH Evidence from Evidence Summit, GOI evidence, Jalin lessons (see component 1.2); other USAID MNH partners. Goes into annual report and slide deck of Evidence Driven Communications Materials updated semi-annually.
Milestone Technical Focus Areas
Program Document
Yes Yes Yes Yes Yes
1.1.3.c MNH evidence slide deck available (updated semi-annually based on synthesis) for use in co-creation, design, and TA
Milestone Technical Focus Areas
Program Documents
Yes Yes Yes Yes Yes
Component 1.2: Constructive and inclusive partnerships, solutions, and advocacy developed
1.2 Partnerships implementing solutions or advocacy
Output District; Technical Focus Area Solution
Program Documents
0 12
USAID JALIN MERLA PLAN, JUNE 4, 2018 24
Activity 1.2.1 Engage influential multistakeholder actors for MNH through Partnership (includes MAB, targeted outreach, and identification of provincial participants for co-creation workshops).
1.2.1.a New multistakeholder actors engaged and participating in partnerships process
Output District, Sector represented (e.g. civil society, private or public sector, etc.); Individuals (by sex) vs Organizations/Entities
Program Documents
0 225 150 150 150 150
1.2.1.b Events and targeted outreach held to share evidence (Activity 1.1.3) and engage multistakeholder actors
Output Partnership Engagement Type (e.g. MAB, targeted outreach, provincial outreach), Sector represented (e.g. civil society, private or public sector, etc.), Individuals (by sex) vs Organizations/Entities
10 13 13 13 13
Activity 1.2.2 Define problem statements for co-creation efforts
1.2.2.a Problem statements defined
Milestone Province; Technical Focus Area
Program Documents
0 12 12 12 12
Activity 1.2.3 Deploy co-creation approaches to develop evidence-driven solutions and advocacy (inclusive of targeted partnerships as well as workshop model)
1.2.3.a Co-creation events held
Output Province Program Documents
0 8 10 10 10 5
1.2.3.b Co-creation design sessions via targeted partnerships and outreach
Output Technical Focus Area Program Documents
0 5 5 5 5 5
1.2.3.c Solutions or advocacy initiatives identified as a result of co-creation events or targeted outreach
Output Technical Focus Area; Province
Program Documents
0 5 5 5 5 5
USAID JALIN MERLA PLAN, JUNE 4, 2018 25
Activity 1.2.4 Prioritize partnerships, solutions, advocacy for impact
1.2.4.a STIR-10 (a and b)
Number of innovations (solutions) supported through USG assistance
Output Province; Technical Focus Area(s); New/Ongoing; Type of USG Support
Program Documents
6 12
1.2.4.b Partnerships receiving local funding beyond Jalin
Outcome Province; Technical Focus Area(s); Type of Organization Receiving Support; Type of Organization Providing Support (GOI, private Sector); Proportion of non-Jalin Support
Implementation Plans
12
1.2.4.c DR.4.2-2 Number of civil society organizations (CSOs) receiving USG assistance engaged in advocacy interventions
Output Province; Technical Focus Area(s);
Program Documents
4 6 6 6
Activity 1.2.5 Build local capacity to use a facilitative/co-creation approach
1.2.5.a MAB meetings held quarterly
Milestone Date of Event, Sex of Participants; Sector Represented
MAB Meeting Agenda and Minutes
4 4 4 4 3
Activity 1.2.6 Monitor and learn from local partnerships, solutions, and advocacy
1.2.6.a Partnerships implementing local solutions with Mini-MELAs** and Technical Assistance plans in place.
Output Geographic Zone (e.g. Province or District), and Technical Focus Area(s)
Implementation Plans
6 12 12 12 12
1.2.6.b Number of local solutions/innovations documented with a pathway for scale and sustainability.
Output Geographic Zone (e.g. Province or District), and Technical Focus Area(s)
Program Documents
0 4 8 12 8
USAID JALIN MERLA PLAN, JUNE 4, 2018 26
Activity 1.2.7 Package local solutions for adaptation/replication, investment, and scale (won’t start until year 2)
1.2.7.a Number of local solutions/innovations packaged with how-to guides, or mentoring plans to ease adaptation/replication and scale.
Output Geographic Zone (e.g. Province or District), and Technical Focus Area(s)
Program Documents
3 6 8 6
Component 2: TA deployed effectively to support impact at scale
Activity 2.1 Provision of specialized TA for local solutions; and Activity 2.2 Provision of responsive TA to the GOI
2.1.a; 2.2.a Number of technical assistance requests (from: partnership plans, grants, GOI support requests, etc.) fulfilled by Jalin
Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multistakeholder Type (Private Sector, GOI, CSO, etc.)
Program Documents
8 12 12 12 8
2.1.b; 2.2.b; USAID Health Leadership -1
Number of Universal Health Coverage (UHC) areas supported by USG investment
Output UHC Category (essential health services; quality; financial protection);
Program Documents
3 3 3 3 3
Activity 2.3 Monitor TA with feedback survey
2.3.a
Percentage of TA with positive feedback
Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multi-stakeholder Type (Private Sector, GOI, CSO, etc.)
Feedback Survey
85% 90% 90% 90% 90%
USAID JALIN MERLA PLAN, JUNE 4, 2018 27
Component 3: Catalytic financing efficiently disbursed to support the incubation and implementation of local solutions
3.1 Total value of USG GUC provided
Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multi-stakeholder Type (Private Sector, GOI, CSO, etc.)
Grant Agreements and Reports
Discuss with USAID
Activity 3.1 Jalin provides catalytic financing to local solutions in a timely manner
3.1.a Number of grants for catalytic financing provided
Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multi-stakeholder Type (Private Sector, GOI, CSO, etc.)
Grant Agreements and Reports
Discuss with USAID
Activity 3.2 Jalin funding is provided in a timely manner
3.2.a
Percentage of local solutions requiring GUC funding where funds disbursed in a timely manner
Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multi-stakeholder Type (Private Sector, GOI, CSO, etc.)
Grant Financial Monitoring
0 100% 100% 100% 100% 100%
28 USAID JALIN MERLA PLAN, JUNE 4, 2018
APPENDIX 2: PERFORMANCE INDICATOR REFERENCE SHEETS (PIRS)
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: HL-1 Maternal Mortality Ratio
Name of result measured: Jalin Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn health services reaching the poorest and most vulnerable.
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): The maternal mortality ratio is the number of maternal deaths per 100,000 live births.
Maternal death is the death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes.
Live birth refers to the complete expulsion or extraction from its mother of a product of conception, irrespective of the duration of the pregnancy, which, after such separation, breathes or shows any other evidence of life - e.g. beating of the heart, pulsation of the umbilical cord or definite movement of voluntary muscles - whether or not the umbilical cord has been cut or the placenta is attached. Each product of such a birth is considered live born.
Unit of Measure: Number
Disaggregated by: Age and parity, location (urban/rural, major regions/provinces), and socio-economic characteristics (e.g. education level, wealth quintile)
Rationale or Justification for indicator (optional): The goal of Jalin is contribute to national goals of reducing maternal and neonatal mortality in Indonesia. Reducing maternal mortality is also a Sustainable Development goal. This is a context indicator and Jalin will not be able to affect this indicator through implementation. .
PLAN FOR DATA COLLECTION
Data Source: Vital registration, health service records, household surveys, census. The data point will be the Maternal Mortality Ratio agreed to by the Ministry of Health.
Method of data collection and construction: Jalin will use national sources to determine this data.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): No data quality assessment specifically will be conducted for this indicator although Jalin will identify any data quality issues concerning national maternal mortality figures.
Known Data Limitations: This data is available at the national level and has very large confidence intervals.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
29 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: HL-1.1 Maternal Mortality as reported in EMNC Studies
Name of result measured: Jalin Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn health services reaching the poorest and most vulnerable.
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): The maternal mortality ratio is the number of maternal deaths per 100,000 live births.
Maternal death is the death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes.
Live birth refers to the complete expulsion or extraction from its mother of a product of conception, irrespective of the duration of the pregnancy, which, after such separation, breathes or shows any other evidence of life - e.g. beating of the heart, pulsation of the umbilical cord or definite movement of voluntary muscles - whether or not the umbilical cord has been cut or the placenta is attached. Each product of such a birth is considered live born.
The EMNC studies will complement national level data by providing evidence to construct causal pathways for maternal and newborn mortality in Indonesia and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale. The EMNC requires methods that provide: (i) the most complete enumeration possible of maternal and neonatal deaths in each study district; (ii) data for determination of the most likely causes of all identified cases of maternal death, and a sample of neonatal deaths, via verbal autopsy; (iii) data for development of causal pathways for maternal and neonatal mortality based on behavioral, social, and health-system factors as collected in a social autopsy.
Unit of Measure: Number
Disaggregated by: Province (district), age, cause of maternal death
Rationale or Justification for indicator (optional): Maternal mortality remains stubbornly high in Indonesia. This indicator will document causes of maternal death with greater accuracy than other studies, providing a basis for developing effective solutions.
PLAN FOR DATA COLLECTION
Data Source: EMNC study reports
Method of data collection and construction: The EMNC data will be collected through the verbal and social autopsies conducted in at least one district in each target province.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Every Mother and Newborn Counts Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: As the data collected will provide information on relative and not absolute determinants for mortality for one district per province, Jalin will have to ensure that data from the EMNC studies is synthesized appropriately to avoid misinterpretation or over generalization.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
30 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: HL-2 Neonatal Mortality Rate
Name of result measured: Jalin Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn health services reaching the poorest and most vulnerable
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): The neonatal mortality rate is the number of deaths during the first 28 completed days of life per 1,000 live births in a given year or period. Neonatal deaths may be subdivided into early neonatal deaths, occurring during the first seven days of life, and late neonatal deaths, occurring after the seventh day but before the 28 completed days of life.
Live birth refers to the complete expulsion or extraction from its mother of a product of conception, irrespective of the duration of the pregnancy, which, after such separation, breathes or shows any other evidence of life - e.g. beating of the heart, pulsation of the umbilical cord or definite movement of voluntary muscles - whether or not the umbilical cord has been cut or the placenta is attached. Each product of such a birth is considered live born.
Unit of Measure: Number
Disaggregated by: Cause of death
Rationale or Justification for indicator (optional): The goal of Jalin is contribute to national goals of reducing maternal and neonatal mortality in Indonesia. Reducing maternal mortality is also a Sustainable Development goal. This is a context indicator.
PLAN FOR DATA COLLECTION
Data Source: Vital registration, health service records, household surveys, census
Method of data collection and construction: Jalin will use national sources for this data. The data point will be the Neonatal Mortality Rate agreed to by the Ministry of Health.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): No data quality assessment specifically will be conducted although Jalin will identify any data quality issues concerning national neonatal mortality figures.
Known Data Limitations: This data is available at the national level and has very large confidence intervals.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 31
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: HL-2.1 Neonatal Mortality as reported in the EMNC Studies
Name of result measured: Jalin Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn health services reaching the poorest and most vulnerable.
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): The neonatal mortality rate is the number of deaths during the first 28 completed days of life per 1,000 live births in a given year or period. Neonatal deaths may be subdivided into early neonatal deaths, occurring during the first seven days of life, and late neonatal deaths, occurring after the seventh day but before the 28 completed days of life.
Live birth refers to the complete expulsion or extraction from its mother of a product of conception, irrespective of the duration of the pregnancy, which, after such separation, breathes or shows any other evidence of life - e.g. beating of the heart, pulsation of the umbilical cord or definite movement of voluntary muscles - whether or not the umbilical cord has been cut or the placenta is attached. Each product of such a birth is considered live born.
The EMNC studies will complement national level data by providing evidence to construct causal pathways for maternal and newborn mortality in Indonesia and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale. The EMNC requires methods that provide: (i) the most complete enumeration possible of maternal and neonatal deaths in each study district; (ii) data for determination of the most likely causes of all identified cases of maternal death, and a sample of neonatal deaths, via verbal autopsy; (iii) data for development of causal pathways for maternal and neonatal mortality based on behavioral, social, and health-system factors as collected in a social autopsy.
Unit of Measure: Number
Disaggregated by: Province (district), sex of mother, sex of newborn, cause of death
Rationale or Justification for indicator (optional): Neonatal mortality in Indonesia is unusually high for a middle-income country. This indicator will document causes of newborn death with greater accuracy than other studies, providing a basis for developing effective solutions.
PLAN FOR DATA COLLECTION
Data Source: EMNC study reports
Method of data collection and construction: The EMNC data will be collected through the verbal and social autopsies conducted in the target provinces.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Every Mother and Newborn Counts Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: As the data collected will provide information on relative and not absolute determinants for mortality for one district per province, Jalin will have to ensure that data from the EMNC studies is synthesized appropriately to avoid misinterpretation or overgeneralization.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
32 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet Number and Name of indicator: Jalin HL-3; STIR-11 Number of innovations (solutions)supported through USG assistance with demonstrated uptake by the public and/or private sector
Name of result measured: Behaviors and Processes Evolve Across Health Systems
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): This indicator counts the subset of innovations reported through Jalin 1.2.4.a that have demonstrated uptake at any point during the reporting period (including those whose uptake is ongoing). For the definition of ‘innovations supported through USG assistance’, please see the indicator reference sheet for Jalin 1.2.4.a. By using the results of Jalin HL-3 as the numerator and Jalin 1.2.4.a as the denominator (within but not across reporting periods), Jalin may calculate the percentage of innovations supported that have been adopted by the public and/or private sector.
• ‘Demonstrated uptake’ includes any support for, or adoption by, the public and/or private sectors at any point during the reporting period.
• The public sector includes: Non-Governmental Organizations, Higher Education Institutions, Recipient Country Governments (including any department, office, subdivision, or other entity within the national or sub-national government of the country where the innovation is supported), and other organizations that are part of the public sector but not included in the categories above.
• The private sector includes: Private organizations (including businesses and corporations; business, industry and trade associations; corporate foundations; social enterprises; financial institutions, investors, and impact investors), Private Philanthropy (including private foundations and philanthropists), and other organizations that are part of the private sector but not included in the categories above.
• Blended adoption includes uptake by both the public and private sectors. This could be simultaneous uptake by both, or separate uptake by each, during a reporting period.
• Examples of demonstrated uptake include:
o Procurement or other financial support provided through public, private, or public-private agreements (i.e. non-revenue monies from non-donor sources), including - but not limited to - private investments, grants, loans, funds, or government bonds
o Regulatory approval or incorporation/institutionalization into a host country government’s national or sub-national guidelines, policies, or other legal frameworks (e.g. Essential Medicines List, Patient Safety Framework)
o Market introduction (e.g. a product developed/supported by USAID is offered for sale, and providers trained, through the public or private sectors)
o Distribution or delivery of an innovation or service to an end-user via the public and/or private sectors, such as distribution by community health workers or agricultural extension agents
Unit of Measure: Number
Disaggregated by: Province, Sector (Public or Private) technical focus area
Rationale or Justification for indicator (optional): This indicator is a proxy for potential sustained demand for the solution beyond Jalin support and indicates potential for impact at scale.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a list of innovations all throughout the working areas.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Partnerships Director and Regional Teams
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
USAID JALIN MERLA PLAN, JUNE 4, 2018 33
Known Data Limitations:
Data for this indicator should not be cumulated over multiple years
As the indicator is purposefully defined broadly to ensure that the full range of uptake modalities can be captured, no assumptions should be made regarding comparability of the level or type of uptake across innovations, nor regarding the value or depth of support for, the public and/or private sectors for any innovation.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
34 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of indicator: Jalin 1.1; STIR 12 Number of peer-reviewed scientific publications resulting from USG support to research and implementation programs
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): This output indicator captures annually the number of scientific publications resulting from USAID support to research and implementation programs. This indicator is NOT cumulative and captures only new publications not reported previously.
‘Peer-reviewed publications’ are defined as and include: scientific studies published in technical journals which conduct technical peer review of the submissions as part of their decision process; technical reports that are subject to external peer-review and then disseminated; and peer-reviewed conference proceedings.
Unit of Measure: Number
Disaggregated by: N/A
Rationale or Justification for indicator (optional): The evidence made available through Jalin support will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will collaborate with the knowledge management partners and University of Indonesia to track and confirm all such publications and presentations
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example publication of the similar data in papers targeting the similar audiences, or in presentations to professional meetings.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 05/30/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 35
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.1.1.a EMNC Activity conducted
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise definitions:
The Every Mother and Newborn Counts activity has the potential to generate critical evidence across Jalin’s technical focus areas as well as contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality in Indonesia, and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale. The University of Indonesia will oversee all field level data collection efforts, analysis, and reporting. A detailed design document will be submitted to USAID for approval by the end of April 2018.
The EMNC activity refers to the verbal and social autopsies conducted for maternal and newborn deaths in selected districts. The EMNC activity will be considered to be conducted if the verbal and social autopsy has been completed, the data has been reviewed and cleaned, and the report has been drafted.
Unit of Measure: Number
Disaggregated by: Province (district)
Rationale or Justification for indicator (optional): Jalin intends to increase quality data and ensure its utilization in programming. The EMNC studies are one set of quality data that can be used.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file that covers the EMNC activity that will be updated routinely.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: The Every Mother and Newborn Counts Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: None anticipated.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 36
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.1.1.b EMNC results reported and communicated
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
The Every Mother and Newborn Counts activity has the potential to generate critical evidence across Jalin’s technical focus areas as well as contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality in Indonesia, and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale.
Once the data from the EMNC activity has been completed, Jalin will use the information for project activity purposes.
Reported is defined as the EMNC activity report is shared with either the national Ministry of Health or subnational units, other government bodies, at academic forums, or to other stakeholders.
Unit of Measure: Number
Disaggregated by: Classification of stakeholder, Province (district), format (report, presentation).
Rationale or Justification for indicator (optional): Jalin intends to increase quality data and ensure its utilization in programming. The EMNC studies are one set of quality data that can be used.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of the dissemination strategy for the EMNC study.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example similar reporting and communication activities might be attempted in multiple provinces.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 37
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.1.2.a Assessment of AIPI Evidence Summit
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Jalin will work to strengthen the knowledge management culture and capacity for maternal and newborn health in Indonesia, at the national and sub-national levels, building on the Evidence Summit and other recent activities. Jalin will build on the Evidence Summit and USAID’s investments with AIPI to support and strengthen AIPI as a national MNH knowledge management leader. In April and May, Jalin will conduct an Assessment and Scoping of AIPI. Following the assessment, ‘priority actions’ will be identified that will form the basis for the working relationship between Jalin and AIPI. This activity will be considered complete when the draft ‘priority actions’ are prepared and presented to the AIPI President, the head of the AIPI Medical Commission, or the Secretary General of AIPI.
Unit of Measure: This is a milestone and the Jalin Annual Report and he Assessment Report will form the basis for a “yes” response.
Disaggregated by: Not applicable
Rationale or Justification for indicator (optional): Successful completion of this exercise will feed into the Evidence Driven Slide Deck and strengthen the empirical foundation for partnerships and solutions.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a draft of the ‘priority actions’ and evidence that they have been communicated to the key stakeholders.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Knowledge Management Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 38
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.1.2.b MNH KM strategy in place
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
In April and May 2018, Jalin will facilitate an Assessment and Scoping of AIPI. At the end of this Assessment and Scoping, ‘priority actions’ will be identified that will serve as the basis for the knowledge management capacity development strategy. A key component of Jalin’s knowledge management strategy at the start of the project is facilitating the sharing of information through knowledge management partners.
The KM strategy will be the combination of the knowledge management partners capacity development strategy and plan and the plan and activities for other knowledge management-related disseminations that Jalin will facilitate. UASID Jalin will update the document every two years.
Unit of Measure: This is a milestone and the Jalin Annual Report and Knowledge Management Strategy will form the basis for a “yes” response.
Disaggregated by: N/A
Rationale or Justification for indicator (optional): The Knowledge Management Strategy is an important tool in support of Jalin’s work to strengthen knowledge management capacity and culture in Indonesia.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of innovations including project plans and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis. The KM plan will be updated every two years,
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Knowledge Management Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: None known at this time
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 05/30//2018
39 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.1.3.a MNH evidence disseminated
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): “Evidence” means the available body of facts or information indicating whether a belief or proposition is true or valid. The evidence will be related to MNH but does not have to be generated by Jalin itself.
“Disseminated” means that such information has been shared beyond USAID/Jalin (by Jalin or a Jalin partner at a Jalin-facilitated event) including but not limited to Government of Indonesia officials at all levels, public and private sector health facilities and their staffs, professional and academic institutions, civil society organizations from national to community level, the media, business enterprises, and the general public. Illustrative means of dissemination include peer-reviewed articles submitted for publication, policy briefs, public and private sector events and meetings, press releases, presentations in academic and professional settings, business roundtables, and civil society events.
Unit of Measure: Number
Disaggregated by: Type of publication or event, technical focus area, province
Rationale or Justification for indicator (optional): The evidence made available through this effort will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of all events, presentations and publications including date and time, location, audience, agenda, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example publication of the same data in papers targeting the same audience, or in presentations to professional meetings.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 40
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.1.3.b Latest MNH evidence synthesized
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): “Synthesis” refers to a report of the results of the included studies and should discuss the reasons for differences among studies such as methodological elements.18 Jalin will collect evidence (defined as the available body of facts or information indicating whether a belief or proposition is true or valid) from multiple sources, including: Every Mother and Newborn Counts and other Jalin supported data collection efforts; Government of Indonesia data; academic research; USAID MNH partner reporting; and other development partners. The synthesized evidence will be assessed against its fit to the Pathway to Survival, the Jalin Technical Focus Areas, and organized for the specific audience to whom the synthesized evidence will be shared.5
Unit of Measure: This is a milestone and the Jalin Annual Report and Evidence Driven Slide Deck will form the basis for a “yes” response.
Disaggregated by: N/A
Rationale or Justification for indicator (optional): The evidence made available through this effort will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.
PLAN FOR DATA COLLECTION
Data Source: Multiple data sources, including newly disseminated information from non-Jalin sources, information from Jalin supported MERLA activities, independent research, GOI data and statistics, and data from development partners.
Method of data collection and construction: Jalin will collaborate with the Indonesian Academy of Sciences and other key evidence partners to conduct the synthesis and develop the body of evidence in the form of an Evidence Driven Slide Deck to be updated twice yearly.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: The fact that the data have been synthesized is not necessarily an indicator of their quality.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
41 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.1.3.c MNH evidence slide deck available for use in co-creation, design, and TA
Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): Jalin will collect evidence (defined as the available body of facts or information indicating whether a belief or proposition is true or valid) from multiple sources, including: Every Mother and Newborn Counts and other Jalin supported data collection efforts; Government of Indonesia data; academic research; USAID MNH partner reporting; and other development partners. Jalin will present the evidence in the form of a slide deck. Available means that the slide deck is open source and accessible to multistakeholder actors through meetings, consultations, presentations and electronic dissemination.
Unit of Measure: This is a milestone and well-documented wide distribution of the Evidence Driven Slide Deck will form the basis for a “yes” response.
Disaggregated by: N/A
Rationale or Justification for indicator (optional): The evidence made available through this effort will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports
Method of data collection and construction: Jalin will collaborate with the Indonesian Academy of Sciences to analyze data from multiple sources and develop the Evidence Driven Slide Deck to be updated twice yearly. Jalin will develop a matrix to catalogue the activities/events undertaken to ensure availability of the data.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: The indicator speaks to the availability of data/evidence but cannot confirm its utilization.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
42 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.2 Partnerships implementing solutions or advocacy
Name of Result Measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): For Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal—e.g., two actors agreeing to collaborate around a common event—or more formal, with a memorandum of understanding and established governance procedures.
Jalin will only count toward “Jalin Partnership” targets within our MERLA Plan those partnerships with structured initiatives and roles for co-creation, co-investment, implementation, and learning from local solutions.
Specific advocacy initiatives will be identified as partnerships are established. “Solutions” are answers to problems – those interventions that are judged most likely to deliver substantive improvements in maternal and newborn health outcomes in Indonesia. To be counted against this indicator the partnership must have implementation, financial, technical assistance and monitoring, evaluation, learning and adaptation plans in place with plans for sustainability and scale and an indication of how, if scaled, could plausibly improve maternal or newborn health, either on its own or in concert with other interventions.
Unit of Measure: Number
Disaggregated by: District and technical focus area
Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports, memoranda of understanding and other partnership agreement documents
Method of data collection and construction: Partnerships will emerge from co-creation workshops and outreach overseen by Jalin’s Partnerships Director. Jalin will maintain a file of the implementation, financial, TA and MELA plans for each partnership.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Partnerships Director and MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: Simply reporting the number of partnerships does not accommodate an evaluation of their success.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
43 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.2 Partnerships implementing solutions or advocacy
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal, such as two actors agreeing to collaborate around a formal event, or more formal, with a memorandum of understanding and established governance procedures. Specific advocacy initiatives will be identified as partnerships are established. “Solutions” are answers to problems – those interventions that are judged most likely to deliver substantive improvements in maternal and newborn health outcomes in Indonesia. To be counted against this indicator the partnership must have implementation, financial, technical assistance and monitoring, evaluation, learning and adaptation plans in place.
Unit of Measure: Number
Disaggregated by: District, sector (civil society, public sector, private sector etc.), sex (for individuals)
Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed. New partners will bring new ideas to the table and potentially provide effective solutions.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports, partnership agreements
Method of data collection and construction: Jalin will establish and maintain a sortable database of all individuals and organizations that play a role within a structured initiative. Data will be drawn from partnership agreements and implementation plans.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Regional Managers and Partnerships Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 44
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: 1.2.1.a New multistakeholder actors engaged and participating in partnerships process
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): “Actors” include individuals, organizations and institutions. Actors can be drawn from public and private health sectors, other public-sector entities, enterprises and corporations, civil society individuals and organizations, media, academic institutions, foundations, charitable institutions and others. Jalin will only include structured partnership initiatives with roles for co-creation, co-investments, and learning from local solutions which will define engaged and participating. “New” refers to individuals and organizations not previously engaged in a partnership with Jalin. Any individual or organization may be counted only once for this indicator even if they are involved in multiple partnerships.
Unit of Measure: Number
Disaggregated by: District, sector (civil society, public sector, private sector etc.), sex (for individuals)
Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed. New partners will bring new ideas to the table and potentially provide effective solutions.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports, partnership agreements
Method of data collection and construction: Jalin will establish and maintain a sortable database of all individuals and organizations that play a role within a structured initiative. Data will be drawn from partnership agreements and implementation plans.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Regional Managers and Partnerships Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
45 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: 1.2.1.b Events and targeted outreach held to share evidence and engage multistakeholder actors
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): “Evidence” means the available body of facts or information indicating whether a belief or proposition is true or valid. Events and targeted outreach may include policy briefs, public and private sector events and meetings, press releases, presentations in academic and professional settings, business roundtables, and civil society events. “Multistakeholder Actors: The term actor includes individuals, organizations, and institutions. To strengthen the MNH Movement with cultural change around the generation and use of evidence to improve MNH outcomes across Indonesia, we need to engage traditional health actors across the health system, as well as nontraditional actors. In the context of Jalin, these could include actors (broadly defined per above) from the public or private health sectors, other public-sector actors, private corporations or other for-profit entities with interests related to healthcare or improved MNH outcomes, civil society, media, academia, and potentially others. The geographic areas of interest among these stakeholders may also be diverse, ranging from national and subnational/provincial to community or household levels. Multistakeholder actors reflect the “whole-of-market” approach that is at the heart of the Jalin Theory of Change.
Engaged means that the actor participates in the process by: providing funding, providing technical input, providing access to facilities or populations, or other factor that could advance the process.
“Targeted outreach” is a directed communication activity towards an actor that can include: event, speech, campaign, document, media-related activity, and other intervention that can fall within communication.
Unit of Measure: Number
Disaggregated by: Event disaggregated by partnership Engagement Type (e.g. MAB, targeted outreach, provincial outreach), Sector represented (e.g. civil society, private or public sector, etc.),
Rationale or Justification for indicator (optional): The evidence made available through such events will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of all events, presentations and outreach including date and time, location, audience, agenda, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Advisor and MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
46 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.2.2.a Problem statements defined
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Problem statements are the foundation of the co-creation process. A problem statement is a concise description of an issue to be addressed or a condition to be improved. Problems identified will be prioritized according to criteria of plausible improvement to MNH outcomes, opportunity for scale, and potential for co-investment.
Problem statements will be developed based on local evidence through a multi-stage process of consultation, definition, refinement, prioritization and market analysis.
Unit of Measure: Number
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): This milestone highlights Jalin’s commitment to partnership, co-creation and local solutions.
PLAN FOR DATA COLLECTION
Data Source: Compilation of data from stakeholder consultations, targeted meetings at provincial level, and MAB deliberations
Method of data collection and construction: Jalin will maintain a master file of problem statements, updated quarterly to capture changes and prioritization.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Evidence Utilization Specialist
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces. If the problem is identified and prioritized in more than one location I would not call it duplication in the same way that reporting the same data to the same audience is.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 47
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.2.3.a Co-creation events held
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Co-Creation: Jalin will adopt an ethos of co-creation. This fundamentally means that we will collaborate with diverse
stakeholders to share design, decision making, investment, and ownership of solutions. Beginning with problem definition informed by evidence and continuing to solution implementation, co-creation cuts across how Jalin operates. Workshops are Jalin facilitated event in which stakeholders come together to work together to develop a solution to improve maternal and newborn health. Targeted outreach refers to a non-workshop setting in which a solution may be discussed between stakeholders.
Unit of Measure: Number
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed.
PLAN FOR DATA COLLECTION
Data Source: For each event, a standard report will be completed indicating attendance, problem statement, and solution presented.
Method of data collection and construction: Jalin will maintain a master file of events disaggregated by province and type of event, to be updated quarterly.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
48 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.2.3.b Co-creation design sessions via targeted partnerships and outreach
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Co-Creation: Jalin will adopt an ethos of co-creation. This fundamentally means that we will collaborate with diverse stakeholders to share design, decision making, investment, and ownership of solutions. Beginning with problem definition informed by evidence and continuing to solution implementation, co-creation cuts across how Jalin operates. Co-creation is not limited to a single format of a multistakeholder workshop to generate ideas, but is integral to Jalin’s approach to partnership, technical assistance, and catalytic funding to deliver solutions for sustainable and scalable impact.
Partnerships: For Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal—e.g., two actors agreeing to collaborate around a common event—or more formal, with a memorandum of understanding and established governance procedures.
Jalin will only count toward “Jalin Partnership” targets within our MERLA Plan those partnerships with structured initiatives and roles for co-creation, co-investment, implementation, and learning from local solutions.
Unit of Measure: Number
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of innovations including project plans and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces., but this is not a negative—just a factor to consider during data analysis.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 49
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.2.3.c Solutions or advocacy initiatives identified as a result of co-creation events or targeted outreach
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Definition: A solution is a technical approach that has been co-created by stakeholders in Jalin-supported areas that is proposed to address a maternal or newborn health issue. Advocacy refers to public support for or recommendation of a particular cause or policy related to MNH. The solutions and advocacy initiative counted against this indicator will be generated as a result of Jalin-supported interventions.
Unit of Measure: Number
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of solutions and targeted outreach that will be updated on a monthly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
50 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.2.4.a; STIR 10 (a and b): Number of innovations (solutions) supported through USG assistance
Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed Behaviors and Processes Evolve Across Health Systems
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): ‘Innovations’ are products, processes, tools, approaches, service delivery models, and/or other interventions (broadly defined) that have the potential to achieve significant (not incremental) improvements in development outcomes versus existing alternatives and are intended to improve the lives of ultimate beneficiaries. Here, innovations are defined not by their novelty, but by their potential to achieve significant improvements in development outcomes versus existing alternatives.
• An innovation can be said to have ‘the potential to achieve significant improvements in development outcomes versus existing alternatives’ if a robust TOC linking the innovation to such outcomes can be articulated. The Theory of Change should be supported by evidence of the potential benefits of the innovation versus existing alternatives, and it should be tested and refined throughout the development of the innovation to ultimately substantiate this claim (i.e. rigorously demonstrate the innovation’s potential versus existing alternatives).
• Ultimate beneficiaries are host country individuals, especially the socially and economically disadvantaged, who are beneficiaries of USAID assistance and whose participation is essential to achieving sustainable development results.
• Support through USG assistance includes human, financial, or institutional resources to support, in full or in part, the discovery, research, development, testing, or implementation of innovations.
Unit of Measure: Number
Data Type: Integer (minimum: 0, maximum: NA)
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions – solutions – to improve maternal and newborn health that could plausibly reduce mortality if scaled. For Jalin, “solution” and “innovation” are synonymous.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of innovations including project plans and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
51 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: 1.2.4.b. Partnerships receiving local funding beyond Jalin
Name of result measured: 1.2 Constructive and Inclusive Partnerships, Solutions and Advocacy Developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): This indicator counts the number of partnerships that receive funding from sources other than Jalin. Jalin is not a small grants program and Jalin financial support will be provided as a secondary resource. All sources of co-investment will be rigorously documented.
Partnerships: For Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal—e.g., two actors agreeing to collaborate around a common event—or more formal, with a memorandum of understanding and established governance procedures.
Jalin will only count toward “Jalin Partnership” targets within our MERLA Plan those partnerships with structured initiatives and roles for co-creation, co-investment, implementation, and learning from local solutions.
Unit of Measure: Number
Disaggregated by: Province, technical focus area, type of recipient organization, type of funding entity, proportion of non-Jalin support
Rationale or Justification for indicator (optional): Key principles of Jalin include co-investment and local ownership. This indicator speaks to those principles.
PLAN FOR DATA COLLECTION
Data Source: Partnership financial reports and budgets
Method of data collection and construction: Each partnership will have a financial plan documenting the resources required for implementation and the sources of those funds. Partnerships receiving Jalin catalytic funding will submit expenditure reports using templates developed by Jalin. The Partnerships Office will provide oversight.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Regional Managers, Partnerships Team
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: Partners may have an interest in either inflating or concealing the amount of non-Jalin support they receive.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
52 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 1.2.4.c Number of civil society organizations (CSOs) receiving USG assistance engaged in advocacy interventions
Name of result measured: Jalin 1.2: Constructive and inclusive partnerships, solutions and advocacy developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): Counts the number of CSOs receiving assistance to initiate or participate in advocacy interventions. Advocacy is a means for individuals, organizations or constituencies to shape public agendas, change public policies, or influence other processes that affect their lives. Advocacy is a series of strategic, interconnected, integrated activities designed to achieve a goal. Advocacy may include lobbying, public interest litigation, letter writing campaigns, information-sharing with target audiences and individuals, and similar activities. For Jalin advocacy will be specifically focused on issues relating to MNH.
Unit of Measure: Number
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): Civil society organization broadly represent the interests of citizens and are key building blocks of Jalin multistakeholder partnerships. Their voices must be heard and recognized in order to shape effective solutions.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of civil society organizations actively engaged in advocacy initiatives and data on these efforts, including project plans and associated documents, data, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: As a simple count of organizations, does not speak to the effectiveness of advocacy conducted.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 53
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.2.5.a MAB meetings held quarterly
Name of result measured: Jalin 1.2: Constructive and inclusive partnerships, solutions and advocacy developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Stakeholder engagement initially focused on engaging the Multistakeholder Advisory Body and is continuing more broadly at the national and sub-national levels. Jalin is continuing to engage with the Chair and Co-Chair to define the scope and clarify the agenda. In addition to the quarterly meetings described in the table below there is ongoing consultation around key priorities (e.g. co-definition, Jalin’s Communications Plan, etc.) via WhatsApp, phone calls, meetings, and other engagement mechanisms. The MAB is a group that has been convened by Jalin.
Unit of Measure: Number
Disaggregated by: NA
Rationale or Justification for indicator (optional): Jalin’s overarching Theory of Change includes engaging influential multistakeholder actors.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will collect MAB meeting agendas, minutes, and other related documents from the MAB meetings. and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Partnerships Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: None anticipated at this time.
TARGETS AND BASELINE
Baseline timeframe (optional): 0
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 54
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 1.2.6.a Partnerships implementing local solutions with Mini-MERLAs and Technical Assistance plans in place
Name of result measured: Jalin 1. 2: Constructive and inclusive partnerships, solutions and advocacy developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Partnerships: For Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal—e.g., two actors agreeing to collaborate around a common event—or more formal, with a memorandum of understanding and established governance procedures.
Jalin will only count toward “Jalin Partnership” targets within our MERLA Plan those partnerships with structured initiatives and roles for co-creation, co-investment, implementation, and learning from local solutions. Specifically, the MAB meets the broader definition of partnership, but would not count towards Jalin Partnership Targets; however, if Jalin were able to establish an initiative with Perhimpunan Rumah Sakit Seluruh Indonesia—the Association of Indonesian Hospitals—around support to scale up utilization of the JKN, this would be an example of a Jalin Partnership for the purpose of targets and monitoring.
A local solution is derived from the co-creation process in which a solution (a technical approach that has been co-created by stakeholders in Jalin-supported areas that is proposed to address a maternal or newborn health issue).
A mini MERLA is a monitoring, evaluation, research, learning, and adaptation plan that is specific to the local solution. Implementing means that the local solution is being conducted.
Inclusive: Inclusive in the context of the Theory of Change reflects Jalin’s overall goal of reaching the poorest and most vulnerable.
Unit of Measure: Number
Disaggregated by: Technical focus area, province (district).
Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. The intervention must have a plan for metrics and technical support to ensure that it can be assessed and that it is given as much support as possible to ensure success.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of local solutions including project plans, mini-MERLAs and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
55 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: 1.2.6.b Number of local solutions/innovations documented with a pathway for scale and sustainability
Name of result measured: Jalin 1.2: Constructive and inclusive partnerships, solutions and advocacy developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s):
Jalin will use three criteria to prioritize partnerships: potential to improve maternal and neonatal health outcomes; opportunity to scale through expansion or replication; potential for co-investment. Jalin will monitor and learn from local partnerships and solutions through Partnership Officers embedded at the provincial level.
Solution and innovation are used interchangeably and are defined as products, processes, tools, approaches, service delivery models, and/or other interventions (broadly defined) that have the potential to achieve significant (not incremental) improvements in development outcomes versus existing alternatives and are intended to improve the lives of ultimate beneficiaries. • Sustainability may be demonstrated by continuity, institutionalization, and/or financial commitment. Scale refers to expansion or replication of an intervention, institutionalization through systemic change, diversification, or diffusion.
Documented means that the innovation has written information that refers to scale or sustainability along the criteria presented above.
Unit of Measure: Number
Disaggregated by: Geographic area, technical focus area
Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. The interventions must also have some consideration for scale and sustainability.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports
Method of data collection and construction: Partnership Officers will work hand in hand with each partnership and document evidence and learning. I am not clear on what criteria will be used to establish that a partnership is on a pathway to scale and sustainability.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Partnership Officers
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: This could be very subjective until the solution has actually proven itself.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
56 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: 1.2.7.a. Number of local solutions/innovations documented with how-to guides or mentoring plans to ease adaptation/replication and scale
Name of result measured: Jalin 1.2: Constructive and inclusive partnerships, solutions and advocacy developed
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): This indicator counts the number of partnerships that understand the factors underlying their success and have the capacity to translate this understanding into actions that other partnerships can build on.
Solution and innovation are used interchangeably and are defined as products, processes, tools, approaches, service delivery models, and/or other interventions (broadly defined) that have the potential to achieve significant (not incremental) improvements in development outcomes versus existing alternatives and are intended to improve the lives of ultimate beneficiaries. • Sustainability may be demonstrated by continuity, institutionalization, and/or financial commitment. Scale refers to expansion or replication of an intervention, institutionalization through systemic change, diversification, or diffusion.
In order to be counted against this indicator the partner(s) must develop and present written material in the form of a manual, mentoring plan, PowerPoint presentation or other written/graphic material.
Unit of Measure: Number
Disaggregated by: Geographic zone, technical focus area
Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. The interventions must also have some consideration for scale and sustainability.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports
Method of data collection and construction: Partnership Officers will work hand in hand with each partnership to document evidence and learning. Data will be drawn from the manuals, guides and/or PowerPoints that the partners submit.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Partnerships Officers
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
57 USAID JALIN MERLA PLAN, JUNE 4, 2018
USAID Performance Indicator Reference Sheet
Name of Indicator: .2.1.a; 2.2 a Number of technical assistance requests fulfilled by Jalin
Name of result measured: Jalin 2.l: Provision of specialized TA for local solutions
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): This indicator is a simple count of the number of TA requests met by Jalin. Each Jalin multistakeholder partnership will develop a technical assistance plan at inception. The TA will be targeted to ensure that successful approaches can be identified, replicated and scaled up. TA will also build on local capacity and be targeted to foster local ownership and co-financing.
Unit of Measure: Number
Disaggregated by: Province, technical focus area, multistakeholder type
Rationale or Justification for indicator (optional): Jalin is to facilitate improvements in maternal and newborn health the provision of targeted technical assistance could provide that support.
PLAN FOR DATA COLLECTION
Data Source: Jalin quarterly and annual reports
Method of data collection and construction: Multistakeholder TA plans, written and oral reports and briefings from TA providers, Jalin TA monitoring templates
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Technical staff and Partnerships Officers
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations: As a simple count, does not address the quality of the TA provided.
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 58
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 2.2a:1.b; 2.2.b.; USAID Health Leadership -1 Number of Universal Health Coverage (UHC) areas supported by USG investment
Name of result measured: Jalin 2: TA Deployed Effectively to Support Impact at Scale
Is this a Performance Plan and Report indicator? No
DESCRIPTION
UHC is defined as all people obtain the health services they need – prevention, promotion, treatment, rehabilitation and palliation – without risk of financial ruin or impoverishment, now and in the future. This means that there are five areas of UHC which comprised of: a) essential package of health services based on country health needs; b) assuring quality of health services; c) access to safe, effective, quality, and affordable essential medicines and vaccines; d) instituting financial risk protection interventions; e) tracking health expenditure, especially out of pocket expenditure through national or system of health account (NHA or SHA), which also provide information on financial protection interventions.
To assess whether the country is moving towards UHC, all five areas need to be addressed. Therefore, we want to measure how many areas of the UHC are supported by the USG. Thus, the number range is 0-5, where zero indicating no support and five indicating support to all five areas:
• Technical assistance (TA) provided in strengthening the essential package of health services (0=No, 1=Yes)
• TA provided for improving quality of health services (0=No, 1=Yes)
• TA provided to strengthen pharmaceutical system and making safe, quality and affordable medicines and vaccine available, reducing adverse reactions and antimicrobial resistance (0=No, 1=Yes)
• TA provided in financial risk protection* (0=No, 1=Yes)
• Health accounts data collection in process or completed using SHA 2011 method (0=No, 1=Yes)
Unit of Measure: Number
Disaggregated by: UHC category
Rationale or Justification for indicator (optional): This indicator provides the foundation for measuring progress on the achievement of Universal Health Coverage, leading to better health outcomes and improved health status.
PLAN FOR DATA COLLECTION
Data Source: TA reports
Method of data collection and construction: Multistakeholder TA plans, written and oral reports and briefings from TA providers, Jalin TA monitoring templates
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 59
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 2.3.a Percentage of TA with positive feedback
Name of result measured: Jalin 2: TA Deployed Effectively to Support Impact at Scale
Is this a Performance Plan and Report indicator? No
DESCRIPTION
Precise Definition(s): This indicator is a proxy for the quality of the technical assistance Jalin provides to the GOI and multistakeholder partnerships. Jalin will develop a survey instrument using a Likert scale to gauge recipients’ satisfaction with the TA provided to them.
Unit of Measure: Percentage
Disaggregated by: Geographic area, technical focus area, multistakeholder type
Rationale or Justification for indicator (optional): Jalin is to facilitate improvements in maternal and newborn health the provision of targeted technical assistance could provide that support.
PLAN FOR DATA COLLECTION
Data Source: Survey of TA recipients
Method of data collection and construction: Jalin will develop a simple survey tool utilizing a Likert scale and administer it to all recipients of Jalin-funded TA. The numerator will be the results from the respondents that responded, and the denominator will be the number of total respondents.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: MERLA Director
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 60
USAID Performance Indicator Reference Sheet:
Name of Indicator: Jalin 3.1 Total value of USG GUC provided
Name of result measured: Jalin 3: Catalytic Financing Disbursed to Support the Incubation and Implementation of Local Solutions
Is this a Performance Plan and Report indicator? No
DESCRIPTION
As a last resort, Jalin may provide catalytic financing for local solutions that promise to be transformative in the form of GUCs. Jalin will track and report the total funding provided in USD and IDR.
Unit of Measure: Dollar and rupiah value
Disaggregated by: Technical Focus Area
Rationale or Justification for indicator (optional): Catalytic financing through Jalin for promising solutions has the potential to accelerate uptake and scaling.
PLAN FOR DATA COLLECTION
Data Source: Jalin financial reports
Method of data collection and construction: Jalin will maintain a database of funding provided and quarterly reconciliation of accounts
Reporting Frequency: Quarterly
Individual(s) responsible at Jalin: Deputy Chief of Party
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 61
USAID Performance Indicator Reference Sheet
Name of Indicator: Jalin 3.1.a Number of grants for catalytic financing provided
Name of result measured: Jalin 3: Catalytic financing efficiently disbursed to support the incubation and implementation of local solutions
Is this a Performance Plan and Report indicator? No
DESCRIPTION
As part of catalytic financing, Jalin will, as a last resort, provide catalytic financing for local solutions. This indicator counts the number of these local solutions that Jalin is funding.
Unit of Measure: Number
Disaggregated by: Technical focus area, province
Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. Funding can increase the likelihood of success.
PLAN FOR DATA COLLECTION
Data Source: Jalin reporting matrix
Method of data collection and construction: Jalin will maintain a master file of grants awarded.
Reporting Frequency: Quarterly
Individual(s) responsible at Jalin: Deputy Chief of Party
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional):
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 62
USAID Performance Indicator Reference Sheet
Number and Name of Indicator: Jalin 3.2.a Percentage of local solutions requiring GUC funding where funds disbursed in a timely manner
Name of result measured: 3: Catalytic financing provided to support the incubation and implementation of local solutions
Is this a Performance Plan and Report indicator? No
DESCRIPTION
“Timely” disbursement of GUC funds means that funds are disbursed from Jalin to the solution within three months of the time requested Numerator: Number of local solutions receiving funds within three months of the request for funding. Denominator: Number of solutions receiving catalytic financing from Jalin.
Unit of Measure: Percentage
Disaggregated by: Province; Technical Focus Area
Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. Catalytic funding through GUC can increase the likelihood of success.
PLAN FOR DATA COLLECTION
Data Source: Jalin financial reports
Method of data collection and construction: Jalin will maintain a master file of that includes information on grants disbursed.
Reporting Frequency: Annual
Individual(s) responsible at Jalin: Deputy Chief of Party
DATA QUALITY ISSUES
Dates of Previous Data Quality Assessments and name of reviewer: N/A
Date of Future Data Quality Assessments (optional): TBD
Known Data Limitations:
TARGETS AND BASELINE
Baseline timeframe (optional): 0
Rationale for Targets (optional):
CHANGES TO INDICATOR
Changes to indicator: N/A
Other Notes (optional):
THIS SHEET LAST UPDATED ON: 04/27/2018
USAID JALIN MERLA PLAN, JUNE 4, 2018 63
APPENDIX 3. PROF ACKMAL TAHER’S PRESENTATION
(Attached separately)
USAID JALIN MERLA PLAN, JUNE 4, 2018 64
References 1. Vogel I. Review of the use of ‘Theory of Change’in international development. UK: Department
for International Development (DFID) 2012. 2. Breuer E, Lee L, De Silva M, Lund C. Using theory of change to design and evaluate public
health interventions: a systematic review. Implementation Science 2015; 11(1): 63. 3. Council NR. Reducing Maternal and Neonatal Mortality in Indonesia: Saving Lives, Saving the
Future: National Academies Press; 2013. 4. Taher AY, Irawan. Evidence-Informed Policy Making on Reducing Maternal and Neonatal
Mortality in Indonesia June 2016 – March 2018. 2018. 5. Kalter HD, Salgado R, Babille M, Koffi AK, Black RE. Social autopsy for maternal and child
deaths: a comprehensive literature review to examine the concept and the development of the method. Population health metrics 2011; 9(1): 45.
6. Filippi V, Ronsmans C, Campbell OM, et al. Maternal health in poor countries: the broader context and a call for action. The Lancet 2006; 368(9546): 1535-41.
7. USAID. USAID Program Cycle Overview. 2012. 8. USAID. Establishing A Learning Agenda. 2017. 9. USAID. Defining a Learning Agenda. 2017. 10. USAID. Activity Monitoring, Evaluation, & Learning Plan Guidance Document. 2017. 11. Garvin DA, Edmondson AC, Gino F. Is yours a learning organization? Harvard business review
2008; 86(3): 109. 12. Ramalingam B. Tools for knowledge and learning: A guide for development and humanitarian
organizations: Overseas Development Institute London; 2006. 13. USAID. Program Cycle Guidance--Discussion Note: Complexity-Aware Monitoring, 2016. 14. Dozois E, Blanchet-Cohen N, Langlois M. DE 201: A practitioner's guide to developmental
evaluation: International Institute for Child Rights and Development, University of Victoria; 2010.
15. Patton MQ. EVALUATION for theWay We Work. 16. Kirschner PA, Hendricks M, Paas F, Wopereis I, Cordewener B. Determinants for Failure and
Success of Innovation Projects: The Road to Sustainable Educational Innovation. Association for Educational Communications and Technology 2004.
17. Westreich D. From exposures to population interventions: pregnancy and response to HIV therapy. American Journal of Epidemiology 2014; 179(7): 797-806.
18. Tricco ACL, E.V.; Straus, S.E Rapid Reviews to Strengthen Health Policy and Systems: A Practical Gudie, World Health Organization, 2017.