evidence of social accountability_kamden hoffmann_5.7.14
DESCRIPTION
TRANSCRIPT
The Role of Social Accountability in Improving Health OutcomesOVERVIEW AND ANALYSIS OF SELECTED INTERNATIONAL NGO EXPERIENCES TO ADVANCE THE FIELD
KAMDEN HOFFMANN, PHD, MA, INSIGHT HEALTH, LLC
CONSULTANT TO THE CORE GROUP
MAY 7, 2014
Social accountability
Involves ongoing, collective action by civil society groups, including NGOs, to hold public officials and service providers accountable for the provision of public goods
Affirming and operationalizing direct accountability relationships between citizens and the state
Broad range of actions and mechanisms beyond voting that citizens can use to hold the state to account, as well as actions on the part of government, civil society, media and other societal actors that promote or facilitate these efforts
Social Accountability Sourcebook, Chapter 2. Social Accountability: What Does it Mean for the World Bank? 2002
Critical factors for social accountability
Social Accountability Sourcebook. Chapter 4: Social Accountability in the Health Sector. Participatory Public Expenditure Management at the National Level. World Bank. 2002.
How does it work?
Social accountability initiatives often interface with varying agencies and divisions of government.
The United States Agency for International Development (USAID) emphasizes the importance of participation and inclusion of citizens in governance and prioritizes this within the USAID Strategy on Democracy, Human Rights, and Governance, with a strong focus on citizen engagement and accountability
Social accountability and health
Accountability is a prominent theme of the U.N. Every Woman Every Child campaign
Engaging communities and community-based workers in the process of measuring health status of children, in assessing causes of deaths, in defining high-risk groups, and in measuring changes in mortality over time will enable governments to achieve levels of under-5 mortality according to their commitments
Overview of selected INGO approaches
Citizen Voice and Action, implemented by World Vision
Partnership Defined Quality, implemented by Save the Children
The Community Score Card, implemented by CARE
White Ribbon Alliance, various approaches
World Vision: Citizen Voice and Action
Citizen Voice and Action
Where applied: The site must be a place where the government is providing services
Applicable sectors: Agenda-neutral process; has been applied in education and health, HIV/AIDS, water and sanitation, and is now expanding into the private sector
Who is involved: World Vision may facilitate with the objective of handing over to local partners. World Vision identifies an existing group and equips them with the tools needed to carry out CVA, .e.g. a local CBO, village committee, etc.
Constructive evidence based dialogue in order to improve government services, government performance, and relationships
Catalyzes alliances between community and key government officials
CVA encourages collective action, driven and managed by civil society
Embedded within Area Development Programs Ability to leverage ongoing work for greater
impact Existing relationships provide groundwork for
institutionalization of programming
Citizen Voice and Action
Length of process: The preparation phase, called “enabling citizen engagement” can take the longest, as it depends on the level of civil society development
How it increases social accountability: CVA equips citizens to engage in evidence-based dialogue with health workers and local government in order to improve the accountability of health services
Financial considerations: Costs range per program, per year. Costs decline significantly over time as citizens drive the bulk of the process
Monitoring and evaluation: World Vision builds the CVA process into its existing Area Development Programs (ADP); evaluation is built into the design of the ADPs
Challenges or barriers to implementation: The enabling environment is the key to implementation.
Save the Children: Partnership Defined Quality
BUILDING SUPPORT
WORKING IN PARTNERSHIP FOR QUALITY
IMPROVEMENT
COMMUNITYDEFINEDQUALITY
HEALTH WORKERDEFINED QUALITY
Better Health
Improve provider job satisfaction
Improve client satisfaction
Increase communities’ sense of ownership of health facility
Increase community capacity for social change
Shared rights and responsibilities for better health outcomes
BRIDGING THE GAP
Partnership Defined Quality
Where applied: Best in projects lasting 2 years or more, with enough staff and budget to adequately support the PDQ process as related to the size of the catchment area involved
Applicable sectors: Health, adapted in education (including non-formal education), youth, adolescent sexual and reproductive health, and HIV/AIDS
Who is involved: Led by project staff members who are working to improve the quality of services in order to achieve project outcomes.
Community based solutions with community resources, with limited external financial support and outside solutions, for social change
“Duty bearers” – rights based work
Quality Improvement Teams (QITs) are a key component
Builds on community capacity, organically grows as the PDQ process is carried out in the community
As quality has very different meanings, quality is defined by the partners in the context of their community setting, e.g. what keeps people from going to the health center?
Partnership Defined Quality
How it increases social accountability: Intended to improve quality at the community level from the perspective of the consumer (client) and more than anything, the marginalized client. Marginalized members address duty bearers
Financial considerations: Intends to use local solutions to community-provider challenges. While costs can range depending on the context, many of the PDQ programs have used local resources as a result of this process
Monitoring and evaluation: The PDQ Monitoring and Evaluation Toolkit provides a set of tools including supervisory checklists, mapping tools and an exit interview to support the implementation of PDQ
Challenges or barriers to implementation: It is intensive and time consuming. Frequent transfers in health staff, lack of political will and commitment to the PDQ process can deter successful implementation.
CARE: The Community Score Card (CSC)
PHASE II: Conducting the Score Card with the CommunityCommunity Score Card:
• Community level assessment of priority issues in one village – what are the barriers to accessibility and delivery of quality services• Develop indicators for assessing priority issues• Complete the Score Card by scoring against each indicator and giving reason for the scores• Generate suggestions for improvement= complete community Score Card for the village
Cluster consolidation meeting:• Feedback from process• Consolidate scores for each indicator to come up withrepresentative score for entire village• Consolidate community priority issues and suggestionsfor improvement= complete (consolidated) Score Card for the cluster
PHASE IV: Interface Meeting and Action Planning
PHASE I: PLANNING AND PREPARATION
PHASE III: Conducting the Score Card with Service Providers
• Conduct general assessment of health service provision – what are the barriers to delivery of quality health services?• Develop indicators for quality health service provision• Complete Score Card by scoring against each indicator• Identify priority health issues• Generate suggestions for improvement
Rep
ea
t cyc
le
CSC Process
PHASE V: Action Plan Implementation and M&E• Execute action plan • Monitor and evaluate actions • Repeat cycles to ensure institutionalization
Action planning:• Develop detailed action plan from the prioritized issues – agreed/negotiated action plan• Agree on responsibilities for activities in the action plan and set time frames for the activities
Interface meeting:• Community at large, community leaders, committee members, health center staff, district officials and process facilitators• Communities and health center staff present their findings from the Score Cards• Communities and health center staff present identified priority health issues• Prioritize the issues together (in a negotiated way)
The Community Score Card
Where applied: Used at the local level to address local-level barriers; the score card is implemented at the intersection between the community and health facility; however, in other sectors this can vary
Applicable sectors: Food security, education, health, HIV/AIDS, infrastructure, agriculture, water and sanitation, gender based violence
Who is involved: Participants in the CSC process is dependent on the focal issue and the improvements and/or changes anticipated
CARE’s Governance Programming Framework reflects a theory of change, grounded in both the literature and practical experience in social accountability
Underlying principles for a rights based approach include Participation and inclusion of voice; Accountability and transparency; Equity; and Shared responsibility and obligation
Community Score Card (CSC) is also used as an internal or forward accountability mechanism to gain feedback on CARE’s accountability from communities
CSC repeated measurement: continuous feedback loop for monitoring and evaluation every six months and institutionalization of process
The Community Score Card
How it increases social accountability: If citizens are empowered; if power holders are effective, accountable and responsive; if spaces for negotiation are expanded, effective and inclusive; then sustainable and equitable development can be achieved
Financial considerations: Dependent upon what unit the score card is done at, e.g. one facility in a catchment area, and what part of the process, e.g. preparation and planning or issue generation
Monitoring and evaluation: CSC process focuses on improved services as an outcome, and improved human development as an impact
Challenges or barriers to implementation: Fear of negative fallout among providers and/or citizens; lack of supervisory support for providers after changes are initiated;
Common themes across models (1)
Preparation and planning
Involvement of marginalized populations and the poorest of the poor
Identification of barriers from civil society and governmental/public sector
Established presence for entrée: World Vision’s Area Development Program is their process of implementing long-term (15 years), local programming that contributes to the sustained well-being of the population. The approach supports local advocacy. World Vision incorporates CVA directly into the Area Development Programs where trust and alliances may already exist due to World Vision’s presence. Save the Children also seeks to implement PDQ in communities where long term programming is established. This includes communities with child sponsorship funding, where Save the Children is typically in a community for 10-15 years. The reason this is effective is that the implementing NGO (in this case Save the Children) becomes a trusted partner for long term change. Save the Children has adapted PDQ for use with adolescents in many of its sponsorship communities worldwide. CARE incorporates the CSC into its projects and programs.
Common themes across models (2)
Interface meetings between civil society and governmental/public sector
Focus on accountability and health outcomes measurement
Facilitation and guides
Rigor of evaluation of interventions
Value of a score card in measuring services: CARE developed the community score card; World Vision adapted the score card in its CVA approach, and PDQ uses another method of scoring. A score card allows for both users of public services as well as providers of public services to use a simple method of assessing the performance of service delivery and offering proposals to improve the quality of service. The score card data is usually collected through focus group discussions among particular interest groups, e.g. women, men, youth, children, community leaders, PLWH/A, health center committee, etc. The score cards help develop a set of indicators for monitoring and evaluation, and can also serve as a baseline for service improvement. The scorecard can be used as a tool to generate issues to advocate for to help integrate some solutions into local policies and systems for sustainability of results. In addition, community member’s health behaviors and actions can be evaluated.
White Ribbon Alliance
WRA uses a variety of tools to promote social accountability, including: participatory budgeting; social audits; participatory planning; public expenditure tracking surveys; citizen report cards/community score cards; budget analysis; citizen-based vigilance committees; public hearings; checklists; and verbal autopsies
Numerous WRA National Alliances have utilized social accountability approaches under several initiatives to increase accountability and improve health outcomes
Social Watch: India
Participatory Health Facility Assessment: Uganda
Practical solutions recommended by WRA: Ensuring upfront investment; accessible information made available to citizens (not just donors); direct feedback and communication loops; value placed on local data and evidence; and institutionalization of social accountability approaches into formal mechanisms.
Recommendations (1)
Expand existing evidence base: While partners are continuously strengthening the rigor of their monitoring and evaluation of social accountability interventions, more evidence is needed regarding the effectiveness of different interventions at the community, district, regional, and national levels
Clarify financial and human resource inputs: It would be helpful if partners could formally cost out essential elements in programs for other practitioners and host countries interested in adapting or applying these social accountability interventions
Identify barriers to scale up: State actors are involved in each of these models, however, once action plans are implemented and evaluated, what further involvement should the government have to ensure more sustainable outcomes? This includes a better understanding of the influence of the larger social, economic and donor interests.
Recommendations (2)
Consider critical factors in achieving successful outcomes
Highlight the importance of community owned progress: it is very important for communities implementing the changes to identify their role in ongoing, measureable improvements in outcomes in order to continue their involvement and ownership of the process
Develop similar definitions and a central location for well-known social accountability approaches in health and development
Explore highlights among different models for promising practices: Each model reviewed by this analysis is comprised of unique elements that merit further exploration. To the extent possible, these elements should be analyzed further for their effectiveness and sustainability
Annex
References Cited and Additional Resources with Websites
World Vision, Save the Children, CARE, World Bank, and others
Case studies
Tables of key elements and activities among the social accountability models