impact assessment: bangladesh leadership development program
TRANSCRIPT
![Page 1: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/1.jpg)
Impact Assessment:Bangladesh Leadership Development Program
Presented at the annual conference of the World Association for Public Opinion Research
Austin, Texas - May 11, 2016 Nurhan Kocaoglu, Zahra Lutfeal i – Counterpart Internat ional
Ju l ie E. Phelan, Gary Langer, Gregory G. Holyk – Langer Research Associates
Matthew Warshaw – D3 Systems Inc.
![Page 2: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/2.jpg)
Nurhan KocaogluCounterpart International
Project Background
![Page 3: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/3.jpg)
Funded by USAID, implemented by Counterpart International in partnership with five Bangladesh CSOs, 2012-15
Train current and future leaders to participate effectively in community development; enhance their civic engagement and democratic values Build and support the capacity of adult
community leaders Encourage emerging youth leaders to become
change agents for democratic processes and local development
BLDP Background
![Page 4: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/4.jpg)
Among the world’s poorest, most densely populated countries
Annual GNI per capita $1,097 (2014); 32% povertyLittle economic opportunity, broad environmental
degradation, lack of access to clean water, electricity and sewage systems; unsafe working conditions, substandard construction/; persistent gender inequities
Developing democracy; centralized, insular and entrenched political system
Pervasive corruption and distrust of national gov’tLocal development dominated by connected elites,
chained to political and financial gain
Country Background: Bangladesh
![Page 5: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/5.jpg)
Lack of understanding of civil rights and responsibilities
Lack of participation in community decision making
Lack of awareness of means by which elected officials can be held accountable
Absence of decentralized, independent community-level leadership
BLDP Concerns
![Page 6: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/6.jpg)
Identify adult and youth community leaders via CSO partners
Train in participatory rural appraisal techniques to identify key development needs and identify assets and resources available to address them
Build capacity of participants to engage with other community members, local government officials and other civil society leaders to promote needed development and improve accountability
BLDP Intervention Approach
![Page 7: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/7.jpg)
Review the community development/civic engagement literature to inform BLDP curriculum and assessment plan
Conduct an independent, empirically based assessment of BLDP’s effectiveness
Assessment produced by Langer Research Associates; field work management by D3 Systems, Inc.; field work by ORG Quest Ltd.
Research Needs
![Page 8: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/8.jpg)
Gary LangerLanger Research Associates
Research Design and Execution
![Page 9: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/9.jpg)
Is the BLDP achieving its goal of increasing the leadership capacity, skills, engagement and effectiveness of its participants?
What does the literature tell us about effective civic engagement and how can it inform our research design?
Research Questions
![Page 10: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/10.jpg)
Importance of cultural context in leadership training Sensitivity toward norms of traditional behavior
for women Impact on women’s views of their ability to
effect changeCultural norms reflect deeply ingrained underlying
values, inc. religious beliefs, that are difficult to influence
Underscore compatibility of civic involvement/democratic values and religious/traditional beliefs by emphasizing shared concepts, e.g., tolerance, respect, community
Buy-in from religious, cultural/traditional or business leaders promotes program legitimacy
Literature Review – Key Findings (I)
![Page 11: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/11.jpg)
Information encourages interest and empowers individuals to take an active role in community affairs
Enhanced leadership skills promote confidence and self-efficacy; these encourage involvement
Program effects may be subtle, require multiple measures
Beware of ceiling effectsLocal living conditions and quality of instruction
(teachers, teaching materials, topics and strategies) impact success
Literature Review – Key Findings (II)
![Page 12: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/12.jpg)
Assist in design of participant databaseConduct F2F pre-treatment interviews with a random
sample of 1,750 Cohort 1 participants, Feb. 21-March 24, 2013
F2F post-treatment interviews with a random sample of 1,731 Cohort 1 and 2 participants and pre-treatment interviews with 1,750 Cohort 3 participants, Jan. 12-Feb. 16, 2015
Combine questions in construct-specific indices (tested with Cronbach’s alpha) mapped to program performance benchmarks
Given large sample sizes, use a more rigorous approach - Cohen’s d - to assess significant change in index scores (difference between two means divided by stdev)
Assessment
![Page 13: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/13.jpg)
Key Findings
![Page 14: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/14.jpg)
Importance of civic values
![Page 15: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/15.jpg)
Are civic & religious values compatible?
![Page 16: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/16.jpg)
Acceptance of others
See community as highly respectful of…• Religious leaders of other faiths: +21 pts• Ethnic and religious minorities: +11 • Women who are involved in the community: +9• Young women who are involved in the community: +14
![Page 17: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/17.jpg)
Willingness to work with others
![Page 18: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/18.jpg)
Civic participation rates
![Page 19: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/19.jpg)
Leadership roles
![Page 20: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/20.jpg)
Information
![Page 21: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/21.jpg)
Self-efficacy
![Page 22: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/22.jpg)
Belief you can have any influence on local government
Pre-training: 40%Post-training: 61%
Ability to influence government
![Page 23: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/23.jpg)
Efficacy: Accountability
![Page 24: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/24.jpg)
Efficacy: Self confidence
![Page 25: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/25.jpg)
Rate self as highly skilled in Teamwork: +18 ptsProblem-solving: +18Communication: +17Conflict resolution: +17Decision making: +17
Efficacy: Group skills
![Page 26: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/26.jpg)
Overall impacts
![Page 27: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/27.jpg)
The BLDP successfully produced measurable, positive advances in trainees’ political and community engagement and commitment to community development
Gains were broadly based across metrics, including: Greater understanding of democracy and
development issues Broader belief in own ability to effect change Enhanced acceptance of others More extensive involvement in community
activities
Conclusions
![Page 28: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/28.jpg)
Gains were smaller among previously trained participants; offer them enhanced training or mentoring roles
Gains were smaller among those in more difficult living conditions; offer them additional support
Gains differed among implementing partners; ensure and monitor training quality
Address room for additional improvement in some areas, e.g. efficacy and involvement in community development activities
Recommendations
![Page 29: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/29.jpg)
Takeaways for Counterpart
![Page 30: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/30.jpg)
Capacity building and learning experience Solidifying and building upon the organization’s workBest practices of creating change & ensuring
sustainabilityDesired effect?
Insights & Gains
![Page 31: Impact Assessment: Bangladesh Leadership Development Program](https://reader035.vdocuments.site/reader035/viewer/2022070516/58731abc1a28ab673e8b61ed/html5/thumbnails/31.jpg)
Impact Assessment:Bangladesh Leadership Development Program
Thank you!