AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme,

UnitedRepublicofTanzania

inceptionreport

11May2015

ii

Contents

Abbreviations iv1 Introduction 1

1.1 ImpactevaluationoftheRWSSP 11.2 Countrycontext 11.3 Programmebackground 21.4 Objectivesoftheimpactevaluationandevaluationquestions 3

2 Theoryofchange 43 Scopeoftheimpactevaluation 8

3.1 Period 83.2 Geographiccoverage 83.3 Typesofintervention 8

4 Impactevaluationdesignandmethods 84.1 Impactevaluationquestion 84.2 Impactestimationmethods 9

4.2.1 Propensityscorematching 94.2.2 Differenceindifferences 104.2.3 AcombinationofDIDandPSM 10

4.3 Definitionofvariables 104.3.1 Treatmentvariable 104.3.2 Outcomevariables 10

5 Estimationofsamplesize 126 Samplingstrategy 137 Surveyinstrumentsanddatacollection 168 Organisationoftheimpactevaluation 179 Qualityassurance 1810 Workplan 18Annex1.Termsofreference 19Annex2.Debriefingnote:preparatorymission 27Annex3.Listofpersonsmetduringinceptionmission 36Annex4.Keyparametervaluesusedintheestimationofsamplesizes 38Annex5.Drafthouseholdquestionnaire 39Annex6.Draftcommunityquestionnaire 58Annex7.Draftwaterpointquestionnaire 68Annex8.DraftLGAWASHteamquestionnaire 86Annex9.Drafthealthfacilityquestionnaire 109Annex10.Draftprimaryschoolquestionnaire 113

iii

Annex11.Howevaluationquestionsareaddressed 120References 123

Tables

Table1.Definitionofkeyoutcome/impactvariables 11Table2.Estimationofrequiredminimumsamplesizes 12Table3.SampledistributionacrossLGAs 14Table4.RWSSPimpactevaluation:schedule 18Table5.Howevaluationquestionsareaddressed 120

Figures

Figure1.RWSSPTanzania:theoryofchange 7

iv

Abbreviations

AfDB AfricanDevelopmentBankBEST BasicEducationStatisticsBRN BigResultsNowCOWSO Community-OwnedWaterSupplyOrganisationCWST CouncilWaterandSanitationTeamDHS DemographicandHealthSurveyDID differenceindifferencesGOT GovernmentofTanzaniaGPS globalpositioningsystemHBS HouseholdBudgetSurveyIDEV IndependentDevelopmentEvaluationDepartmentJMP JointMonitoringProgrammeLGA localgovernmentauthorityMDG MillenniumDevelopmentGoalMOEVT MinistryofEducationandVocationalTrainingMOHSW MinistryofHealthandSocialWelfareMOW MinistryofWaterNPS NationalPanelSurveyNSC NationalSanitationCampaignO&M operationandmaintenancePIM ProjectImplementationManualPSM propensityscorematchingPMO-RALG PrimeMinister’sOffice–RegionalandLocalGovernmentRWSS ruralwatersupplyandsanitationRWSSP RuralWaterSupplyandSanitationProgrammeTOC theoryofchangeTOR termsofreferenceTZFO TanzaniaFieldOffice(AfDB)WASH water,sanitationandhygieneWB WorldBankWSDP WaterSectorDevelopmentProgrammeWSP WaterandSanitationProgramme

1

1 Introduction

1.1 ImpactevaluationoftheRWSSP

In2006,theAfricanDevelopmentBank(AfDB)approvedfundingofUSD84mforPhaseIofthe Rural Water Supply and Sanitation Programme (RWSSP) in the United Republic ofTanzania.PhaseIIofAfDBfunding,contributingUSD65m,ranfrom2011to2015.TheRWSSPisacontributiontoComponent2(RuralWaterSupplyandSanitation)ofthenationalWaterSectorDevelopmentProgramme(WSDP),2006–2025.TheUnitedKingdomDepartmentforInternationalDevelopment(DFID)isanothermajorcontributortothiscomponent.PhaseIofthe WSDP ended, from the perspective of the Government of Tanzania (GOT), in 2014,although from the donor perspective it continues until June 2015, while funds that theyprovidedforthatphaseareusedup.

The Independent Development Evaluation Department (IDEV) of the AfDB intends toundertakeanimpactevaluationoftheRWSSP.Thetermsofreference(TOR)fortheevaluationareshownatAnnex1.ItisdueforcompletioninNovember2015.Twoconsultantshavebeencontractedtocarryouttheevaluation,whichissupervisedbyanIDEVTaskManager. IDEVhasestablishedareferencegroupforthestudy,comprisingrepresentativesofgovernmentand development partners (section 8 below). An external impact evaluation specialistwillprovide peer review services to the exercise (section 9). As part of IDEV’s StrengtheningAfrican National Evaluation Systems Initiative, arrangements have been made with theMinistryofWater(MOW)fortwostaffmemberstotakepartinthestudy.

IDEVrecentlycommissionedacomparable impactevaluationof ruralwaterandsanitationwork supported by the AfDB in Ethiopia. To some extent, the Ethiopia study provides amethodologicalbasisfortheevaluationtobecarriedoutinTanzania.

The consultants and the IDEV TaskManager undertook an inceptionmission between 26February and 12March 2015 in order to carry out consultations, preliminary informationgatheringandotherpreparationsfortheimpactstudy.ThedebriefingnotepreparedattheendofthemissionisreproducedatAnnex2.

1.2 Countrycontext

TheUnitedRepublicofTanzaniahadapopulationof49m in2013,andoneof thehighestpopulationgrowthratesintheworldat2.7%peryear(UNDPandGOT,2015:4).Withanareaof945,203km2,itisnotdenselypopulated(about56/km2,comparedwith78/km2inKenyaand188/ km2 inUganda (WorldBank, 2015)).Gradual urbanisationhas reduced the ruralpopulationtoabout70%ofthetotal(GOT,2013a:24).

Economic growth in Tanzania has been substantial over the past decade, with grossdevelopmentproductincreasingbyanaverage7%peryear.However,therehasbeenonlyamarginalreductioninnationalpovertylevels.ThemostrecentHumanDevelopmentReportstates that “withexceptionof somenotableprogress ina fewareas suchas child survival(reductionofchildmortalityrates)andschoolenrolment,improvementsintheoverallstatusofhumandevelopmentinTanzaniaareonlymarginal”(UNDPandGOT,2015:viii).ItquotesaHumanDevelopmentIndexscoreof0.488forTanzania,rankingitat159outof187countries–inthebottomquartile(UNDPandGOT,2015:1).Thereportconcludesthat“theMillenniumDevelopmentGoalofreachingapovertylevelof18%by2015isunattainable”andnotesthat“povertyinTanzaniaisaruralphenomenon”(UNDPandGOT,2015:3,4).

2

Inthiscontextofpoverty,accesstosafedrinkingwaterremainsamajorchallengeformanyTanzanians, particularly those in rural communities. According to one recent study, it hasdeclinedfrom55%to53%forruralpeopleoverthelasttwodecades–despitehighlevelsofdevelopmentfundingforthesector.Between1995and2005,“TanzaniareceivedUSD57perbeneficiaryinaidflowsearmarkedforwaterbutcoveragefellby1%”(Twaweza,2014:2,3).Statistical definitions of access to safe drinking water are often inconsistent. A 2010/11nationalpanelsurveyfoundthat32%ofruralTanzanianshadaccessintherainyseason,and40%inthedryseason(comparedwith66%and74%respectivelyofurbancitizens).Anotherrecentestimateisthat46%oftheruralpopulationuseanimprovedwatersource.Meanwhile,only8%oftheruralpopulationwereestimatedtouseanimprovedsanitationfacility(GOT,2013a:v,17).

1.3 Programmebackground

TheAfDBsupportforruralwatersupplyandsanitationwasabasketfundingcontributiontoComponent2oftheWSDP.TherewasnoseparatetechnicaldesignfortheAfDBinput,andthisevaluationisthereforeconcernedwiththeRWSSPasComponent2oftheWSDP.

TheWSDPandtheRWSSPhadaslowstart.TheWSDP-describedas“probably[the]largestnationalwaterprogrammeoperatinginAfricatoday”(GOT,2013b:1)-startedoneyearlate,andalthoughanumberof‘quickwin’(mostlyrehabilitation)projectsthathadalreadybeenidentifiedanddesignedcouldbeimplementedwithouttoomuchdelay,a2010reviewfoundthat “themain activities underWSDPwill start only in its fourth year” (GOT, 2010: iv). AProgramme Implementation Manual was developed, but proved to be too complex forpractical application (GOT, 2013b: ii). A restructuring plan was approved in June 2011,includinganamendedresultsframework,procurementplananddisbursementindicators.TheProgrammeImplementationManualwasrevisedtoo(GOT,2014b:4).

Constructionofnewruralwater schemesonlybeganat scale in2012,pickingupspeed in2013. This followed an extensive period of delay in developing and implementingprocurement procedures for consultants to design new schemes –which, once designed,oftenprovedtobemoretechnicallysophisticatedandexpensivethanhadbeenenvisaged.

The 2013 evaluation of WSDP Phase I concluded that “relatively few of the rural waterschemesplannedunderbasketfundinghavematerialisedsofarandthiscomponentisunlikelyto make a significant impact on national access figures by 2014… The reasons for thedisappointingoutputappeartobeacombinationof(a)delaysinprocurement,(b)irregularandsomewhatunpredictablefundreleasesfromthecentre(c)limitedabsorptivecapacityat[localgovernmentauthority]leveland(d)thetimetakentoestablishaneffectiverolefor[thePrimeMinister’s Office – Regional and Local Government] and achieve goodMOW/PMO-RALG co-ordination. Expenditure in this component has fallen further behind scheduledallocationstoagreaterextentthantheotherprogrammecomponents”(GOT,2013b:28).

The water sector was one of six sectors identified for focused development through thenationalBigResultsNow(BRN)initiative(2013/14–2015/16).ThiseffortwasmainstreamedwithintheWSDPandledtoarenewedcommitmentto“achieve67%ruralwatercoverageby2015”(GOT,2014a:22)throughtheimplementationoftenruralwaterprojectsineachlocalgovernmentauthority(LGA)area.This‘tenvillages’campaignhashelpedtoaccelerateRWSSPimplementationsince2013.

TheNationalSanitationCampaign(NSC)resultedfromtheconversionofthesanitationsub-componentofComponent2oftheWSDPintoaseparateentityundertheco-ordinationof

3

MOHSW. The four-year target was to construct 1.52m improved latrines and implementschoolwater,sanitationandhygiene(WASH)programmesin812schools.ByJune2014,only25%oftheimprovedlatrinesand16%oftheschoolprogrammeshadbeenachieved(GOT,2014b:18).ThroughtheRWSSP,theAfDBhasbeenfundingthissanitationcomponent,alongwiththeWaterandSanitationProgramme(WSP)oftheWB.TheseparatestatusoftheNSCwithintheWSDPhasledtoco-ordinationissuesatLGAandfieldlevelsbetweenruralwaterandsanitationinterventions.

Theconsensusamongstakeholdersisthat,althoughthetangibleruralwatersupplyoutputsoftheWSDP(andRWSSP)havebeenlimited,importantinstitutionalprogresshasbeenmade.Majoreffortsandsubstantialresourcesweredevotedtoenhancingsystemsandproceduresatnational,regional,districtandcommunitylevels–helpingtoexplainwhysuchverylargeinvestmentsachievedonlymarginalincreasesincoverage.Asatheory-basedevaluationthatassessesnotonlytheultimateimpactbutalsothecausalfactorsandassumptionsthroughoutthe theoryof changeunderpinning theprogramme, the studywill be careful to learn andreport on the lessons from this institutional effort. This should lead it to offer usefulconclusionsonthesustainabilityofruralwaterandsanitationinterventions.

1.4 Objectivesoftheimpactevaluationandevaluationquestions

AsstatedintheTOR(Annex1),theobjectiveofthisimpactevaluationistoprovidecredibleestimatesoftheimpactofAfDB-supportedinterventionsattheleveloftheultimatetargetgroups;assesswhetherRWSSP interventionsworkasexpected;assessthesustainabilityofresults, and derive lessons and recommendations that can be used to improve theeffectivenessofAfDBassistance.

Thecharacterofthestudyasatheory-basedevaluationderivesfromtheseobjectives.Ratherthanjuststatingwhatimpact,ifany,theinterventionhasachieved,thisevaluationisintendedtoexplorethenatureofthecausalrelationshipsandprocessesthatwereintendedtoachievethatimpact,andtounderstandhowtheseworkedoutinpractice,determiningthelevelofperformanceandimpactthatwasactuallyachieved.Byexplainingtheresults,theevaluationcanderivetherequiredlessonsandrecommendations.

TheTORpresentedatentativelistofevaluationquestions.Withreferencetothetheoryofchange(TOC)outlinedinsection2below,thesequestionscanbeelaboratedasfollows.

1. Whattypesandquantitiesofwatersupply,sanitationandhygieneoutputshastheRWSSPachievedathouseholdandschoollevels?

2. Whattypes,quantitiesandqualityofcapacitydevelopmenthastheRWSSPachievedat LGA and community levels with regard to the design, delivery, operation,maintenanceandsustainabilityofWASHinterventions?

3. What is the quality of drinkingwater in beneficiary communities, households andschool,atpointofsupplyandpointofuse?

4. Do the quantity and proximity of improved drinking water supplies 1 available tobeneficiaryhouseholdsmeetinternationalstandards?

1IntheframeworkoftheWHO/UNICEFJointMonitoringProgramme(JMP)ofMDGimprovedwaterandsanitationfacilities,animprovedwatersourceisdefinedasone,thatbynatureofitsconstructionandwhenproperlyused,adequatelyprotectsfromoutsidecontamination,particularlyfromfaecalmatter.

4

5. Whatisthequalityoflatrines2inbeneficiaryhouseholdsandschools?

6. ArebeneficiaryhouseholdsandschoolsusingdrinkingwaterasintendedbyRWSSPdesign?

7. What time savings are accruing to girls and women as a result of RWSSPinterventions?

8. Towhat extent are the sanitation and hygiene practices promoted by the RWSSPimplementedbybeneficiaryhouseholdsandschools?

9. Arethechangesinwater,sanitationandhygieneuseandpracticeachievedbyRWSSPinterventionsuniformlydistributedbetweenandwithinbeneficiarycommunitiesandhouseholds?

10. Whattargeting,awarenessandplanningactivitiesprecedeRWSSPinterventions?

11. WhataretheprincipalfeaturesofthepolicythatguidesRWSSPinterventions?

12. WhatinstitutionaloutputshastheRWSSPachievedatcommunitylevel?

13. WhatinstitutionaloutcomeshastheRWSSPachievedatcommunitylevel?

14. AretheinstitutionalassumptionsembodiedintheRWSSPTOCvalid?

15. Canchangesintheincidenceofdiarrhoeainchildrenagedunderfiveinbeneficiarycommunities – as aproxy for incidenceofwaterbornediseases –beattributed toRWSSPinterventions?

16. Canchangesintheenrolmentandattendanceofgirlsfrombeneficiarycommunitiesatschool–aproxyforenhancededucationalopportunity–beattributedtoRWSSPinterventions?

17. Canchangesintheincomegeneratingactivitiespractisedbywomenfrombeneficiarycommunities–aproxyforenhancedeconomicopportunity–beattributedtoRWSSPinterventions?

18. Canchanges in local(self)employment incommunity-basedWASHservicedeliverybeattributedtotheRWSSP?

19. AretheresultsofRWSSPinterventionstechnicallysustainable?

20. AretheresultsofRWSSPinterventionsinstitutionallysustainable?

21. What are the linksbetween technical and institutional sustainability, andare theyadequatelyreflectedintheRWSSPTOC?

22. IstheRWSSPTOCreplicableattheintendedscale?

Table 5 at Annex 11 shows how these evaluation questions are addressed by the surveyinstrumentsandtheothermodesofenquirythatwillbeundertakenbythisevaluation.

2 Theoryofchange

Figure 1 below shows a theory of change for the RWSSP that the evaluation team haveconstructedfromareviewofprogrammedocumentationand,inparticular,thedraftrevised

2IntheframeworkoftheWHO/UNICEFJointMonitoringProgramme(JMP)ofMDGimprovedwaterandsanitationfacilities,animprovedsanitationfacilityisdefinedasonethathygienicallyseparateshumanexcretafromhumancontact.Theseincludepitlatrineswithslabs.

5

programmeimplementationmanual(GOT,2015).Therearevariouswaysinwhichthecausallogicofprogrammedesigncanbeassessedandpresented.TheprincipaldistinguishingfeatureofTOCapproachestothistaskisthattheyidentifytheassumptionsonwhichthedesignlogicisbased.Thiscanguideatheory-basedimpactevaluationinitsassessmentofwhyintendedfinaloutcomeswere,orwerenot,achieved.

TheTOCoutlinedbelowfocusesontheprincipalcausallinksandstagesbetweeninputsandfinaloutcomes,butaddsapreliminarystageoftargeting,awarenessandplanningthatshouldleadtotherequiredinputsfortheRWSSPprocessbeing inplace.Akeyassumptioninthisregard is that systems, procedures and budgets are indeed in place, co-ordinated andefficiently implemented so that the targeting, planning and related preparatory processesleadtotheprovisionofinputsatscaleinamannerthatmatchescommunityawarenessandexpressedneedtoavailableresources.Mostfundamentally,theTOCassumesthatthepolicybeing implemented by the RWSSP is conducive to efficient achievement of the intendedoutputsandoutcomes.

WhethertheinputsshowninFigure1achievethespecifiedoutputsdepends,inturn,onsomeimportantassumptions.Oneisthatdesignandconstructionaretechnicallysound.Anotheristhat thenewschemesareable todeliverwater that is safe forhumanconsumption.Userresponses are fundamental to achieving the intended outputs. The TOC assumes thatcommunitiesandhouseholdswill commit todeveloping the requireduser institutionsandinstallingdomesticsanitationandhygienefacilities.AnotherimportantassumptionisthattheawarenessraisingandinstitutionaldevelopmentcarriedoutbyserviceprovidersareeffectiveincreatingcompetentCommunity-OwnedWaterSupplyOrganisations(COWSOs)orsimilarstructures.Additionally, theTOCassumes that theseusermanagementbodiesareable toestablishworkingrelationswithoperationandmaintenance(O&M)serviceproviders.Finally,itassumesthattheCouncilWaterandSanitationTeam(CWST)iscompetentandadequatelyresourcestoco-ordinateplanninganddeliveryoftheintendedoutputs.

FurtherimportantassumptionslinkoutputstooutcomesintheRWSSPtheoryofchange.Forexample,theTOCassumesthatcommunitymembersactuallyusetheimprovedwatersupplyat all times; that the quality of thewater remains safe; and that the system continues todeliverthiswater,inadequatequantities,atalltimes.Asecondmajorassumptionisthatthereisnorelapseinsanitationandhygienepractice,andthatpeoplecontinuetousethefacilitiesandpractisetheenhancedhygienethathavebeenintroduced.SimilarassumptionsapplytothelinkbetweenschoolWASHoutputsandtheintendedoutcomesinTanzanianschools.TheTOC assumes also that the institutional outputs are converted into sustained institutionaloutcomes: COWSOs or other structures that stay in place and continue to operate andmaintain water services effectively, with appropriate support from LGAs. This implies anongoing, constructive relationship of communication and support between LGAs and userinstitutions. Outputs and outcomes are also linked by the significant assumption that theprivatesectorprovidesanefficient,effectiveandaffordablemaintenanceservice towateruserbodies.AfinalandvitalassumptionintheTOCisthattheoutputofanimprovedwatersupply in the community reduces the amount of time that girls and womenmust spendcollectingwaterandbringingittotheirhouseholds.Ifthenumberofhouseholdsperwaterpointistoogreat,orthesupplyatthewaterpointislimited,thisassumptionmaynotholdtrueandtimesavingsmaybelimitedornegligible.

ThefinalsetofassumptionsintheTOClinksoutcomestotheintendedfinaloutcomes:theresultsthatthisevaluationaimstotestdirectly.Fullhealthbenefitsarerealisedonlywhendrinkingwaterissafeatpointofuse;enoughsafewaterisavailablethewholeyearroundand

6

withinashortdistancefromthehousehold;thereislargescaleaccesstotoiletsthatmeettherequirementofhygienicseparationofhumanexcreta fromhumancontact (throughaslabthatcanbecleaned),andhygienicuseoftoilets;andwhenhandsarewashedwithsoaporasoap substitute at all critical times. It is further intended that the interventionswill haveeconomicbenefitsinthattherewillbeapositiveeffectonlocal(self)employmentinWASHservicedeliveryand that timesavingswillhaveaneffectonwomen’semploymentand/ortimespentonincomegeneratingactivities.Boththesesetsofresultsdependontheeconomiccontext being conducive – for example, local support enterprisesmust be able to sourceinputsandtooperateprofitably,andtheremustbeeconomicopportunitiesforwomentoexploitwiththetimesavedwhenwatercollectionismadeeasier.

ThispresentationoftheRWSSPTOCisthusintendedtohelpidentifythekeyassumptionsinthe design logic of the programme and to identify the factors and processes that theevaluationmustexploreinordertoexplaintheextenttowhichtheintendedfinaloutcomes(asrepresentedbytheproxyindicatorsshowninFigure1)havebeenachieved.

Table5atAnnex11showsthelinksbetweentheevaluationquestionsposedbythisstudy(section1.4above),thevariouselementsoftheTOC,andthesurveyinstrumentsandothermodesofenquiryandanalysisthatwillbeundertakenbytheevaluation.

7

Figure1.RWSSPTanzania:theoryofchange

Targeting,awarenessandplanning è Inputs è Outputs è Outcomes è Finaloutcomes

Communitiesaware,ormadeaware,ofopportunitiesforandbenefitsofimprovedwaterandsanitation

Communitiesapplyforruralwatersupplyandsanitation(RWSS)projects

CWSTappraisesandprioritisesvillageprojectproposals,inaccordancewithRWSSPProjectImplementationManual(PIM)

CWSTpreparesCouncilWaterandSanitationPlan

MOWandPMO-RALGreviewandapproveCWSP

CommunityProjectAgreementsigned

è

MOWmakesRWSSPfunding(fromAfDBandothersources)available

Communitymakecontributioninlinewithpolicy

ConsultantsandcontractorsdesignandconstructdomesticwaterfacilitiesandschoolWASHfacilities

Householdsbuilddomesticsanitationfacilities

CWSTserviceprovidersdeliverinstitutionalfacilitationanddevelopment

Privatesectorsparesandmaintenanceservices(made)available

è

Adequate,functioning,safedomesticwatersuppliesavailabletodomesticuserswithinappropriatedistance

Improvedandfunctioningdomesticlatrinesandhandwashingfacilitiesinplace

Adequate,functioning,safeschoolWASHsystemsinplace

TrainedandcapableCOWSOorothermanagementgroupinplace

Functioningmaintenanceservicesavailable

è

Allcommunitymembershaveadequatesuppliesofsafedrinkingwateratalltimes

Allcommunitymemberspractiseappropriatesanitationandhygiene

Womenandgirlsspendlesstimeonwatercollection

Girls,boysandteachersallhaveadequatesafedrinkingwatersuppliesandappropriatesanitationandhygienefacilities(includingmenstrualhygiene)atschools

COWSOsorothercommunityRWSSinstitutionshaveresources,skillsandcommitmenttooperateandmaintainRWSSfacilitieseffectively

CWSTsprovideeffectivetechnicalandinstitutionalsupporttousers

Privatesectorprovidesaffordable,effectivemaintenanceservices

è

Reducedincidenceofwaterbornedisease(proxyindicator:diarrhoeainchildrenunderfive)

Girlslessconstrainedbywatercollectionandsanitation/hygieneconcernsfromadvancingtheireducation(proxyindicators:girls’enrolmentandattendanceatprimaryschool)

LocalemploymentcreatedthroughWASHservicedeliveryenterprises

Womenlessconstrainedbywatercollectionfrompursuingincomegeneratingactivities

8

3 Scopeoftheimpactevaluation

3.1 Period

RWSSPPhaseIoperatedfrom2007to2010.PhaseIIcoveredtheperiod2011–2014,withanocostextensiontoJune2015.ThesetwophaseswereconcurrentwithPhaseIoftheWSDP(whosefurtherphaseswillrunto2025).TheAfDB-fundedRWSSPwasaprincipalsourceoffundingforComponent2(RuralWaterSupplyandSanitation)oftheWSDP.Asnotedabove,genuinelynewinterventionsundertheWSDP(asopposedtothe‘quickwins’thatdominatedtheearlyyearsoftheprogramme)onlybeganconstructionin2012.Thisevaluationwillcoverallschemescommissionedunderthe‘TenVillages’initiativeoftheWSDPbetween2012andJune 2014, i.e. one year before the anticipated field survey – on the assumption thatmeasurable beneficial impactsmay be achievedwithin 12months of the enhancedwatersupplycomingintoservice.

3.2 Geographiccoverage

TheRWSSPandComponent2oftheWSDPcoveredallruralLGAsinmainlandTanzania.Theimpact evaluationwill therefore cover thewholeof the ‘TenVillages” experience, using aquasi-experimental design comprising a random sample of LGAs, comparing changes overtimeinkeyoutcomevariablesinaselectionoffourcommunitieswithandfourcomparablecommunitieswithoutWASHinterventions(section6below).

3.3 Typesofintervention

Inordertoidentifytheresultsandtesttheassumptionssetoutinthetheoryofchange,theevaluationwill be concernedwith the followingRWSSP interventions in the selected ruralcommunities:

• rehabilitationand/orextensionofexistingcommunitywatersupplies;

• installationofnewcommunitywatersupplies;

• promotionofenhancedsanitationandhygienesystemsandpractices;

• capacitybuildingfordistrictandlocalinstitutionsinthemanagementofwatersupplysystemsandthepromotionofappropriatesanitationandhygienepractices(includinghardwareandsoftware);

• schoollevelwater,sanitationandhygiene(WASH)interventions(forwhichAfDBwastheprincipalfunderundertheWSDP).

4 Impactevaluationdesignandmethods

4.1 Impactevaluationquestion

Thebasicimpactevaluationquestiontobeansweredis:“whatwouldhavehappenedtotheoutcomevariablesofinterestincommunitiessupportedbytheRWSSPhadtheprogrammenotbeenimplemented?”Answeringthisquestionrequiresestimatingoutcomesintwostates:withandwithoutprogrammeintervention.Estimatingtheformerisstraightforwardbecausewe candirectly observe it. Estimating the latter howeverposes some challenges sincewecannot directly observe it. This challenge is commonly referred to as the counterfactualproblemormissingdataproblem(Heckmanetal.,1998).

9

Thekeygoalofanimpactevaluationistoestablishtwogroups,participantsintheprogramme(treatment group) and non-participants in the programme (control group), that arestatistically identical in all other aspects except programme participation/treatment. Thechallengethenistoidentifyavalidcontrolgroup,agroupwithsimilarcharacteristicsasthetreatmentgroup.Themostrobustwaytomeasureimpactwouldbetorandomlyassignsomecommunitieswithprogrammetreatmentandkeeptheremainderascontrolgroup.Inaway,the average value of an outcome variable of a control group serves as proxy for thecounterfactualoutcomeofthetreatmentgrouphaditnotparticipatedintheprogramme.InTanzania,RWSSPinterventionswerenotrandomlyassigned.Theassignmentusedademand-driven approach where, among other things, communities specifically expressed gettingimprovedwatersupplyastheirpriority.Adirectcomparisonbetweentreatmentandcontrolcommunitiesinthesecircumstancesismostlikelytoproducebiasedresultsandcompromisethe internal validity of the impact evaluation.Nevertheless, a ‘before-and-after’ approachcould also be misleading because it is most unlikely that the treatment communitiesexperiencednootherchangesthantheprogrammetreatment.Intherealworldanumberoffactorsthataffectoutcomevariablesofinterestmightbechangingovertime(Gertleretal.,2011).Itparticularlybecomesdifficulttoisolategeneraltimetrendeffectsfromtheactualprogramme impact. For these reasons the ‘before-and-after’ approach isnot ideal for thisimpactevaluation.Itwillthereforenotbeapplied.

Instead,thestudywillusequasi-experimentalmethodsintheimpactevaluation.Inparticular,the study will utilise: (1) propensity score matching (PSM) methods; (2) difference-in-differences(DID);and(3)acombinationofDIDandPSMmethods.

4.2 Impactestimationmethods

4.2.1 Propensityscorematching

Themain idea in the use of PSMmethods is to identify control communitieswith similarprobabilitiesofparticipating inRWSSPaswithtreatmentcommunities. Informationontheselectionprocessofcommunitiesintheprogrammeandothersocio-economiccharacteristicsofthecommunitieswillbeusedformatchingpurposes(thesewillincludeexistenceoftowncentre, school, hospital etc.). This processwill removebias due toobservables3. A Probitmodelwill be used to estimate the probability of participation in the programme using apooled sample of treatment and control observations (1 = treatment and 0 = controlcommunity).Main covariates of the predictionmodelwill include: village pre-programmecharacteristics such as access to water, sanitation, population density, distance to basicinfrastructuresuchasschools,hospital,marketplace,literacyrate,accesstoelectricityandpoverty status. To account for community-specific heterogeneities in both treatment andcontrolgroups,themodelwillincludetime-invariantfeaturessuchasagro-ecologicalzonesandlocation.

The internal validity of the evaluation will require a good selection of the counterfactualgroup; hence a careful selection of control group will be done. To reduce bias,treatment/controlcommunitiesthatdonothaveacomparablepropensityscore/predictedprobabilityintheothercomparisongroupwillbeexcluded/trimmedoutfromtheestimationsample.Theappropriatematchingestimatorwillbeusedforefficientmatching4.Lastly,the

3ThemainassumptionofthePSMisthattheselectionbiasisentirelybasedonobservedcharacteristics.4Thesewillincludethenearestneighbourmatching,kernelmatchingandradiusmatchingetc.(willcompareandchoosethebest).

10

difference inaverageonanoutcomevariablebetweenthematchedpairoftreatmentandcontrolcommunitieswillbeanestimateofRWSSPimpact.

4.2.2 Differenceindifferences

Underthisapproach,impactswillbeestimatedbycomputingthedifferenceinaveragevaluesofagivenoutcomevariablebetweenthetreatmentandcontrolcommunitiesbeforeandaftertheprogrammeintervention.Theoutcomedifferencewillbetestedforstatisticalsignificance.The key assumption under this approach is that, in the absence of the programme, ouroutcomevariablesofinterestwouldhavechangedinasimilarmannerinbothtreatmentandcontrol groups. One of the challenges with Tanzania’s RWSSP implementation is that nobaselinedatawerecollected.Suchdataareusefulinmeasuringchangeinoutcomevariablesofinterestbetweentreatmentandcontrolcommunities.Consequently,applicationofDIDwillbelimitedtooutcomevariablesthatallowforthereconstructionofpre-programmedata,andthis will be achieved through respondent recall 5 . We specifically consider the followingvariablesforrecalls:(1)distancetothenearestwatersource(2)timespentonaround-triptofetchwater.Advantageof theDID is that ithelpstocontrol for time-invariantunobservedvillagecharacteristics.

4.2.3 AcombinationofDIDandPSM

Estimation bias can emerge from both observed pre-programme characteristics (such asaccesstowater,sanitationfacilitiesandpopulationdensity)andunobservedtime-invariantfactors(suchasabilitytopayforwaterservices,andcommunity’scommitmenttoparticipateinprogramme).Toreducethisbias,wewilluseamixofDIDandPSM.Theestimationwillalsocontrol for beneficiaries’ specific characteristics (gender, location, distance to basicinfrastructure,wealth,educationlevel,durationofexposuretotheprogramme)tomeasurehowtheprogrammeaffectsindividualsdifferently.

Furthermore,analysisofthecollecteddatawillbedoneto(a)establishwhethertheimpactsof the programme interventions are uniform across the beneficiaries (communities andhouseholds)and(b)iftherearedifferentialimpactsin(a),identifythemainfactorsinfluencingprogrammeimpact.

4.3 Definitionofvariables

4.3.1 Treatmentvariable

The RWSSP has several intervention components ranging from capacity building to actualimprovement in access to water. The current evaluation will consider the programme’sinterventionsintotalityandtakethemasone‘treatment’.Thus,inthisevaluation,wedefinecommunitieswhohaveparticipated intheRWSSPas ‘treatment/programme’communitiesandthosewhohavenotas‘control/non-programme’ornon-treatmentcommunities6.

4.3.2 Outcomevariables

ThedesignandimplementationoftheRWSSPhavebeenintendedtoachievepositivewelfareimpactsinarangeofoutcomesincluding:accesstowaterandsanitation;health;education;and employment. Based on consultations with the key stakeholders of the water and

5Deaton,A.,andM.Grosh.2000.“Consumption.”InDesigningHouseholdSurveyQuestionnairesforDevelopingCountries:Lessonsfrom15YearsoftheLivingStandardsMeasurementStudy,Vol.3,ed.M.GroshandP.Glewwe,91–134.Washington,DC:WorldBank.Thisdiscussesthepowerofrecallmethodstoreconstructbaselinedata.6Inourcontext,communitywillmeansub-village,whichisknownasKitongojiinSwahili.

11

sanitationsectorinTanzaniaandprogrammedocuments,weproposethatthequantitativeimpactevaluationofTanzania’sRWSSPshould focusonanumberofoutcomevariablesaslistedanddescribedinTable1.

Table1.Definitionofkeyoutcome/impactvariables

Household-leveloutcomevariable Community-level outcome

indicators

Keyreferencequestionsinhouseholdsurvey

AccessanduseofimprovedsourcesofwatersupplyandsanitationfacilityUsing an improvedsourceofwater

Fromwhichsourcedoesyourhouseholdobtainwater?

What is the proportion ofhouseholdsobtainingdrinkingwaterfromanimprovedwatersource?

Distance to a watersource

Whatisthewalkingdistancefromhometotheprimarysourceofwater?

Average travel distance to theprimarywatersource(oneway)

Total time spent tofetchwater

Howmuchtime(includingwaiting, fillingtime)does it take for the household to fetch waterfromthesourcepertrip?

Averagetotal timespentper roundtriptofetchwater

Per capita daily waterconsumption

Whatvolumeofwaterisusedbyahouseholdfordomestic use (i.e. drinking, food preparation,cleaningutensils,andbasicpersonalhygiene)

Average daily per capita waterconsumption

Usingatoiletfacility Do householdmembers use a toilet/latrine allthetime?

Proportion of households using atoiletfacility;usingitallthetime

UsingImprovedlatrine What is the main type of toilet that thehouseholduses?

Proportion of households usingimprovedtoilets/latrines

Hygienepractices Do household members wash their hands atcritical times (beforeeating, aftergoing to thetoilet,beforefoodpreparation)?

Is water transport handled safely duringtransportandstorageanduseathome?

Iswatersafeatsourceandpointofuse?

Proportionofhouseholdspracticingsafehandwashingpractices

Proportion of householdstransporting water safely to theirhomes

Proportion of households handlingwatersafelyathome

Healthoutcome

Diarrhoeal prevalenceinunder-fivechildren

Did anymember of this household experiencediarrhoeainthelasttwoweeks?

Proportion of under-five childrenwhowassickduetodiarrhealinthelasttwoweeks?

Educationoutcomes

School enrolment forchildren

Is a school-age child currently enrolled inprimaryschool?

Proportion of primary school-agechildren who are currentlyregistered to attend school (i.e.total,boys,andgirls)

School dropout forchildren

Didchilddropoutofschoollastyear? Proportion of primary school-agechildrenwhodroppedoutofschoollastyear(i.e.total,boys,andgirls)

EmploymentoutcomeWomen'sparticipationin productive (self)employment

Was a woman in the household employed inproductive(self)employment?

Proportion of women working inproductive(self)employment

Localserviceproviders(self)employment

What was the effect on (self) employment inWASHlocalserviceprovision

Type and number of local WASHservice providers active andapproximatehours/daysaweek

12

5 Estimationofsamplesize

Implementation of the RWSSP has been aimed at generating desirable changes incommunities’ welfare through changes in a number of impact variables. Sample sizeestimation in the current study focuses on key impact variables, for which the necessaryinformationisavailabletocomputeastatisticalsample.Inestimatingthesample,wewereguided by a number of steps and assumptions. First, in impact estimations, there is apossibilityofconcluding,basedonanoutcomevariableinquestion,thatimpacthasoccurredwhileinactualfactithasnot.InstatisticaltermsthisisknownasType-Ierror.Similarly,thereisapossibilityofconcludingthattheimpactdidnotoccurwhileinactualsenseithasoccurred.ThisisassociatedwithType-IIerror.TominimizetheprobabilityofTypeIandTypeIIerrors,welimitthematcommonstandardsof10%and20%respectively.TakingoneminusTypeIIerrorgivesthestatisticalpowerofthetest,which is80%inourcase.This impliesthatourevaluationdesignhasapowerof80%todetectimpactwheneveritoccurs.

Secondly,foreachoutcomevariableof interest,wearerequiredtoestimatetheminimumnumber of samples necessary for detecting the impact. To achieve this, we consulted anumberofdocumentsandsecondarydatasets:mainlytheHouseholdBudgetSurveys(HBS),NationalPanel Surveys (NPS),DemographicandHealthSurveys (DHS)andBasicEducationStatistics(BEST).Thirdly,treatmentofRWSSPisatcommunitylevel.Nevertheless,mostoftheoutcomes aremainlymeasured at the level of households and of individuals living in thecommunities. This necessitatedpower calculations. In particular,weemployed a two-stepprocedureimplementedinSTATAsoftwaretoestimateoursamplesize.Incomputationsofthesamplesize,weconsideredtwokeyissues:(1)thedegreeofintra-clustercorrelationofhouseholds/individualswithinthecommunity,(2)thesurveycostoftheevaluation.Normally,whenintra-clustercorrelationishigh,addinganewhousehold/individualtothesamplefroman additional community increases the statistical power more than adding a newhousehold/individual from an already selected community. This however has some costimplications(Gertleretal.2011).

Fourthly,inordertooptimisestatisticalpowerweappliedbalanceddesign,allocatingequalnumbers of sample units between treatment and control communities. Fifthly, there is apossibilityofdetectingintendedaswellasunintendedprogrammeeffects,someofwhichwillbenegativewhileexpectedtobepositive.Forsuchpossibilitywewilluseatwo-tailedtestinevaluatingtheprogrammeeffects.Sixthly,inmatchingobservationsbetweentreatmentandcontrol communities, we anticipate a 15% trimming of the samples. For this reason, theestimatedsamplesizebasedonpowercalculationswillbeadjustedbya15%inflationfactortoarriveatthefinalevaluationsample.

Usingrelevantvaluesandimportantassumptions(seeAnnex4),theestimationofrequiredminimumsamplesizeforeachoutcomevariableisgiveninTable2.

Table2.Estimationofrequiredminimumsamplesizes

Outcome/impactindicator Unitofobservation Minimumrequiredsamplesize

#communities #householdspercommunity

Useofimprovedwatersource Household 172 2

13

Travel time to water source(oneway)

Household 203 3

Total time spent on fetchingwater

Household 44 2

Useoflatrine Household 168 2

Prevalenceofdiarrhoea Children aged less than fiveyears

162 8

Schoolenrolment Childrenaged7-14years 234 9

Girlsaged7-14years 232 8

Boysaged7-14years 240 10

Schooldropout Childrenaged7-14years 237 8

Girlsaged7-14years 226 6

Boysaged7-14years 238 7

Women(self)employment inproductiveeconomicactivities

Adultfemalesage18-65years 240

7

As is shown inTable2, the requiredminimumsample sizes for theevaluationvaryacrossoutcomevariables.However,thesamplesizerequirementforthe‘schoolenrolmentforboys’variablesatisfiessamplesizerequirementsforallotheroutcomevariables.Consequently,theimpact evaluation requires a sample of 240 communities and 10 households per samplecommunity. Considering equal distribution of the sample, 120 communities and 1,200householdswillbecoveredintreatmentandcontrolcommunities,respectively,makingatotalsampleof240communitiesand2,400households.

6 Samplingstrategy

Ashasbeenstatedearlier,WSDPComponent2isfinancedisthroughbasketfundingandAfDBisthemajordonor.WiththisfundingmechanismitisdifficulttoisolatetheAfDBcontributionto the programme from that of other donors. The design of the impact evaluation thusrequires covering thewhole country,whichwould not be feasible given time and budgetconstraints. We propose a random sample of 30 LGAs out of a total of 79 LGAs thatconstructedatleastfourwaterschemesundertheTenVillagesinitiativebyJuly2014(atotalof 138 LGAs completed at least one scheme). We particularly use a systematic randomsamplingproceduretoselectLGAsinsuchawaythateachLGAthathascompletedatleastfourschemeshasanequalchanceofbeingselectedinthesample.IneachoftheLGAs,therewillbeanequalnumberoftreatmentandcontrolcommunityandhouseholdsamples.Thisismainly to ensure a self-weighting sample. Based on these criteria, theminimum requiredsampleisdistributedasfollows7.

7An alternative sampling procedurewe consideredwould be to take a random sample of LGAs, clustered byRegionsoradministrativezones.

14

Table3.SampledistributionacrossLGAs

Region LGA

TreatmentSample ControlSample Total

Commun-ities

House-holds

Commun-ities

House-holds

Commun-ities

House-holds

Geita

Geita 4 40 4 40 8 80Mbogwe 4 40 4 40 8 80ChatoDC 4 40 4 40 8 80

Kagera

BiharamuloDC 4 40 4 40 8 80BukobaMC 4 40 4 40 8 80

Kigoma Kigoma 4 40 4 40 8 80Kiliman-jaro MwangaDC 4 40 4 40 8 80

Lindi

Liwale 4 40 4 40 8 80Kilwa 4 40 4 40 8 80Nachingwea 4 40 4 40 8 80

Manyara KitetoDC 4 40 4 40 8 80

MaraButiama 4 40 4 40 8 80Tarime 4 40 4 40 8 80

MbeyaBusokeloDC 4 40 4 40 8 80Kyela 4 40 4 40 8 80

Mtwara

MtwaraDC 4 40 4 40 8 80TandahimbaDC 4 40 4 40 8 80

Mwanza

MisungwiDC 4 40 4 40 8 80Magu 4 40 4 40 8 80SengeremaDC 4 40 4 40 8 80

Njombe MaketeDC 4 40 4 40 8 80

PwaniKibahaTC 4 40 4 40 8 80MkurangaDC 4 40 4 40 8 80

RukwaSumbawangaMC 4 40 4 40 8 80

RuvumaNyasa 4 40 4 40 8 80SongeaDC 4 40 4 40 8 80

Singida Manyoni 4 40 4 40 8 80Tabora IgungaDC 4 40 4 40 8 80

TangaKilindiDC 4 40 4 40 8 80LushotoDC 4 40 4 40 8 80

TOTAL 120 1,200 120 1,200 240 2,400

Source:Authors’computationsbasedonRWSSPadministrativedatafromMinistryofWater(Tanzania).

AfterselectingtheLGAs,thenextstep istodrawarandomsampleofbothtreatmentandcontrolcommunitiesandhouseholds.Thistaskfollowsatwo-stageselectionprocess.First,ineach sampled LGA we use systematic random sampling to select four communities/sub-villages,eachonewithatleastonewaterscheme.InacasewhereanLGAhasamaximumoffourwaterschemes,villageswiththoseschemeswillbeautomaticallyselected.Inthesecondstagethetargetnumberofhouseholdsperselectedcommunitywillbedrawn.Itisimportanttonotethatsamplingofcommunitiesandhouseholdswillbedoneseparatelyfortreatmentandcontrolgroups.Inthisway,thefollowingprocedureswillbefollowed.

Samplingoftreatmentcommunitiesandhouseholds

15

IneachofthesampledLGAs,communitiesandhouseholdswillbeselectedusingfoursteps:

1. In consultation with the district CWST, all communities with a water schemeimplementedbytheRWSSPthroughtheTenVillageprogramme,whichcommencedin2013,willbelisted.

2. ProgrammecommunitieswhostartedreceivingwatersupplyandsanitationservicesafterJune2014willberemovedfromthelist.

3. A random sample of four treatment communities will be drawn from the list. Intreatmentcommunitieswheretheschemecomprisesmorethanonewaterpoint,asinglewaterpointwillbeselectedrandomly.

4. Ineachoftheselectedtreatmentcommunities10householdswillbeselectedusingsystematicrandomsamplingprocedure.Thiswillbedoneusingthelistofhouseholdskeptbythewaterusergroup(COWSO).Intreatmentcommunitieswheretheschemecomprisesmorethanonewaterpoint,the10householdswillbeselectedrandomlyfromamongtheusersofthesinglerandomlysampledwaterpointwithinthescheme.

Samplingofcontrolcommunitiesandhouseholds

Control communities and households will be selected from the sampled LGAs using thefollowingsteps.

1. Ineach LGA,all villages thatarenon-beneficiariesofRWSSPwill be identifiedandlisted.

2. From the list of non-beneficiary communities, the team will identify thosecommunities with similar characteristics before the programme intervention andsimilarfeaturesfixedovertimeaswiththetreatmentcommunities.ThiswillbedoneinconsultationwiththedistrictWASHteam.ControlcommunitieswillbeidentifiedandlistedbasedontheirsimilaritiestotheRWSSP’streatmentcommunitiesonthefollowing:

i). populationdensitypriortotheinterventioninthetreatmentcommunities;

ii). distancetothedistrictcapitalandotherbasic infrastructuresuchasallseasonroads;

iii). waterandsanitationcoveragepriortotheintervention;

iv). communitymotivationandcommitmenttoparticipateintheprogrammehaditbeengiventheopportunity;

v). agro-ecologicalzones.

3. Communities that are near to RWSSP recipient communities or have receivedimprovedwater sources through support from other sources than RWSSPwill beexcludedfromthelist.Theformerisintendedtoreducethepossiblespillovereffectstothecontrolcommunitieswhilethelatterisintendedtoreducesubstitutionbiasifcontrolcommunitiessomehowreceivedtreatment.

4. A random sample of four communities will be drawn from the list of controlcommunitiespreparedinthesecondstep.

5. Ineachofthesampledcontrolcommunities,10householdswillbeselectedusingasystematicrandomsamplingprocedurebasedonthesub-villageroster.

16

7 Surveyinstrumentsanddatacollection

SurveyinstrumentsaredesignedtoreflectandexplorethetheoryofchangeidentifiedfortheRWSSP (see Annex 11). This impact evaluation will collect primary data using surveyinstrumentspreparedbytheteam:ahouseholdquestionnaire;acommunityquestionnaire;an LGA WASH team questionnaire; a health facility questionnaire; and a primary schoolquestionnaire. Draft instruments are shown at Annex 5 - Annex 10. These are subject torevisioninconsultationwiththesurveyserviceprovider,whenappointed(section8below).Some amendments are likely, notably after piloting, which will be required for eachinstrument. Another factor to be discussed with the service providers is whether globalpositioningsystem(GPS)technologycanbeusedfordistancemeasurement,complementingrespondents’estimatesofdistancetowaterpointsandotherfacilities.

Thehouseholdquestionnairewillbethemaininstrumentforcapturingprimaryinformationdirectly from water and sanitation services users, i.e. households. The household surveyinstrument will be used to capture information on various modules including social anddemographiccharacteristics,educationprofile,health,usageofwaterandsanitationservices,hygienepractices,ownershipofassetsandengagementineconomicactivities.Thepurposeof the community-level questionnaire is to capture information on both past and presentcharacteristicsofthesampledcommunities.Specifically,thecommunityquestionnairewillbeused to collect community-level data on population density, water supply, sanitation andhygiene, public infrastructure, land use characteristics, agro-ecology features and majoreconomicactivities.

Thehouseholdandcommunityquestionnaireswillbeadministeredbytrainedenumerators,whocanspeakbothEnglishandSwahili.Thehouseholdquestionnairewillbeadministeredtotheheadofhouseholdand/orspouse.Thecommunityquestionnaireontheotherhandwillbeadministeredtoagroupofatleastfivekeyinformantscomprisingvillageleader,waterandsanitation committee member, a village elder, and two adult females. The fieldwork isexpectedtotakeplacebetweenJuneandAugust2015.Thesurveywillbeconductedduringthesameperiodinsampledtreatmentandcontrolcommunities.

Facility-levelquestionnaires(waterpoint,primaryschoolandhealthfacility)willbeusedtocomplementtheprimarydatacollectedusinghouseholdandcommunity-levelsurveys.ThewaterpointquestionnairewillbeusedtorecordtheRWSSPcommunitylevelinterventions,outcomesandissuesandincludingtestingifwaterqualityatsourceandpointofuse.Watersampleswillbecollectedfromrandomlysampledprimarywatersources(point-of-collection)reportedasbeingusedbyhouseholdsurveyrespondentsintreatmentcommunities.Similarly,about30%ofhouseholdsintreatmentcommunitieswillbeselectedrandomlyandawatersamplewillbetakenatthepoint-of-use.Bothwatersamples(point-of-collectionandpoint-of-use)willbetestedforEscherichiacoli(E.coli),whichislinkedtohumanfaecesexposure8.Thewater test datawill be linked to thehouseholddata usinghousehold IDs. The schoolquestionnairewillrecordinformationonavailabilityanduseofwaterandsanitationfacilities,hygienepractices,andschoolparticipationamongboysandgirls.Similarly,thehealthfacilityquestionnairewill record information on access towater and sanitation facilities, hygienepracticesanddiarrhoealoutpatientrecordsat thehealthfacility. Inaddition,waterqualitytestswillbeundertakenatschoolswhereschoolWASHinterventionshavetakenplace.The

8Thisisconsideredtobethecommonwaterqualitytestperformedindevelopingcountries.ArecentAfDBstudyonImpactEvaluationforRWSSPinEthiopiaalsoconductedthistest.

17

WASH team questionnaire will provide information on how the RWSSP activities areconducted including provision of water supply and sanitation services as well as capacitybuildingatvariousstagesofservicedelivery.

Apart from theanalysis usingprimarydata collected from the survey, therewill alsobe aseparatefollowupmissionoftheIDEVevaluationteamtothesurveyedareas.Themissionwillfurtherinvestigatefactorsbehindthequantitativefindings.Themissionwillalsoaddresstheevaluationquestionsonsustainabilityofdevelopmentresults.

8 Organisationoftheimpactevaluation

TheimpactevaluationteamcomprisesDrStephenTurner(seniorevaluator)andDrKennethMdadila (expert in quantitative research) under the guidance of Rita Tesselaar, IDEVsupervisory Task Manager, and the Evaluator General of IDEV. For MOW, the AssistantDirector,OperationPlanning, Eng. JacksonMutazamba,will be the contact person for theevaluation.

TheevaluationteamisresponsiblefordeliveringthedraftfinalimpactevaluationreporttotheIDEVTaskManager.DrMdadilawilltakeleadresponsibilityforthedesignandsupervisionofthesamplesurveysandtheanalysisofthedatathattheygenerate(sections4-6above).Dr Turner will take lead responsibility for institutional and policy analysis and for overalleditingoftheevaluationreport.

Asnoted in section1.1above,arrangementshavebeenmadeunder IDEV’sStrengtheningAfricanNational Evaluation Systems Initiative for twoofficersofMOW to takepart in theevaluation.InconsultationwithMOW,theevaluationteamandtheTaskManagerwillidentifysuitabletasksfortheseofficersinordertogivethemmoreexperienceofsuchwork.

FollowingacompetitivebiddingprocessinaccordancewithstandardAfDBprocedures,IDEVwill contract a Tanzanian survey organisation to carry out the required field surveys. Thecontractedserviceproviderwillberequiredtoworkincloseconsultationwiththeevaluationteam in order to ensure that the surveys deliver the types, quantity and quality of datarequired,toschedule.InconsultationwithDrTurner,DrMdadilawillparticipateinthepilotingandfinalisationofsurveyinstrumentsandtechniques(checking,forexample,onthepossibleuse ofGPS for fixing survey site positions andmeasuring distances). Both consultantswillcontribute,eitheronsiteorremotely,toenumeratortraining.DrTurnerwillarrangehisfieldmission (scheduled for July 2015) in consultation with the survey firm, with the aim ofparticipatinginsomeofthefieldwork.Bothevaluatorswillhelptoensurethequalityofthesurveydatadeliveredbytheserviceprovider(seealsosection9below).

IDEV has established a reference group for the study, comprising IDEV, the water andsanitationsectorspecialistintheAfDBTanzaniaFieldOffice(TZFO),theAfDBResearchandOperationsDepartments, theMinistryofWater (MOW), theMinistryofHealth and SocialWelfare(MOHSW),theMinistryofEducationandVocationalTraining(MOEVT),andsectorspecialistsfromthecountryofficesofDFIDandtheWorldBank(WB).Thereferencegroupwillcommentondraftsoftheinceptionreportandoftheevaluationreport,andprovideotheradvisoryinputasrequired.

18

9 Qualityassurance

Inadditiontothereferencegroup,IDEVhasengagedtheimpactevaluationexpertDrHowardWhitetoserveaspeerreviewerofthisstudy–arolehehasalsoperformedfortherelatedEthiopia RWSS evaluation (section 1.1 above). By commenting on drafts of this inceptionreportandoftheevaluationreport,andprovidingadhocadviceasrequiredtotheevaluationteam, the peer reviewer will help to ensure that the evaluation achieves the requiredanalyticalstandards.

10 Workplan

Recruitmentarrangementsforthesurveyserviceproviderareproceedinginparallelwiththepreparationofthisinceptionreport.FieldsurveyswillbeundertakeninJune–July2015.DatadeliverybytheserviceprovidershouldbecompletedbytheendofAugust.InJuly,DrTurnerwillmakeafurtherfieldvisitofapproximatelythreeweeksinordertocarryoutinstitutionalandpolicyanalysisandpreparewithDrMdadilafordataanalysisandreportwriting.Furtherdetailsoftheworkplanareshowninbelow.Overall,theworkscheduleisverytight.Itcanonlybeaccomplishedsuccessfullyiftherearenounforeseenobstaclesintheprocess.

Table4.RWSSPimpactevaluation:schedule

Inceptionmission 26February–12March2015Draftinceptionreport 1May2015Finalinceptionreport 15May2015Recruitmentofsurveyserviceprovider April–May2015Surveys June–July2015Qualitativeresearch July2015Dataanalysis August–September2015Draftevaluationreport 15October2015Finalevaluationreport 15November2015

19

Annex1. Termsofreference

1. Generalbackground

The IndependentDevelopment EvaluationDepartment (IDEV) of theAfricanDevelopmentBank Group (AfDB) is planning to conduct an ex post Impact Evaluation (IE) of the AfDBsupportedRuralWaterSupplyandSanitationProgram(RWSSP)inTanzania.

The objective of the IE is to provide credible estimates of the impact of AfDB supportedinterventionsattheleveloftheultimatetargetgroups,assessifPrograminterventionsworkasexpected,assesssustainabilityofresultsandderivelessonsandrecommendationsthatcanbeusedtoimproveeffectivenessofAfDBassistance.TheIEwillalsobeusedasaninformationsourceforahigherlevelAfDBTanzaniaCountryStrategyandProgramEvaluationandaWatersupplyandSanitationthematicevaluation.

TheimpactevaluationwillbedesignedandconductedaspertheseTermsofReferencebyateamoftwoexperts,aseniorevaluatorwithabackgroundinprogramevaluationinthesector(expert I), including institutional analysis and sustainability assessment, and aquantitativeimpactanalysisexpert(expertII),preferablywithrelevantexperienceinTanzania.TheteamwillberesponsibleforpreparingthemethodologicaldesignoftheIE,forimplementingthestudy as well as for writing the IE draft and final report, under the overall guidance andsupervisionofIDEV.ThetermsofreferenceaspartofthecontractwithDr.TurnerpertaintotheservicesanddeliverablestobespecificallyprovidedbyexpertI.

2. RuralWaterSupplyandSanitationPrograminTanzania

Tanzaniaisavastcountrywithalmostoneoutofeverytwopersonshavingnoaccesstosafewatersupply.Duetothevastgeographicdispersion,ruralTanzaniansoftenhavetotravellongdistances, consuming many hours to fetch water. This has a huge negative impact oneconomicdevelopmentandoftenresultsingirlsdroppingoutofschoolsastheyhavetojointheirmothersinfetchingpotablewater.

In2006theNationalRuralWaterSupplyandSanitationProgram(NRWSSP)wasadoptedinTanzania, for the period 2006-2025. It is a long-term plan for the rural water supply andsanitation development to meet the Millennium Development Goals (MDGs) targets andbeyond.ItisaprojectsupportedbyseveralDevelopmentPartners(DPs),includingtheAfricanDevelopmentBankGroup(theBankhereafter).

In2006theBankapprovedaRuralWaterSupplyandSanitationProgramPhaseI(RWSSPI)(2007-2010)atanamountofUA55million(USD84million),outofatotalrequirementofUA223million(USD339million)undertheWaterSectorDevelopmentProgram(WSDP).Intheperiod2007-2009some3,550watersubprojectswereimplemented,resultingin8,250waterpointsservinganestimatedadditional1.9millionpeople.Itwasfurtherreportedthatduringthesameperiod,over1.5millionpeoplehavebeensensitizedonsanitationandhygieneandabout370demonstrationlatrinesbuilt,morethan1200artisanstrained,andover524schoolsanitationclubswereformed.

20

Theprojectisduetobecompletedbytheendof2014underPhaseIIoftheRWSSP.PreparedandfundedjointlywiththeGovernmentofTanzania(GOT)andtheDPs,theProgramincludesconstruction of rural water supply and sanitation infrastructure, national SanitationCampaigns& SchoolWASH, and SectorManagement Support. The Phase II investment isexpectedtoprovidepotablewatertoanadditional3.6millionpeoplefromnewinfrastructureand1.0millionfromrehabilitatedwaterinfrastructure.ThisphasehasatotalcostofUA200million (USD 304 million), and the Bank will finance UA65 million (USD 99 million)implementedoveraperiodoffouryears(2011-2014).Inrespecttosanitation,thePhaseIIintendedbeneficiariesarevillagersandschoolchildrenin264schools.Sanitationawarenesscampaignshavebeenprovidedtoanestimated10millionvillagersinruralcommunities.ForPhaseII,theprogram’stargetareaandpopulationisthepopulationofvillagesinthe132LocalGovernment Authorities (LGAs). Program villages are selected using criteria including thecurrentwatersupplyandsanitationcoverage(thevillageswiththeleastcoveragewillbegivenhighestpriority)andthedistancetravelledtofetchwater.

TheProgram is expected to capacitate local government and communities toprovide andsustainWASHservices;reducetheincidenceofwaterbornediseasesandhealthrelatedcosts;savetimeasaresultofa reduction in timeadultsandchildrenspentwatercollectionandsanitationanduseoftimesavingsforproductivepurposesandforgoingtoschool.ThiswaytheProgramisexpectedtocontributetowardsmeetingtheMDGpopulationcoveragetargetsforaccesstoimprovedwatersourcesandsanitationandtoeradicationofpoverty.

Keyoutcomevariablesofinterestinclude:1)ruralwatersupplyaccessandcoverage;2)useofimprovedwatersource;3)ruralsanitationaccessandcoverage;4)useofbasicsanitationhardware;5)waterqualityatsourceandpointofuse6)hygieneandsanitationpractices(safehandling of water, hand washing, sanitary conditions); 7) incidence of water borne andwasheddiseases8) travel time for collection from thenearestwaterpoint; 7) distance tonearest water point; 8) drop out of girl students; 9) productive (self) employment 10)inclusiveness/distributionofbenefitsbetweencommunitiesandhouseholds.Thevariablesofinterest tobe takenup in thedesignof the studywillbedecidedafter the IEpreparatorymissiontoTanzaniaplannedtotakeplacebetween20Januaryand15February2015.

3. IEquestions

ThetentativelistofkeyquestionsthatwillsteertheIEisasfollows:Thetentativelistofevaluationquestionstobeaddressedisasfollows(tobefinalizedafterthepreparatorymission):

1. Whathavebeenthetypesofwatersupply,sanitationandhygienepromotioninterventionsattheleveloffinaltargetgroups?

2. Inwhatwaywastheprogramimplemented(focusonthedistrict,communityandhouseholdlevel)?HowdiditevolveandwasthisinaccordancewiththeprogramTheoryofChange?

3. Whathasbeentheeffectonaccesstoanduseofimprovedwatersources?4. Whathasbeentheeffectonaccesstoanduseofsanitaryfacilities?5. Isthedrinkingwateratsourceandpointofusesafe(comparedtoWHOnorms)?6. Whathasbeentheeffectonhumanwaterconsumption?7. Whathasbeentheeffectonhealthoutcomevariablesofinterest?8. Whathasbeentheeffectontimeusedforwatercollectionandsanitarypurposes

21

anddistancetothenearestimprovedwatersource?9. Whathasbeentheeffectonproductive(self)employment(inclusiveofuseoftime

savingsforproductive(self)employment?10. Haveimprovementsbeeninclusive(e.g.betweencommunitiesclassifiedbywelfare

indicator,distancetoroad,size)?11. Havetheinterventionscontributedtoequalopportunitiesforwomenandgirls?12. Aretheresultssustainable?

a. Haveinstitutionalstructuresandrolesbeenwelldefinedandaretheseunderstoodandfulfilled?

b. Havetherelevantinstitutionsthecapacitytoperformtherequiredfunctions?

c. Arethefacilitiesprovidedtechnicallysound?d. Arethefacilitiesandservicesprovidedeconomicallyandfinanciallyviable,

includingmaintenanceandlongertermrequiredreplacementofinfrastructure?

e. Dotheinstitutionalarrangementsprovideforadequatemonitoring?13. WhathasbeentheroleandproportionalcontributionoftheAfDB,ascomparedto

othercontributors(communities,governments,developmentpartners)?

4. Methodology

InlinewiththeNetworkofNetworksonIE(NONIE)GuidanceonIEthemethodologicaldesignwillidentifythetypeofinterventionsthataresubjecttoIE,identifymainoutcomevariablesofinteresttostakeholders,articulatethetheoryofchangelinkinginterventionstooutcomes,addresstheattributionproblemanduseamixedmethodsapproachtoanalyzeimpact9.TheexpostIEdesignwillbequasiexperimental.Acrediblecontrolgroupneedstobeidentifiedtoaddresstheattributionquestion.Inadditionbasedontheoryonhowtheinterventionsareexpectedtoworkcriticalassumptionswillbetested.Forthekeyoutcomevariablesofinterestthebaselinewilltotheextentpossiblebyreconstructed.IEwillincludetheundertakingofasurvey of treated and control communities and households for a selection of regions andsampleofcommunitiesandhouseholds.Statisticalandeconometrictechniqueswillbeusedtodesigntheevaluationandestimateneteffects.Themethodforconstructingthecontrolgroup,theunit(s)ofimpactanalysis,sampleframework(s)andsamplingstrategyneedstobedefined. The feasibility of Difference in Difference design (before and after andwith andwithout comparison) will be assessed depending on possibilities to reconstruct base lineinformation.Asinterventionshavebeenappliedatdifferentperiodsintimeandindifferentcombinationssuchheterogeneitymaybeusedforthedesignoftheimpactevaluation.

In additional qualitative techniques (based on interviews of full range of stakeholders,observations, Group Discussions in a selection of communities) will be used forcomplementary analysis of factors that explain findings on effects, assessment ofsustainabilityofprogrambenefitsandexplorationofanypertinentissuesthatmayarise..Itwillalsoincludeanassessmentofsustainabilityofresultsandstudyofinstitutionalandotherdeterminingfactors.Aseparatemissionwillbefieldedforthecomplementaryanalysisandassessmentofsustainability.

9Source:NONIEIEsandDevelopment;NONIEGuidanceonIE,2009

22

SourcesofData

As part of preparations the usability of available data for the impact evaluation will beascertained.Totheextentpossibleavailabledatasourceswillbeusedtoestimateandassesseffects of interventions. Sample based community and household level surveys will bedesignedandadministeredasfarasrequiredtocomplementavailabledata.

5. TasksandResponsibilitiesoftheConsultant

ThisTORdescribesthetaskandresponsibilitiesfortheconsultantsprovidingservicesfortheimpactevaluation.ThekeyrolesandresponsibilitiesfortheconsultantliesindesigningandconductingtheimpactevaluationoftheAfDBsupportedRuralWaterSupplyandSanitationPrograminTanzania.Theconsultantsshouldidentifytherelevantmethodology.Amongotheractivities,theywilldecide/proposeontheappropriatenessoftheexistingsecondarydataandtheneedforcollectingprimarydata-definethesamplesizesrequiredtoestimateeffects,aswell as the sampling strategy. S/he work in consultation with the IDEV supervisory TaskManagerandanationalresearchinstitute/surveyfirminimplementingthesurvey.

Thescopeoftheassignmentincludes,butisnotlimitedto,thefollowingactivities:

Preparatorymission

The IDEVTaskManager, in consultationwith theAfDBFieldOffice,willpreparea10dayspreparatorymission to Tanzania, togetherwith the consultants. Themission teamwill betaskedtoi)consulttherelevantauthoritiesandotherkeystakeholdersontheIE;ii)obtainagood understanding of the program interventions and final target beneficiary target level(communityhousehold, localGovernment) level theoryofchangebyvisitingaselectionofdistricts WASH teams and program sites; iii) check availability of data and develop themethodologicaldesignfortheIEandiv)discussthedesign,tentativeworkprogramandroleofstakeholdersintheIEprocesswithkeystakeholdersv)identifyandshortlistsurveyfirmsthatarequalifiedandcapabletoconductthesurveyifandasrequired.

Developtheimpactevaluationdesign

TheConsultantswilldeveloptheimpactanalysisdesigntoprovidecredibleestimatesofneteffectsoftheBank’ssupportedinterventionsonkeyoutcomevariablesofinterest.

• Participate in the preparatory mission to understand and properly describe thecontextandbackgroundoftheprogram,investigateavailabilityofsecondarydataanditsusabilityfortheimpactevaluationandconsultauthoritiesandotherdevelopmentpartners.

• Proposetheimpactevaluationdesignandmethodologyfortheassignmentathand.

23

SamplingsizeandStrategy

S/he will define the counterfactual, sample frame, sample sizes and sampling strategy toestimateprograminterventioneffects.Thiswillinclude:• Theoutcomeindicator(s)thatareusedtodeterminethesamplesize(s)• Theminimumimpactsthatthestudyshouldbedesignedtomeasure• Thenumberofcommunitiesineachofthecontrolandtreatmentgroups• Thenumberofhouseholdsandindividualsineachcommunity• Definitionofthesampleinclusioncriteria.

Surveyquestionnairedevelopment

• Developsurveyquestionnairefortheimpactevaluation• Developtrainingmanualfortheconductofthesurvey.• Providetrainingforthesupervisorsandfieldworkers(enumerators).

Implementationofimpactevaluation

• Questionnairepretesting.• Overseethedatacollectionprocess.• Provideguidelinefordataentryandrecording.• Communicationwithotherevaluationteammembersandnationalresearchersinvolved.• Undertakefollowupmissiontofurtherstudyexplanatoryfactorsandassesssustainability

ofresults

Reportwriting

• Conductdataanalysisandvalidation.• Preparedraftimpactevaluationreport

6. DeliverablesandSchedule

Tworeportsareexpectedasmaindeliverablesofthisassignment

1. Inceptionreport:Theinceptionreportwillbepreparedafterthepreparatorymissiontothecountrywithinaperiodofonemonth.Atthisstage,thereporthastoprovideadetaileddescriptionoftheprogram,typesofinterventionsandimplementationandthe detail of the quantitative impact analysis design and methodology, surveyquestionnaires,sampledesignsetc.Italsohastooutlinetheimplementationplan.Itisexpectedthattheinceptionreportprovidesthefoundationfortheimplementationofthequantitativeanalysispartoftheimpactevaluation.

2. Impactevaluationreport.Thisreportprovidestheresultsofthestudyofruralwatersupply and sanitation, addressing the key questions and accounting for themethodologyappliedtoaddressthequestions.

The inception reportanddraft impactanalysis reportwillbe reviewedboth internallyandexternally toensurehighstandardofqualityof thereport.Thepeer reviewerscomefromIDEV, other departments in the Bank, Government of Tanzania representatives and anexternalexpertinthefieldofimpactevaluation.Theconsultantshavetoaddresscommentsand suggestions in revising and producing the inception report and final draft report. AlldeliverablesmustbewritteninEnglish.

24

TheassignmentisscheduledtobegininJanuary/February2015withthepreparatorymission,andendaroundOctober/November2015.Theworkloadisestimatedtobe70workingdaysforeachoftheconsultants.Theexpertswillneedtobeavailableanddedicatedatkeystagesofthework.Thetentativescheduleisshowninthetablebelow.

Table1.Deliverablesandtentativescheduleforimpactstudy

No. ServicesExpert1 Estimateofnumberof

days

Tentative

completionperiod

1 IEpreparatorymissiontoTanzania 10 January-February2015

2 Inception report, including 3-5 pagedescriptive chapter on the TanzaniaRWSSPandAfDBsupport,onmethodologyforsustainabilityandinstitutionalanalysisandinsertingcontributionofexpertII

10 March-April2015

3 Contribution to quality assurance ofsurvey,includingcontributiontoreviewofproposed survey and training ofenumerators

5 March-April2015

4 Fieldmissionforsustainabilityassessmentand institutional analysis and holding ofstakeholderworkshop

20 September2015

5 Drafting of IE report, including insertingcontributionofexpertII

20 September-October2015

6 Communication with expert II, IDEVsupervisory Task Manager, stakeholders,peer reviewer and survey firms andprocessing of comments on inceptionreportanddraftIEreport

5 February-November2015

Totalnumberofdays 70 No. ServicesExpertII Estimateofnumberof

days

1 IEpreparatorymission 10 January-February2015

2 Inception report part on methodologicaldesignforquantitativeimpactanalysisanddesignandtestingofsurveyinstruments

10 March-April2015

3 Quality assurance of survey, includingcontribution to piloting of questionnairesandtrainingofenumerators

10 May-June2015

4 Quantitativeimpactanalysis 20 July-September2015

25

No. ServicesExpert1 Estimateofnumberof

days

Tentative

completionperiod

5 Draft chapter on quantitative impactevaluation

15 September-October2015

8 Communication with expert I, IDEV TaskManager,stakeholders,peerreviewerandsurveyfirmsandprocessingofcommentsoninceptionreportanddraftIEreport

5 February–November2015

Totalnumberofdays 70

7. Requiredskillsandqualifications

Theexpertsshouldmeetthefollowingrequirements.

ExpertI:

• Advanceduniversitydegreeinsocialscienceswithstrongresearchskills;• At least 5 years of experience in policy and/or program evaluations in developing

countries;• Experiencewithsustainabilityassessmentandinstitutionalanalysis;• ExperiencewithconductingmixedmethodsIE;• ExperienceinAfricancountries,inparticularinTanzania,willbeadefiniteadvantage;• Priorevaluationexperience inmultilateralaidorganizations/financial institutions is

anadvantage;• Excellentreportwritingskills;• ExcellentspokenandwrittenproficiencyinEnglish;• ProficiencywithstandardMSsuite,alongwithSPSSorStataorequivalent.

ExpertII

• Advanceduniversitydegreeineconomics,withstrongtechnicalskills intheareaofquantitativeIEtechniques(statisticalandeconometrictechniques);

• At least fiveyearsofpriorexperience inevaluationand in statistical IEdesignandimplementationofsurveys,ofwhichatleasttwoyearsindevelopingcountries;

• Experience in conducting IE in ruralwater supply and sanitationwill be a definiteadvantage;

• ExperienceinAfricancountries,inparticularTanzania,willbeadefiniteadvantage;• Priorevaluationexperience inmultilateralaidorganizations/financial institutions is

anadvantage;• ExcellentspokenandwrittenproficiencyinEnglish;• ProficiencywithstandardMSsuite,namelyExcel,alongwithStataorequivalent.

26

8. ManagementandReporting

ThisimpactevaluationwillbeconductedundertheguidanceofIDEV’sEvaluatorGeneralandsupervisionoftheassignedsupervisoryTaskManager.Asdescribedabove,theservicesrequiredfromtheteamofexpertpertaintothedesign,implementation and reporting of the impact evaluation results. These services entailfieldwork,datacollectionandanalysisandreportwritingandreviewing.IndeliveringthereporttheexpertsareexpectedtoworkcloselytogetherandinconsultationwiththeIDEVTask Manager, national research institute/ survey firm, and national staff from theconcernedministryinthegovernmentAreferencegroupwillbeestablishedwhichcomprisesIDEV,Bank’sResearchDepartmentandOperationsDepartment,GovernmentofTanzaniaandexternalIEexpert.Thegroupwillcommentandmakesuggestionsontheexpectedinceptionreportanddraftimpactevaluationreport.The field work, namely the conduction of surveys if needed, will be supported by anationalresearchinstitute/surveyfirm.Thetermsofcollaborationwillbediscussedandagreedinduetimeandtheseserviceswillbecommissionedseparately.

9. Attachments

AfDB,2005.Tanzania:RuralWaterSupplyandSanitationProgramCompletionReportAfDB,2010.Tanzania:RuralWaterSupplyandSanitationProgramAppraisalReportMinistryofWater,2004,RWSSPimplementationmanual

27

Annex2. Debriefingnote:preparatorymission

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

INDEPENDENTDEVELOPMENTEVALUATIONDEPARTMENT

DEBRIEFINGNOTE:PREPARATORYMISSION:

IMPACTEVALUATIONOFRURALWATERSUPPLYANDSANITATIONPROGRAMME

1. Introduction

AmissionteamoftheIndependentDevelopmentEvaluationDepartment(IDEV)oftheAfricanDevelopmentBank (AfDB)comprisingMrsRitaTesselaar (IDEVTaskManager),DrKennethMdadila(consultantspecialisinginquantitativeresearch)andDrStephenTurner(consultantspecialisingininstitutionalissues)undertookthepreparationofaproposedimpactevaluationoftheAfDBsupportedRuralWaterSupplyandSanitationProgramme(RWSSP)between26Februaryand12March2015.Thisdebriefingnoteoutlinestheworkdoneduringthemission.

Thetasksofthemissionteamwerei)toconsultstakeholders,ii)collectrequiredinformationfor the design of the impact evaluation of the programme interventions, allocationmechanismsandoutcomeandcontextualvariablesof interest, iii) check theavailabilityofrelevantexistingdata(statisticaldata,administrativerecords)iv)preparethemethodologicaldesignandv)makearrangementsfortheimplementationoftheimpactevaluation.Followingthe mission an inception report further detailing the methodology and implementationarrangementsofthestudywillbeprepared.

ThemissionteamhelddiscussionswithofficialsoftheMinistryofWater(MoW),theMinistryof Education and Vocational Training (MoEVT), theMinistry of Health and SocialWelfare(MoHSW),theNationalBureauofStatistics,theUnitedKingdomDepartmentforInternationalDevelopment,theWorldBank,WaterAidandtheAfDB.Thepurposeofthesemeetingswastoreviewthestatus,performance,achievementsandchallengesofthenationalWaterSectorDevelopment Programme (WSDP) to which the RWSSP has contributed; to obtaindocumentationanddataaboutruralwatersupplyandsanitation; toassess theavailabilityandadequacyofdatathatwillbeneededfortheimpactevaluationanditssurveysamplingprocess; to introduce IDEV’s plan for an impact evaluation; and to identify issues andquestionsthatstakeholderswouldliketheevaluationtocover.

Themission teamvisitedMkurangaandKisarawedistricts,where theymetDistrictWaterEngineersandWaterSupplyTechniciansoftherespectiveDistrictCouncils.Withthesupportoftheseoffices,theyvisitedKilamba,KihareandMwengavillages,wheretheymetmembersof Community Water Supply Organisations (COWSOs), staff of primary schools anddispensaries,waterusersandacontractedwaterschemedevelopmentserviceprovider.

28

IDEViscommittedtodevelopingevaluationcapacityinAfricangovernments.Ithasfacilitatedinitial training on impact evaluation forGovernment staff, including staffmembers of theTanzaniaMOW.Themissionteammettwoofthesepersonnelforpreliminarydiscussionsontheirparticipationintheplannedimpactevaluation.

Implementation of the impact evaluation will require the selection and contracting of aTanzanian researchorganisationor firm. Inorder to explore serviceprovider capacity andinterest and draw up a shortlist, themission teammet representatives of the Centre forEconomicResearchandPolicy(CERP)attheUniversityofDaresSalaam;theEconomicandSocialResearchFoundation(ESRF);EconomicDevelopment InitiativesLtd. (EDI);andPolicyResearchforDevelopment(REPOA).

Thisdebriefingnoteprovidestheviewsofconsultedstakeholders,theproposedcoverageandmethodology for the impactevaluation, the implementationarrangements,nextstepsandplanningofthestudy.

Themission team is grateful to all stakeholdersmet for their views, information and thesupportprovidedtoit.ThemissionteamparticularlywishestothanktheMOWandtheAfDBField Office for facilitating the mission programme. The list of persons met is attachedasAnnex3.

2. Viewsofconsultedstakeholders

Governmentanddevelopmentpartnersexpressedsupportfortheplannedimpactevaluation,believing that itwould be a usefulway to enhance understanding of the ruralwater andsanitationsectoroutcomesandmakefutureprogrammingmoreeffective.Outcomevariablesof interest mentioned include district and community levelWASH institution building forWASHserviceprovisionandfunding,useofsafewatersuppliesandimprovedtoiletfacilities,handwashing,health,timesavings,useoftimesavings,schoolenrolmentandattendance,(self)employment,domesticconflictsandwomen’ssafety.AnimpactevaluationoftheWorldBankWaterandSanitationProgramme’sTotalSanitationandSanitationMarketingProjecthasbeenundertaken,andfinalreportingshouldbecompletesoon.Buttherehasbeennoother impact evaluation of rural water and sanitation in the country since the study ofShinyangaRegioncarriedoutin2007.

Stakeholders confirmed theassessmentofdocumentation consultedby themission team:thattheperformanceoftheWSDP(andthusoftheRWSSPPhasesIandII)wasslowformostofPhaseI,whichended(fromthegovernmentperspective) in201410. Intheearlyperiod,from2007,andaftersubstantialimplementationdelaysduringwhichneverthelesscapacitieswere built and service providers contracted, the focus was on ‘quick wins’, whichmainlycomprised rehabilitation of existing schemes. Construction of new schemes at scalecountrywideonlybeganin2012,pickingupspeedin2013.Intermsofinfrastructureoutputsand livelihood impacts, the amount this impact evaluation can assess will therefore bemodest.

There is awidespread view that ruralwater and rural sanitation interventions have beenpoorly harmonised in practice at community level in recent years. District Water and

10Fromthedonorperspective,WSDPPhaseIcontinuesuntilJune2015,whilefundstheyprovidedforthatphaseareusedup.FullimplementationofPhaseIIwillstartinJuly2015.

29

SanitationTeamscontinuetoexistandtheNationalSanitationCampaignthatwaslaunched(withsubstantialAfDBfunding)in2012wasmeanttoprioritisevillagesselectedforimprovedwatersupplies.ButthisCampaignhaspartlybeen implemented independentlyofthe ‘TenVillages’interventiontoputnewwatersupplyinfrastructureintothatnumberofvillagesineachdistrict.Itisreportedlycommonforruralwatersupplyprogrammestobeimplementedincommunitieswithlittleornoreferencetoenhancedsanitationandhygienepractice.Thisplaces a question mark over the extent to which the integrated WASH policy has beenimplemented and improved water supplies may be having a beneficial impact on healthindicators.

Theconsensusamongstakeholdersisthat,althoughthetangibleruralwatersupplyoutputsoftheWSDP(andRWSSP)havebeenlimited,importantinstitutionalprogresshasbeenmade.Majoreffortsandsubstantialresourcesweredevotedtoenhancingsystemsandproceduresatnational,regional,districtandcommunitylevels–helpingtoexplainwhysuchverylargeinvestmentsachievedonlymarginalincreasesincoverage.Asatheory-basedevaluationthatassessesnotonlytheultimateimpactbutalsothecausalfactorsandassumptionsthroughoutthe theoryof changeunderpinning theprogramme, the studywill be careful to learn andreport on the lessons from this institutional effort. This should lead it to offer usefulconclusionsonthesustainabilityofruralwaterandsanitationinterventions.

3. Coverageandfocusoftheproposedimpactevaluation

Timeperiod:RWSSPPhaseIoperatedfrom2007to2010.PhaseIIcoveredtheperiod2011–2014,withanocostextensiontoJune2015.ThesetwophaseswereconcurrentwithPhaseIof the WSDP11 (whose further phases will run to 2025). The AfDB-funded RWSSP was aprincipalsourceoffundingforComponent2(RuralWaterSupplyandSanitation)oftheWSDP.Asnotedabove,genuinelynewinterventionsundertheWSDP(asopposedtothe‘quickwins’that dominated the early years of the programme) only began construction in 2012. Thisevaluationwillcoverallschemescommissionedunderthe‘TenVillages’initiativeoftheWSDPbetween 2012 and June 2014, i.e. one year before the anticipated field survey – on theassumption thatmeasurable beneficial impactsmaybe achievedwithin 12months of theenhancedwatersupplycomingintoservice.

Geographic coverage: the RWSSP and Component 2 of theWSDP covered all rural LocalGovernmentAuthorities (LGAs) inmainlandTanzania.The impactevaluationwill thereforecover the whole of the ‘Ten Villages” experience, using a quasi-experimental designcomprisingarandomsampleofLGAs,comparingchangesovertimeinkeyoutcomevariablesinaselectionofthreecommunitieswithandthreecomparablecommunitieswithoutWASHinterventions(seesection4below).

Typesofinterventions:theevaluationwillbeconcernedwiththefollowinginterventionsintheselectedruralcommunities:

• rehabilitationand/orextensionofexistingcommunitywatersupplies;

• installationofnewcommunitywatersupplies;

• promotionofenhancedsanitationandhygienesystemsandpractices;

11Seefootnote2above.

30

• capacitybuildingfordistrictandlocal institutionsinthemanagementofwatersupply systems and the promotion of appropriate sanitation and hygienepractices(includinghardwareandsoftware);

• schoollevelwater,sanitationandhygiene(WASH)interventions(forwhichAfDBwastheprincipalfunderundertheWSDP).

4. Impactevaluationmethodology

ThemissionteamworkedtogetherandwithMoWcolleaguestoidentifythemainfeaturesoftheimpactevaluationmethodologythatwillbeappliedduringthisstudy.Themethodologywillbespecifiedinfullintheinceptionreport.

Outcomevariables:themainoutcomevariablestobemeasuredwillincludethefollowing:

• numberofusersperimprovedwatersource;

• purposesforwhichimprovedwatersourcesareused;

• functionalityofimprovedwatersource;

• consistencyofuseofimprovedwatersourcesthroughtheseasons;

• distancetotheprimaryimprovedwatersourceforhumanconsumption;

• waterqualityatsourceandpointofuse;

• waterconsumption(forhumanconsumptionandbasichygiene,l/person/day);

• use,typeandconditionoflatrines;

• hygieneandsanitationbehaviourchange(self-builtimprovedlatrines,safehandwashingpractices,safewaterhandling);

• healthimprovement:reductioninincidenceofwaterbornediseases(diarrhoeaasproxy);

• traveltimetofetchwater;

• timesavings;

• girls'primaryschoolenrolment,attendanceanddropoutrates;

• women’sperceivedsafetyinfetchingwaterandeffectondomesticconflicts;

• economic benefits (e.g. employment and income generating opportunitiescreatedforadults,especiallywomen);

• affordabilityofwatersupply;

• inclusivityofwatersupply(verypoor,disabledetc.haveaccess);

• functioninglocalmanagementinstitutions;

• functioningwatersystem(maintenanceisachieved).

Theidentificationwillbeguidedbyatheory-basedapproach.‘Theory’referstotheexpectedway (processes,mechanisms, actions)bywhich capacities arebuilt and changes in impact

31

indicator variables occur (from correct identification of beneficiary communities, tocommunitymobilisationandcapacitybuilding,toprovidingaccesstosafewateranduseoffacilities,toimprovedsanitationandhygienepractices,tohealthandnon-healthoutcomes).Thiswillmakeitpossibletoexplainthedegreeofimpactachievedatcommunity,householdand individual levels, and to learn lessons and make recommendations, e.g. on howinstitutional and procedural outcomes can be enhanced in order to achieve strongerdevelopment impact The inception report will further elaborate on the theory-basedapproach.

Inoutline,thestudywillinvolvethefollowingdatacollectionmethods:

• review of documentation and available secondary data, ranging from sectoranalysis and programme reporting to databases maintained by local primaryschoolsandhealthfacilities;

• survey questionnaires: LGAWASH team, water point committee, community,households,schools,healthdispensaries;

• structured and semi-structured interviews with key informants, ranging fromnationalgovernmentanddevelopmentpartnerpersonneltoofficialsofregional,districtandvillagegovernments;

• focusgroupdiscussionsinbeneficiaryandnon-beneficiarycommunities;

• collectionandanalysisofwaterqualitysamplesatwaterpointsandpointsofuse;

• statistical andquantitative impact analysis of primary and secondary datasetsobtainedbytheabovemethods.

The impactsurveywillnotbeabletorefertosystematicallycollectedbaselinedata. Itwilltherefore have to reconstruct the baseline situation in beneficiary and non-beneficiarycommunitiesby:

• reviewofsecondarydatasetscoveringthe‘baseline’period,beforetheschemewasintroducedoratasimilarperiodfornon-beneficiarycommunities’–notablyhealthfacilityandprimaryschoolrecords;

• recallquestionstocommunityrespondentsaboutparameterslikehealth,watersourcesusedandtimetakentocollectwater.

Usability of existing databases/secondary data: In Tanzania, there are various householdsurveydatasets(includingHouseholdBudgetSurvey(HBS),DemographicandHealthSurvey(DHS)andNationalPanelSurvey(NPS)).TherearealsoadministrativedatabasessuchastheManagement Information System (MIS). These datasets tend to contain some modulesrelatedtoaccesstoimprovedwatersourcesandsanitation.However,theirsuitabilityforthepurposeof the current impact evaluation is limited. First, the samplingunit used in thesesurveys is the enumeration area (EA), which does not overlap with the primary unit ofobservationenvisagedbythepresentstudy(i.e.,beneficiaryvillagesoftheRWSSP).Secondlyandmostimportant,suchhouseholdsurveysarenotdesignedformeasuringtheimpactofRWSSPastheylackenoughbeneficiaryvillages/communitiesandhouseholdsintheirsamples.Thirdly,theadministrativedatacurrentlyavailablelacksomeimportantinformationfortheenvisaged impact evaluation study. For instance, the water sectorMIS currently containsfinancial and contract management information only and nothing on monitoring andevaluationofthewaterschemes.Similarly,theWaterPointMappingdatabaseisinfrequentlyupdated and does not contain household and individual level variables. Nevertheless, the

32

existingsurveydataandadministrativerecordswillbeusedtoprovideabetterunderstandingofthetrendsandpatternsofsocio-economicdevelopmentovertimeinthecountryingeneralandthesampleddistrictsinparticular.Furthermore,thesedatasetswillassisttheevaluationteaminestablishingmeasurableindicators.

Counterfactual and statistical design: the fundamental question for this envisaged impactevaluationstudyis“whatwouldhavehappenedtotheoutcomevariablesofinterestinthebeneficiary villages and households with RWSSP interventions had the program not beenimplementedintheselocalities?”Toanswerthisquestionandmeasuretheimpact,variousstatisticalandeconometricapproacheswillbeemployed.Ideally,theimpactwillbemeasuredby comparing average values of the outcome variables for the sample beneficiarycommunitiesandhouseholds(treatmentgroup)withtheaveragevaluesofthesameoutcomevariablesforasampleofcomparablenon-beneficiaryvillagesandhouseholds(controlgroup).Thecommunitylevelunitofanalysiswillbethehouseholdsregisteredasusersofaparticularwaterpoint.Robustimpactevaluationrequiresamongotherthingsaproperselectionofthecontrolgroup.Inthecurrentstudy,thisgroupwillbeformedbyidentifyingcommunitiesandhouseholds with similar characteristics as those of the beneficiary communities andhouseholds. The main factors or characteristics for identification of control communitieswithineachofthesampleddistrictswillbe:

• similarityinpopulationdensity;

• similarity in infrastructural development (e.g. presence of school and healthfacility);

• similarityinagro-ecologicalzone;

• similarity in sources of water supply and sanitation services prior to RWSSPinterventions.

Oncethedatanecessaryfortheimpactevaluationhavebeencollectedfrombothbeneficiaryand non-beneficiary communities and households, some combination of statistical andeconometric techniques will be used in the estimation of the RWSSP interventions. Inparticular, the following methods will be used: (1) propensity score matching (PSM); (2)difference-in-differences(DD);(3)acombinationof(1)and(2).Furthermore,analysisofthecollecteddatawillbedoneto(i)establishwhethertheimpactsoftheprograminterventionsareuniformacrossthebeneficiaries(villagesandhouseholds)and(ii)iftherearedifferentialimpactsin(i),identifymainfactorsinfluencingprogrammeimpact.

Determinationof sample size: the sample sizeof villagesandhouseholds required for thisstudywillbedeterminedusingpowercalculation.Thestudywilluseabalanceddesignandallocateanequalnumberofsamplevillagesandhouseholdswithinthetreatmentandcontrolgroups.Thekeyvariableusedforpowercalculationwillbediarrhoeaprevalence.Thetotalsamplesizeobtainedthroughthepowercalculationwillbeadjustedbya15%inflationfactortoaccountforanticipatedtrimmingofthesampleduringthematchingbetweentreatmentandcontrolgroups.

Sampling strategy: As has been stated earlier,WSDP Component 2 is financed is throughbasket fundingandAfDB is themajordonor.With this fundingmechanism it isdifficult toisolatetheAfDBcontributiontotheprogrammefromthatofotherdonors.Thedesignoftheimpactevaluationthusrequirescoveringthewholecountry,whichwouldnotbefeasible.Weproposearandomsampleof30LGAsoutofatotalof113LGAsthatconstructedatleastthree

33

waterschemesundertheTenVillagesinitiativebyJuly2014(atotalof138LGAscompletedatleastonescheme).Thestudywillconsidertwosamplingoptions.

The first option involves taking a random sample of 30 LGAs. Subsequently two samplingframeswillbedevelopedforselectingthreewaterpointbeneficiarycommunities,usingthelistofwaterschemesasreferenceforsamplingthreeschemesandsubsequentlyoneofthewaterpointsineach;andthreenon-beneficiarycommunitieswithinthesampledLGAsusingalistofcomparablecommunitieswithoutaccesstoimprovedsources.Thiswillbefollowedby the selection of user households from within chosen communities using a systematicsamplingprocedure.Forthebeneficiarycommunitiestheregistryofuserhouseholdsfortheparticular water point will be used for sampling ten households. For the selected non-beneficiarycommunitiesalistofhouseholdswillbepreparedforsubsequentsamplingof10households.

Thesecondoptioninvolvesfirstselecting15regionsrandomly.SecondlyasystematicrandomprocedurewouldbeusedtoselecttwoLGAswithineachsampledregion.Thetotalsamplewillthuscomprise30LGAssampledfrom15regions.Communitiesandhouseholdswillbeselectedusingthesameapproachasinoption1.Afterconsideringlogistical issuesandtheimpliedcost,oneofthetwoproposedsamplingoptionswillbeadopted.TheinitialsamplingoutcomesusingoptiononeandoptiontwoareshowninAnnex2.

Preparation of survey instruments: the inception reportwill give full details of the surveyinstrumentstobeusedintheevaluation.Thesewillcomprise:

• QuestionnaireforusewiththeLGAWASHteam(DistrictWaterEngineers,DistrictHealthandEducationOfficers) tocollect informationonhistoryof selectionofsamplecommunities,interventions,districtcapacitybuildingandoutcomesandfollowupsupporttosamplecommunitiesprovided;

• Surveyquestionnaire forwaterpoint (water committee/COWSO), community,households,school,dispensary.

Surveyinstrumentswillbedesignedtoreflectandexplorethetheoryofchangeidentifiedforthe RWSSP. The survey instruments will includemultiple modules to collect data at thecommunity, household and individual levels and will include recall questions to capturebaselinecharacteristicsofthesamplecommunitiesandhouseholds.Inparticular,householdrespondentswillbeaskedquestionson their current statusaswellas their characteristicsbeforeand/oratthestartoftheRWSSPinterventions.Community-levelsurveyswillcapturecommunitycharacteristicsandmainfactorsexplainingcommunityparticipationintheRWSSP,tocontrolforexternalandselectionfactorsintheestimationofimpactoftheinterventions.Among others, the community questionnaires will collect the following data on variablesaffectingcommunityparticipationintheRWSSP:

• programmetargetingcriteria(e.g.populationdensity,distancetowatersource,severityofWSSproblem,communitymotivationandcommitment,etc.);

• self-selection characteristics and factors, including community motivation andcontribution;

• othervillage-level characteristics includingaccess to roads,populationdensity,markets,andagro-ecologicalzones.

34

5. Implementationarrangements

TheimpactevaluationteamcomprisesDrStephenTurner(SeniorEvaluator)andDrKennethMdadila (expert in quantitative research) under the guidance of Rita Tesselaar, IDEVsupervisoryTaskManager,andtheEvaluatorGeneralofIDEV.DrTurnerandDrMdadilaareresponsiblefordeliveringthedraftimpactevaluationreportoftheRuralWaterSupplyandSanitationProgramsupportedbyAfDB.

Quality assuranceof the report: IDEV accords highpriority to thequality of its evaluationreports.Therequiredqualityofthis impactevaluationwillbeenhancedthroughformingaReferenceGroup(RG)andPeerReview(PR)mechanism.

TheproposedcompositionoftheRGisarepresentativeoftheMoW,theMoHSWandtheMoEVT,theTaskManagersofDfIDandtheWorldBank,theAfDBSectorDepartmentandFieldOffice.RGmembersareexpectedtocommentonthedraftinceptionreportandthedraftfinalimpact evaluation report. For the MoW, the Assistant Director Operation Planning Eng.JacksonMutazambawillbethecontactpersonfortheimpactstudy.

Inaddition to theRGdescribedabove, IDEVhasengaged the impactevaluationexpertDrHowardWhitetoserveaspeerreviewerofthisimpactevaluation.In2014DrWhiteprovidedimpactevaluationtrainingtoGovernmentstaff,includingthetwostaffmembersoftheMoW(seeabove).

IDEVintendstocontractaresearchorganisationorsurveyfirmforconductingthesurveyatthedistrict,communityandhouseholdlevels.Asmentionedinsection1,themissionteamheld initial discussions on possible collaborationwith four potential organisations, namelyREPOA; ESRF; CERP; and EDI. The National Bureau of Statistics also expressed interest inproviding the required services. Based on the impact evaluation design, IDEV will detailrequirementsandprepareaRequestforProposalsleadingtoprocurementoftheservicesofoneof theseorganisations.Theresearchorganisation isexpectedtoworkcloselywiththeevaluationteam.

StrengtheningAfricanNationalEvaluationSystemsinitiative:IDEVhasbeenworkingwiththeGovernmentofTanzaniaonstrengtheningevaluationsystems.Inthiseffort,staffcapacitywasidentifiedasoneofthechallenges.Tohelpaddressthischallenge,IDEVhasorganizedtrainingonthefundamentalsofevaluationandimpactevaluation.IDEVintendstoenhanceevaluationcapacity through providing on the job practice to government staff after the theoreticaltraining.Thiswillhelptobuildtherequiredcapacitythroughapragmaticapproach.Twostaffmembersof theMoW,whoparticipated in impact evaluation training in 2014, havebeennominatedbytheMoWtobeinvolvedintheimpactevaluationasalearningopportunity.Theconcerned staff members will be asked to comment on the inception report; assist theevaluationteaminretrievinginformationanddevelopingafileonavailabledescriptivedataas requiredon sample LGAs,water points and communities; andwill be invited to attendtrainingofsurveysupervisorsandenumerators,pilotingofquestionnairesandapartofdatacollection.

Nextsteps:afterthismission,DrTurnerandDrMdadilawillpreparetheinceptionreport.Thereport will detail the design of the impact evaluation, survey questionnaires andimplementation.TheinceptionreportisdueattheendofApril2015.Aftertherecruitmentofa researchorganisation/survey firm, it isplanned toconduct the survey in June-July2015.Qualitativeresearchwillbeconductedtocomplementthequantitativeanalysisandassess

35

sustainabilityofthecommunitybasedruralwatersupplyandsanitationservices.Thisverytightworkschedulecanonlyberealisediftherearenounforeseenobstaclesintheprocess.ThecompletionoftheentireimpactevaluationreportisscheduledforOctober/November2015.

Theworkscheduleisshownbelow.

• Inceptionreport April2015• Recruitmentofsurveyfirm April2015• Pilotingandtrainingofenumerators SecondhalfofMay2015• Conductofsurveys June–July2015• Qualitativeresearch(focusgroup/keyinformant

interview)July2015

• Dataanalysisandcompilingofreport August–September2015

36

Annex 3. List of persons met during inception mission

Name Position e-mail address 1 Mr. S.Marandu AfDB Task Manager RWSSP s.marandu@afdb.org 2 Eng. Frida C.Rweyemamu Director Rural Water Supply forweye@hotmail.com

drws@mow.go.tz 3 Eng. Jackson L.Muttazamba Assistant Director Rural Water

Supply jmuttazamba@yahoo.com

4 Dr. Philipo Chacha Director Central Water Laboratory

MoW

5. Mr. Melmba Abassy National Bureau of Statistics mlemba.abassy@nbs.go.tz

6. Mrs. Sylvia Meku National Bureau of Statistics sylvia.meku@nbs.go.tz 7. Mrs. Gertrude Mapunda Social Development Adviser g-kihunrwa@dfid.gov.uk

8. Mr.Yitbarek Tessema Lead Water and Sanitation

Specialist, AFTU 1 ytessema@worldbank.org

9. Eng.Renard J.Baseki District Water Engineer renardbaseki@yahoo.com

10. Alphonce L Nyamba VEO Kilamba 11. Damas Jones CO Kilmaba damasnciz@yahoo.com 12. Mrs. Asha Kuligani Teacher Kilamba 13. Mr. Augustino Chikawe Secretary COWSO 14. Mrs. Razia Ally User Household member 15. Mr. Majid A. Mitili DWE Kisarawe mitilijunior@yahoo.com

16. Mr.L.Balige WASH Facilitator baligeleo@gmail.com 17. Mr. Mohamed Omari Ndalo Mwikiti chairperson water

committee

18. Mr. Ajth Kumar Manager WSP-TZ ckumar@worldbank.org

19. Mr. Kaposo B. Mwambuli Water and sanitation specialist

WSP kmwambuli@worldbank.org

20. Dr. Tansi Kida Director Programs ESRF tkida@esrf.org.tz 21. Dr. Blandina Kilama REPOA bkilama@repoa.or.tz 22. Mrs. Theresia Kuiwite NSWASH coordinator, MoE Tkuiwite2000@yahoo.com 23. Mr. Anyitike Mwakitalima NSC coordinator MoH Anyitike76@yahoo.co.uk

24. Mr. Joseph Mbuya MoE WASH Accountant 25. Dr. Stephen Kirama Coordinator Fieldwork CERP Ngareni3@yahoo.co.uk

26. Eng. Samwel Kayombo MoW Technical Support samwelkayombo@yahoo.com

37

27. Eng. Conrad Mkomoya MoW Operations planning conradmkomoya@yahoo.com

28. Dr. Tonia Kandiero ResRep AfDB FO t.kandiero@afdb.org 29. Mrs. Amy Kahn EDI-Bukoba a.kahn@edi-africa.com

38

Annex4. Keyparametervaluesusedintheestimationofsamplesizes

Outcome/impactvariables Baselevel/rate Target/minimum

effectsize

Intra-cluster

correlation

Useofimprovedwatersource 55.7% 64%target 0.24168Traveltimetowatersource(oneway)

35

30

0.14050

Totaltimespentonfetchingwater

57 0.22565

Useoflatrine 23% 30% 0.11614Prevalenceofdiarrhea 0.15 Reductionby30% 0.02430Schoolenrolment:all 0.9660 0.9803 0.11568Schoolenrolment:boys 0.9693 0.9803 0.13239Schoolenrolment:girls 0.9573 0.9803 0.09963Schooldropout:all 0.031

Reductionby30%

0.04784Schooldropout:boys 0.0286 0.07061Schooldropout:girls 0.033575 0.02369Women'sparticipationinproductiveemployment

83% 95% 0.07102

39

Annex5. Drafthouseholdquestionnaire

40

UNITEDREPUBLICOFTANZANIAAFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

HOUSEHOLDQUESTIONNAIRE

HouseholdID

SECTIONA.IDENTIFICATIONPARTICULARS

A1.LOCATIONIDENTIFICATION

S/N LOCATION NAME ID.NO

A1.1 REGION A1.2 DISTRICT A1.3 WARD A1.4 VILLAGE A1.5 COMMUNITY A1.6 WATERPOINT(NAME) A1.7 TYPEOFWATERPOINT 1=TreatmentScheme2=ControlScheme A1.8 AGRO-ECOLOGICALZONE

41

A2.SURVEYSTAFFDETAILS

A2.1 NAMEOFENUMERATOR A2.2 ENUMERATORCODE A2.3 TIMEINTERVIEWSTART A2.4 TIMEINTERVIEWEND A2.5 DATEOFINTERVIEW A2.6 NAMEOFSUPERVISOR A1.7 SUPERVISORCODE A2.8 NAMEOFDATAENTERER A2.9 DATAENTERERCODE

INTRODUCTIONTOHOUSEHOLDTOBEINTERVIEWED

Mynameis________,andIamhereonbehalfof(SURVEYFIRM),theMinistryofWaterandtheAfricanDevelopmentBank.TheobjectiveistocarryoutasurveyforanImpactEvaluationofTanzania’sRuralWaterSupplyandSanitationProgramme.Iwillbeaskingyouaseriesofquestionsrelatingtogeneralhouseholdinformation,economicactivities,accessanduseofwaterandsanitationservicesandotherquestions.Letmeclarifyandinsistthatthissurveyisconfidentialandvoluntary,andanyinformationthatweobtainwillonlybeusedanonymously,forimpactevaluationpurposes.BeforeIstart,doyouhaveanyquestionsoristhereanythingwhichIhavesaidonwhichyouwouldlikefurtherclarification?MayIproceedwiththeinterview?

InstructiontotheSurveyor:ThisquestionnaireshouldbeadministeredtoHouseholdHeadand/oradultfemalememberofthehousehold.

A3 NAMEOFHOUSEHOLDHEAD A4 NAMEOF RESPONDENT (if different from the head) at least one of two respondent to be female spouse/ head of

household)

A5 IstheHouseholdselectedforWaterQualityTestatPoint-of-Use?1=YES2=NO

CommonCodestobeusedinthequestionnaire:-66=NoAnswer-77=Don’tknow/Don’tremember-88=NotApplicable-99=Other(specify)___________

[COMMENTS]

42

SECTIONB:HOUSEHOLDPARTICULARS

B1.HOUSEHOLDSIZE:____________persons.B2a B2b B3 B4 B5 B6 B7

ID.N

o.

NAMEMake complete list ofall individuals whonormally live and eattheirmealstogetherinthis household,startingwithHHhead,spouse next andchildren fromelder toyounger and othermembers.[Confirm HH head listedhere is the same as HHheadlistedinsectionA)

Sexof[Name]1=Male2=Female

Ageof [Name] in completedyears.[Forchildrenlessthan5yearswritebothyearandmonth]

Relationshipof [Name] toHHhead1=Head2=Spouse/Partner3=Son/Daughter4=StepSon/Daughter5=Grandchild6=Father/Mother7=Brother/Sister8=Niece/Nephew9=Uncle/Aunt10=Son/Daughter In-Law11=Father/Mother In-Law12=Brother/SisterIn-Law13=Grand Parent14=Other Relatives15=House Maid16=Non-relative99=Other(specify)_____

Maritalstatusof[Name][Askifindividualis15yearsorolder]1=Married2=Livingtogether3=Unmarried/single4=Divorced5=Separated6=Widowed

Main occupation of [Name] forthepast12months[ifage5yearsandabove]1=Agriculture/Livestock2=Mining3=Tourism4=Handicrafts(Weaving/Potter/Blacksmith……)5=Carpenter/Mason6=Trader)/Merchant(retail/wholesale)7=Driver/Mechanic8=FactoryWorker9=Teacher10=Civilservant11=Preparing food/drinks for sale12=NGO/Religious13=Student14=Herding15=Guard16=Jobseeker17=Retired18=Disabled19=Tooyoung20=Tooldandunabletowork99=Other(specify)-_____________

Year Month

1 2 3 4 5 6 7 8 9 10

NB:Formorethan10membersuseadditionalpaperhavingthesametable.

43

SECTIONC:EDUCATION

Educationalstatusofhouseholdmembersaged5yearsandabove.[ObtainID.NoofpersonsfromtheHHParticulars]

C1 C2 C3 C4 C5 C6 C8 C9 C10

NDIVIDUALID.N

o

Can [Name]read andwritein anylanguage?1=Yes2=No

Did [Name]ever go toschool?1=Yes2=No →Nextperson

WhatistheHighestgradecompletedby[Name]00=Pre-primary01=Std102=Std203=Std304=Std405=Std506=Std607=Std708=Std809=CourseafterPrimaryeducation10=FormI11=FormII12=FormIII13=FormIV14=CourseafterSecondaryeducation15=FormV16=FormVI17=CourseafterformVI18=DiplomaCourse19=OtherCertificate20=UniversityDegree21=AdultEducationOnly

Did (NAME)attendschoollastyear?1=Yes2=No→C9

If NO to D6, reasonfornotattending?1=Sickness2=Had to work for family

enterprise/farm3=Had to work domestic

activitiesathome(i.e.takecare of children, fetching wateretc.)

(incl.domesticchores)3=Health problems with

otherHHmember(s)6=Schoolistoofar7=Lack of money to cover

education expense (inc.fee)

8=Educationqualitydeteriorated9=Marriage10=Pregnancy/maternityleave11=Naturalcalamities12=Humancausedcalamities99=Other(specify)_____

Is [Name]currentlyattendingschool?1=YesàC102=No

IfNO,reasonfornotcurrently attendingschool?1=Sickness2=Had to work for family

enterprise/farm3=Had to work domestic

activitiesathome(i.e.takecare of children, fetching wateretc.)

(incl.domesticchores)3=Health problems with

otherHHmember(s)6=Schoolistoofar7=Lack of money to cover

education expense (inc.fee)

8=Educationqualitydeteriorated9=Marriage10=Pregnancy/maternityleave11=Naturalcalamities12=Humancausedcalamities99=Other(specify)_____

What grade is[Name] currentlyenrolled?00=Pre-primary01=Std102=Std203=Std304=Std405=Std506=Std607=Std708=Std809=Course afterPrimaryeducation10=FormI11=FormII12=FormIII13=FormIV14= Course afterSecondaryeducation15=FormV16=FormVI17=Course after formVI18=DiplomaCourse19=OtherCertificate20=UniversityDegree21=Adult EducationOnly

44

SECTIOND:HEALTH

S/N Question ResponseD1 Didanymemberofthishouseholdexperiencediarrhoeainthe lasttwoweeks?1=YES 2=NO

→D3

D2.1 IfYES,whoexperienceddiarrhoeainthelasttwoweeks?

[EnterindividualIDNo.ofapersonfromtheHHparticularsstartwiththeyoungestmember]

IndividualIDNumber

D2.2 Didthediarrhoeastartinthelastfourweeksorwasitcontinuingfrompreviousperiod?

1=Occurredinthelastfourweeks2=Continuedfrompreviousperiod

D2.3 Forhowlongwas[Name]sickfromdiarrhoea?(Numberofdays) D2.3 Wasthereanysignofbloodinthestools?1=YES2=NO D3 Howdoyoudescribetheincidenceofdiarrhoeainyourhouseholdoverthepastfiveyears?

1=Ithasremainedthesame2=Ithasincreased3=ithasdecreased

D4 Howdoyoudescribe the incidenceofdiarrhoea inyour community/villageover thepast fiveyears?

1=Ithasremainedthesame2=Ithasincreased3=ithasdecreased

45

SECTIONE:DRINKINGWATERSUPPLY

Question ResponseDrySeason Rain/wetseason

E1 Which of the following sources does yourhouseholdusetoobtaindrinkingwater?(recordallapplicable)

2015 2010 2005 2015 2010 2005

E1.1 Forhumandrinking E1.2 For basic personal hygiene (hand washing, bath,

shower)

E1.3 Forwashingutensils E1.4 Washingclothes E2 Whatisthemainsourceofdrinkingwatersupplyfor

yourhouseholdcurrently?

Codes:WaterSources

1=Pipedwaterinsidedwelling2=Privateoutsidestandpipe/tap3=Publicstandpipe/tap4=Watervendor5=shallowwell6=deepwell7=handdugwell

8=protectedspring9=Tankerservice10=Unprotectedwell11=Unprotectedspring12=River/lake/pond13=Rainwater99=Other(specify)____

46

QuestionsE3-E42refertotheprimarywatersourceusedinthedryseasonandwetseason(asrecordedinE2).

InDrySeason Inwet/rainSeason

E3 IsthissourceofdrinkingwatersupplythesameastheonerecordedinA1.61=YES2=NO E4 Isthissourcethenearestdrinkingwatersupplyavailabletoyourhousehold inthe

locality?1=YES→E62=NO

E5 If NO,why isn’t the household obtain its drinkingwater from the nearest source?(Allowmultipleresponses)1=Watersourceisunsafefordrinking2=Watersourceissafebuttoosalty2=Watersourceisnotfree3=ExcludedbyCOWSO4=Excludedbyusergroup99=Other(specify)_____

E6 Arethereanyeligibilitycriteriatousethiswatersource?1=YES2=NOàE8 E7 IfYES,whatarethecriteria?(Allowformultipleanswers)

1=Resourcecontributionforschemeconstruction2=Resourcecontributionforrepairandmaintenance3=MembershipinCOWSO4=Paymentforwateruse99=Other(specify)_____________

E8 Whoisresponsibleformanagingthiswatersource?1=COWSO2=Communitymembers3=Personhiredbythecommunity-77=Donotknow99=Other(specify)___________

E9 Whatisthereasonforyourhouseholdchoosingthiswatersource?1=Nootheroption/onlyavailableinthelocality2=Waterfromthissourceissafetodrink3=Closeness4=Nofeesrequired99=Other(specify)___

E10 Wasthiswatersourcefunctionalallthetimeinthelast12months?

1=Yes,fullyandproperlyfunctional2=Yes,functionalbutnotwithadequatesupply3=No,wasfunctionalforsometimeonly

47

SectionE:Drinkingwatersupply(continued)

E11 Themainwatersourceusedindryandwetseason: InDrySeason Inwet/rainSeasonE11.1 Isfenced?1=YES2=NO E11.2 Hasdrainageditchbeenexcavated?1=YES2=NO

E11.3 Isprotectedfromcontactwithanimals?1=YES2=NO E12 Whatisyourperceptionaboutqualityofwaterfromthissource?

1=VeryBad2=Bad3=Reasonable4=Good5=VeryGood-77=Don’tKnow

E13 IftheanswertoE12is1or2,givethereason(s)foryourperception.[Allowmultipleresponses)1=WaterisSalty2=Smellsbad3=Tastesbad4=Waterismuddy5=Contaminatedbyanimals6=Irontaste99=Other(specify)_____________

E14 Sincewhichyearhasthiswatersourcebecometheprimarysourceofdrinkingwatersupplyforthehousehold?

E15 Whoconstructedthewatersupply?1=selfconstructedbythehousehold2=DistrictAuthority-77=Donotknow99=Other(specify)_____________

E16 Didanymemberofyourhouseholdparticipateintheplanningoftheconstructionofthiswatersupply?1=YES2=NO-àE18

E17 IfYES,whichmemberofyourhouseholdparticipatedintheplanningprocess?[EnterID.NofromtheHHParticulars]

E18 Didyourhouseholdparticipateinthechoiceofthetypeofwatersupplyconstructed?1=YES2=NO

E19 Didyoucontributeanyinputfortheconstructionofthewatersupply?1=YES2=NO E20 IfYES,whatwasyourcontributionfortheconstructionofthewatersupply?

1=Labour2=Materials 3=Cash4=labourandMaterials 5=LabourandCash6=MaterialsandCash7=Labour,materialsandcash99=Other(specify)_____________

E21 Hasthissourceofwatersupplyeverbeenmalfunctioning?1=Yes2=No-àF23 E22 IfYES,whatwasthespecificproblemwiththiswatersource?

1=Insufficientwaterquantity2=Waterisnotalwaysavailable3=Poorwaterquality

48

4=Stoppedgivingwaterinrecenttimes5=Facilitywasbroken99=Other(specify)__________________

InDrySeason Inwet/rainSeasonE23 Whomainlyfetchwaterforthishousehold?

(EnterIDfromHouseholdParticulars)

E24 Whatisthedistancefromhometothissource(inmeters)?(oneway)

E25 Howmuchtimedoesittaketofetchwaterfromthissource(inminutes)? E25.1 Walktothewatersource(oneway) E25.2 Queuingtimeatthesource E25.3 Fillingtime

E25.4 Returninghome(carrying)water E26.1 Howmanytimesdidhouseholdfetchwateryesterday?(Numberoftimes) E26.2 Howmanytimesdoesyourhouseholdfetchwaterperday?(Numberoftimes) E27 Howmuchvolumeofwaterdoesyourhouseholdnormallyfetchpertrip?(in

Litres)enumeratorwillshowapictureillustratingdifferentsizeofbuckets

E28 Does thishouseholdpaywater fees togetwater fromthissource?1=Yes 2=No→E32

E29 IfYES,howmuchinTanzanianShillingsisthepaymentforthequantityindicatedonE27?

E30 Ifthepaymentismadeperperiod,howmuchdoyoupayinTanzanianshillingspermonth?

Tshs. Amount

E31 Whatisyouropinionabouttheamountyoupayforwaterfromthissource?1=Expensive2=reasonable3=Cheap

InDrySeason Inwet/rainSeasonE32 Doesyourhousehold treatwater fromthis source tomake it safer?1=Yes 2=No

àE34

E33 IfYES,whatdoesyourhouseholddotomakewatersafertodrink?1=Boilingthewater2=Addingbleachorchlorinetothewater3=Usingawater-filteringdevice(Ceramic,Sand,etc.)4=Solardisinfection

49

5=Letitstandandsettle/Settlingmethods99=Other(specify)__________________

E34 Whatisthemainsourceofwaterusedbythishouseholdforthefollowingotherpurposes?UseCodes2below

E34.1 Cooking E34.2 Clotheswashing

E34.3 Bathing E35 Inatypicaldayoverthelastweek,howmuchvolumeofwaterdidyourhouseholdconsume

fromtheprimarywatersourceforthefollowingpurposes?(QuantityinLitres)enumeratorwillshowapictureillustratingdifferentsizeofbuckets

E35.1 Forhumanconsumption E35.2 Forbasichygiene(handwashing,bath) E35.3 Forcleaningutensils E35.3 Forwashingclothes

E36 Sincewhichyearhasthissourcebecomeyourprimarysourceofwater?

Codes2:WaterSources

1=Pipedwaterinsidedwelling2=Privateoutsidestandpipe/tap3=Publicstandpipe/tab4=Watervendor5=shallowwell

6=deepwell7=handdugwell8=protectedspring9=Tankerservice10=Unprotectedwell

11=Unprotectedspring12=River/lake/pond13=Rainwater99=Other(specify)____

50

SectionE:Drinkingwatersupply(continued)

InDrySeason Inwet/rainSeasonE37 In your opinion, howdoes the present source ofwater supply comparewith your previous

sourceoverthesameseason?

E37.1 Reliabilityofwatersource 1=Improved2=Remained the same3=Decreased-77=Dnotknow

E37.2 Qualityofwater E37.3 Adequacyofwaterfromthesource

QuestionsE38toE42refertoPREVIOUSprimarysourceofwatersupplyusedbythehouseholdE38 Whatwasyourprimarysourceofdrinkingwaterbeforetheyearansweredinquestion

F36?Seethecodesbelow

E39 Whoinyourhouseholdwasresponsibletofetchwatertodrink? E40 Whatwasthetraveldistancetothiswatersourcefromyourhome?(inmeters) E41 Howmuchtimedidittakeyoutogetwaterfromthissource?(inminutes) E41.1 Walktothesourceofwater(oneway) E41.2 Queuingtimeatthesource E41.3 Filltime E41.4 Returnhome(carrying)water

Codes

1=Pipedwaterinsidedwelling2=Privateoutsidestandpipe/tap3=Publicstandpipe/tab4=Watervendor5=shallowwell6=deepwell

7=handdugwell8=protectedspring9=Tankerservice10=Unprotectedwell11=Unprotectedspring12=River/lake/pond13=Rainwater99=Other(specify)____

51

SectionE:Drinkingwatersupply(continued)

InstructiontotheSurveyor:askyourrespondenthowthewaterforhumanconsumptionisstoredinthehouse.Askyourrespondentforpermissiontoinspecthowitisstored. E42 Isthecontainerinwhichthewaterisstoredthesameasthecontainerusedtofetchwaterfromthesource?1=YES2=NO E43 Isthecontainerusedforfetchingwaterclean?1=YES2=NO

(checkguidelinesashow‘clean’isdefined)

E44 Whatisthemainmaterialinwhichthewaterisstored?1=SmallJar,plastic2=BigJar/can,plastic3=Smalljar,clay4=Bigjar/can,clay5=Jerrycan99=Other(specify)__

E45 Isthecontainerusedforstoringwaterclean?1=YES2=NO E46 Isdrinkingwatercontainerkeptabovefloorlevel?1=YES2=NO E47 Isdrinkingwaterkeptoutofreachofchildren?1=YES2=NO E48 Howiswatertakenfromthecontainer?

1=Poured2=Cup/dipper3=Otherutensil

E50 IstheCup/dipperorotherutensilclean?1=YES2=NO E51 Doesthecontainerhavealid/cover?1=YES2=NO E52 Dowatercontainershaveanarrowneck/mouth?1=YES2=NO E53 Whenwasthewatercurrentlyfoundinthestoragecollectedfromthesource?

1=Today2=Yesterday3=Beforeyesterday

E54 Howoftenisthecontainerusedforthewaterstoragecleaned?1=Daily2=Weekly3=Monthly4=Bi-annually5=Rarely6=Never

E55 Whatmaterialdoesthehouseholdusetocleanthedrinkingwaterstorage?1=Soaporotherdetergent2=Wateronly99=Other(specify)___

E56 Hasthewatercurrentlystoredinthecontainerbeentreatedwithchemicalsorothermethods?1=Yes2=No-->Nextsection

E57 Whichmethodisusedfortreatment?1=Boilingthewater2=Addingbleachorchlorinetothewater3=Usingawater-filteringdevice(Ceramic,Sand,etc.)4=Solardisinfection5=Letitstandandsettle/Settlingmethods99=Other(specify)__________________

52

SECTIONF:SANITATION

F1 Doesthehouseholdhaveaprivatetoilet?1=Yes2=No→F10 F2 Whatisthemaintypeoftoiletthatthishouseholduses?

1=Pitlatrinewithslab2=Pitlatrinewithoutslab3=Pourflush4=Flushtoiletwithseptictank5=Flushtoilet with sewage connection 6=communal toilet 7=Public toilet 8=No toilet 99= Other (specify)_______Ifthelatrinehasaslab,whatisthemainmaterialofwhichtheslabismade?

F3.1 Whatisthedistancefromyourhousetothelatrinefacility? Meters Minutes(walking)

F3.2 Whendidyouconstructit?(year) F3.3 Whendidyoustartusingthelatrinefacility? F3.4 Howfrequentdoesthehouseholdusethisfacility?

1=Always2=Sometimes3=Never

F4 WhatwasyourmaintoiletfacilitybeforetheyearansweredinquestionF3.3?1=Pitlatrinewithslab2=Pitlatrinewithoutslab3=Pourflush4=Flushtoiletwithseptictank5=Flushtoilet with sewage connection 6=communal toilet 7=Public toilet 8=No toilet 99= Other (specify)_______

F4.1 Howfarwasthistoiletfacilityfromyourhouse?(inwalkingminutesoneway) F5 Whoinitiatedthedemandforconstructionofthecurrenttoiletfacility?

1=Selfinitiated2=Advisedbyfriend/neighbour3=AdvisedbyNSCteam4=other,specify

F7 Isthetoiletfacilityusedclean(nostains)?1=YES2=NO F8 Doesthistoiletfacilityhavehandwashingfacilitywithwithinthreemetres?

1=Yes,hand-washingfacilityisavailablewithin3m2=Yes,handwashingfacilityisavailablebutfartherthan3m3=No,handwashingfacilityisnotpresent

F8.1 Issoaporsoapsubstitutepresentwiththehandwashingfacility?1=YES2=NO F9 IfF3.4responseisnever,whyareyouoryourhouseholdmembersnotusingyourprivatetoilet?

1=Ithassometechnicalproblem2=Itneedsemptyingtouse3=It isnotcleantouse 4=Itcreatesbadsmell since it isbuilt 5=It isclose tomyhouse 99=Other(specify)________

F10 Isthetoiletfacilitysharedwithotherhouseholds?1=YES2=NO F11 Howmanyotherhouseholdsusethistoiletfacility?(Number)

53

F12 Whydidn’tyouconstructyourownhouseholdlatrine?1=Donothaveenoughland2=Lackofskilltoconstruct3=Do not consider it important 4=Shortage of money 5=Shortage of building materials 99=Other(specify)__________

F13 Whatisyouropiniononthetrendofopen-defecationpracticesinthiscommunity?1=Increased2=Remainedthesame3=Decreased-77=Donotknow

SECTIONG:HYGIENEPRACTICES

Part1:BasicPersonalHygiene: ForquestionsG3.1-G3.4askyourrespondent/swhetherthereismainhabitamonghouseholdmemberstowashtheirhandsatthefollowingcriticaltimes?G3.1 Beforeeatingfood

1=Yes,withwater2=No3=Yes,waterwithsoap4=Yes,waterwithash5=Yes,waterwith(othermaterials)

G3.2 Beforepreparingfood G3.3 Afterusingtoilet G3.4 Afterdisposingofbaby'sfaeces

G4 Howdoyoumainlydisposechildren’sfaeces?1=Dropped into toilet facility 2=Washed away into toilet facility 3=Buried4=Indiscriminatedumping99=Other(specify)_____________

54

Part2:HygieneAwarenessandParticipationinHygiene-relatedTraining

G5 Didanyofyourhouseholdmembersattendhygienepromotiontraininginthelast12months?

1=YES2=NO→G11

G6 IfYES,howmanyofsuchtrainingswereattendedbyyourhouseholdmembers? G7 Whenwastherecenttrainingattendedbyanymemberofyourhousehold?(Specifymonthand

year)

G8 Whoprovidedthetraining?1=WASHCommittee2=Government/NGOofficer3=99=Other(specify)_______

G9 Whoattendedtherecenttraining?[EnterID.NofromtheHHParticulars] G9.1 Whatwerethetopicsofdiscussionduringthetraining?(Allowmultipleresponses)

1=safewatertransport2=safewaterstorageandhandlingathome3=buildingofprivatelatrines4=cleanlinessoflatrines5=Opendefecationfreecommunity6=handwashing

G10 Howusefulwasthetrainingtoyourhousehold'shygienepractices?1=Notuseful2=Useful3=veryuseful

G11 Doyouagreeordisagreewiththefollowingstatements?1=Strongly agree 2=Agree 3=Disagree 4=Strongly disagree-77=Donotknow

G11.1 Washinghandsonceadayisenoughtoavoiddiarrhoealdiseases G11.2 Diarrhoealdiseaseistransmittedthroughamosquitobite G11.3 Baby'sfaecescontainnoharmfuldiseases G11.4 Diarrhoealdiseaseistransmittedonlythroughdrinkingcontaminatedwater

55

SECTIONH.COMMUNITYPARTICIPATION

H1 IsthereanyoneinyourhouseholdwhoiscurrentlyamemberofaCOWSOcommittee?1=Yes2=No

→H6

H2 If YES, enter ID.Noof theperson(s)who is/are amemberof aCOWSO? (see IDNo. from theHHparticulars)

Person1 Person2 Person3

H3 Howdidhe/shebecomeamemberofaCOWSO?1=Electedbycommunity2=Appointedbylocalgovernment3=Volunteer4=Hiredbythecommunity99=Other(specify)____________________

H4 Sincewhenhashe/shebecomeamemberofaCOWSO? H5 Whatishis/herpositionwithinthecommittee(SkiptoH9)

1=Chairperson/vicechairperson 2=Secretary 3=Treasurer 4=Member99=Other(specify)____________________

H6 Hasanyoneinyourhouseholdeverbeenmemberofawatercommittee?1=Yes2=No→I9H7 IfYES,enter ID.Noofthemember(s)whois/areamemberofaCOWSO?(see IDNo.fromtheHH

particulars)

H8 Whatwashis/herpositionwithintheCOWSO1=Chairperson/vicechairperson 2=Secretary 3=Treasurer 4=Member99=Other(specify)____________________

H8.1 IstheCOWSOwellcapacitatedtoprovideneededWASHservices?1=YES2=NOTENOUGH H8.2 Ifanswer toH8.1 is2, inwhichareasshould theCOWSO improve its capacity? [Allow forMultiple

answers]1=committeeprocedures2=Operationandmaintenance3=schemeadministration4=financialadministration5=financialtransparency6=promotionofsanitationandhygiene99=Other(specify)----------

H9 Areyouoranymemberofyourhouseholdcurrentlyamemberofaschoolcommittee?1=YES2=NOskiptoH11

H10 Sincewhen? H11 Areyouoranymemberofyourhouseholdcurrentlyamemberofahealth/sanitationandhygiene

promotioncommittee?1=YES2=NO

H12 Sincewhen?

56

SECTIONI:TIMESAVINGS,USEANDLABOUR

I1 Hastimetofetchwaterreducedinthelastfiveyears?

1=YES2=NOàK3

I2 IfYes,onwhichactivityisthetimesavedfromfetchingwatermainlyspent? (Allowmultipleanswers)1=Cookingandotherdomesticactivities2=Spentonproductiveunpaidlabour3=Fetchingfirewood4=Spentonproductivepaidlabour5=Unpaidfarmlabour6=Spentonincomegeneratingactivities7=Paidfarmlabour99=other(specify)

I3 Haswalkingtimetotoiletfacilityreducedinrecentyears?1=Yes2=No-àI5

I5.Howmanyhoursinthelastsevendaysdidhouseholdmembersage7yearsandabovespendonthefollowingactivities?[CopyIDCodeofPersonsaged7yearsandabovefromtheHHParticulars]S/N Activity IDNumber

I5.1 PaidLabour I5.2 CollectingFirewood I5.3 Cookingandotherdomesticduties I5.4 Unpaidfarmlabour I5.6 Spentonincomegeneratingactivities

57

SectionJ:Assets

PHYSICALASSETSJ4 Assetscurrentlyownedbythehousehold Do you have these assets? 1=YES

2=NOSinceWhen?

J4.1 Radio J4.2 Musicplayer J4.3 TV J4.4 Landlinetelephone? J4.5 Mobiletelephone J4.6 Wristwatch/clock J4.7 Refrigerator J4.8 Cart J4.9 Bicycle J4.10 MotorBike J4.11 Car J4.12 Othervaluableasset(specify)__________

SECTIONK:MICROBIOLOGICALQUALITYOFWATERSAMPLEATPOINTOFSTORAGE/POINTOFUSE

K1.E.coliconcentrationperml

58

Annex6. Draftcommunityquestionnaire

59

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

COMMUNITYQUESTIONNAIRE

TobecompletedduringaninterviewwithVillageGovernmentmembersand/orofficials.The‘community’inthisquestionnairereferstothevillagewithinwhichthesampledwaterpointusersorsampledcontrolgroupofhouseholdsarelocated.

CommunityID

SECTIONA.IDENTIFICATIONPARTICULARS

A1.LOCATIONIDENTIFICATION

S/N LOCATION NAME ID.NO

A1.1 REGION A1.2 DISTRICT A1.3 WARD A1.4 VILLAGE A1.5 SUB-VILLAGE(IFAPPLICABLE)

A1.6 NAME&CODEOFWATERSCHEME A1.7 TYPEOFWATERSCHEME 1=Treatment2=Control

60

A2.SURVEYSTAFFDETAILS

A2.1 NAMEOFENUMERATOR A2.2 ENUMERATORCODE A2.3 TIMEINTERVIEWSTART A2.4 TIMEINTERVIEWEND A2.5 DATEOFINTERVIEW A2.6 NAMEOFSUPERVISOR A1.7 SUPERVISORCODE A2.8 NAMEOFDATAENTERER A2.9 DATAENTERERCODE

INTRODUCTIONTOCOMMUNITYLEADERSTOBEINTERVIEWED

Mynameis________,andIamhereonbehalfof(SURVEYFIRM),theMinistryofWaterandtheAfricanDevelopmentBank.TheprimaryobjectiveistocarryoutasurveyforanImpactEvaluationofTanzania’sRuralWaterSupplyandSanitationProgramme.Iwillbeaskingyouaseriesofquestionsrelatingtogeneralcommunityinformation.Letmeclarifyandinsistthatthissurveyisconfidentialandvoluntary,andanyinformationthatweobtainwillonlybeusedanonymously,forimpactevaluationpurposes.BeforeIstart,doyouhaveanyquestionsoristhereanythingwhichIhavesaidonwhichyouwouldlikefurtherclarification?MayIproceedwiththeinterview?

[COMMENTS]

61

SECTIONB:BASICINFORMATION

B1 B2 B3 B4 B5 NameofKeyInformant Position

1=VillageChair2=VEO

Age(Years) Sex(1=Male2=Female) Highest Grade Completed(usecode1)

1 2 3 4 5

Code1

00=Pre-primary01=Std102=Std203=Std304=Std405=Std506=Std607=Std7

08=Std809=CourseafterPrimaryeducation10=FormI11=FormII12=FormIII13=FormIV14=CourseafterSecondaryeducation15=FormV

16=FormVI17=CourseafterformVI18=DiplomaCourse19=OtherCertificate20=UniversityDegree21=AdultEducationOnly

62

Question ResponseB6 DistancetotheDistrictCapitalfromVillageCentre KM_________B7 Presenceofmicro-financeinstitution?1=YES2=NO

B8

IsthereanyonefromthisvillagewhohasbeenamemberoftheDistrictCouncilintheseyears?

2005-2006 2007-2008 2009-2010 2011-2012 2013-2014

SECTIONC:DEMOGRAPHICANDSOCIOECONOMICCHARACTERISTICSOFTHECOMMUNITY

YEAR C1 C2 C3 C4 How many people were

living in this community inYEAR____

Howmanywereabletoreadandwriteinanylanguage?

HowmanyhouseholdswerethereinYEAR______

HowmanyHouseholdheadswereabletoreadandwriteinanylanguage?

2014 2013 2012 2011 2010 2009 2008 2007 2006 2005

63

SECTIOND:ACCESSTOPUBLICINFRASTRUCTURE

PARTI.SCHOOLINFRASTRUCTUREINSIDEORNEARESTTOTHECOMMUNITY

Schoollevel Pre-School PrimarySchool

OrdinarySecondarySchool

AdvancedSecondarySchool

Technical andVocationTraining

College University

D1 Isthisschoolavailableinthecommunity?1=YES2=NO

D2 Whenwastheschoolbuilt? D3 NumberofSchoolsAvailable D4 Whoownstheschool?

1=Government2=Private3=Community4=NGO5=Religiousorganization99=Other________

D5 Ifnotpresent,pleaseprovidenameofthenearest school from the centre of thecommunity

5.1 Name 5.2 Ownership

1=Government2=Private3=Community4=NGO5=Religious6=Other________

5.3 Distancefromvillageoffice(inkm)

64

PARTII:HEALTHFACILITIESAVAILABLEINORNEARESTTOCOMMUNITY

D6 D7 D8 D9Typeofhealthfacility1=Healthpost2=Healthclinic3=Healthcentre4=Hospital

Isthishealthfacilityavailableinsidethecommunity?1=YES2=NOàE10

Sincewhen? Ownership1=Government2=Private3=Community4=NGO5=Religiousorganization99=Other_______

Ifnotavailable,pleaseprovide thenameof thenearesthealth facilityusedbymembersofthiscommunity9.1Name 9.2Ownership

1=Government2=Private3=Community4=NGO5=Religious6=Other________

9.3Distance from villageoffice

a.KM

b.Minutes

65

PARTIII:DRINKINGWATERSUPPLY

Thisquestionreferstothesource(s)ofdrinkingwatersupplyavailabletothecommunityasawhole.

2015 2014 2013 2012 2011 2010 2009 2008 2007 2006D10 What is/was the primary

source of drinking watersupplyinthecommunity?

DRY WET

D11 What is the mostimportant secondarysource of drinking watersupplyinthecommunity?

DRY

WET

D12 Please specify any othersecondary source ofdrinking water supply inthecommunity.

DRY

WET

D13 Please specify any othersecondary source ofdrinking water supply inthecommunity.

DRY

WET

Codes

1=Pipedintodwelling2=Pipedtoyard/plot3=PublicTap/standtap4=Shallowwell5=Deepwell6=Handdugwell7=Protectedspring8=Unprotectedwell9=Unprotectedspring10=Tankerlorry11=River/stream/pond12=Rainwater13=Other(specify)_________

66

SECTIONE.OTHERSERVICESANDDEVELOPMENTACTIVITIESINSIDEORNEARBYTHECOMMUNITY

Infrastructure

E1 E2 E3 E4Is this infrastructure/publicwork available inside thecommunity?1=Yes2=No--->F3

IfYes,sincewhen?

Whereisthenearestofthis[Infrastructure]located?1=Inothersub-villagewithinthevillage2=Inothervillageinsamedistrict3=Inotherdistrict

Howfaristhenearestofthis[Infrastructure](inKm)?

1 Agriculturalextensionoffice

2 Allweatherroad

3 Grainmarket

4 Livestockmarket

5 PSNPpublicworks

6 Landlinetelephoneservice

7 NGOactivities

SECTIONF:LABOURMARKETANDWAGES

TYPESOFACTIVITIESWAGERATE(TSH)–INDICATEUNIT(DAY,ACREETC.)

Adultmale(15&above) Adultfemale(15andabove) Children(6-14)A) AGRICULTURALACTIVITIES

1 Landpreparation

2 Planting

3 Weedingandmaintenance

4 Harvesting

5 Livestockherdingandwatering

B) NON-AGRICULTURALACTIVITIES

6 Unskilleddailylabour

67

SECTIONG:PERCEPTIONSOFCHANGEINWATERSUPPLY,SANITATION,HYGIENEANDGENDEREQUALITY G1

WhathashappenedtopeopleinthiscommunityoverthelastfiveyearsINTERMSOF:Responses

1=Increasedalot2=Increasedalittle3=Remainedsame4=Decreasedalittle5=Decreasedalot

a Accesstoimprovedwatersupply b Latrineuse c Sanitationandhygiene d Health e Women’sdomesticworkload f Women’sinvolvementintheplanninganddecisionmakingofwatersupplyandsanitationprojects g Women’sparticipationinothercommunityaffairs h Women’sparticipationinpaidemploymentorincomegeneratingactivities i. Local(self)employmentinwatersupply,hygieneandsanitationservicedelivery i Girls’schoolenrolment j Girls’schoolattendance k Girls’schooldropout

68

Annex7. Draftwaterpointquestionnaire

69

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

WATERPOINTQUESTIONNAIRE

Thisquestionnairewillrefertoasampledwaterpointanditsusers,inthecaseoftreatmentsites,oracomparablegroupofwaterusersandtheirwatersource(s),inthecaseofcontrolsites.

SiteID

SECTIONA.IDENTIFICATIONPARTICULARS

A1.LOCATIONIDENTIFICATION

S/N LOCATION NAME ID.NO

A1.1 REGION A1.2 DISTRICT A1.3 WARD A1.4 VILLAGE A1.5 SUB-VILLAGE(IFAPPLICABLE)

A1.6 NAME&CODEOFWATERSUPPLY A1.7 TYPEOFSITE 1=Treatment2=Control

70

A2.SURVEYSTAFFDETAILS

A2.1 NAMEOFENUMERATOR A2.2 ENUMERATORCODE A2.3 TIMEINTERVIEWSTART A2.4 TIMEINTERVIEWEND A2.5 DATEOFINTERVIEW A2.6 NAMEOFSUPERVISOR A1.7 SUPERVISORCODE A2.8 NAMEOFDATAENTERER A2.9 DATAENTERERCODE

INTRODUCTIONTOCOMMUNITYLEADERSTOBEINTERVIEWED

Mynameis________,andIamhereonbehalfof(SURVEYFIRM),theMinistryofWaterandtheAfricanDevelopmentBank.TheprimaryobjectiveistocarryoutasurveyforanImpactEvaluationofTanzania’sRuralWaterSupplyandSanitationProgramme.Iwillbeaskingyouaseriesofquestionsrelatingtowatersuppliesandtheirusers.Letmeclarifyandinsistthatthissurveyisconfidentialandvoluntary,andanyinformationthatweobtainwillonlybeusedanonymously,forimpactevaluationpurposes.BeforeIstart,doyouhaveanyquestionsoristhereanythingwhichIhavesaidonwhichyouwouldlikefurtherclarification?MayIproceedwiththeinterview?

[COMMENTS]

71

SECTIONB:BASICINFORMATION

B1 B2 B3 B4 B5 NameofKeyInformant(s) Position

1=WaterUserGroupChair2=OtherofficeholderinWaterUserGroup

Age(Years) Sex(1=Male2=Female) Highest Grade Completed(usecode1)

1 2 3 4 5

Code1

00=Pre-primary01=Std102=Std203=Std304=Std405=Std506=Std607=Std708=Std809=CourseafterPrimaryeducation10=FormI11=FormII12=FormIII13=FormIV14=CourseafterSecondaryeducation15=FormV16=FormVI17=CourseafterformVI18=DiplomaCourse19=OtherCertificate20=UniversityDegree21=AdultEducationOnly

72

SECTIONC:GENERALINFORMATIONABOUTLOCALWATERSUPPLIES

Thisquestionreferstoallthesource(s)ofdrinkingwatersupplythatare(orwere)usedbytheusersofthesampledwaterpoint(treatmentsites)orthecomparablegroupofwaterusers(controlsites).

2015 2014 2013 2012 2011 2010 2009 2008 2007 2006C1 What is/was the primary

source of drinking watersupplyinthecommunity?

DRY WET

C2 What is the mostimportant secondarysource of drinking watersupplyinthecommunity?

DRY

WET

C3 Please specify any othersecondary source ofdrinking water supply inthecommunity.

DRY

WET

C4 Please specify any othersecondary source ofdrinking water supply inthecommunity.

DRY

WET

Codes

1=Pipedintodwelling2=Pipedtoyard/plot3=PublicTap/standtap4=Shallowwell5=Deepwell6=Handdugwell7=Protectedspring8=Unprotectedwell9=Unprotectedspring10=Tankerlorry11=River/stream/pond12=Rainwater13=Other(specify)_________

73

SECTIOND:INFORMATIONABOUTWATERSOURCES

CURRENTPRIMARYSOURCEOFDRINKINGWATER(C1ABOVE)

D1Mostrecentmajordevelopment(construction/rehabilitation/expansion)fortheprimarysourceofdrinkingwater:D2 D3 D4

Constructed/rehabilitated by RWSSP?1=Yes;2=No_________

Yearconstructed___________

Yearrehabilitated(ifapplicable)

________________

Yearexpanded(ifapplicable)

________________

Not applicable (e.g. primary source ofdrinkingwater isanunimprovedspringorriver)

Whomainlyinitiatedtheconstruction/rehabilitation/expansion?(Allowformultipleanswers)

1=Communityleaders2=Communitymembers3=villageadministration4=WaterandSanitationCommittee/COWSO/otherwaterusergroup5=DistrictWaterandSanitationteam6=CommunityFacilitationTeam/CFT7=HealthExtensionWorkers88=Notapplicable

99=Other(specify)_______________

Whobuilt/rehabilitated/expandedthewatersupply?(Allowformultipleanswers)

1=ExternalContractors2=Localcontractors/Artisans3=Community88=Notapplicable

99=other(specify)______

[Multipleanswerspossible]

Whoprovidedtheresourcesneededtobuild/rehabilitate/expandthewatersupply?[allowformultipleanswers]1=Communityonly2=Community+govt3=Community+govt+other(specify)_______4=govt99=other(specify)____________________

74

D5 D6 D7 D8 D9Istheprimarywatersourcecurrentlyoperational?

1=Yes2=No

Hadthissupplybeenbrokenornotfunctioninginthelast12months?1=Yes2=No

IfYes,whatwasthemainreasonfortherecentproblem?

1=defectinthetechnicaldesign2=Lackofproperuse3=Over-utilizationofthefacility4=Conflict99=Other(specify)_____

Wastheprimarywatersourcechlorinatedlastyear?1=Yes2=No

Whathashappenedtothequalityofthewaterfromtheprimarysourcesinceitcameintouse?1=Improved2=remainedthesame3=Decreased

D10 D11 D12 D13

Whathashappenedtothequantityof the water from the primarysourcesinceitcameintouse?1=Increased2=Decreased3=Remainedthesame

Wasthequalityofwaterfromtheprimarysourcetestedlastyear?1=Yes2=No

Do all householdswithin 500m ofthissourceuseit?

1=Yes2=No

Ifnotallhouseholdswithin500mofthissourceuseit,whynot?

1=Cannotpay2=Notmembersofusergroup3=Preferothersources4=Other(specify)

_____________

75

CURRENTMOSTIMPORTANTSECONDARYSOURCEOFDRINKINGWATER(C2ABOVE)

D14Mostrecentmajordevelopment(construction/rehabilitation/expansion)forthemostimportantsecondarysourceofdrinkingwater:D15 D16 D17

Constructed/rehabilitated by RWSSP?1=Yes;2=No_________

Yearconstructed___________

Yearrehabilitated(ifapplicable)

________________

Yearexpanded(ifapplicable)

________________

Not applicable (e.g. primary source ofdrinkingwater isanunimprovedspringorriver)

Whomainlyinitiatedtheconstruction/rehabilitation/expansion?(Allowformultipleanswers)1=Communityleaders2=Communitymembers3=villageadministration4=WaterandSanitationCommittee/COWSO/otherwaterusergroup5=DistrictWaterandSanitationteam6=CommunityFacilitationTeam/CFT7=HealthExtensionWorkers88=Notapplicable99=Other(specify)_______________

Whobuilt/rehabilitated/expandedthewatersupply?(Allowformultipleanswers)1=ExternalContractors2=Localcontractors/Artisans3=Community88=Notapplicable99=other(specify)______[Multipleanswerspossible]

Whoprovidedtheresourcesneededtobuild/rehabilitate/expandthewatersupply?[allowformultipleanswers]1=Communityonly2=Community+govt3=Community+govt+other(specify)_______4=govt99=other(specify)____________________

76

D18 D19 D20 D21 D22Isthemostimportantsecondarywatersourcecurrentlyoperational?1=Yes2=No

Hadthissourcebeenbrokenornotfunctioninginthelast12months?1=Yes2=No

IfYes,whatwasthemainreasonfortherecentproblem?1=defectinthetechnicaldesign2=Lackofproperuse3=Over-utilizationofthefacility4=Conflict99=Other(specify)_____

Wasthemostimportantsecondarywatersourcechlorinatedlastyear?1=Yes2=No

Whathashappenedtothequalityofthewaterfromthemostimportantsecondarysourcesinceitcameintouse?1=Improved2=remainedthesame3=Decreased

D23 D24 D25 D26

Whathashappenedtothequantityofthewaterfromthemostimportantsecondarysourcesinceitcameintouse?1=Increased2=Decreased3=Remainedthesame

Wasthequalityofwaterfromthemostimportantsecondarysourcetestedlastyear?1=Yes2=No

Do all householdswithin 500m ofthissourceuseit?

1=Yes2=No

Ifnotallhouseholdswithin500mofthissourceuseit,whynot?

1=Cannotpay2=Notmembersofusergroup3=Preferothersources4=Other(specify)

_____________

77

CURRENTOTHERSECONDARYSOURCEOFDRINKINGWATER(C3ABOVE)–IFAPPLICABLE

D27Mostrecentmajordevelopment(construction/rehabilitation/expansion)forthisadditionalsecondarysourceofdrinkingwater:D28 D29 D30

Constructed/rehabilitated by RWSSP?1=Yes;2=No_________

Yearconstructed___________

Yearrehabilitated(ifapplicable)

________________

Yearexpanded(ifapplicable)

________________

Not applicable (e.g. primary source ofdrinkingwater isanunimprovedspringorriver)

Whomainlyinitiatedtheconstruction/rehabilitation/expansion?(Allowformultipleanswers)1=Communityleaders2=Communitymembers3=villageadministration4=WaterandSanitationCommittee/COWSO/otherwaterusergroup5=DistrictWaterandSanitationteam6=CommunityFacilitationTeam/CFT7=HealthExtensionWorkers88=Notapplicable99=Other(specify)_______________

Whobuilt/rehabilitated/expandedthewatersupply?(Allowformultipleanswers)1=ExternalContractors2=Localcontractors/Artisans3=Community88=Notapplicable99=other(specify)______[Multipleanswerspossible]

Whoprovidedtheresourcesneededtobuild/rehabilitate/expandthewatersupply?[allowformultipleanswers]1=Communityonly2=Community+govt3=Community+govt+other(specify)_______4=Govt88=Notapplicable99=other(specify)____________________

78

D31 D32 D33 D34 D35Isthisadditionalsecondarywatersourcecurrentlyoperational?1=Yes2=No

Hadthissourcebeenbrokenornotfunctioninginthelast12months?1=Yes2=No

IfYes,whatwasthemainreasonfortherecentproblem?1=defectinthetechnicaldesign2=Lackofproperuse3=Over-utilizationofthefacility4=Conflict99=Other(specify)_____

Wasthisadditionalsecondarywatersourcechlorinatedlastyear?1=Yes2=No

Whathashappenedtothequalityofthewaterfromthisadditionalsecondarysourcesinceitcameintouse?1=Improved2=remainedthesame3=Decreased

D36 D37 D38 D39

Whathashappenedtothequantityof the water from this additionalsecondarysourcesinceitcameintouse?1=Increased2=Decreased3=Remainedthesame

Wasthequalityofwaterfromthisadditionalsecondarysourcetestedlastyear?1=Yes2=No

Do all householdswithin 500m ofthissourceuseit?

1=Yes2=No

Ifnotallhouseholdswithin500mofthissourceuseit,whynot?

1=Cannotpay2=Notmembersofusergroup3=Preferothersources4=Other(specify)

_____________

79

CURRENTOTHERSECONDARYSOURCEOFDRINKINGWATER(C4ABOVE)–IFAPPLICABLE

D40Mostrecentmajordevelopment(construction/rehabilitation/expansion)forthisadditionalsecondarysourceofdrinkingwater:D41 D42 D43

Constructed/rehabilitated by RWSSP?1=Yes;2=No_________

Yearconstructed___________

Yearrehabilitated(ifapplicable)

________________

Yearexpanded(ifapplicable)

________________

Not applicable (e.g. primary source ofdrinkingwater isanunimprovedspringorriver)

Whomainlyinitiatedtheconstruction/rehabilitation/expansion?(Allowformultipleanswers)1=Communityleaders2=Communitymembers3=villageadministration4=WaterandSanitationCommittee/COWSO/otherwaterusergroup5=DistrictWaterandSanitationteam6=CommunityFacilitationTeam/CFT7=HealthExtensionWorkers88=Notapplicable99=Other(specify)_______________

Whobuilt/rehabilitated/expandedthewatersupply?(Allowformultipleanswers)1=ExternalContractors2=Localcontractors/Artisans3=Community88=Notapplicable99=other(specify)______[Multipleanswerspossible]

Whoprovidedtheresourcesneededtobuild/rehabilitate/expandthewatersupply?[allowformultipleanswers]1=Communityonly2=Community+govt3=Community+govt+other(specify)_______4=govt88=Notapplicable99=other(specify)____________________

80

D44 D45 D46 D47 D48Isthisadditionalsecondarywatersourcecurrentlyoperational?1=Yes2=No

Hadthissourcebeenbrokenornotfunctioninginthelast12months?1=Yes2=No

IfYes,whatwasthemainreasonfortherecentproblem?1=defectinthetechnicaldesign2=Lackofproperuse3=Over-utilizationofthefacility4=Conflict99=Other(specify)_____

Wasthisadditionalsecondarywatersourcechlorinatedlastyear?1=Yes2=No

Whathashappenedtothequalityofthewaterfromthisadditionalsecondarysourcesinceitcameintouse?1=Improved2=remainedthesame3=Decreased

D49 D50 D51 D52

Whathashappenedtothequantityof the water from this additionalsecondarysourcesinceitcameintouse?

1=Increased2=Decreased3=Remainedthesame

Wasthequalityofwaterfromthisadditionalsecondarysourcetestedlastyear?

1=Yes2=No

Do all householdswithin 500m ofthissourceuseit?

1=Yes2=No

Ifnotallhouseholdswithin500mofthissourceuseit,whynot?

1=Cannotpay2=Notmembersofusergroup3=Preferothersources4=Other(specify)

_____________

81

SECTIONE:MANAGEMENTOFCOMMUNITYWATERSERVICES

E1 E2 E3 E4 E5 E6 E7 E8 E9Whatcommunitywaterandsanitationmanagementstructureexistsforthesampledwaterpoint(treatmentsites)ortheprincipalwatersourceforthecomparablegroupofwaterusers(controlsites)?1=COWSO2=WaterUserGroup3=Other(specify)_________________4=None---->E13

Howwasthismanagementstructureappointed?1=Electedbywaterusers2=Appointedbyvillagegovernment3=AppointedbyLGA4=Other(specify)_____________

Forwhichofthewatersourcesspecifiedaboveisthisstructureresponsible?C1_____C2_____C3_____C4_____

Whatwasthemostrecentconstruction/rehabilitation/expansionschemeforwatersuppliesaffectingthisusergroup?C1_____C2_____C3_____C4_____

Inwhatyeardidthismostrecentconstruction/rehabilitation/expansionschemetakeplace?_____

Whatdidhouseholdscontributetowardsthisscheme?Cash:TSh_______perhouseholdLabour(specify)_____Materials(specify)_____Other(specify)_____Nothing

Didhouseholdscontributeequally?1=Yes2=No(pleaseexplain)

Howoftenareall-membermeetingsofthemanagementstructureheld?1=Annually2=Quarterly3=Monthly5=Irregularly/whenneeded6=Never

Howoftenareleadership/managementmeetingsofthemanagementstructureheld?1=Annually2=Quarterly3=Monthly4=Weekly5=Irregularly/whenneeded7=Never

82

E10 E11 E12 E13 E14 E15 E16 E17 E18Whatpercentageofthegeneralmembershipofthemanagementstructurearewomen?_____

Whatpercentageoftheleadershippositionsinthemanagementstructureareheldbywomen?_____

Doallcommunitymembersbelongtothewatermanagementstructure?1=Yes2=No

Howmuchdowaterusershavetopay?TSh______

Thispaymentisper:_____(e.g.week,month,20litres)

Whocollectsthepayments?1=Pumpminder2=COWSO/usergrouptreasurer3=Other(specify)______________88=Notapplicable

Whenwasthispaymentratelastchanged?1=Statedate_____2=Never

Areallwaterusersrequiredtopay?1=Yes2=No

Ifsomewaterusersarenotrequiredtopay,whynot?1=Poverty2=OldAge3=Disability4=Other(specify)_____88=Notapplicable

83

E19 E20 E21 E22 E23 E24 E25 E26 E27Mostrecentbreakdown/interruptionofwatersupplywasforsource:C1_____C2_____C3_____C4_____

Monthandyearwhenthisbreak-down/interruptionofwatersupplyoccurred:Month_____Year_____

Whatwastheproblem?1=Sourcerandry2=Pumpfailure3=Pipe(s)broken4=Other(specify)_____

Forhowmanymonthswasthesupplyinterrupted?_____

Howwastheproblemfixed?1=FixedbyLGAstaff2=Fixedbyprivatesectorserviceprovider3=Fixedbycommunitymanagementstructure,e.g.waterminder,pumpmechanic4=FixedbyNGOstaff5=Notfixed6=Other(specify)_____88=Notapplicable

Whopaidtofixtheproblem?1=Communitymanagementstructure2=LGA3=Communitystructure+LGA4=NGO5=Communitystructure+NGO6=Somecommunitymember(s)7=Notfixed8=Other(specify)_____88=Notapplicable

Wherecanyougetsparepartsforthecommunity’sprimarywatersource?1=Withinthiscommunity2=Elsewhereinthisdistrict3=Furtheraway88=Notapplicable

Whattraininghastheleadershipofthelocalwatermanagementstructurereceivedinthelastfiveyears?(allowmultipleanswers)1=Financialmanagement2=Generalmanagement3=Committeeprocedures4=Technicalandmaintenancetraining5=Other(specify)_____6=None88=Notapplicable

Whoprovidedthistraining?1=LGAstaff2=Contractedtrainers3=Other88=Notapplicable

84

E28 E29 E30 E31 E32 E33 E34 E35 E36Doesthelocalwatermanagementstructurehaveabankaccount?1=Yes2=No88=Notapplicable

Ifthelocalwatermanagementstructuredoesnothaveabankaccount,howdoesitkeepitsfunds?1=Treasurerlooksaftermoney2=Other(specify)88=Notapplicable

Howmuchmoneydoesthelocalwatermanagementstructurereceiveonaveragepermonth?TSh_____88=Notapplicable

Approximatelyhowmuchmoneydoesthelocalwatermanagementstructurehaveatpresent?TSh_____88=Notapplicable

Approximatelyhowmuchmoneydidthelocalwatermanagementstructurehaveoneyearago?TSh_____88=Notapplicable

Whatwasthelastmajorexpenditureofthelocalwatermanagementstructure?1=Constructionofwatersupply2=Rehabilitationofwatersupply3=Expansionofwatersupply4=Routinemaintenance5=Repair6=Other(specify)_____88=Notapplicable

Whatwastheamountofthislastmajorexpenditure?TSh_________

Doesanyonereceivepaymentfortheirworkinlocalwatersupply?1=None2=Chair3=Treasurer4=Pumpminder(s)5=Other(specify)__________

Howmuchispaid,andhowoften?2:TSh_____per_____3:TSh_____per_____4:TSh_____per_____5:TSh_____per_____

85

SECTIONF:SANITATIONANDHYGIENEPRACTICES

F1 F2 F3 F4 F5 F6 F7 F8Participationbythiswaterusergroup(treatmentsites)orcomparablegroupofusers(controlsites)inNationalSanitationCampaign?1=YES2=NO

Isthiscommunityopendefecationfree?1=Yes--->E362=No,wearestillfar3=No,somefamiliesstillnot

IftheanswertoE31is2or3,whydofamiliesnotconstructtheirownlatrine?1=Lackofcapital2=lackofland3=Notculturallyacceptable4=lackofawareness99=Other(specify)______

Whatfractionofthetotalnumberofhouseholdsinthiscommunitypractiseopendefecation?1=lessthan10%2=10%-25%3=25%-50%4=above50%

Whatfractionofthetotalnumberofhouseholdsinthiscommunityhavetheirownlatrines?1=None2=lessthan10%3=10%-25%4=25%-50%5=above50%

Isthereacommunallatrineinthisgroup’sarea?1=Yes2=No

Whoisthemainagentforconstructinghouseholdlatrinesinthisgroup’sarea?1=Trainedlocalartisan?2=Localcommunitymembers3=COWSO4=None99=Other(specify)----

Whoisthemainsourceofhygieneandsanitationinformationforthisgroup?1=COWSO2=Artisans3=Localanimators4=Healthworkers5=None99=Other(specify)______

SECTIONG:PERCEPTIONSOFCHANGEINWATERSUPPLY,SANITATION,HYGIENEANDGENDEREQUALITY G1

WhathashappenedtopeopleinthisusergroupoverthelastfiveyearsINTERMSOF:Responses1=Improved

2=Remainedsame3=Deteriorated

a Accesstoimprovedwatersupply b Latrineuse c Sanitationandhygiene d Health e Women’sdomesticworkload f Women’sinvolvementintheplanninganddecisionmakingofwatersupplyandsanitationprojects g Women’sparticipationinothercommunityaffairs h Women’sparticipationinpaidemploymentorincomegeneratingactivities i Girlsschoolenrolment j Girls’schoolattendance

86

k Girls’schooldropout

Annex8. DraftLGAWASHteamquestionnaire

87

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

LGAWASHTEAMQUESTIONNAIRE

Thisquestionnaireisintwoparts.

PartIshouldbecompletedbytheinterviewerinameetingwiththefullWASHteam.Ifitisnotpossibleforthefullteamtositwiththeinterviewer,itmaybenecessarytogetasmuchinformationaspossiblefromwhoeverisavailable.

PartIImayrequiresometimefortheWASHteamtoobtaintherequiredinformationfromthefiles.Ifso,itcanbeleftwiththeWASHteamandcollectedlater.

LGAID

IDENTIFICATIONPARTICULARS

LOCATIONIDENTIFICATION

LOCATION NAME ID.NO

REGION DISTRICT

88

SURVEYSTAFFDETAILS

LOCATION NAME

REGION DISTRICT NAMEOFENUMERATOR ENUMERATORCODE TIMEINTERVIEWSTART TIMEINTERVIEWEND DATEOFINTERVIEW NAMEOFSUPERVISOR SUPERVISORCODE NAMEOFDATAENTERER DATAENTERERCODE

INTRODUCTION

Mynameis________,andIamhereonbehalfof(SURVEYFIRM),theMinistryofWaterandtheAfricanDevelopmentBank.TheprimaryobjectiveistocarryoutasurveyforanImpactEvaluationofTanzania’sRuralWaterSupplyandSanitationProgramme. IwillbeaskingyouaseriesofquestionsrelatingtotheworkofthisWASHteam.Letmeclarifyand insistthatthissurvey isconfidentialandvoluntary,andanyinformationthatweobtainwillonlybeusedanonymously,forimpactevaluationpurposes.BeforeIstart,doyouhaveanyquestionsoristhereanythingwhichIhavesaidonwhichyouwouldlikefurtherclarification?MayIproceedwiththeinterview?

[COMMENTS]

89

PART1

1. WASHteamcomposition

Name

Gender

Jobtitle

Yearstartedinjobinthisdistrict

PositioninWASHteam

Training/orientationreceivedonWASHissuessincetakingposition(pleasespecifysubject(s)anddate(s))

1

2

90

3

4

91

2. HowoftendoestheWASHteammeet?

✓

Weekly Fortnightly Monthly Quarterly Onlywhenthereisaneedtomeet Never

Comments:

92

3. WhataretheresponsibilitiesofthisWASHteam?[donotprompt]

✓

Planningnewwaterinfrastructure Planningrehabilitationofwaterinfrastructure Planningsanitationandhygieneprogrammes Co-ordinatingwaterandsanitationinterventions BudgetpreparationforWASHsector BudgetmanagementforWASHsector FinancialreportingforWASHsector Co-ordinatingreportingonWASHsectorinthisLGA Supervisingnewwaterinfrastructure Supervisingrehabilitationofwaterinfrastructure Monitoringstatusofwaterinfrastructure Managingrepairstowaterinfrastructure FacilitatingestablishmentofCOWSOs Co-ordinatingtrainingofCOWSOs CarryingouttrainingofCOWSOs OngoingadvisorysupporttoCOWSOs Monitoringperformance,receivingreportsofCOWSOs Other(pleasespecify)

Comments:

93

4. WhattraininghasthisWASHteamreceivedsince2012?

Subject(s) Trainer(s) Date

94

5. ForhowmanyvillagesisthisWASHteamresponsible?___________

6. ForhowmanyWUGs/COWSOsisthisWASHteamcurrentlyresponsible?___________

7. New/rehabilitatedwaterinfrastructureinthisLGAsinceJanuary2012:howmanysuchprojectshastheLGAstarted?_______

Inthetablebelow,pleasegivedetailsofthefirstfoursuchprojectsthattheLGAstartedsinceJanuary2012.

Project1 Project2 Project3 Project4Location Briefdescription(mentionwhethernew,rehabilitatedorboth)

Numberofwaterpoints Averagenumberofregistereduserhouseholdsperwaterpoint

Howandwhywasthisprojectselectedforimplementation?

95

Project1 Project2 Project3 Project4Whodesignedthescheme(e.g.DistrictWaterEngineer,WASHteam,consultants…)?

Responsibilityfortendering,contractorselection

WhofacilitatedCOWSOformation?

WhoundertookCOWSOtraining?

Dateconstructioncontractawarded

Dateschemecommissioned(orconstructionongoing?)

DateCOWSOregistered Waswaterprojectaccompaniedbysanitationandhygieneprogramme?

No.ofnewtoiletsbuiltbyusercommunitiessinceschemestarted

%increaseinimprovedtoiletusebyusercommunitiessinceschemestarted

Waswaterqualitytestedatcommissioning?

96

Project1 Project2 Project3 Project4Howoftenhaswaterqualitybeentestedsincecommissioning?

8. Foreachoftheprojectsidentifiedin7above:

Project1 Project2 Project3 Project4

Totalschemecost(TShs)

Totalcommunitycontribution(TShs)

StepsinRWSSPimplementationmanualthatwerefollowed(✓):

• Awarenessraising

• Proposalwriting

• Electionofcommittee

• Sanitationandhygienetraining

97

Project1 Project2 Project3 Project4

• Schememanagementtraining

• COWSOregistration

• Other(specify)

Howwascommunicationbetweenstakeholders(usergroup,WASHteam,serviceproviders,NGOsetc.)facilitated?

Isthisfacilitationongoing?

Whatwerethestrongandweakpointsinfacilitationofcommunityparticipationforthisproject?

98

Project1 Project2 Project3 Project4

9. BywhatpercentagehasimprovedtoiletuseincreasedinthisLGAsince2012?________

10. WASHserviceprovidersestablishedinthisLGAsince2011:tickservice(s)providedbyeach:

Serviceproviderno.

Watersupplyspareparts

Watersupplyrepairs

Watersupplyconstruction

Latrinematerials,slabs Latrineconstruction Other(specify)

✓ ✓ ✓ ✓ ✓ ✓1 2 3 4 5 6

99

11. Proportionofcommunitywatersupplyrequests(rehabilitationorconstruction)receivedintheLGAsince2012thathavebeenimplemented:

2012 2013 2014Numberofcommunitywatersupplyrequestsreceived Numberofcommunitywatersupplyschemesapproved Numberofcommunitywatersupplyschemescompleted

12. ForexistingwaterschemesintheLGA,howoftendoesthisWASHteamcommunicatewithCOWSOs?

✓ Inwriting Byphone BothRegularmonitoringvisits(statefrequency) Occasionalmonitoringvisits(stateroughlyhowoften) ReceiveregularreportsfromCOWSO(statefrequency) ReceiveoccasionalreportsfromCOWSO(stateroughlyhowoften) OnlywhenCOWSOsreportproblems Never

Comments:

13. WhatwouldyousayhavebeenthestrongestachievementsofthisWASHteamsinceJanuary2012?

100

14. WhatarethemainchallengesandconstraintsforthisWASHteam?[donotprompt]

Afteridentifyingallofthem,pleaserankthefirst,secondandthirdmostseriousproblem.

✓ RankLackofcapitalfunding Lackofrecurrentfunding Delaysinavailabilityoffunding LackofstaffinWASHteam Otherstaffshortages Lackoftechnicalexpertisein,trainingforWASHteam LackofequipmentforWASHteam LackoftransportforWASHteam Lackofqualifiedcontractors Lackofsparepartsforwaterinfrastructure Lackofparts(e.g.slabs)forsanitationinfrastructure ManagementproblemsinWASHteam Managementproblemselsewhereinlocalgovernment Managementproblemsincentralgovernment InadequatetrainingofCOWSO

101

ManagementproblemsinCOWSO COWSOlackoffunds Transportproblemsindistrict Communicationproblemsindistrict Failuretoundertakesanitationprogrammes Failuretointegratewaterandsanitationprogrammes Other(pleasespecify)

Comments:

15. WhatchangestoruralwaterandsanitationpolicywouldthisWASHteampropose?

16. WhatchangestoruralwaterandsanitationsystemsandprocedureswouldthisWASHteampropose?

102

Thankyou!

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

LGAWASHTEAMQUESTIONNAIRE

PARTII

LGAID

IDENTIFICATIONPARTICULARS

LOCATIONIDENTIFICATION

103

LOCATION NAME ID.NO

REGION DISTRICT

17. Budgetsandfunding:RWSSP

PleaseprovidethefollowinginformationaboutbudgetsandMinistryofWater(RWSSP)fundingforWASHinthisLGAoverthelastfourfinancialyears,ifpossible.Pleasestatewhetherthetablebelowreferstowateronly,sanitationonlyoranintegratedWASHbudget:

✓ ✓ ✓ Tablerefersto: Wateronly Sanitationonly IntegratedWASHprogramme 2011/12 2012/14 2013/14 2014/15Month(s)whenbudgetprepared Bywhombudgetprepared Monthwhenbudgetsubmitted Bywhombudgetsubmitted Month(s)whenfundsreceived Budgetamountrequested(TZSm) Budgetamountreceived(TZSm) Actualexpenditure(TZSm)

Comments:

104

18. Budgetsandfunding:nonRWSSP

Pleaseprovidethefollowinginformationaboutbudgetsandanyother(nonRWSSP)fundingforWASHinthisLGA,ifapplicable,overthelastfourfinancialyears,ifpossible.Pleasestatewhetherthetablebelowreferstowateronly,sanitationonlyoranintegratedWASHbudget:

✓ ✓ ✓ ✓

Tablerefersto:

Wateronly Sanitationonly IntegratedWASHprogrammeNotapplicable(nonon-

RWSSPfunding) 2011/12 2012/14 2013/14 2014/15Month(s)whenbudgetprepared Bywhombudgetprepared Monthwhenbudgetsubmitted Bywhombudgetsubmitted Month(s)whenfundsreceived Sourceoffunding(e.g.government,bilateraldonorprogramme,NGO)

Budgetamountrequested(TZSm) Budgetamountreceived(TZSm) Actualexpenditure(TZSm)

105

Comments:

19. RoughlyhowmanynotificationsofbreakdownsandrequestsformaintenancesupportdoesthisWASHteamreceivefromCOWSOseachmonth?_____

20. PleasegivethefollowingdetailsforbreakdownsandmaintenancerequestsnotifiedtotheWASHteamoverthelastsixmonths.ContinueonTable2ifTable1isnotenough:

Table1

Breakdown/maintenance1 Breakdown/maintenance2 Breakdown/maintenance3 Breakdown/maintenance4Location Briefdescriptionofproblem

DateproblemnotifiedtoWASHteam

Responsibilityforaction

106

Breakdown/maintenance1 Breakdown/maintenance2 Breakdown/maintenance3 Breakdown/maintenance4Actiontakentodate

Problemresolved? Ifproblemnotyetresolved,pleaseexplainwhy.

107

Table2

Breakdown/maintenance5 Breakdown/maintenance6 Breakdown/maintenance7 Breakdown/maintenance8Location Briefdescriptionofproblem

DateproblemnotifiedtoWASHteam

Responsibilityforaction

Actiontakentodate

Problemresolved?

108

Breakdown/maintenance5 Breakdown/maintenance6 Breakdown/maintenance7 Breakdown/maintenance8Ifproblemnotyetresolved,pleaseexplainwhy.

Comments:

Thankyou!

109

Annex9. Drafthealthfacilityquestionnaire

110

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

HEALTHFACILITYCHECKLIST

HealthFacilityCode

SECTIONA.IDENTIFICATIONPARTICULARS

A1.LOCATIONIDENTIFICATION

S/N LOCATION NAME ID.NO

A1.1 REGION A1.2 DISTRICT A1.3 WARD A1.4 VILLAGE A1.5 SUB-VILLAGE/STREET A1.6 HEALTHFACILITY(NAME)

A1.7 INWHICHCOMMUNITYISTHE HEALTH FACILITYLOCATED?

1=Intreatmentcommunity2=Incontrolcommunity

A1.8 RESPONDENTNAME A1.9 RESPONDENT(POSITION)

A2.SURVEYSTAFFDETAILS

A2.1 NAMEOFENUMERATOR A2.2 ENUMERATORCODE A2.3 TIMEINTERVIEWSTART A2.4 TIMEINTERVIEWEND A2.5 DATEOFINTERVIEW A2.6 NAMEOFSUPERVISOR A1.7 SUPERVISORCODE A2.8 NAMEOFDATAENTERER A2.9 DATAENTERERCODE

111

INTRODUCTIONTOHEALTHPERSONELTOBEINTERVIEWED

Mynameis________,andIamhereonbehalfof(SURVEYFIRM),theMinistryofWaterand theAfricanDevelopmentBank.Theobjective is tocarryouta survey foran ImpactEvaluationofTanzania’sRuralWaterSupplyandSanitationProgramme.Iwillbeaskingyouaseriesofquestionsrelatingtogeneralhealthfacility informationanduseofwaterandsanitationservices.Letmeclarifyandinsistthatthissurveyisconfidentialandvoluntary,andanyinformationthatweobtainwillonlybeusedanonymously,forimpactevaluationpurposes.BeforeIstart,doyouhaveanyquestionsoristhereanythingwhichIhavesaidonwhichyouwouldlikefurtherclarification?MayIproceedwiththeinterview?

SECTIONB:WATERINFRASTRUCTUREATHEALTHFACILITY

B1 B2 B3 B4 B5

Doesthishealthfacility have animproveddrinking watersupplycurrently?1=YES2=NOàB5

If YES, is thewater supplyfunctioningcurrently?1=Yes2=NO

When was thewater supplyinstalled?

What were majorsources of fundingusedforbuildingthiswatersupply?1=Communityonly2=RWSSP99=Other___________

How does thehealth facilityobtain drinkingwaterforitsdailyuse?1=own improvedsource;2=non improvedsourceBuying fromtankers2=Buying fromVendors3Buying bottledwaterOthers(Specify)_____

[COMMENTS]

112

SECTIONC:SANITATIONINFRASTRUCTUREATHEALTHFACILITY

C1 C2 C3 C4

Does this healthfacility have an nonimproved/ improvedtoilet facility forpatientscurrently?1=yesimproved2=yesnonimporved=3=NOàC7

If YES, is the toiletfacility functioningcurrently?1=YES2=NO

When was the toiletfacilityconstructed?

What were majorsources of fundingused for building thistoiletfacility?1=Communityonly2=RWSSP99=Other___________

C6 C7 C8

Is the toilet facilityseparate for men andwomen?1=YES2=NOà

Does the toilet facilityhavewater supply forhandwashing?1=YES2=NO

Does the toilet facilityhaveasoapsupplyforhandwashing?1=YES2=NO

PARTII:USERSANDOUTPATIENTVISITSTOTHEHEALTHFACILITYDUETODIARRHOEA

D1:Ineachoftheperiods,usersofthishealthfacilitymainlycamefromwhichvillages?(Rankvillagesbynumberofusersindescendingorder)2014 2013 2012 2011 2010 2009 2008 2007 2006 2005

PARTIII:OUTPATIENTVISITSDUETODIARRHOEA

Diarrhoea D2:Howmanydiarrhoeaoutpatientvisitorsdidthehealthfacilityhaveintheyearsshownbelow?2014 2013 2012 2011 2010 2009 2008 2007 2006 2005

Individuals (aged 5yearsandabove)

Children (aged lessthan5years

113

Annex10. Draftprimaryschoolquestionnaire

114

UNITEDREPUBLICOFTANZANIA

AFRICANDEVELOPMENTBANK

ImpactEvaluationoftheRuralWaterSupplyandSanitationProgramme(RWSSP)

PRIMARYSCHOOLCHECKLIST

SchoolCode

SECTIONA.IDENTIFICATIONPARTICULARS

A1.LOCATIONIDENTIFICATION

S/N LOCATION NAME ID.NO

A1.1 REGION

A1.2 DISTRICT

A1.3 WARD

A1.4 VILLAGE

A1.5 SUB-VILLAGE/STREET

A1.6 SCHOOL(NAME)

115

A1.7 IN WHICH COMMUNITY IS THE SCHOOLLOCATED?

1=Intreatmentcommunity2=Incontrolcommunity

A1.8 RESPONDENTNAME

A1.9 RESPONDENTPOSITION

A2.SURVEYSTAFFDETAILS

A2.1 NAMEOFENUMERATOR A2.2 ENUMERATORCODE A2.3 TIMEINTERVIEWSTART A2.4 TIMEINTERVIEWEND A2.5 DATEOFINTERVIEW A2.6 NAMEOFSUPERVISOR A1.7 SUPERVISORCODE A2.8 NAMEOFDATAENTERER A2.9 DATAENTERERCODE

INTRODUCTIONTOSCHOOLPERSONELTOBEINTERVIEWED

Mynameis________,andIamhereonbehalfof(SURVEYFIRM),theMinistryofWaterandtheAfricanDevelopmentBank.TheobjectiveistocarryoutasurveyforanImpactEvaluationofTanzania’sRuralWaterSupplyandSanitationProgramme.Iwillbeaskingyouaseriesofquestionsrelatingtogeneralschoolinformation,attendanceandaccessanduseofwaterandsanitationservices.Letmeclarifyandinsistthatthissurveyisconfidentialandvoluntary,andanyinformationthatweobtainwillonlybeusedanonymously,forimpactevaluationpurposes.BeforeIstart,doyouhaveanyquestionsoristhereanythingwhichIhavesaidonwhichyouwouldlikefurtherclarification?MayIproceedwiththeinterview?

[COMMENTS]

116

SECTIONB:WATERINFRASTRUCTUREATSCHOOL

B1 B2 B3 B4 B5Does this school have adrinking water facilitycurrently?1=YES2=NOàB5

If YES, is the water facilityfunctioningcurrently?1=Yes2=NO

When was the water facilitybuilt?

What were major sources offunds used for building thiswaterfacility?1=Communityonly2=RWSSP99=Other___________

How does the school obtaindrinkingwaterforitsdailyuse?1=ownimprovedsource2=ownnonimprovedsourceBuyingfromtankers2=BuyingfromVendors3BuyingbottledwaterOthers(Specify)_____

SECTIONC:SANITATIONINFRASTRUCTUREATSCHOOL

C1 C2 C3 C4 C5 C6Does this school havetoilet facilities for pupilscurrently?Distinguish betweenimprovedandnonimprovedtoilet1=YES2=NOàC7

If YES, are the toiletfacilitiesinusecurrently?1=YES2=NO

Do boys and girls haveseparatetoiletfacilitiesintheschool?1=YES2=NO

How many students pertoilet?

Does the school toiletfacilityhavewatersupplyforhandwashing?`1=YES2=NO

Does the school providesoap or soap substituteforhandwashing?1=YES2=NO

Boys’Toilets

Girls’Toilets

117

SECTIOND:SCHOOLENROLMENT,DROPOUTANDATTENDANCE

Year D1. Number of students enrolled inStandardI-IV

D2. Number of students enrolled inStandardV-VII

D3.Numberofstudentsdropped-outinStandardI-IV

D4. Number of students dropped-out inStandardV-VII

2014 1.Boys 2.Girls 3.Total 1.Boys 2.Girls 3.Total 1.Boys 2.Girls 3.Total 1.Boys 2.Girls 3.Total

2013 2012 2011 2010 2009 2008 2007 2006 2005

Respondent’scommentsonSchoolenrollmentanddropouttrendforboysandgirls(Reasonsfortheobservedtrend).

118

D5:AttendanceRate(Percentageattendedperannum)

STDI

STDII

STDIII

STDIV

STDV

STDVI

STDVII 1.Boys 2.Girls 1.Boys 2.Girls 1.Boys 2.Girls 1.Boys 2.Girls 1.Boys 2.Girls 1.Boys 2.Girls 1.Boys 2.Girls

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

119

SECTIONE:MICROBIOLOGICALQUALITYOFWATERSAMPLEATPOINTOFSTORAGE/POINTOFUSE

E1.E.coliconcentrationperml

Respondent’scommentsonSchoolattendancetrendforboysandgirls(Reasonsfortheobservedtrend).

120

Annex11. Howevaluationquestionsareaddressed

Thetablebelowshowshowtheevaluationquestionsposedinsection1.4(page3)andthetheoryofchangefortheRWSSPsetoutinFigure1onpage7willbeaddressedbythesurveyinstrumentsandtheothermodesofenquirythattheevaluationwilluse.

Table5.Howevaluationquestionsareaddressed

EvaluationquestionTheoryofchange

reference Questionnaire Annex Questionno(s) Othersources,comments1 Whattypesandquantitiesofwatersupply,sanitation

and hygiene outputs has the RWSSP achieved athouseholdandschoollevels?

Outputs LGAWASHteam Annex8 7,10,11,20 RWSSPdocumentation

2 What types, quantities and quality of capacitydevelopment has the RWSSP achieved at LGA andcommunitylevelswithregardtothedesign,delivery,operation,maintenanceand sustainabilityofWASHinterventions?

Outputs Waterpoint

LGAWASHteam

Annex7

Annex8

E26-27

4

3 What is thequalityofdrinkingwater inbeneficiarycommunities, households and school, at point ofsupplyandpointofuse?

Outputs Household

Waterpoint

Primaryschool

Annex5

Annex7

Annex10

K1

-

E1

Nospecificquestioninquestionnaire,butwaterqualitywillbemeasuredatwaterpointsattreatmentsites

4 Dothequantityandproximityof improveddrinkingwater supplies available to beneficiary householdsmeetinternationalstandards?

Outputs Household Annex5 E2,24,25,26,27,35

5 What is the quality of latrines in beneficiaryhouseholdsandschools?

Outputs Household

Primaryschool

Annex5

Annex10

F2,F7,F8

C1-6

121

EvaluationquestionTheoryofchange

reference Questionnaire Annex Questionno(s) Othersources,comments6 Are beneficiary households and schools using

drinkingwaterasintendedbyRWSSPdesign?Outcomes Household

Primaryschool

Annex5

Annex10

E1-2,32,35.1

B5

7 WhattimesavingsareaccruingtogirlsandwomenasaresultofRWSSPinterventions?

Outcomes Household Annex5 E24-27,40-41,I1-2

8 To what extent are the sanitation and hygienepractices promotedby theRWSSP implemented bybeneficiaryhouseholdsandschools?

Outcomes Household Annex5 F1-2,3.2-3.4,5,7,8,8.1,13,G3.1-4

Primaryschool Annex10 C1-6

9 Arethechangesinwater,sanitationandhygieneuseand practice achieved by RWSSP interventionsuniformlydistributedbetweenandwithinbeneficiarycommunitiesandhouseholds?

Outcomes Waterpoint Annex7

D12-13,D25-26,E12,F4,F5

10 What targeting, awareness and planning activitiesprecedeRWSSPinterventions?

Targeting,awareness andplanning

LGAWASHteam Annex8 7,8

Waterpoint Annex7

E26,27,F1

11 What are the principal features of the policy thatguidesRWSSPinterventions?

Targeting,awareness andplanning

RWSSPdocumentation

12 What institutionaloutputshas theRWSSPachievedatcommunitylevel?

Outputs Waterpoint Annex7

E1-3,8-12,26-27

13 WhatinstitutionaloutcomeshastheRWSSPachievedatcommunitylevel?

Outcomes Waterpoint Annex7 E28-34

LGAWASHteam Annex8 14

Household Annex5 H8.1

14 Are the institutional assumptions embodied in theRWSSPTOCvalid?

Inputsè Outputsè Outcomes

Waterpoint Annex7 E28-34

LGAWASHteam Annex8 14

122

EvaluationquestionTheoryofchange

reference Questionnaire Annex Questionno(s) Othersources,comments15 Canchangesintheincidenceofdiarrhoeainchildren

aged under five in beneficiary communities – as aproxy for incidence of waterborne diseases – beattributedtoRWSSPinterventions?

Finaloutcomes Healthfacility Annex9 D1,2 Statisticalanalysisofhealthfacilitydatarepresentingpatientsfromtreatmentandcontrolvillages

16 Canchangesintheenrolmentandattendanceofgirlsfrombeneficiarycommunitiesatschool–aproxyforenhancededucationalopportunity–beattributedtoRWSSPinterventions?

Finaloutcomes Primaryschool Annex10 D1-5 Statisticalanalysisofprimaryschooldatarepresentingpupilsfromtreatmentandcontrolvillages

17 Can changes in the income generating activitiespractisedbywomenfrombeneficiarycommunities–a proxy for enhanced economic opportunity – beattributedtoRWSSPinterventions?

Finaloutcomes Household

Community

Annex5

Annex6

I2

G1

18 Can changes in local (self) employment incommunity-based WASH service delivery beattributedtotheRWSSP?

Finaloutcomes Community Annex6 G1 Statisticalanalysisofemploymentdatafromtreatmentandcontrolvillages

19 Are the results of RWSSP interventions technicallysustainable?

Outcomes Waterpoint Annex7 D6,7,19,20,E19-25

LGAWASHteam Annex8 20

20 AretheresultsofRWSSPinterventionsinstitutionallysustainable?

Outcomes Waterpoint Annex7 E28-34

LGAWASHteam Annex8 14

Household Annex5 H8.1

21 What are the links between technical andinstitutional sustainability, and are they adequatelyreflectedintheRWSSPTOC?

Inputsè Outputsè Outcomes

Waterpoint Annex7 E19-24 Qualitativeanalysis

22 IstheRWSSPTOCreplicableattheintendedscale? Inputsè Outputsè Outcomes

Qualitativeanalysis

123

References

Gertler,P.G.,Martinez,S.,Premand,P.,Rawlings,L.B.andVermeersch,C.M.J.,2011.Impactevaluationinpractice.Washington,DC:TheWorldBank.

GOT,2010.WaterSectorDevelopmentProgramme.Phase1midtermreview.DaresSalaam:MinistryofWaterandIrrigation.

GOT,2013a.Tanzaniainfigures2012.DaresSalaam:NationalBureauofStatistics.

GOT, 2013b. Final report.Water Sector Development Programme, Tanzania. Evaluation ofPhaseI.DaresSalaam:MOW.

GOT,2014a.WaterSectorDevelopmentProgrammePhaseII((2014/2015–2018/2019).DaresSalaam:MinistryofWater.

GOT,2014b.Thewatersectorstatusreport2014.MarkingtheendofWSDPPhaseI.DaresSalaam:MinistryofWater.

GOT, 2015. Water Sector Development Programme revised programme implementationmanual.DaresSalaam:MOW:draft.

Heckman, J., Ichimura, H. and Todd, P. 1998. Matching as an econometric evaluationestimator.ReviewofEconomicStudies65:261-294.

Twaweza,2014.Moneyflows,watertrickles.ChallengesofaccesstocleanwaterinTanzania.Sautizawananchibrief10.DaresSalaam:Twaweza.

UNDPandGOT,2015.SummaryTanzaniahumandevelopmentreport2014.DaresSalaam:EconomicandSocialResearchFoundation.

World Bank, 2015. Population density. http://data.worldbank.org/indicator/EN.POP.DNST[accessed18April2015]