sarv-siksha abhiyaan-neelam shami rao

RESEARCH EVALUATIONRESEARCH, EVALUATION, MONITORING AND SUPERVISION

Sarva Siksha AbhiyanSarva Siksha Abhiyanbbbyby

Neelam Shami RaoNeelam Shami Rao

Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India

11

P t ti C t tP t ti C t tPresentation ContentsPresentation Contents

SSA GoalsSSA GoalsMonitoring Principles Under SSAMonitoring Principles Under SSAMonitoring Systems Under SSAMonitoring Systems Under SSAg yg yMonitoring InstituteMonitoring InstituteDISEDISEDISE DISE QMTQMTResearchesResearchesResults FrameworkResults Framework


22

SSA GOALSSSA GOALS

All children in school, Education Guarantee Centre Alternate School ‘Back-to-School’Centre, Alternate School, Back-to-School camp by 200Bridging gender and social gaps in:Bridging gender and social gaps in:• Primary : 2007• Elementary : 2010Universal retention by 2010Universal retention by 2010Focus on satisfactory quality with emphasis on education for life


33

on education for life

Monitoring Principles Under SSAMonitoring Principles Under SSA

SSA EnvisagesSSA EnvisagesCommunity based Monitoring systemCommunity based Monitoring systemEMIS to Incorporate Correlation ofEMIS to Incorporate Correlation ofEMIS to Incorporate Correlation of EMIS to Incorporate Correlation of school level data with community school level data with community b d i f i f i l ib d i f i f i l ibased information from microplanning based information from microplanning and surveysand surveysyyPMIS for periodic reporting systemPMIS for periodic reporting system


44

Contd/…(Monitoring Principles Under SSA)Contd/…(Monitoring Principles Under SSA)

Basic Principles in MonitoringBasic Principles in MonitoringCommunity OwnershipCommunity OwnershipPeriodic quality checks by externalPeriodic quality checks by externalPeriodic quality checks by external Periodic quality checks by external teamsteamsIndependent feedback on programmeIndependent feedback on programmeIndependent feedback on programme Independent feedback on programme implementationimplementationP i i f t R 1500/P i i f t R 1500/ h lh lProvision of upto Rs 1500/Provision of upto Rs 1500/-- per school per school per year for REMSper year for REMS


55

Monitoring Systems UnderMonitoring Systems UnderMonitoring Systems Under Monitoring Systems Under SSASSA

DistrictDistrict LevelLevel CommitteeCommittee comprisingcomprising locallocalpublicpublic representativesrepresentatives forfor monitoringmonitoringpublicpublic representativesrepresentatives forfor monitoringmonitoringProgressProgress againstagainst keykey monthlymonthly indicatorsindicators andandquarterlyquarterly progressprogress reportreport fromfrom StatesStates totoq yq y p gp g ppGovernmentGovernment ofof IndiaIndia..EducationalEducational MISMIS (DISE)(DISE) -- annualannual schoolschool--b db d d td tbasedbased datadata..EducationalEducational DevelopmentDevelopment IndexIndex (EDI)(EDI) ToToassessassess statestate progressprogress towardstowards UEEUEEassessassess statestate progressprogress towardstowards UEEUEE..SchoolSchool ReportReport CardsCards developeddeveloped atatwwwwww nuepanuepa orgorg


66

wwwwww..nuepanuepa..orgorg..

M it i S t U d SSAM it i S t U d SSAMonitoring Systems Under SSAMonitoring Systems Under SSA

4141 IndependentIndependent NationalNational SocialSocial ScienceScienceppInstitutionsInstitutions toto makemake independentindependent &&regularregular fieldfield visitsvisits toto monitormonitorperformanceperformanceperformanceperformance..AnAn independentindependent JointJoint ReviewReview MissionMissionreviewsreviews thethe progressprogress ofof SSASSA twicetwice aa yearyearreviewsreviews thethe progressprogress ofof SSASSA twicetwice aa yearyearPupilPupil achievementachievement levellevel samplesample surveyssurveysareare conductedconducted everyevery threethree yearsyears bybyyy yy yyNCERTNCERT toto checkcheck increaseincrease inin learninglearninglevelslevels


77

Contd/…(Monitoring Systems Under SSA)Contd/…(Monitoring Systems Under SSA)

Several Several independent independent assessments/studiesassessments/studies carried out forcarried out forassessments/studiesassessments/studies carried out for carried out for independent feedback on implementation of independent feedback on implementation of SSASSA

Out of School Study, 2005. Out of School Study, 2005. Student & Teacher attendance rates 2007Student & Teacher attendance rates 2007study on Parastudy on Para--Teachers 2007.Teachers 2007.

Independent Independent concurrent financial reviewsconcurrent financial reviewsi i d b th Mi i t 32 St t /i i d b th Mi i t 32 St t /commissioned by the Ministry. 32 States/ commissioned by the Ministry. 32 States/

UTs covered so far & review in respect of 3 UTs covered so far & review in respect of 3 States/UTs under progressStates/UTs under progress


88

States/UTs under progress.States/UTs under progress.

Contd/…(Monitoring Systems Under SSA)Contd/…(Monitoring Systems Under SSA)

A set of quality monitoring tools, developed in A set of quality monitoring tools, developed in collaboration with NCERT, to provide quarterly and collaboration with NCERT, to provide quarterly and , p q y, p q yannual information on several quality related indices of annual information on several quality related indices of SSA has been rolled out, with 29 States reports SSA has been rolled out, with 29 States reports received, covering: received, covering: --, g, g

Student enrolment and actual attendanceStudent enrolment and actual attendancePupil achievement levelsPupil achievement levelsTeacher availability and teacher trainingTeacher availability and teacher training

Classroom PracticesClassroom PracticesA d i i i f h l b Cl tA d i i i f h l b Cl tAcademic supervisions of schools by Cluster Academic supervisions of schools by Cluster and Block Resource Centres.and Block Resource Centres.Community perceptions of school functioningCommunity perceptions of school functioning


99

Community perceptions of school functioning.Community perceptions of school functioning.Regular reviews at secretary level and field visitsRegular reviews at secretary level and field visits

Monitoring Institutes to giveMonitoring Institutes to giveIndependent Feedback – triangulation of i f ti i d f St t th hinformation received from States through

PMIS/ DISE/QMTTo assess the progress of implementation of approved plans at District and To assess the progress of implementation of approved plans at District and State level.State level.

To sample check progress in achievement of some key out come indicators.To sample check progress in achievement of some key out come indicators.p p g yp p g yTo verify process and procedures undertaken for implementation of SSA.To verify process and procedures undertaken for implementation of SSA.

The monitoring institutions engaged for a 2 year period.5% of Elementary Schools/EGS/AIE centre will be visited

during period of two years.Si thl t i 25% f th b f di t i tSix monthly reports covering 25% of the number of districts

allotted to the Monitoring Institutes.SPDsSPDs areare requiredrequired toto shareshare thethe findingsfindings ofof MIsMIs withwith thethe DistrictDistrict levellevel officerofficer


1010

qq gginin theirtheir MonthlyMonthly meetingsmeetings forfor remedialremedial actionaction..

4141 InstitutesInstitutes provideprovide feedbackfeedback tilltill nownow moremore thanthan 400400 districtsdistricts coveredcovered

Sample of Observations from MIsSample of Observations from MIsSample of Observations from MIsSample of Observations from MIs

TextbooksTextbooks

All categories of children in the districts received All categories of children in the districts received text books within one month of the beginning oftext books within one month of the beginning oftext books within one month of the beginning of text books within one month of the beginning of the academic year 2006the academic year 2006--07 (Gauwahati 07 (Gauwahati University)University)100100 perper centcent childrenchildren receivedreceived textbookstextbooks (IDS,(IDS,Jaipur)Jaipur)TextText booksbooks notnot beenbeen suppliedsupplied withinwithin oneone monthmonthofof thethe openingopening ofof thethe schoolsschools inin anyany sampledsampled

h lh l (A(A NN Si hSi h I tit tI tit t P t )P t )schoolsschools (A(A..NN.. SinhaSinha Institute,Institute, Patna)Patna)FullFull setssets ofof textbookstextbooks havehave notnot beenbeen receivedreceivedandand distributeddistributed toto thethe UpperUpper primaryprimary studentsstudents


1111

andand distributeddistributed toto thethe UpperUpper primaryprimary studentsstudentseveneven upup toto SeptemberSeptember 20072007(Kurukshetra(KurukshetraUniversity,University, Haryana)Haryana)

District Information SystemDistrict Information SystemDistrict Information System District Information System of education (DISE)of education (DISE)

DISE started in 1990sDISE started in 1990sScaled up in all districts since 2004Scaled up in all districts since 2004Scaled up in all districts since 2004Scaled up in all districts since 2004Provide a time series dataProvide a time series dataBase for evidence based planningBase for evidence based planningp gp g

School based information systemSchool based information systemPhysical infrastructure and facilitiesPhysical infrastructure and facilitiesyyAvailability of teachersAvailability of teachersEnrollment and academic performanceEnrollment and academic performanceppTraining of teachersTraining of teachers


1212

District Information SystemDistrict Information SystemDistrict Information System District Information System of education (DISE)of education (DISE)

3030thth September as a record dateSeptember as a record dateComputerised indigenous and flexibleComputerised indigenous and flexibleComputerised indigenous and flexibleComputerised indigenous and flexibleSoftware responds to field requirementSoftware responds to field requirementData Utilised for monitoring as well as planningData Utilised for monitoring as well as planningData Utilised for monitoring as well as planningData Utilised for monitoring as well as planningData TriangulationData Triangulation

5% sample check by Independent Agency for data5% sample check by Independent Agency for data5% sample check by Independent Agency for data 5% sample check by Independent Agency for data veracityveracityConsistency checks inbuilt in the systemConsistency checks inbuilt in the system


1313

Educational Development Index (EDI)

• Educational Development Indexdeveloped based on Districtdeveloped based on DistrictInformation System of Education(DISE) in 2006-07

• Ranking on 4 parameters – Access,Infrastructure, Teachers, Outcome(GER, GPI etc)( )

• No. of States on low EDI Valuereducing

EDI EDI ValueValue

No. of StatesNo. of States

> 0.75> 0.75 0.6250.625--0.750.75

<0.62<0.6255

• Ranking of districts on similar basis

20072007--0808 33 1616 1616

20062006--0707 00 1313 2222


14141-9 10-1819-27 28-35

• More SSA funds for low EDI areas.

Tracking Quality OutcomesTracking Quality OutcomesNationalNational SampleSample SurveysSurveys forfor PupilPupil AchievementAchievementeveryevery 33 yearsyearsyy yyBaseBase lineline studiesstudies forfor ClassClass III,III, V,V, VIIVII andand VIIIVIIIcompletedcompletedppFundFund setset upup toto enhanceenhance NCERTNCERT capacitiescapacities forformodernizingmodernizing testingtesting methodologiesmethodologiesgg gg ggSecondSecond roundround ofof achievementachievement surveysurveyss -- ClassClass VVcompletedcompleted,, ClassClass IIIIII && VII/VIIIVII/VIII underunder wayway..yyNationalNational CurriculumCurriculum FrameworkFramework 20052005 rollingrolling outoutMeasurableMeasurable outcomesoutcomes forfor ClassClass IIIIII revisedrevisedMeasurableMeasurable outcomesoutcomes forfor ClassClass IIIIII revisedrevised


1515

MONITORING FOR QUALITY DIMENSIONS UNDER SSA: Quality Monitoring ToolsUNDER SSA: Quality Monitoring Tools

STATE

DISTRICT

BLOCK

CLUSTER

SCHOOL/ COMMUNITY

QualityQuality outcome:outcome:Learners’ AchievementLearners’ Achievement in scholastic and coin scholastic and co--


1616scholasticscholasticQuality of outcome, input, processesQuality of outcome, input, processes, ,

Objectives of QualityObjectives of QualityObjectives of Quality Objectives of Quality Monitoring toolsMonitoring tools

The Objective of monitoring has been to: The Objective of monitoring has been to: f f ili i d i l hf f ili i d i l hperform a facilitative and supportive role ratherperform a facilitative and supportive role rather

than supervisory role in strengthening the than supervisory role in strengthening the i i i l li i i l lexisting systems at various levelsexisting systems at various levels..

focus on processes rather than on physical focus on processes rather than on physical targetstargetsprovide feed back to States for taking corrective provide feed back to States for taking corrective

d l i i f id l i i f imeasures and evolving strategies for managing measures and evolving strategies for managing QualityQuality


1717

i ii i ff Q li l d iQ li l d iDimensionsDimensions forfor Quality Elementary Education Quality Elementary Education (Components of Formats)(Components of Formats)

• Basic Infrastructure and other Facilities

M dC i S• Management and Community Support

• School and Classroom Environment

• CurriculumandTeachingLearningMaterial• Curriculum and Teaching Learning Material

• Teacher and Teacher Preparation

• OpportunityTime(Teaching LearningTime)

Quality Dimensions

of • Opportunity Time (Teaching-Learning Time)

• Classroom Practices and Processes

• Learners' Assessment MonitoringandSupervision

of Elementary Education

• Learners Assessment, Monitoring and Supervision


1818

fl f f ifl f f iTwo way flow of InformationTwo way flow of Information

National level

Di t i t l l

State level

SPO + SCERT

BRC level

District level

DPO + DIET

CRC level

School Level / Community Level


1919

PrePre requisites for Effective Monitoringrequisites for Effective MonitoringPrePre--requisites for Effective Monitoringrequisites for Effective MonitoringStructures (BRCs, CRCs) are in place.Structures (BRCs, CRCs) are in place.Personnel are in position at all places (Teachers, Personnel are in position at all places (Teachers, CRCCs,BRCCs, DEO, DIET faculty, etc.)CRCCs,BRCCs, DEO, DIET faculty, etc.)J b fil d li t d lJ b fil d li t d lJob profiles are delineated properly.Job profiles are delineated properly.Capacities are builtCapacities are built--up among personnel at different levels.up among personnel at different levels.Systems are gearedSystems are geared up to enable the personnel toup to enable the personnel toSystems are gearedSystems are geared--up to enable the personnel to up to enable the personnel to discharge their responsibilities.discharge their responsibilities.Need identification exercise in respect of capacity building ofNeed identification exercise in respect of capacity building ofNeed identification exercise in respect of capacity building of Need identification exercise in respect of capacity building of

personnel is undertaken regularly. personnel is undertaken regularly. Organizational climate is conducive.Organizational climate is conducive.Data are gathered timely on Quality Monitoring Formats and Data are gathered timely on Quality Monitoring Formats and analyzed/ shared at each level.analyzed/ shared at each level.


2020

Results Framework

Against all four Goals• Outcome IndicatorOutcome Indicator

• Baseline

• Target Value for the next three year

• Frequency & Reportq y p

• Data Collection Instruments

f C• Responsibility for Data Collection


2121

Researche: TriangulatingResearche: TriangulatingResearche: Triangulating Researche: Triangulating InformationInformation

Rs 1,500/Rs 1,500/-- per school per school –– Rs 200 at the National levelRs 200 at the National levelCommittee for approval of research projects (CARP)Committee for approval of research projects (CARP)Committee for approval of research projects (CARP) Committee for approval of research projects (CARP) under chairmanship of Secreatry SE&L at National under chairmanship of Secreatry SE&L at National level to decide on research agendalevel to decide on research agendaCARP State levelCARP State levelCARP State levelCARP State levelImportant information for triangulationImportant information for triangulation–– Out of school children sample study 2005Out of school children sample study 2005p yp y–– Study on Student and teacher attendanceStudy on Student and teacher attendance–– Study on para teachers etcStudy on para teachers etc

Many studies in pipelineMany studies in pipelineMany studies in pipelineMany studies in pipelineResearch including action researches at the district Research including action researches at the district and subdistrict leveland subdistrict level


2222

Tracking Quality: Triangulating Information• Tracking teacher and student attendance• Tracking teacher and student attendance• States commitment to revamp teacher accountability mechanisms

Students Attendance 68.5% Teacher Attendance 81.7%

Primary

< 70%70 – 80%


232380 – 90%> 90%

Goal I : All children in school / EGS centres / Alternative and Innovative Education centresAlternative and Innovative Education centres

Outcome IndicatorOutcome Indicator: Number of children aged 6-14 years not enrolled in School / EGS Centres / AIE Centres

Baseline: 13 4 million children were out of schoolBaseline: 13.4 million children were out of school (Independent Study 2005)

Target: Reduce OoSC to Zero

Frequency & Report: Annual PMIS ReportIndependent Sample Survey on OoSC in 2008 09


2424

Independent Sample Survey on OoSC in 2008-09

Outcome Indicator: Process indicators on quality -

Goal 4 :Contd/….

Baseline:

Outcome Indicator: Process indicators on quality Attendance Rates of Students and Teachers

Student Attendance level is 70% at primary and 75% at upper primary Teacher Attendance level is 81% at primary and 80% at upper primary (2006 : Independent Study 17 States)

Target Value:Increase student and teacher attendance to more than 90% at all levels

Frequency & Report: Annual PMIS/ QMT Reports disaggregated by States


2525

p gg g yIndependent Sample Study on student and teacher attendance to be repeated in 2009-10

Outcome Indicator: National student achievement level Goal 4 :Contd/….

outcomes Baseline:Learning levels for Class III -58 % in Maths & 63 % LanguageLearning levels for Class V 46% in Maths, 58 % in Language,

0% i EVS50% in EVS Learning levels for Class VII/VIII - 30% / 38% in Maths, 52% / 52% in Language 36% / 40 in Science and 33% / 40% in52% in Language, 36% / 40 in Science and 33% / 40% in Social Science( NCERT National Assessment Sample Survey -1st round)( NCERT National Assessment Sample Survey 1 round) Target: Improve Learning levels in each round.Frequency & Report:Frequency & Report:

2nd round outcomes for Class III and Class VII in 2008 - 09 3rd round for Class V in 2009-10


2626

3 round for Class V in 2009 103rd round for Class III and VII/. VIII in 2010 - 2011

Tracking Quality Outcomes Cntd/...Tracking Quality Outcomes Cntd/...

State Rankings for overall MAS Class V

• Improvement in learningachievement in all the subjects in

State Rankings for overall MAS Class V

RanksRanks StatesStates

ClassesClasses MathsMaths LangLang EVSEVS

achievement in all the subjects inclass V.1 to 51 to 5 West Bengal, Karnataka, West Bengal, Karnataka,

Gujarat, Jharkhand, TripuraGujarat, Jharkhand, TripuraClassesClasses MathsMaths Lang. Lang. EVSEVS

Class VClass V((11stst

roundround))

46.5146.51 58.5758.57 50.3050.306 to 106 to 10 Uttar Pradesh, Maharastra, Uttar Pradesh, Maharastra,

Tamil Nadu, Delhi, Madhya Tamil Nadu, Delhi, Madhya PradeshPradesh

11 1511 15 O i Hi h l P d hO i Hi h l P d h roundround))Class VClass V

((22ndnd

roundround))

48.4648.46 60.3160.31 52.1952.1911 to 1511 to 15 Orissa, Himachal Pradesh, Orissa, Himachal Pradesh,

Mizoram, Manipur, RajasthanMizoram, Manipur, Rajasthan

16 to 2016 to 20 Kerala, Punjab, Arunachal Kerala, Punjab, Arunachal roundround))

• Goa, HP, Gujarat, J& K, UP, Karnataka Kerala improved by

Pradesh, Nagaland, HaryanaPradesh, Nagaland, Haryana

21 to 2521 to 25 Andhra Pradesh, D & N H, Andhra Pradesh, D & N H, Daman & Diu, Chandigarh, Daman & Diu, Chandigarh, Karnataka, Kerala, improved by

more than 5 percent pointsJammu & Kashmir Jammu & Kashmir

26 to 3026 to 30 Meghalaya, Assam, Meghalaya, Assam, Uttarakhand, Sikkim, GoaUttarakhand, Sikkim, Goa


272731 to 3331 to 33 Chhattisgarh, Puducherry, A Chhattisgarh, Puducherry, A

& N Island, & N Island,


2828

sarv-siksha abhiyaan-neelam shami rao

Documents