11

Indicators and Indicators and Improvement PlansImprovement Plans

October 2009October 2009SPR&I TrainingSPR&I Training

22

ObjectivesObjectives

Become familiar with the Indicators Become familiar with the Indicators used to make final determinations and used to make final determinations and the performance indicatorsthe performance indicators MeasurementsMeasurements TargetsTargets DataData

A brief overview of improvement plansA brief overview of improvement plans A view of the year in SPR&IA view of the year in SPR&I

33

SPP- Part CSPP- Part CIndicator 1: Timely Service DeliveryIndicator 1: Timely Service DeliveryIndicator 2: Services in Natural EnvironmentsIndicator 2: Services in Natural EnvironmentsIndicator 3: Child OutcomesIndicator 3: Child OutcomesIndicator 4: Family OutcomesIndicator 4: Family OutcomesIndicator 5: Child Find Birth -1Indicator 5: Child Find Birth -1Indicator 6: Child Find Birth - 3Indicator 6: Child Find Birth - 3Indicator 7: Timeliness of IFSPIndicator 7: Timeliness of IFSPIndicator 8: Early Childhood TransitionIndicator 8: Early Childhood TransitionIndicator 9: Part C Monitoring SystemIndicator 9: Part C Monitoring SystemIndicator 10: Administrative ComplaintsIndicator 10: Administrative ComplaintsIndicator 11: Due Process HearingsIndicator 11: Due Process HearingsIndicator 12: Resolution AgreementsIndicator 12: Resolution AgreementsIndicator 13: MediationsIndicator 13: MediationsIndicator 14: Data AccuracyIndicator 14: Data Accuracy

44

SPP – Part BSPP – Part B Indicator 1: GraduationIndicator 1: Graduation Indicator 2: DropoutIndicator 2: Dropout Indicator 3: Statewide AssessmentIndicator 3: Statewide Assessment Indicator 4: Suspension/ExpulsionIndicator 4: Suspension/Expulsion Indicator 5: LRE PlacementIndicator 5: LRE Placement Indicator 6: Preschool SettingsIndicator 6: Preschool Settings Indicator 7: Preschool SkillsIndicator 7: Preschool Skills Indicator 8: Parent InvolvementIndicator 8: Parent Involvement Indicator 9: Disproportionate Rep. in SpedIndicator 9: Disproportionate Rep. in Sped Indicator 10: Disproportionate Rep. in specific disability categoryIndicator 10: Disproportionate Rep. in specific disability category Indicator 11: Child FindIndicator 11: Child Find Indicator 12: Part C to B TransitionIndicator 12: Part C to B Transition Indicator 13: Secondary Transition w/IEP GoalsIndicator 13: Secondary Transition w/IEP Goals Indicator 14: Secondary Transition/Post School OutcomesIndicator 14: Secondary Transition/Post School Outcomes Indicator 15: Monitoring, Complaints & HearingsIndicator 15: Monitoring, Complaints & Hearings Indicator 16: Written ComplaintsIndicator 16: Written Complaints Indicator 17: Due Process HearingsIndicator 17: Due Process Hearings Indicator 18: Hearing Requests that went to ResolutionIndicator 18: Hearing Requests that went to Resolution Indicator 19: MediationsIndicator 19: Mediations Indicator 20: Timeliness of State Reported Data & ReportsIndicator 20: Timeliness of State Reported Data & Reports

55

C1C1 Indicator 1: Percent of infants and Indicator 1: Percent of infants and

toddlers with IFSPs who receive the toddlers with IFSPs who receive the early intervention services on their early intervention services on their IFSPs in a timely manner.IFSPs in a timely manner.

66

C1 Measurement and TargetC1 Measurement and Target Measurement: Percent = [(# of infants and toddlers Measurement: Percent = [(# of infants and toddlers

with IFSPs who receive the early intervention with IFSPs who receive the early intervention services on their IFSPs in a timely manner) divided services on their IFSPs in a timely manner) divided by the (total # of infants and toddlers with IFSPs)] by the (total # of infants and toddlers with IFSPs)] times 100.Account for untimely receipt of services.times 100.Account for untimely receipt of services.

FFY 2007 Target: FFY 2007 Target: 100%100% of children with IFSPs receive of children with IFSPs receive early intervention services in a timely manner.early intervention services in a timely manner.

The Oregon Department of Education (ODE) defined The Oregon Department of Education (ODE) defined timely manner as the initiation date on the IFSP timely manner as the initiation date on the IFSP oror 10 10 days from when the parent provides consent for the days from when the parent provides consent for the IFSP service.IFSP service.

77

C1 Actual Target DataC1 Actual Target DataYear Year Oregon Oregon

FFY 2005FFY 2005 99.3%99.3%

FFY 2006FFY 2006 100%100%

FFY 2007FFY 2007 95.1%95.1%

TentativeTentativeFFY 2008FFY 2008 95.7%95.7%

88

C2C2 Indicator 2: Percent of infants and Indicator 2: Percent of infants and

toddlers with IFSPs who primarily toddlers with IFSPs who primarily receive early intervention services in receive early intervention services in the home or programs for typically the home or programs for typically developing children. developing children.

99

C2 Measurement and TargetC2 Measurement and Target Measurement: Percent = [(# of infants and toddlers Measurement: Percent = [(# of infants and toddlers

with IFSPs who primarily with IFSPs who primarily receive early intervention receive early intervention services in the home or programs for typically services in the home or programs for typically developing childrendeveloping children) divided by the (total # of infants ) divided by the (total # of infants and toddlers with IFSPs)] times 100.and toddlers with IFSPs)] times 100.

FFY 2007 Target: FFY 2007 Target: 70.0%70.0% of infants and toddlers with of infants and toddlers with IFSPs will receive early intervention services in the home IFSPs will receive early intervention services in the home or in programs for typically developing children. All or in programs for typically developing children. All decisions regarding where children receive their IFSP decisions regarding where children receive their IFSP services are made by the child’s IFSP team and are services are made by the child’s IFSP team and are based on the individual needs of the child. based on the individual needs of the child.

1010

C2 Actual Target DataC2 Actual Target Data

Year Year Oregon Oregon

FFY 2005FFY 2005 81.3%81.3%

FFY 2006FFY 2006 85.0%85.0%

FFY 2007FFY 2007 90.4%90.4%

1111

C5C5 Indicator 5: Percent of infants and toddlers Indicator 5: Percent of infants and toddlers

birth to 1 with IFSPs compared to National birth to 1 with IFSPs compared to National data.data.

1212

C5 Measurement and TargetC5 Measurement and Target Measurement: A. Percent = [(# of infants and Measurement: A. Percent = [(# of infants and

toddlers birth to 1 with IFSPs) divided by the toddlers birth to 1 with IFSPs) divided by the (population of infants and toddlers birth to (population of infants and toddlers birth to 1)] times 100 compared to National data.1)] times 100 compared to National data.

FFY 2007 Target: FFY 2007 Target: 0.60%0.60% of infants, birth to age of infants, birth to age 1, in conformance with state eligibility 1, in conformance with state eligibility requirements, are determined eligible for early requirements, are determined eligible for early intervention services and have IFSPs. intervention services and have IFSPs.

1313

C5 Actual Target DataC5 Actual Target DataYear Year Oregon Oregon National National

FFY 2005FFY 2005 0.74%0.74% 0.95%0.95%

FFY 2006FFY 2006 0.67%0.67% 1.04%1.04%

FFY 2007FFY 2007 0.61%0.61% 1.01%1.01%

TentativeTentativeFFY 2008FFY 2008 0.66%0.66%

State TargetState Target0.70%0.70%

FFY 2009FFY 2009 State TargetState Target0.75%0.75%

1414

C6C6

Indicator 6: Percent of infants and Indicator 6: Percent of infants and toddlers birth to 3 with IFSPs compared toddlers birth to 3 with IFSPs compared to National data.to National data.

1515

C6 Measurement and TargetC6 Measurement and Target Measurement: Measurement: A. A. Percent = [(# of infants Percent = [(# of infants

and toddlers birth to 3 with IFSPs) divided by and toddlers birth to 3 with IFSPs) divided by the (population of infants and toddlers birth the (population of infants and toddlers birth to 3)] times 100 compared to National data.to 3)] times 100 compared to National data.

FFY 2007 Target: FFY 2007 Target: 1.67%1.67% of infants and toddlers, of infants and toddlers, birth to age 3, in conformance with state birth to age 3, in conformance with state eligibility requirements, are determined eligible eligibility requirements, are determined eligible for early intervention services and have IFSPsfor early intervention services and have IFSPs

1616

C6 Actual Target DataC6 Actual Target DataYear Year Oregon Oregon National National

FFY 2005FFY 2005 1.78%1.78% 2.40%2.40%

FFY 2006FFY 2006 1.80%1.80% 2.43%2.43%

FFY 2007FFY 2007 1.78%1.78% 2.48%2.48%

TentativeTentativeFFY 2008FFY 2008 1.84%1.84%

State TargetState Target1.83%1.83%

FFY 2009FFY 2009 State TargetState Target2.0%2.0%

1717

C7C7 Indicator 7: Percent of eligible infants Indicator 7: Percent of eligible infants

and toddlers with IFSPs for whom an and toddlers with IFSPs for whom an evaluation and assessment and an evaluation and assessment and an initial IFSP meeting were conducted initial IFSP meeting were conducted within Part C’s 45-day timeline.within Part C’s 45-day timeline.

1818

C7 Measurement and TargetC7 Measurement and Target Measurement: Percent = [(# of eligible Measurement: Percent = [(# of eligible

infants and toddlers with IFSPs for whom an infants and toddlers with IFSPs for whom an evaluation and assessment and an initial evaluation and assessment and an initial IFSP meeting was conducted within Part C’s IFSP meeting was conducted within Part C’s 45-day timeline45-day timeline) divided by the (# of eligible ) divided by the (# of eligible infants and toddlers evaluated and infants and toddlers evaluated and assessed)] times 100. Account for untimely assessed)] times 100. Account for untimely evaluations.evaluations.

FFY 2007 Target: FFY 2007 Target: 100%100% of eligible infants and of eligible infants and toddlers with IFSPs will have evaluation, toddlers with IFSPs will have evaluation, assessment, and initial IFSP meeting assessment, and initial IFSP meeting conducted within 45 daysconducted within 45 days

1919

C7 Actual Target DataC7 Actual Target Data

Year Year Oregon Oregon

FFY 2005FFY 2005 99.7%99.7%

FFY 2006FFY 2006 99.3%99.3%

FFY 2007FFY 2007 99.7%99.7%

TentativeTentativeFFY 2008FFY 2008

99.5%99.5%

2020

C8C8 Indicator 8: Percent of all children exiting Part Indicator 8: Percent of all children exiting Part

C who received C who received timely transition planningtimely transition planning to to support the child’s transition to preschool and support the child’s transition to preschool and other appropriate community services by their other appropriate community services by their third birthday including:third birthday including:a.a. IFSPs with IFSPs with transition stepstransition steps and services; and services;b.b. Notification to LEANotification to LEA, if child potentially , if child potentially

eligible for Part B; andeligible for Part B; andc.c. Transition conferenceTransition conference, if child potentially , if child potentially

eligible for Part B.eligible for Part B.

2121

C8 MeasurementC8 Measurement A. Percent = [(# of children exiting Part C who have A. Percent = [(# of children exiting Part C who have

an IFSP with an IFSP with transition stepstransition steps and services) divided and services) divided by the (# of children exiting Part C)] times 100.by the (# of children exiting Part C)] times 100.

B. Percent = [(# of children exiting Part C and B. Percent = [(# of children exiting Part C and potentially eligible for Part B where potentially eligible for Part B where notification to notification to the LEAthe LEA occurred) divided by the (# of children occurred) divided by the (# of children exiting Part C who were potentially eligible for Part exiting Part C who were potentially eligible for Part B)] times 100.C. B)] times 100.C.

C. Percent = [(# of children exiting Part C and C. Percent = [(# of children exiting Part C and

potentially eligible for Part B where the potentially eligible for Part B where the transition transition conferenceconference occurred) divided by the (# of children occurred) divided by the (# of children exiting Part C who were potentially eligible for Part exiting Part C who were potentially eligible for Part B)] times 100.B)] times 100.

2222

C8 TargetC8 Target FFY 2007 Target:FFY 2007 Target: A. A. 100%100% of children exiting Part C have an IFSP with of children exiting Part C have an IFSP with

transition steps and services to support the child’s transition steps and services to support the child’s transition to preschool and other appropriate community transition to preschool and other appropriate community services prior to the third birthday.services prior to the third birthday.

B. B. 100%100% of children exiting Part C and potentially eligible of children exiting Part C and potentially eligible for Part B have the ECSE program notified prior to the for Part B have the ECSE program notified prior to the third birthday. third birthday.

C. C. 100%100% of children exiting Part C and potentially eligible of children exiting Part C and potentially eligible for Part B have a transition conference at least 90 for Part B have a transition conference at least 90 calendar days, and, at the discretion of the parties, up to calendar days, and, at the discretion of the parties, up to nine months before the third birthday.nine months before the third birthday.

2323

C8 Actual Target DataC8 Actual Target DataYear Year A. Transition A. Transition

StepsStepsB. NotificationB. Notification C. Transition C. Transition

Conference Conference FFY 2005FFY 2005 93.8%93.8% 100%100% 86.8%86.8%

FFY 2006FFY 2006 100%100% 100%100% 100%100%FFY 2007FFY 2007 95.6%95.6% 100%100% 96.3%96.3%TentativeTentativeFFY 2008FFY 2008

96.2%96.2% 100%100% 93.2%93.2%

2424

B11B11

Indicator 11: Percent of children with Indicator 11: Percent of children with parental consent to evaluate, who were parental consent to evaluate, who were evaluated and eligibility determined evaluated and eligibility determined within 60 days (or State established within 60 days (or State established timeline).timeline).

2525

B11 MeasurementB11 Measurementa.a. # of children for whom # of children for whom parental consent to evaluate parental consent to evaluate

was received.was received.b.b. # determined # determined not eligiblenot eligible whose evaluations and whose evaluations and

eligibility determinations wereeligibility determinations were completed within 60 completed within 60 daysdays (or State established timeline). (or State established timeline).

c.c. # determined # determined eligibleligible whose evaluations and e whose evaluations and eligibility determinations were eligibility determinations were completed within 60 completed within 60 daysdays (or State established timeline). (or State established timeline).

Account for children included in a but not included in b Account for children included in a but not included in b or c. Indicate the range of days beyond the timeline or c. Indicate the range of days beyond the timeline when eligibility was determined and any reasons for when eligibility was determined and any reasons for the delays.the delays.

Percent = [(b + c) divided by (a)] times 100.Percent = [(b + c) divided by (a)] times 100.

2626

B11 TargetB11 Target

FFY 2007 target: FFY 2007 target: 100%100% of students with of students with parental consent to evaluate will be parental consent to evaluate will be evaluated and eligibility determined within evaluated and eligibility determined within 60 school days.60 school days.

This information is consolidated with This information is consolidated with school age. school age.

2727

Actual Target Data for FFY 2007 Actual Target Data for FFY 2007

15,930 children for whom parental consent to evaluate 15,930 children for whom parental consent to evaluate was received.was received.

3,191 children determined not eligible whose evaluations 3,191 children determined not eligible whose evaluations and eligibility determinations were completed within 60 and eligibility determinations were completed within 60 days (or state-established timeline).days (or state-established timeline).

11,915 children determined eligible whose evaluations 11,915 children determined eligible whose evaluations and eligibility determinations were completed within 60 and eligibility determinations were completed within 60 days (or state-established timeline).days (or state-established timeline).

94.8%94.8% = [(3,191 + 11,915) divided by (15,930)] times = [(3,191 + 11,915) divided by (15,930)] times 100.100.

2828

B12B12

Indicator 12: Percent of children Indicator 12: Percent of children referred by Part C prior to age 3, who referred by Part C prior to age 3, who are found eligible for Part B, and who are found eligible for Part B, and who have an IEP developed and have an IEP developed and implemented by their third birthdays.implemented by their third birthdays.

2929

B12 MeasurmentB12 Measurment Measurement: Measurement:

a. # of children who have been a. # of children who have been served in Part C and referred to served in Part C and referred to Part BPart B for eligibility determination. for eligibility determination.

b. # of those referred determined to be b. # of those referred determined to be NOT eligibleNOT eligible and whose and whose eligibilities were determined prior to their third birthdays.eligibilities were determined prior to their third birthdays.

c. # of those c. # of those found eligiblefound eligible who have an IEP developed and who have an IEP developed and implemented by their third birthdays.implemented by their third birthdays.

d. # of children for whom d. # of children for whom parent refusalparent refusal to provide consent to provide consent caused delays in evaluation or initial services.caused delays in evaluation or initial services.

Account for children included in “a” but not included Account for children included in “a” but not included in “b, c, or d.” Indicate the range of days beyond the in “b, c, or d.” Indicate the range of days beyond the third birthday when eligibility was determined and third birthday when eligibility was determined and the IEP developed and the reasonsthe IEP developed and the reasons for the delays.for the delays.

Percent = [(c) divided by (a - b - d)] times 100.Percent = [(c) divided by (a - b - d)] times 100.

3030

B12 TargetB12 Target

FFY 2007 target: FFY 2007 target: 100%100% of children of children referred by Part C prior to age three, who referred by Part C prior to age three, who are found eligible for Part B, have an are found eligible for Part B, have an ECSE IFSP developed and implemented ECSE IFSP developed and implemented by the third birthday.by the third birthday.

3131

B12 Actual Target DataB12 Actual Target DataYear Year Oregon Oregon

FFY 2005FFY 2005 98.0%98.0%

FFY 2006FFY 2006 100%100%

FFY 2007FFY 2007 100%100%

TentativeTentativeFFY 2008FFY 2008

100%100%

3232

Websites for Technical Assistance on Websites for Technical Assistance on IndicatorsIndicators

Part B SPP/APRPart B SPP/APR http://http://www.ed.gov/policy/speced/guid/idea/bapr/index.htmlwww.ed.gov/policy/speced/guid/idea/bapr/index.html

Part C SPP/APRPart C SPP/APR http://www.ed.gov/policy/speced/guid/idea/capr/index.htmlhttp://www.ed.gov/policy/speced/guid/idea/capr/index.html

NECTAC State Reporting Instructions:NECTAC State Reporting Instructions: http://www.nectac.org/partc/partc.asphttp://www.nectac.org/partc/partc.asp

http://www.nectac.org/topics/quality/statereq.asp#619http://www.nectac.org/topics/quality/statereq.asp#619 IDEA data site:IDEA data site:

https://https://www.ideadata.org/default.aspwww.ideadata.org/default.asp

3333

They are back…They are back…

3434

WorksheetsWorksheets Worksheets are required when a program does Worksheets are required when a program does

not meet a target for the following indicators:not meet a target for the following indicators: C2: Early Intervention Services in Natural C2: Early Intervention Services in Natural

EnvironmentsEnvironments C5: Children Birth to One with IFSPsC5: Children Birth to One with IFSPs C6: Children Birth to Two with IFSPsC6: Children Birth to Two with IFSPs Child Identification ECSEChild Identification ECSE In the future: B6: Placement in the LRE for Preschool. In the future: B6: Placement in the LRE for Preschool.

Currently all programs complete improvement plans Currently all programs complete improvement plans for B6. for B6.

3535

WorksheetsWorksheets

Submitting a worksheet with an analysis of Submitting a worksheet with an analysis of your data serves two purposes:your data serves two purposes: It may provide sufficient information to justify It may provide sufficient information to justify

not meeting the target. If justified, an not meeting the target. If justified, an improvement plan would not be necessary.improvement plan would not be necessary.

If not justified to meet a target, it provides a If not justified to meet a target, it provides a foundation for determining activities for your foundation for determining activities for your improvement plans. improvement plans.

3636

Worksheets Worksheets

Just the facts…Just the facts… What does your data tell you?What does your data tell you? What factors contributed to the performance What factors contributed to the performance

on the indicator this year?on the indicator this year? Were there circumstances that may justify not Were there circumstances that may justify not

meeting the target?meeting the target?

3737

Improvement PlansImprovement Plans

Improvement plans are required when a Improvement plans are required when a program does not meet the target for an program does not meet the target for an indicator and the data does not provide indicator and the data does not provide justification for not meeting the target.justification for not meeting the target.

3838

Improvement Planning ComponentsImprovement Planning Components PurposePurpose: To map out observable, measurable, actionable, : To map out observable, measurable, actionable,

and realistic activities intended to improve performance.and realistic activities intended to improve performance.

Components:Components: Team Membership and RolesTeam Membership and Roles Data Analysis (including trend data)—Data Analysis (including trend data)—refer to Worksheet as a refer to Worksheet as a

possible resource possible resource Progress Report (of completed activities addressing Progress Report (of completed activities addressing issues identified in Data Analysis)issues identified in Data Analysis) Measurable ObjectivesMeasurable Objectives Specific ActivitiesSpecific Activities Timeline(s)Timeline(s) Person(s) ResponsiblePerson(s) Responsible Evidence of Completion and Outcome(s)Evidence of Completion and Outcome(s)

3939

Summary of Components of EI/ECSE Improvement Plans

ODE GUIDANCE SUBMITTED IMPROVEMENT PLAN

Team Members

Process Example Outcome

Data ReviewMeasurable Objectives

Specific Activities & TimelinesPerson(s) Responsible for

ActivityEvidence of Completion

4040

WorkflowWorkflowIndicatorIndicator WorksheetWorksheet Improvement PlanImprovement Plan Corrective ActionCorrective Action

C1C1 √√C2C2 √√ √√C5C5 √√ √√C6C6 √√ √√C7C7 √√C8C8 √√Child Find Child Find 3-4+3-4+

√√ √√

B6B6 √√B11B11 √√B12B12 √√

4141

The end….The end….

or is it??or is it??

4242

EI/ECSE APR

Indicator and PCR

Cycle

July

April

January

October

August

May

March

February December

November

JuneMay 2010

Programs continue to submit evidence of correction for 08-09 and 2009-2010 noncompliance Programs revise improvement plans /CAPs (if required)Submit Service Area Plans to LICC

Jan. 2010Programs continue submitting 09-10 PCR data

2009-2010

Aug. 2009ODE disseminates FFY 2007 Determinations based on 2007-2008 data

Nov. 2009Programs submit evidence of correction for 08-09 noncompliance until 100% compliantPrograms continue submitting 09-10 PCR data

Dec. 2009Programs continue submitting 09-10 PCR data 12/7: B6and B11 Improvement plans due12/7: C2, 5, 6, & ECSE Child Identification worksheets due

Feb. 2010FFY 2008 APR due to OSEPProgram 09-10 PCR data dueImprovement plans due for C2,5,6 and ECSE Child Identification based on 08-09 data

March 2010ODE verifies 09-10 PCR submissionPrograms to verify public report card dataBegin planning for Service Area Plan

Oct. 2009Programs submit evidence of correction for 08-09 noncompliance until 100% compliantSPR&I Annual Trainings ODE populates reports for B11

June 2010Programs continue to submit evidence of correction for 08-09 and 09-10 noncomplianceJune 15th Service Area Plans due

July 2010 Programs continue to submit evidence of correction for 09-10 noncomplianceODE finalizing FFY 2008 final determinations based on correction of 08-09 noncompliance

September

Sept. 2009Programs submit evidence of correction for 08-09 noncompliance until 100% compliant09-10 PCR report opens for submission ODE populates reports for C2, C5, C6, ECSE Child Identification, B6, Primary Disability Distribution, and Ethnicity Distribution with 08-09 data

April 2010Programs submit evidence of correction for 08-09 and 2009-2010 noncomplianceODE approves/rejects improvement plans/CAPs EI/ECSE

APR Indicator and PCR

Cycle