Paving the Way for Online Paving the Way for Online Testing in Elementary Testing in Elementary

SchoolsSchools

Presented by Betty MillsPresented by Betty Mills

Arlington CountyArlington County

We did it and you can We did it and you can too!too!

Students Say…Students Say…

Success in APSSuccess in APS

Percentage of Online Testing In Arlington Public Schools

2006

2006

2006

2007

2007

2007

2008

2008

20082009

2009

2009

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Elementary Secondary Division

Goals for Year OneGoals for Year One

Get a few volunteers to try online Get a few volunteers to try online testing at the elementary level testing at the elementary level

Focus on the positive Focus on the positive Share results and success with all Share results and success with all

elementary schoolselementary schools

How It Rolled Out in APSHow It Rolled Out in APS

Year 1 - 2007Year 1 - 2007 6 of 22 schools participated6 of 22 schools participated 3% of tests online3% of tests online Most Schools chose:Most Schools chose:

– One grade levelOne grade level– One or two content areasOne or two content areas

STCs were enthusiasticSTCs were enthusiastic Principals were pleasedPrincipals were pleased

We knew that once they We knew that once they tried ittried it

they would love it!they would love it!

Goals for Year TwoGoals for Year Two

Ask all schools to participateAsk all schools to participate– Space for paper materials was limited Space for paper materials was limited

and difficult to manageand difficult to manage– Wanted to prepare students for online Wanted to prepare students for online

testing at Middle schooltesting at Middle school– Immediate test results help with Immediate test results help with

remediation and placement for remediation and placement for following yearfollowing year

APS Inventory - 2005APS Inventory - 2005Inventory: Inventory: Spring 2005

7 pallets / 5 tons/ 1000+ boxes

Unloaded by 4 employees Stacked boxes formed a maze

What We Did - Year 2What We Did - Year 2

Superintendent encouraged all schools to Superintendent encouraged all schools to participateparticipate

Urged STCs from pilot schools to share Urged STCs from pilot schools to share their experiencestheir experiences

Nudged apprehensive schools by Nudged apprehensive schools by suggesting they test one grade or content suggesting they test one grade or content areaarea

Worked closely with apprehensive schoolsWorked closely with apprehensive schools Elicited more feedbackElicited more feedback

Year TwoYear Two

Elementary participation went Elementary participation went from 6 schools to 17 schoolsfrom 6 schools to 17 schools

Online tests from 3% to 31%Online tests from 3% to 31%

Year TwoYear Two

3 Schools went over 95% online 3 Schools went over 95% online (two were not pilot schools)(two were not pilot schools)

School 2007 2008Claremont 0% 95%Glebe 17% 95%Tuckahoe 0% 90%

Year TwoYear Two

SupportSupport– Comprehensive trainingComprehensive training– Online assistance sessionsOnline assistance sessions– Held their hands every step of the Held their hands every step of the

wayway Step PapersStep Papers

Goal for Year ThreeGoal for Year Three

To have every elementary school To have every elementary school offer online testing in at least one offer online testing in at least one grade level subjectgrade level subject

To help with scheduling we added 2 To help with scheduling we added 2 additional days to the testing additional days to the testing window. This ability was the direct window. This ability was the direct result of fewer paper tests to review result of fewer paper tests to review and prepare for shipment to be and prepare for shipment to be scored.scored.

Year ThreeYear Three

All schools participatedAll schools participated 70 % of tests were online70 % of tests were online Six schools at 90% or aboveSix schools at 90% or above 73% of schools above 55% 73% of schools above 55%

onlineonline

4th Grade Student @ Barrett

Year ThreeYear Three

First Year School – 97% First Year School – 97% (only PEM on (only PEM on paper)paper)

School 2007 2008 2009ATS 0% 29% 97%Claremont 0% 95% 93%Drew 0% 0% 97%Glebe 17% 95% 93%Key 15% 58% 90%Tuckahoe 0% 90% 98%

Year ThreeYear Three

““LOVED, LOVED online testing. It is LOVED, LOVED online testing. It is gratifying to get the (near) real-time gratifying to get the (near) real-time results so you can impact instruction for results so you can impact instruction for the rest of the school year.” the rest of the school year.” Erin, STCErin, STC

“ “For us, ‘growing’ the pool of testers by For us, ‘growing’ the pool of testers by adding one grade at a time brought a adding one grade at a time brought a needed comfort level to the teachers needed comfort level to the teachers involved in testing. The third grade involved in testing. The third grade teachers loved getting the SOL scores so teachers loved getting the SOL scores so quickly. The immediacy of the process quickly. The immediacy of the process was very affirming.” was very affirming.” Angela, STCAngela, STC

Do Your ResearchDo Your Research

State certification comes firstState certification comes first– BandwidthBandwidth– Requirement 1:5 computers to studentsRequirement 1:5 computers to students– No stipulation as to ratio that must be No stipulation as to ratio that must be

available for testingavailable for testing APS schools – all levels – certified APS schools – all levels – certified

20062006

IT support in the schoolsIT support in the schools– You need solid IT help & supportYou need solid IT help & support

APS Approach – Year 1APS Approach – Year 1

Brief the PrincipalsBrief the Principals Inform the ITCsInform the ITCs Keep IT personnel up to dateKeep IT personnel up to date

Get the Word OutGet the Word Out

Brief your PrincipalsBrief your Principals– Share the benefitsShare the benefits

Online audio, immediate scores, one test Online audio, immediate scores, one test item per page, opportunity to reviewitem per page, opportunity to review

Online practice testsOnline practice tests Supports technology initiativesSupports technology initiatives Prepares students for online testing is Prepares students for online testing is

Middle schoolMiddle school Forces “old school” teachers to move into Forces “old school” teachers to move into

the 21the 21stst century! century!

Get the Word OutGet the Word Out

Brief your PrincipalsBrief your Principals– Share the hindrancesShare the hindrances

Some accommodations not availableSome accommodations not available Lack of practice tests for content areas Lack of practice tests for content areas

other than readingother than reading Possible scheduling changesPossible scheduling changes

– Share district’s online history @ Share district’s online history @ secondary levelsecondary level

Students SayStudents Say

““It was SO MUCH better. Only one It was SO MUCH better. Only one question at a time-just one! I question at a time-just one! I didn’t have to worry about all the didn’t have to worry about all the other questions. I wasn’t stressed other questions. I wasn’t stressed at all.”at all.”

55thth grade student at ATS grade student at ATS

Students SayStudents Say

From a special ed student calling out From a special ed student calling out to the teacher:to the teacher: “I need to tell you “I need to tell you something and you are are not going to something and you are are not going to like it…but this test is easy!”like it…but this test is easy!”

From the teacher: From the teacher: “Remarkably, “Remarkably, students do not need to use the students do not need to use the restroom or get drinks during online restroom or get drinks during online testing. Paper and pencil takers are testing. Paper and pencil takers are constantly parading to restrooms and to constantly parading to restrooms and to get drinks.”get drinks.”

Get the Word OutGet the Word Out

Inform Your STCsInform Your STCs– Benefits vs. HindrancesBenefits vs. Hindrances– RequirementsRequirements

TrainingTraining Computer availabilityComputer availability SchedulingScheduling Roles of testing personnelRoles of testing personnel Who to test and howWho to test and how AccommodationsAccommodations

Get the Word OutGet the Word Out

Keep IT Personnel Up to DateKeep IT Personnel Up to Date– Equipment requirementsEquipment requirements– TestNavTestNav– TrainingTraining– TroubleshootingTroubleshooting– Roles of IT personnel during testingRoles of IT personnel during testing

Develop a close working Develop a close working relationship with IT departmentrelationship with IT department

Online Pilot TestingOnline Pilot Testing

Ask for Volunteer SchoolsAsk for Volunteer Schools Choose Schools with:Choose Schools with:

– Principal’s endorsementPrincipal’s endorsement– Enthusiastic STCEnthusiastic STC– Willing and supportive IT personnelWilling and supportive IT personnel

Provide Comprehensive Training Provide Comprehensive Training – STCs and ITSTCs and IT

Participation PlanParticipation Plan

Online Pilot TestingOnline Pilot Testing

Require a Participation Require a Participation PlanPlan– Will enable you to see Will enable you to see

trouble spots beforehandtrouble spots beforehand– Will inform you of unusual Will inform you of unusual

circumstances that may circumstances that may require more time or require more time or hardwarehardware

– Good indication to IT as to Good indication to IT as to time / personnel required time / personnel required for setting up computersfor setting up computers

ObstaclesObstacles

Bandwidth?

APS dedicated a separate server for Elementary School Testing

ObstaclesObstacles

No fulltime STCsNo fulltime STCs Shared ITCsShared ITCs

Schedule from each school was Schedule from each school was necessary.necessary.

We did not allow any school to test if We did not allow any school to test if there was no ITC in the building.there was no ITC in the building.

ObstaclesObstacles

Lack Lack

of of

spacespace

Support… Support…

Support…Support…

Support!Support!

Support Through Team WorkSupport Through Team Work

Kenny – designated as TestNav Kenny – designated as TestNav authorityauthority

Betty – administration authorityBetty – administration authority Michelle – policyMichelle – policy

Team kept each other informed andTeam kept each other informed and

communicated with everyone – communicated with everyone – principals, ITCs, STCsprincipals, ITCs, STCs

Support Through TrainingSupport Through Training

Ensured each group understoodEnsured each group understood– Proctor cachingProctor caching– Test ticketsTest tickets– Printing answers in case of EWSPrinting answers in case of EWS– Turning on computers in prep for Turning on computers in prep for

testingtesting Defined roles for each groupDefined roles for each group Set up chain of events in case of a Set up chain of events in case of a

problemproblem

Emergency PlanEmergency Plan

Where to StartWhere to Start

Form a Team Form a Team – All PitchersAll Pitchers– Enthusiasm is the Game PlanEnthusiasm is the Game Plan– Prepare for the Foul Balls and Strike Prepare for the Foul Balls and Strike

OutsOuts– Start with Bunts Start with Bunts – Home Runs will Follow!Home Runs will Follow!

Make Their Lives EasierMake Their Lives Easier

Use Electronic FormsUse Electronic Forms Provide Online Training & “Help” Provide Online Training & “Help”

sessionssessions Accommodations Excel FileAccommodations Excel File ePATS – involve teachers & parentsePATS – involve teachers & parents Elicit feedback along the wayElicit feedback along the way

Credits for Our SuccessCredits for Our Success

We built on previous success at We built on previous success at secondary levelsecondary level

Extolled the benefitsExtolled the benefits Promised support and followed Promised support and followed

throughthrough Solicited feedback & shared itSolicited feedback & shared it Reported progress through statisticsReported progress through statistics Word of mouth among STCsWord of mouth among STCs

And the Best Part Was…And the Best Part Was…

Built cooperation between IT Built cooperation between IT department, ITCs, STCs, Principals department, ITCs, STCs, Principals and the Testing Office by:and the Testing Office by:– Highly organized approachHighly organized approach– Being always availableBeing always available– Working through worst case scenariosWorking through worst case scenarios– Using feedback to improve processes Using feedback to improve processes

each yeareach year Greatly improved our relationship Greatly improved our relationship

with schools with regards to with schools with regards to testingtesting

Students Say…Students Say…

4th grade student @ Barrett

If we did it, you can too!