technical readiness training. introduction to computer-based testing (cbt) resources for cbt system...

Technical ReadinessTraining

Technical Readiness Training

• Introduction to Computer-based Testing (CBT)

• Resources for CBT

• System Requirements

• Chromebooks

• Components of Computer-based Testing

• Putting It All Together

• Best Practices

• Support

Agenda

South Carolina Technical Readiness Training2

General Information

Computer-based Testing (CBT) Overview

• SCDE will only allow ACT Aspire computer-based testing in 2015 as an accommodation for students that need “oral administrations” on the Writing, Math, and /or optional Science tests

• Manuals will not besent for CBT; can be printed from Avocet

• Essential CBT manuals:

– Room Supervisor Manual

– Test Coordinator Manual(covers both CBT and PBT)

– Technical Readiness Manual


Assess CBT Preparedness

Can you deliver CBT?– Identify scope

• How many students are testing?• What testing devices will be used?• Where will tests be delivered?• Do you have sufficient bandwidth?

– Review technology requirements• Verify that testing devices meet minimum requirements

– Use SystemCheck to assess basic readiness

If it is determined that CBT is not a viable solution– Place students into PBT test sessions by 3/23

• Students can still receive pre-coded answer documents– Place students into PBT test sessions after 3/23

• Schools will have to hand grid all answer documents


South Carolina Schedule

• Computer-based Test Session set-up window; deadline is 4/14/15

3/6 - 4/14/15

• ACT Aspire tests are administered4/28-4/30/15

• Make-up and optional Science testing occurs5/1-5/13/15


Testing Window


Spring 2015 Test ScheduleWriting, English April 28 (Tuesday)

Reading April 29 (Wednesday)

Mathematics April 30 (Thursday)

Make-up and optional Science through May 13

Computer-based Testing

Computer-based Testing (CBT)– Uses traditional testing devices

– Chromebooks

Components of CBT– ProctorCache

– SystemCheck

– TestNav 8

– The ACT Aspire Portal


CBT Resources

ACT Aspire Landing Page


• Easily locate news, resources, and training

• http://actaspire.pearson.com

http://actaspire.pearson.com/

Avocet

• Online indexing of ancillaries, manuals, and program resources

• Only the latest version will be posted

• Requires no log in and can be accessed on your smartphone or device

http://actaspire.avocet.pearson.com


http://actaspire.avocet.pearson.com/

Technology

Coordinator Checklist

Avocet• Located under C for checklist

ACT Aspire Landing Page• Located on the Technology

Set-up page


Training Management System

• Repository for training modules - enables convenient self paced training

• Transcript feature shows date/time training was taken• Requires email to log in and can be accessed on your

smartphone or device.

• http://actaspire.tms.pearson.com/


http://actaspire.tms.pearson.com/

Handy Technical Resources

• ACT Aspire Landing Page– Technology Set-up page

• System Requirements: TestNav & ProctorCache– A list of minimum system requirements

• Technology Coordinator Checklist– A list of technology activities

• Testnav 8 Error Codes– List of error codes and troubleshooting / resolution steps

• ProctorCache Quick Guide– Steps for configuring ProctorCache– Step by Step on last two pages

Each of these resources found on Avocet and Landing Page– http://ACTAspire.Avocet.Pearson.com– http://ACTAspire.Pearson.com

14 South Carolina Technical Readiness Training

http://actaspire.avocet.pearson.com/

http://actaspire.pearson.com/

System Requirements

System Requirements – General Requirements


System Requirements

• Available for Three Systems– ACT Aspire Portal

– TestNav 8

– ProctorCache

• Locations– ACT Aspire Landing Page

• Technology Set-up section

– Avocet

• see each individual component section

• Online Resources Always Up to Date


Computer-based Testing Components

Computer-based Testing Components

• ProctorCache– Works with TestNav 8 to reduce bandwidth requirements

• SystemCheck for TestNav 8– Web-based tool for assessing

readiness

• TestNav 8– Test delivery engine

– TestNav 8 Early Warning System

• The ACT Aspire Portal– Manage test sessions

19 South Carolina Technical Readiness Training

Environment Configuration


• Identify Testing Devices and Rooms– Which computers and labs will you use?– Do you need to gather any extra peripherals?

• Mice / keyboards / power strips– Set up temporary testing labs

• Whitelist URLs and Open Ports– Configure your firewalls, security devices, and content filters to

allow traffic flow to the URLs and ports listed on the system requirements

• Determine and Account For Unique Considerations– Does your infrastructure have any unique needs or considerations?

• Do you use upstream proxies?• Specific devices that should not be used for testing?• Bandwidth shaping or throttling?



• Wired or Wireless– Use best practices for either type of connectivity.– Know the capacity of your access points and take care not to

exceed the maximum connections

• Background Applications and Notifications– Pop-ups will pull students out of the test– Effort must be made to suppress, disable, or reschedule any

application or notification from launching in the background• Screensavers• Antivirus scan reports• Power, email, message, or update notifications• Reschedule applications that automatically run

• Install and Verify ProctorCache– New installers added to documentation and Landing Page


Chromebooks

Chromebooks

• Chromebooks Supported for All Assessments– Periodic and Summative

• TestNav 8 App– Chromebooks do not use a browser to access TestNav

• Managed / Unmanaged– Instructions can be different if your Chromebooks are managed or

unmanaged.• Managed Chromebooks – mass configuration• Unmanaged Chromebooks – individual configuration

• Minimal Setup– Place Chromebook in Kiosk mode– Install the TestNav 8 app and set as a Kiosk Application– Instructions recently added to Avocet (under Chromebooks)


Chromebooks – System Requirements

TestNav 8 App Currently Supports• Hardware

– Any processor, memory, screen size, and screen resolution

• Software– Chrome OS 35 and Higher– Install TestNav 8 App

• App is installed while configuring device

• No Java or Browser Dependencies

• Chromebooks and ProctorCaching– Students testing on Chromebooks can gather cached content– Chromebooks can not be used as ProctorCache machines


Chromebooks – Setup Overview

Two Setup Methods• Managed Chromebooks

– Can be performed simultaneously on all Chromebooks in your domain

– Two main steps to complete• Preserve local data on Chromebook to retain Student Response File

(SRF) and log files on the device• Install TestNav 8 app and set it to run as a Kiosk App

• Unmanaged Chromebooks– Steps have to be performed on each Chromebook– Requires access to the administrator account for device

• Device will be backed up to cloud storage and wiped if you do not have access to the administrator account for the device


Chromebooks – Managed Setup

Managed Chromebook Setup1. Configure device to retain local data

1. Log into your Google Apps for Education account, and log in to the Admin console for your domain.

2. From the Admin console, select Device Management > Chrome > Device settings.

3. In the User Data section, ensure that Do not erase all local user data is selected.

4. Select Save changes, if visible.

2. Enable Kiosk Mode and set up TestNav on the Chromebook1. In the Kiosk Settings section, verify that Allow Single App Kiosk is

selected in the Single App Kiosk drop-down.2. Select Manage Kiosk Applications > Chrome Web Store. Search for

and install the TestNav 8 app from the Web Store3. Select Add. Then select Save4. Leave Auto-Login to Kiosk App set to None, and select Save changes,

if visible.


Chromebooks – Unmanaged Setup

Unmanaged Chromebook Setup1. Log in to the Chromebook using the owner account.

– If you do not have the owner account information, back up any important data into cloud storage, and wipe the device.

– Create a new owner account and log in with that account information2. Start the Chrome browser3. Enter chrome://extensions in the browser address bar. Click Enter4. Select the Developer mode checkbox, and click Manage kiosk

applications. This can only be done from the owner account5. Enter the TestNav ID - mdmkkicfmmkgmpkmkdikhlbggogpicma in the

Add kiosk application box. Click Add, and click Done.6. Sign out of the Chromebook.


Chromebooks – Usage

• Starting the TestNav 8 App– After the Chromebook has been configured there will be a TestNav

icon in the Apps drawer on the login screen– Clicking on TestNav in the App drawer will open TestNav 8 in a full

screen mode secure mode– On the initial launch of the app, you will be asked to select ‘ACT

Aspire’ from a dropdown list.• This only has to be done the first time the app is launched

– Once at the login screen, students can log in with the credentials on their student authorization ticket.

• Closing the App– To exit the app, hold the power button down for a few seconds.– The Chromebook will power down and return to the login screen

when powered back on.


Chromebooks – Usage


ProctorCache

ProctorCache

Proctor Cache is Pearson-supplied software that is used in conjunction with TestNav to reduce bandwidth requirements and accelerate the delivery of test content.

Proctor caching:• allows you to pre-cache test

content to your local network before a test;


• reduces the burden on your internet service provider (ISP) by eliminating redundancy in requests for test content; and

• stores an encrypted local copy of all pre-cached tests.

ProctorCache

• Reduces Bandwidth – Accelerates Content Delivery

• Minimal Installation, Configuration

• Flexible Requirements– Does not require server class operating system– Runs on Mac OS X and Windows Operating Systems

• Verify Connectivity– Use SystemCheck to verify connectivity and throughput between

testing workstations and ProctorCache machine

• ProctorCache Diagnostics Page– View status of cached content and connecting clients– Refresh, reload, or purge content


ProctorCache


ProctorCache – System Requirements

• Runs on Windows and Mac OS X

• Utilizes TCP Ports 80, 443, 4480, and 4481

• Proctor caching requires a fixed internal IP address


ProctorCache - Setup

1. Download Installer– Installers can be found on ProctorCache documentation or the

ACT Aspire Landing Page

2. Run Installer and Start Service– Service is normally started by default.– Shortcuts exist to start or stop the service if necessary

3. Verify Service Is Running– Open ProctorCache Diagnostics screen

4. Verify Connectivity With SystemCheck– Add caching computer on the Testing Capacity tab– Run test to verify connectivity and throughout


ProctorCache – Diagnostics Screen

• Select the Contents tab for information about test content and caching status

• Select the Client List tab to monitor client connectivity


ProctorCache – Diagnostics Screen - Content

• Content is displayed at the Test and Form level.• Functionality is available to Refresh, Reload, or Purge selected

test content.• Clicking on a test name will display the Content Details screen

which displays individual items in a test.


ProctorCache – Diagnostics Screen - Clients

• Clients that have connected to TestNav are listed by IP address.

• Clicking on a computer will display the Client Details screen which displays information regarding a particular computer connecting to proctor caching


ProctorCache - The ACT Aspire Portal

• Manage proctor cache in the ACT Portal• TestNav will detect and use proctor cache settings entered into the

Portal• No need to configure individual student work stations for proctor

caching• Set default proctor cache settings for district and schools• Default settings can be applied to test sessions



• Default proctor cache settings will be set for each school• Once saved, settings can be applied to any test sessions at that

school.

• Default settings must be entered before tests can be pre-cached



• Enter fixed internal IP address for the proctor cache machine• Enter port 4480• Check Status allows you to quickly navigate to the Proctor

Caching Diagnostics page



• Pre-caching test content gathers all of the test content that students will need

• Test content is encrypted and stored locally



• Verify that content has been cached successfully from the Proctor Caching Diagnostics screen – Content will be listed on the Tests tab– Each subject that you selected should appear here– Verify that there is a green ‘OK’ indicator in the Status column for

each test form



• After they have been saved, default settings can be applied to test sessions at the organization selected.


SystemCheck for TestNav 8

SystemCheck

• Launch SystemCheck from http://SystemCheck.ACTAspire.org


http://systemcheck.actaspire.org/

SystemCheck – Check Your System

Check Your System:

• Validates system requirements are met on testing workstations

• Provides steps to verify whether TestNav can run on the workstation


SystemCheck – Verification


SystemCheck – Testing Capacity

Testing Capacity:• Bandwidth testing for internet and proctor caching connections• Volume estimates for capacity planning

• Click Add Caching Computer to add your potential proctor caching machine for a local network bandwidth test


SystemCheck – Testing Capacity

• Tests bandwidth between the workstation and Pearson servers

• Click Add Caching Computer to add your potential proctor caching machine for a local network bandwidth test


TestNav 8

TestNav 8 – System Requirements

• Mac OS X and Windows Supported– Mac OS X 10.6 through 10.10– Windows XP (sp3) through Windows 8.1

• All Major Browsers Supported– Chrome, Internet Explorer, Firefox, Safari– Version number is dependent on operating system

• Dependencies– Java (version dependent on OS and browser)– Pop-ups enabled for ACT Aspire sites– Requires read/write file access to local home directory– Disable Skype plugin in Windows 7 and Firefox– Minimum screen resolution of 1024 x 768


TestNav 8 – Setup

• No Installation– Completely browser based– No individual system configuration

• Network Configuration– Firewalls, content filters, spam filters, and any other routing or

blocking systems should be set to allow access to the following:• *.tn.actaspire.org: 80• *.tn.actaspire.org: 443• *.pearsontestcontent.com• S3.amazonaws.com


TestNav 8 - Usage

• Students Visit TestNav 8 URL– http://tn.actaspire.org

• Use Authorization Ticket to Log In– Printed from ACT Aspire Portal– Contains unique session specific login information


http://tn.actaspire.org/

TestNav 8Early Warning System (EWS)

TestNav 8 EWS – Early Warning System

• Early Warning System– Designed to alert users of issues that arise during testing– Part of TestNav 8

• No additional software to install or configure– Provides fail-safes to preserve student responses in the event of

unexpected network disruptions

• Early Warning Training Module– “TestNav 8.0 Overview” training module on the TMS contains info

around Early Warning System

• Early Warning System Resources– Avocet ‘Early Warning and System Error Codes”– ACT Aspire Landing Page – TestNav 8 Resources


TestNav 8 EWS – Student Response File

• Student Response File (SRF)– EWS Writes to Student Response File in the background– Captures student responses locally

• Periodically Transmitted– Responses bundled into packets and transmitted to Pearson

servers

• Verification– TestNav 8 will wait for handshake acknowledgement– If handshake is not received, multiple attempts are made– If transmission is successful process begins with new SRF


TestNav 8 EWS – Scenarios

Scenario 1: Response File Location UnreachableTestNav is unable to read or write to the SRF location

– Results in an immediate Test Proctor Click Here notification.

Scenario 2: Test ContentTestNav is unable to download portions of the test.

– Results in an immediate Test Proctor Click Here notification.

Scenario 3: Student Response UploadRepeated attempts to upload the SRF have failed.

– Results in a Test Proctor Click Here notification only if the student attempts to Exit or Submit the test.


TestNav 8 EWS – Notifications

• Prompt Displayed to the Screen• Students Should Alert Proctor

• Note : Technology Coordinators or local staff may be the first contact if these messages appear

• Interruptions Stop Timer– Timer will be resumed when the student logs back in.


Exemplars

Exemplars– Online samples of test

questions

– Booklet provides overview, concepts measured, and answer key

– Requires login

– Should not be accessed from tablets or smartphones


Putting It All Together

Pre-planning for CBT

Big Picture – Before the Test

• Work With System Coordinators– When are you testing?– What devices will you use?

• Develop Communication Plan– Who contacts who?– What communication needs to happen?

• Think About A Contingency Plan– What do I do in a blackout?– What is the process for a fire drill?

• Review Documentation– Technology Coordinator checklist– Compare system requirements with testing devices– Review technical component documentation


Set-up for CBT

Big Picture – Setting Up

• Set Up Your Test Environment– Configure firewalls, IPS, IDS, content filters, proxy servers

• Whitelist URLs and ports• Disable, suppress, or reschedule background applications and

taskbar notifications– Set a ProctorCache default in the ACT Aspire Portal

– Plan Out Testing Rooms• Do you have enough devices, power strips, keyboards and mice,

headphones (for students with aural supports)

– Wireless Testing• Use best practices when testing wirelessly


Assess Readiness

Big Picture – Are you Ready?

• Assess or Verify Readiness– Use SystemCheck to verify readiness and connectivity

• Verify ProctorCache default has been applied to all test sessions

• Verify connectivity to ProctorCache machine

• Pre-cache test content to the ProctorCache machine

• Account for any last minute gaps or risks– Has anything changes with your software or hardware since

environment was configured• Have there been any software or hardware updates?• Any configuration or image changes• Has anything new been installed that may impact testing?


Deliver the Assessment

Big Picture – Delivering the Assessment

• Verify ProctorCache is Working– Use ProctorCache Diagnostics screen to verify that students are

connecting and content is being served– Does not have to be monitored extensively

• Make Yourself Available– Where will you and your team be the most accessible and

supportive in the case anything is needed?

• Celebrate Victories– Did things go smoothly?

• Its not magic, it is everyone’s planning and hard work!


Post Assessment Steps

Big Picture – After the Assessment

• Purge Cached Test Content– Purge cached test content using the Purge function on the

ProctorCache diagnostics screen Tests tab

• (Optional Activities)– Uninstall ProctorCache– Remove TestNav 8 from Kiosk Mode on Chromebooks– Revert any firewall, security, and systems configuration– Review with your System and Test Coordinators

• What went well, what can be improved for next time?


Best Practices

Best Practices

• Planning– Make use of the Technology Coordinator Checklist– Create communication and contingency plans– Keep Test Coordinators informed

• Preparing Your Environment– Do you have additional security devices to account for?– Have you suppressed system tray notifications?– Desktop restoration – thaw / exclude Pearson folder– Have some extra mice / keyboards available


Best Practices

• ProctorCache– Consider setting up a few ProctorCache machines and test

connectivity for each– Use a wired connection– Do not proctor cache to a workstation that will be used for testing

• Wireless Testing– Prevent aggressive roaming of devices– Turn off automatic channel switching– Are your WAP’s secure – prevent non-testing devices from

connecting– Consider range and location– Be aware of WAP capacity

• Overloading / ‘popcorn effect’ / degraded performance


Best Practices

• Bandwidth– Contact your ISP to let them know when you are testing– Do you need to set ‘testing’ rules on your network?

• Bandwidth throttling• Reschedule bandwidth heavy activities• Block bandwidth intense sites

• Partner With an Experienced Neighbor– Share best practices and tips


Support

Customer Support

79

Phone Support

• 888-802-7502

• Monday – Friday

• 7:00 am – 8:30 pm (ET)

Email Support

• [email protected]

South Carolina Technical Readiness Training

CanStock Photo and Bigstock Photo

technical readiness training. introduction to computer-based testing (cbt) resources for cbt system...

Documents

basic readiness

cbt preparedness

handy technical resources

optional science testing

general information

avocet essential cbt

training http

checklist act