AASHTOWare Beta TestingAASHTOWare Beta Testing

An Agency’s Perspective and An Agency’s Perspective and ResponsibilitiesResponsibilities

Shirley DaughertyShirley Daugherty

Nebraska Department of RoadsNebraska Department of Roads

Why participate in a beta Why participate in a beta test?test?

• AASHTOWare software are your AASHTOWare software are your products products

• You have a vested interest in helping You have a vested interest in helping with beta tests to ensure a quality with beta tests to ensure a quality product product

• Adds the agency’s perspective to the Adds the agency’s perspective to the processprocess

• Opportunity for inputOpportunity for input

What needs to be What needs to be considered?considered?

• Staff available to participateStaff available to participate

• Software versions requiredSoftware versions required

• Test environment availableTest environment available

• Time frame for doing beta testTime frame for doing beta test

• Familiarity with product or subject Familiarity with product or subject mattermatter

Staff available to participateStaff available to participate

• Someone to manage the beta test Someone to manage the beta test process for the agency and process for the agency and coordinate with contractorcoordinate with contractor

• IT and DBA support staff to install IT and DBA support staff to install software and set up test databasesoftware and set up test database

• Software users to do the hands-on Software users to do the hands-on testingtesting

Software versions requiredSoftware versions required

• What versions and service pack What versions and service pack levels of the software are required levels of the software are required for the beta testing ?for the beta testing ?– DatabaseDatabase– Operating systemOperating system– ServersServers– Supporting software, ie. PowerBuilder, Supporting software, ie. PowerBuilder,

SAS, Apache, Internet Explorer, etc.SAS, Apache, Internet Explorer, etc.

Test environmentTest environment

• Establish a separate test Establish a separate test environment environment

• Contractor access to test Contractor access to test environment is very desirableenvironment is very desirable

• Test data may or may not be Test data may or may not be providedprovided

• Agency data to use for testingAgency data to use for testing

TestingTesting

• Perform testing without agency Perform testing without agency customizations appliedcustomizations applied

• After beta test is successfully After beta test is successfully completed, agency may apply any completed, agency may apply any customizations and rerun the tests, if customizations and rerun the tests, if desireddesired

• AASHTO is not responsible for agency AASHTO is not responsible for agency customizations and how they affect customizations and how they affect the productthe product

Testing (cont’d)Testing (cont’d)

• Use test scripts providedUse test scripts provided

• Run through test scripts using test Run through test scripts using test data, if provided data, if provided

• Run through test scripts using Run through test scripts using agency dataagency data

• Test the software the way the Test the software the way the agency uses itagency uses it

Testing (cont’d)Testing (cont’d)

• Use the reporting mechanism Use the reporting mechanism providedprovided

• Report all issues promptly with Report all issues promptly with details and a copy of test resultsdetails and a copy of test results

• Report the successful completion of Report the successful completion of each testeach test

Completion of Beta TestCompletion of Beta Test

• Verify all tests were performed and Verify all tests were performed and results reportedresults reported

• If all tests were not performed for If all tests were not performed for some reason, report that as wellsome reason, report that as well

• Provide a Beta Test Summary to Provide a Beta Test Summary to contractor and task forcecontractor and task force

Things to RememberThings to Remember

• Don’t assume anythingDon’t assume anything– That includes both the agency’s and That includes both the agency’s and

contractor’s staffcontractor’s staff

• No news is not always good newsNo news is not always good news– Nothing reported doesn’t mean it was Nothing reported doesn’t mean it was

tested and it was satisfactorytested and it was satisfactory– or if reported, that it was verified and or if reported, that it was verified and

fixedfixed

What Are We Asking From What Are We Asking From YouYou

• A commitment of time that benefits A commitment of time that benefits you and all licenseesyou and all licensees

• You have a vested interest in helping You have a vested interest in helping with beta tests to ensure a quality with beta tests to ensure a quality product product

• We’re asking you to participate in We’re asking you to participate in doing these tests doing these tests

Questions?Questions?