brian phillips, president systest

7
3/17/200 4 We Test . . . You Succeed Trust the Experts Voting Systems Testing Summit 2005 Sacramento, CA November 28-29, 2005 Presented by: Brian Phillips Demystifying the Independent Test Authority (ITA)

Upload: softwarecentral

Post on 06-Dec-2014

324 views

Category:

Documents


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Brian Phillips, President Systest

3/17/2004

We Test . . . You Succeed

Trust the Experts

Voting Systems Testing Summit 2005Sacramento, CA

November 28-29, 2005

Presented by: Brian Phillips

Demystifying the Independent Test Authority (ITA)

                     

Page 2: Brian Phillips, President Systest

04/10/23SysTest Labs’ Proprietary and Confidential

Who is SysTest Labs? Established in 1996Sole Business Focus is to Provide Test Engineering, Quality Assurance and Certification Services

Voting Systems ITA Qualification TestingIndependent Verification and Validation (IV&V)Software Test Engineering Consulting and Services

Accredited Software Independent Test Authority in 2001Accredited Hardware Independent Test Authority in 2004Small and Woman-Owned Business (70+ staff)

Page 3: Brian Phillips, President Systest

04/10/23SysTest Labs’ Proprietary and Confidential

What is an Independent Test Authority?

ITA Charter from NASEDQualification Testing of DRE Election Systems to Voting System Standards3 main components

Election ManagementPolling PlaceCentral Count

Not Exhaustive Testing

Page 4: Brian Phillips, President Systest

04/10/23SysTest Labs’ Proprietary and Confidential

Software ITA Test Standards & Resources

SysTest Labs uses the following to perform ITA Qualification Testing:

Federal Election Commission Voting System Standards published April 2002, Released 2003

SysTest Labs Quality Manual & Standard Procedures (Advanced Test Operations Management™)Various review/report forms, databases, templates, and tools

Page 5: Brian Phillips, President Systest

04/10/23SysTest Labs’ Proprietary and Confidential

Software ITA Process Pre-Qualification Technical Data Package (TDP) review and reportPhysical Configuration Audit - documentation, source code, test result reviewFunctional Configuration Audit – hardware and software testing to verify logic, results and accuracyFinal Qualification Report

Page 6: Brian Phillips, President Systest

04/10/23SysTest Labs’ Proprietary and Confidential

Process after ITA

State Certification County Acceptance Testing

Page 7: Brian Phillips, President Systest

04/10/23SysTest Labs’ Proprietary and Confidential

We Test . . . You SucceedTrust the Experts