testing web to wireless …and back march 2001 presenter: shirley delewis, cqa, cste, cpsa

Testing Web to Wireless…and Back

March 2001

Presenter:

Shirley DeLewis, CQA, CSTE, CPSA

© DMR Consulting

2Confidential Information

What Were we Testing? What’s the Product? Architecture Overall Test Strategy Team Responsibilities Test Environment Test Strategy Test Plans Summary Questions Contact Information

AgendaAgenda

© DMR Consulting


A multi-tiered architecture with multiple components Wireless Hand-held PC running Windows CE Web-Based (Dispatcher) Work Order

Management Application Work Flow Engine High Performance Middleware (because of

Wireless Packet Transfers) RiMMS (dynamic route optimization &

scheduling) Databases (SQL Server, LDAP, Oracle) NT Servers

What were we testing?What were we testing?

© DMR Consulting


What’s the Product:What’s the Product: ARROW ARROW

ARROWARROW schedules work orders for field technicians based upon customer need, company needs, location, and technician availability

Work orders are dispatched dynamically, wirelessly, to the technician in the field

Field technicians complete their work orders, keep

track of their time, record all important information, and wirelessly transfer completed work order back up to the central office

© DMR Consulting


ArchitectureArchitecture

Intranet

Dispatcher NT Server - Business & Data Services

Pen Centra 200

Radio tower

WirelessData

Network

Work Order System Architecture

Garage

FieldTechnicians

Fujitsu HandheldPC

with Windows CEversion 2.11

© DMR Consulting


Overall Test StrategyOverall Test Strategy

Unit Testing/Peer Reviews by Development PenCentra Hand-Held Field Testing plus Data

Center Operations and Procedures tested by Operations Group

BUT WHAT DID THE TEST TEAM DO? Full System Integration and Functional Testing

by Test Team in Test Environment Internal DMR Field Tests in San Diego &

Dallas/Fort Worth Customer Acceptance Testing

(End-to-End with Connectivity to Client Test Lab)

Extensive Parallel Field Tests

© DMR Consulting


Test Team ResponsibilitiesTest Team Responsibilities

Develop Overall Testing Strategy Define Test Groups, Units and Test Cases Implement Problem Tracking Tool/Procedures Create Test Plans and Schedules Establish/Build Test Environment Develop Daily Build Environment/Processes Coordinate Testing with Development Team Discover, Report and Monitor Defects & Issues Verify Requirements were Fully Tested

…TEST! And RETEST!

© DMR Consulting


Test EnvironmentTest Environment

Front EndHOOD

DEVELOPMENT

Front EndBAKER

Exchange Server

BACHELOR

DispatcherWinCE WirelessHandheld Device

RIMMSST

HELEN

Tower

FismoRAINIER

Data Servers Front-end Servers

Router to ATT

SQL 7SHASTA

ATTTest

T1

Tape StorageRAID 5Disk array

Laser printer

Internet

Front EndCRATER

LAKE

TEST Intranet

Front EndWIZARD

RIMMSGARIBALDI

Data Servers Front-end Servers

SQL 7MAZAMA

RAID 5Disk array

Laser printer

IIS Server & FirewallFUJI

© DMR Consulting


Six Parts to be TestedSix Parts to be Tested

1.

2.

5.

Scheduling

AutomaticallyCreates appointments - linked to dispatch,route optimization

Dispatch

Automatically sends the technician into thefield, handles all normaloperations, humans used for exceptions only - linked to scheduling tooland route optimizer

Hand-Held Device

Receives Wireless data andInstructions from Hosted application, workers performtasks and send completed work orders--automaticallyupdated, stored & forward -linked to all software and to support system

Enterprise Connections

Route Optimization

Linked to dispatch tool, and scheduling tool, sends the right tech. To theright place, at the righttime, doing the right things , reshuffles schedule

Hosted Facility

Hosts the scheduling, dispatching, routing, and database. Houses all servers,TI connections to Carrier - links scheduling, routing,dispatching, hand-helds, and reporting software

4.Reporting Screen

Powerful web-based reporting screen for management of entiresystem. Takes informationfrom hosting site and allowsmanagement to makecritical decisions viewing:inventory, A/R, HRwork process, dispatch,exception routing, issuemanagement, etc.

6.

3.

© DMR Consulting


How we Managed Testing the PartsHow we Managed Testing the Parts

Established High Level System Integration & Verification Test Groups and Units

Developed Testing Strategy for Each Functional Segment:

Hand-Held Wireless PenCentra Hardware Tests Dispatcher (Web) User Interface Field Technician (Hand-Held Wireless) In-House Testing Middleware (wireless communication piece) included:

– Work Flow Engine and XML Gateway Stress Testing (200 Hand-Held utilized) Routing Optimization (RiMMS) Testing included

– Associated mapping and address database Operations-Infrastructure Tests Management Reporting (about 30 reports)

© DMR Consulting


Test PlansTest Plans

© DMR Consulting


Integration of Test GroupsIntegration of Test Groups

Tracking Work Orders from the Web Interface to the Wireless Hand-held Unit in our Test Environment

Extensive Parallel Field Tests Team members sent to San Diego and

Dallas/Fort Worth to work with client dispatchers & field technicians

End-to-End Client Acceptance Test From Client databases through our systems and

back to verify accurate data transmissions utilizing client test lab

– Performed as part of system Pilot phase– Also tested our databases—SQL7 to Oracle

© DMR Consulting


Master Test Plan Table of ContentsMaster Test Plan Table of Contents

1.INTRODUCTION 1.1Purpose 1.2Document Structure 1.3Project Overview 1.4System Overview 1.5Testing Scope

2.ORGANIZATION & RESPONSIBILITIES 2.1DMR Organization 2.2Test Staffing and Assignments 2.3Additional Personnel & Assignments 2.4Test Team Responsibilities

3.TESTING APPROACH 3.1Environment and Tools

– 3.1.1Test Environment

– 3.1.2Identification of Requirements

– 3.1.3Test Data

– 3.1.4 Daily Builds

– 3.1.5 Testing Tools

– 3.1.6 Version Control

1

3.1.7 Problem Reporting & Change

Control

4.DEFINITION OF TEST COMPONENTS

5.TESTING STRATEGIES 5.1Unit Testing 5.2PenCentra Field Testing 5.3Full System Integration and

Functional Testing 5.3.1Dispatcher Testing 5.3.2 PenCentra In-House

Testing 5.3.3 Middleware & Stress

testing 5.3.4 RiMMS testing

5.4 Operations Infrastructure Test5.5 End-to-End Acceptance Testing5.6 Parallel Field Test5.7 Management Reporting

APPENDIX A - A Guide to PR-Tracker

APPENDIX B - Issues and Triage Process

APPENDIX C - P410G Integration &

Verification Test Groups

© DMR Consulting


User Interface Test PlansUser Interface Test Plans

Specific Web Interface (Dispatcher) Test Plan Written to ensure Web interface screens

mapped to functional specs

Updated as change requests came in from client and changes made to interface

Specific Hand-Held Units Test Plan One overall Test Plan to ensure full work order

lifecycle covered

Eight individual Test Plans—one for each type of work order

© DMR Consulting


Other Test PlansOther Test Plans

Middleware Test Plan Test Cases and Procedures to isolate specific

functionality requirements of this component Real World Stress from production model

handheld field computers Client side heartbeat for configurable

continuous load

RiMMS Test Plan Data verification through ARROW to RiMMS

relay utilizing SQL Server Stored Procedures Typical business scenarios Verification of RiMMS automation

© DMR Consulting


And yet More Test PlansAnd yet More Test Plans

End-to-End Testing Migration of data from client database through

work order pipeline to ARROW and back using both the ARROW test environment and the client test lab

Work Order creation, completion, cancellation, and rescheduling

Work Order Parallel Field Testing Designed to train/coach field personnel in use

of system while testing, using local SMEs Typical business scenarios run through hand-

held units and dispatcher web site while simultaneously using paper system work orders and running a comparison of data accuracy

© DMR Consulting


SummarySummary

Extensive variety of Web to Wireless and Infrastructure technical testing solutions

Took full team cooperation Managers System and Functional (Business) Architects Developers Operations Group Client Support And of course, the Test Group & extra folks as

available

30 member Team Work made it happen!!!

© DMR Consulting


QUESTIONS?QUESTIONS?

Wed Hosted ASP

Dispatcher

Solution:

• Software

• Hardware

• ARROW Application

• Mobile Devices

• Installation

• Help Desk

• Hosting

Field-Force AutomationManagement Services

ManagementInformation

Work OrderClosure

Work OrderDispatch, Routing,

Scheduling

Field Technician

© DMR Consulting


Contact InformationContact Information

Shirley DeLewis, CQA, CSTE, CPSA Director, Software Quality Assurance & Test DMR Consulting, Bellevue, Washington 425-451-3100 [email protected]

testing web to wireless …and back march 2001 presenter: shirley delewis, cqa, cste, cpsa

Documents