software product testing challenges

Software Product Testing Challenges

AgendaAgenda

• State of Testing - ISV vs End-user enterprises

• System Testing – Generalized business products

• Innovative Test Approaches – Dealing with M&A

• Tester Attitudes in Product Testing Teams

ISV vs End-user enterprisesISV vs End-user enterprisesThe maturity of testing services for the end-user market and the ISV market is dramatically different

Source: Gartner (August 2007)

Production Testing in EnterpriseProduction Testing in Enterprise

Source: Gartner (August 2007)

Generalized Business ProcessGeneralized Business Process

Finished Goods

Components/Subassemblies

Raw Materials

Suppliers

Lead

T

ime

Short

Long

Decoupling PointsMake-to-Stock (MTS)

Assemble to Order (ATO)

Make to Order (MTO)

Engineer to Order

System Test Approach System Test Approach

V V V

V V V

V V V

V V V

V V V

V V V

V V

V V

Business

Processes

B u s i n e s s t y p e s

Business Flow Matrix

Packages / modules

Business Business MatrixMatrix

Overview ofbus. processesandbusiness types,by indicatingcombinations thatcan/need to/will be tested during ST(Business Scenario driven)

Goal

Level of FunctionalityLevel of

Inte

gra

tion

Idea

l

Tra

dit

ion

al

Best Practice

System Integration Strategy System Integration Strategy

Common Technology Platform

The Tower-Bridge MetaphorThe Tower-Bridge Metaphor

Common Technology Platform

The Tower-Bridge MetaphorThe Tower-Bridge Metaphor

Planner 2.0

ERP

Stnd. Comp.

Int. Comp.

Integration

Scope Assembly TestPlanner - ERP

Cross-Product Integration TestingCross-Product Integration Testing

Tester AttitudesTester Attitudes

Design Test Project

Design Tests

Execute Tests

Make Product

Design Product

Design Dev. Project

Dev Fo

cus

Test Fo

cus

From DownstreamSubcontractor

to Upstream Co-maker

From DownstreamSubcontractor

to Upstream Co-maker

Tester AttitudesTester Attitudes

From Development Driven to Customer

Focussed

From Development Driven to Customer

Focussed

Tester AttitudesTester AttitudesTester AttitudesTester Attitudes

Dev and Test RelationsDev and Test Relations