increase your effectiveness with the right test techniques · 2016. 2. 4. · techniques processes...

58
Increase yur effectiveness with the right Test Techniques Derk-Jan de Grd TrondheimTestConference2015 1

Upload: others

Post on 20-Aug-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Increase your effectiveness with the right Test Techniques

Derk-Jan de GroodTrondheim Test Conference 2015

1

Page 2: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

My 1st Pocket knife

2

Page 3: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

3

Page 4: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

4

Page 5: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

5

Definition tool

A tool is any aid

that helps you to

do a better job

faster.

A tool is any aid

that helps you to

do a better job

faster.

Page 6: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Checklist

These include:

Templates

Checklists

Heuristics

Physical tool

Application

Techniques

Processes

Frameworks

Models Work forms

etc

Checklist

These include:

Templates

Checklists

Heuristics

Physical tool

Application

Techniques

Processes

Frameworks

Models Work forms

etc

6

Tools: like word processor, excel, outlookModels: e.g. six hats from bono, but also an excel model to verify your outcome.Facilitation methods: like brown paper session, risk sessions, etc..Techniques: like design techniques, communication techniques, Frameworks: e.g. COBIT, SCRUM, etc

Tools: like word processor, excel, outlookModels: e.g. six hats from bono, but also an excel model to verify your outcome.Facilitation methods: like brown paper session, risk sessions, etc..Techniques: like design techniques, communication techniques, Frameworks: e.g. COBIT, SCRUM, etc

Page 7: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

7

Page 8: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

8

The wrong tool…

Page 9: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

9

Page 10: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Searching for tools

10

Page 11: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

11

What do we do when testing?

Page 12: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

12

Analyse

Page 13: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

13

Page 14: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Test Design Techniques

BVA

Syntax

EP

State

ECT

C/E

Decision table

Pair testing

PCT

Algorithm test

14

Page 15: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

15

Challenge

Page 16: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

16

James Wittacker

Page 17: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

17

Page 18: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Some examples

Reduce the bandwidth of the network connection

Make the network fail

Limit the disk space available for the application

Interruptions

SQL statement injection

Searching for overflows (256, 1024, 32767, etc…)

Change the order of activities

18

Page 19: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

19

Chessboard technique

Page 20: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Think, Challenge and Observe

20

Obs

erve

Page 21: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Test Recognition Techniques

21

Inconsistencies: internal

Inconsistencies: external

Absences

Extras

Agony

Delays

Page 22: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Searching for tools

Test Design

Error Creation

Error Detecting

Page 23: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Two Trends

23

Page 24: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

24

Page 25: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Agile testing Characteristics

25

• Cooperation and teamwork• Variety in cooperation and workshops• Roles merging and testers get involved

into design and development• Automated or Exploratory testing• Keep track on progress and quality

Page 26: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP

(Plann

ing & C

ontrol)

Test Improvement

Fac

ilita

tion

M

etho

ds

Searching for tools

Page 27: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

27

The IIBA- BABOK guide…

Page 28: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Jan Jaap Cannegieter (QATest 30-10-2013)

Page 29: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Scoping techniques

29

Page 30: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

PRIMA

30

Page 31: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

KANO

31

1. Persona’s

2. Qualifers

3. Disqualifers1. Persona’s

2. Qualifers

3. Disqualifers

Page 32: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Story Decomposition

32

MINIMAL

MARKETABLE

FEATURE

MINIMAL

MARKETABLE

FEATURE

Page 33: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Story Mapping

33

Page 34: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Getting a grip on the project

34

Page 35: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Kanban

35

Page 36: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

36

Release Charts

Page 37: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Subway mapping

37

4 5

6

1 3

7 8 911 12 QGQG

2

15Ju

ly

1Au

g.

15Au

g.

1Se

pt.

15Se

pt.

10

Tobedone(on me)

Inprogress(on me)

Inprogress(cri cal)

Done

Order processing

Front EndWebshop

Payment

Delivery

Inprogress(delayed)

24July2013

6a

Project XSubwaymap

Date: <Date>By: <Name>

Page 38: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Business Benefit (MFF)

38

Page 39: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Lets do it a little different, this time

Facilitation Methods

39

Page 40: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Facilitation methods

Standup meetings

Mind map

Brown paper session

Sorting and Prioritizing

Process simulation

Serious Gaming

Role playing

Demo

Interview techniqueS

40

Page 41: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Influence diagram

41

Thanks to Graham Thomas

Page 42: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Improvement techniques

42

Page 43: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Value Stream Map

43

Page 44: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Service Virtualisation

44

Assume a Process within a system that requires interaction with other systems.

44

Step 1Step 1 Step 2Step 2 Step 3Step 3 Step 4Step 4

Ext Syste

m

Ext Syste

m

Ext Syste

m

Ext Syste

m

Ext Syste

m

Ext Syste

m

Considerations that define the waste on the interface:• How often used • Error proneness of

the interface• Delay in processing• Manual effort on the

interface• Cost for processing• Ability to test rainy

scenarios’• Easy of investigating

errors• Support issues• High risk due to not

testing at all or error situations

Considerations that define the waste on the interface:• How often used • Error proneness of

the interface• Delay in processing• Manual effort on the

interface• Cost for processing• Ability to test rainy

scenarios’• Easy of investigating

errors• Support issues• High risk due to not

testing at all or error situations

11 = delay

(waste) per day

based on normal

usage (or testing)

11 33

55

Page 45: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Business Capacity model

45

Page 46: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Persona’s46

Page 47: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Persona’s47

Speed

Cheap

Quality

Involvement

NoFuss

Simple

AlbertSuzan

Eric

Speed

Cheap

Quality

Involvement

NoFuss

Simple

AlbertSuzan

Eric

Page 48: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

48

Page 49: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP

(Plann

ing & C

ontrol)

Test Improvement

Fac

ilita

tion

M

etho

ds

Page 50: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Draw-back

When showing one techniques, people are are likely to state that they missed another technique.

50

Page 51: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP(P

lanning & C

ontro l)

Test Improvement

Fac

ilita

tion

Met

hods

Root Cause Analysis

techniques

Root Cause Analysis

techniques

Thanks to Jan van Moll

Page 52: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP(P

lanning & C

ontro l)

Test Improvement

Fac

ilita

tion

Met

hods

Root Cause Analysis

techniques*

Root Cause Analysis

techniques*

Cause Effect graphing

ECFA (Events and Causal Factors

Analysis)

Current Reality Tree

Change Analysis

Why-Because Analysis

Re-enactment

Fault Tree Analysis

MORT

Common Cause Analysis

Barrier Analysis

MES (Multi-Linear Event

Sequencing)

STEP (Sequential Timed Event

Plotting)

CIT (Critical Incident Technique)

Is-Is Not Matrix

5-times Why

HFA (Human Factors

Assessment)

Storytelling

Reality charting

Cause Effect graphing

ECFA (Events and Causal Factors

Analysis)

Current Reality Tree

Change Analysis

Why-Because Analysis

Re-enactment

Fault Tree Analysis

MORT

Common Cause Analysis

Barrier Analysis

MES (Multi-Linear Event

Sequencing)

STEP (Sequential Timed Event

Plotting)

CIT (Critical Incident Technique)

Is-Is Not Matrix

5-times Why

HFA (Human Factors

Assessment)

Storytelling

Reality charting

Page 53: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

53

Page 54: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Fault Tree

54

Page 55: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Wrap-up

55

Page 56: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

Quick replay

56

Two Trends

22

Two Trends

22

23

23

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP

(Plan

ning & C

ontrol)

Test Improvement

Fac

ilita

tion

Met

hods

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP

(Planning &

Control)

Test Improvement

Fac

ilita

tion

Met

hods

Searching for tools

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP

(Planning &

Control)

Test Improvement

Fac

ilita

tion

Met

hods

Test Design

Error Creation

Error Detecting

Focus (Scope & Prio)

GR

IP

(Plan

ning & C

ontrol)

Test Improvement

Fac

ilita

tion

Met

hod

s

Searching for tools

27

The IIBA- BABOK guide… 27

The IIBA- BABOK guide…

Story Mapping

31

Story Mapping

31

Value Stream Map

2

Value Stream Map

2

Business Capacity model

3

Business Capacity model

3

Subway mapping

7

15#Ju

ly#

1#A

ug.#

15##A

ug.#

1#Se

pt.#

15##S

ept.

#

2 4 #J u ly #2 0 1 3Subway mapping

7

15#Ju

ly#

1#A

ug.#

15##A

ug.#

1#Se

pt.#

15##S

ept.

#

2 4 #J u ly #2 0 1 3

Page 57: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

57

Page 58: Increase your effectiveness with the right Test Techniques · 2016. 2. 4. · Techniques Processes Frameworks Models Work forms etc 6 Tools: like wor excel, outlo d processor, ok

SUCCESS !

Derk-Jan

ValoriColtbaan 4a3439 NG NIEUWEGEINThe Netherlands

[email protected]+31(0)651807878@DerkJanDeGroodhttp://djdegrood.wordpress.com

60

Slides: http://www.slideshare.net/DerkJandeGrood/unpack-your-toolkit-becoming-more-effective-with-the-right-tools-and-techniques