Upload File

axioms paul gerrard the testing of

110
Paul Gerrard THE TESTING OF

Upload: miles-bailey

Post on 16-Jan-2016

229 views

Category:

Documents


0 download

Report

Tags:

TRANSCRIPT

Page 1: AXIOMS Paul Gerrard THE TESTING OF

Paul Gerrard

THE

TESTINGOF

Page 2: AXIOMS Paul Gerrard THE TESTING OF
Page 3: AXIOMS Paul Gerrard THE TESTING OF
Page 4: AXIOMS Paul Gerrard THE TESTING OF
Page 5: AXIOMS Paul Gerrard THE TESTING OF
Page 6: AXIOMS Paul Gerrard THE TESTING OF
Page 7: AXIOMS Paul Gerrard THE TESTING OF
Page 8: AXIOMS Paul Gerrard THE TESTING OF
Page 9: AXIOMS Paul Gerrard THE TESTING OF
Page 10: AXIOMS Paul Gerrard THE TESTING OF
Page 11: AXIOMS Paul Gerrard THE TESTING OF
Page 12: AXIOMS Paul Gerrard THE TESTING OF
Page 13: AXIOMS Paul Gerrard THE TESTING OF
Page 14: AXIOMS Paul Gerrard THE TESTING OF
Page 15: AXIOMS Paul Gerrard THE TESTING OF
Page 16: AXIOMS Paul Gerrard THE TESTING OF
Page 17: AXIOMS Paul Gerrard THE TESTING OF
Page 18: AXIOMS Paul Gerrard THE TESTING OF
Page 19: AXIOMS Paul Gerrard THE TESTING OF

There is no agreed set of laws.

Is our profession based on weak foundations?

I REPEAT….

Page 20: AXIOMS Paul Gerrard THE TESTING OF

American Heritage Dictionary:

Test: (noun)• A procedure for critical evaluation;• A means of determining the presence,

quality, or truth of something;• A trial.

Page 21: AXIOMS Paul Gerrard THE TESTING OF
Page 22: AXIOMS Paul Gerrard THE TESTING OF
Page 23: AXIOMS Paul Gerrard THE TESTING OF

Many books on software testing…

And there appear to be 713 of them …

Page 24: AXIOMS Paul Gerrard THE TESTING OF
Page 25: AXIOMS Paul Gerrard THE TESTING OF
Page 26: AXIOMS Paul Gerrard THE TESTING OF
Page 27: AXIOMS Paul Gerrard THE TESTING OF
Page 28: AXIOMS Paul Gerrard THE TESTING OF
Page 29: AXIOMS Paul Gerrard THE TESTING OF
Page 30: AXIOMS Paul Gerrard THE TESTING OF
Page 31: AXIOMS Paul Gerrard THE TESTING OF
Page 32: AXIOMS Paul Gerrard THE TESTING OF
Page 33: AXIOMS Paul Gerrard THE TESTING OF
Page 34: AXIOMS Paul Gerrard THE TESTING OF
Page 35: AXIOMS Paul Gerrard THE TESTING OF
Page 36: AXIOMS Paul Gerrard THE TESTING OF

Testing as a lifecycle activity

Model-based testing

Test-obsessed

Testing as exploration

Business goal-based testing

Agile testing

Test-first, test-driven

Risk-based testing

Testing as learning

Page 37: AXIOMS Paul Gerrard THE TESTING OF
Page 38: AXIOMS Paul Gerrard THE TESTING OF
Page 39: AXIOMS Paul Gerrard THE TESTING OF
Page 40: AXIOMS Paul Gerrard THE TESTING OF
Page 41: AXIOMS Paul Gerrard THE TESTING OF
Page 42: AXIOMS Paul Gerrard THE TESTING OF
Page 43: AXIOMS Paul Gerrard THE TESTING OF
Page 44: AXIOMS Paul Gerrard THE TESTING OF
Page 45: AXIOMS Paul Gerrard THE TESTING OF
Page 46: AXIOMS Paul Gerrard THE TESTING OF
Page 47: AXIOMS Paul Gerrard THE TESTING OF
Page 48: AXIOMS Paul Gerrard THE TESTING OF
Page 49: AXIOMS Paul Gerrard THE TESTING OF
Page 50: AXIOMS Paul Gerrard THE TESTING OF
Page 51: AXIOMS Paul Gerrard THE TESTING OF
Page 52: AXIOMS Paul Gerrard THE TESTING OF
Page 53: AXIOMS Paul Gerrard THE TESTING OF
Page 54: AXIOMS Paul Gerrard THE TESTING OF
Page 55: AXIOMS Paul Gerrard THE TESTING OF

Practices are always

context-sensitive

Page 56: AXIOMS Paul Gerrard THE TESTING OF
Page 57: AXIOMS Paul Gerrard THE TESTING OF
Page 58: AXIOMS Paul Gerrard THE TESTING OF
Page 59: AXIOMS Paul Gerrard THE TESTING OF
Page 60: AXIOMS Paul Gerrard THE TESTING OF
Page 61: AXIOMS Paul Gerrard THE TESTING OF
Page 62: AXIOMS Paul Gerrard THE TESTING OF
Page 63: AXIOMS Paul Gerrard THE TESTING OF
Page 64: AXIOMS Paul Gerrard THE TESTING OF

“Murder is wrong” is axiomatic.

Page 65: AXIOMS Paul Gerrard THE TESTING OF

ALL the Axioms have been compared with the writings of the folk who

have objected.

Page 66: AXIOMS Paul Gerrard THE TESTING OF

Too many schools push dogma, demand obedience to school

rules and mark people for life. They put up barriers to entry and exit and require members to sing the same school song. No thanks.

Page 67: AXIOMS Paul Gerrard THE TESTING OF
Page 68: AXIOMS Paul Gerrard THE TESTING OF
Page 69: AXIOMS Paul Gerrard THE TESTING OF
Page 70: AXIOMS Paul Gerrard THE TESTING OF
Page 71: AXIOMS Paul Gerrard THE TESTING OF

The Axiom

Axioms are one-liners that succinctly state the

principle.

Page 72: AXIOMS Paul Gerrard THE TESTING OF

Testing has no meaning without

stakeholders

Page 73: AXIOMS Paul Gerrard THE TESTING OF

You need a source of knowledge to

select things to test

Page 74: AXIOMS Paul Gerrard THE TESTING OF

Test needs a source of

knowledge to evaluate actual

behaviour

Page 75: AXIOMS Paul Gerrard THE TESTING OF

Your sources of knowledge are

fallible and incomplete

Page 76: AXIOMS Paul Gerrard THE TESTING OF

If you don’t manage scope, you may never

meet stakeholder expectations

Page 77: AXIOMS Paul Gerrard THE TESTING OF

Test design is based on models

Page 78: AXIOMS Paul Gerrard THE TESTING OF

Testing requires a coverage model or models

Page 79: AXIOMS Paul Gerrard THE TESTING OF

The usefulness of the intelligence

produced by test determines the value of testing

Page 80: AXIOMS Paul Gerrard THE TESTING OF

Test execution requires a

known, controlled

environment

Page 81: AXIOMS Paul Gerrard THE TESTING OF

Testing never goes as planned

Page 82: AXIOMS Paul Gerrard THE TESTING OF

The most important tests are those that uncover the

best intelligence, fast

Page 83: AXIOMS Paul Gerrard THE TESTING OF

Run your most important tests first – you may not have time to run them

later

Page 84: AXIOMS Paul Gerrard THE TESTING OF

Repeated tests are inevitable

Page 85: AXIOMS Paul Gerrard THE TESTING OF

Acceptance is always a

compromise

Page 86: AXIOMS Paul Gerrard THE TESTING OF

Testing never finishes; it

stops

Page 87: AXIOMS Paul Gerrard THE TESTING OF

The value of intelligence is

independent of who produces it

Page 88: AXIOMS Paul Gerrard THE TESTING OF

Suggestions?

Page 89: AXIOMS Paul Gerrard THE TESTING OF
Page 90: AXIOMS Paul Gerrard THE TESTING OF
Page 91: AXIOMS Paul Gerrard THE TESTING OF
Page 92: AXIOMS Paul Gerrard THE TESTING OF

TestStrategy

Risks

Goals

ConstraintsHuman resourc

e

EnvironmentTimescales

Process(lack of?)

Contract

Culture

Opportunities

User involvement

Automation

De-Duplicatio

n

Early Testing

Skills

Communication

Axioms

Artefacts

Page 93: AXIOMS Paul Gerrard THE TESTING OF

Design

Coverage

ValueScope

Prioritisation

Fallibility

Event

Oracle

Never-Finished

Good-EnoughEnvironment

Basis

Repeat-Test

Delivery

Sequencing

Stakeholder

Page 94: AXIOMS Paul Gerrard THE TESTING OF

Sequencing

Stakeholder

What tests do the different stakeholders value most?

What information do the different stakeholders want first?

Page 95: AXIOMS Paul Gerrard THE TESTING OF
Page 96: AXIOMS Paul Gerrard THE TESTING OF
Page 97: AXIOMS Paul Gerrard THE TESTING OF

Much better than generic ‘maturity models’ that

MUST BE context-dependent

Page 98: AXIOMS Paul Gerrard THE TESTING OF

Who are they?What intelligence do they want?

What do they need it for?When do they want it?

In what format?How often?

Etc.

Page 99: AXIOMS Paul Gerrard THE TESTING OF
Page 100: AXIOMS Paul Gerrard THE TESTING OF

RiskManagement

Coverage

Stakeholder

Event

NeverFinished

• Managing Uncertainty• Facilitation, influencing and reporting• Expectation management• Crisis management

Page 101: AXIOMS Paul Gerrard THE TESTING OF
Page 102: AXIOMS Paul Gerrard THE TESTING OF
Page 103: AXIOMS Paul Gerrard THE TESTING OF
Page 104: AXIOMS Paul Gerrard THE TESTING OF
Page 105: AXIOMS Paul Gerrard THE TESTING OF

The words software, system, technology,

methodology, v-model, entry/exit criteria, risk – do

not appear

Page 106: AXIOMS Paul Gerrard THE TESTING OF

Testers test software, systems, interfaces,

documents, processes, buildings, people etc…

(Should they apply to testing anything? Discuss!)

Page 107: AXIOMS Paul Gerrard THE TESTING OF

• A procedure for critical evaluation

• A means of determining the presence, quality, or truth of something

• A trial.

Page 108: AXIOMS Paul Gerrard THE TESTING OF

RefinementExamples

Applications

Page 109: AXIOMS Paul Gerrard THE TESTING OF

www.gerrardconsulting.com

Page 110: AXIOMS Paul Gerrard THE TESTING OF

Thank-You!

THE

TESTINGOF


Simulating Condor Stephen McGough, Clive Gerrard & Jonathan Noble Newcastle University Paul Robinson, Stuart Wheater Arjuna Technologies Limited Condor

Innovative Test Practices Assurance with Intelligence Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire SL6 2RD UK e: [email protected]

Steven Gerrard Www.filmenoion.ucoz

A New Model for Testinggerrardconsulting.com/mainsite/wp-content/uploads/...A New Model for Testing Discussion Paper Paul Gerrard Gerrard Consulting e: [email protected] w:

Slide 1 Test Methods and Tools for ERP Implementations - Proposed Research Project Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire

Steven Gerrard Autobiography

No Slide Title · Exploratory Testing Paul Gerrard [email protected] Twitter: @paul_gerrard Web: gerrardconsulting.com Slide 1 Agenda •A New Model for Testing •Exploring

Software Success Improvement Paul Gerrard

New Model for Testing @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com Programme Chair 2014

Test Management and Contracts in Agile Environments Assurance with IntelligenceSlide 1 Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire

Gerrard Excavating, Inc

2014 Programme Announcement with Paul Gerrard

Number Sets, Field Axioms and Order Axioms

60704 Gerrard Residence

Connecting Business and Testing with Test Analytics Twitter: @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com

Removing Terminology Barriers to Deliver Success @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com

Agile Test Strategy @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com

Test Process Improvement …is a waste of time? Paul Gerrard Technical Director Systeme Evolutif

Nicci Gerrard

Test Process Improvement - Paul Gerrard

Will the Test Leaders Stand Up? A personal view @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com

Research on gerrard

The Future of Testing in Finance Paul Gerrard [email protected] Twitter: @paul_gerrard@paul_gerrard Web: gerrardconsulting.comgerrardconsulting.com

Regression Testing – What to Automate and how Assurance with Intelligence Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire SL6 2RD

Intelligent Testing, Improvement and AssuranceSlide 1 Open Source Script Languages and Utilities What Every Tester Should Know Paul Gerrard [email protected]

Gerrard 2013 sale

Risk-Based Testing – An Overview Assurance with IntelligenceSlide 1 Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire SL6 2RD UK e:

What Is the Value of Testing and How Can We Increase It? Paul Gerrard Technical Director

Slide 1 Should Test Managers Get Emotionally Involved? Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire SL6 2RD UK e: [email protected]

Paul Gerrard - Advancing Testing Using Axioms - EuroSTAR 2010

Axioms for infinite matroids - uni-hamburg.de · Axioms for infinite matroids Henning Bruhn Reinhard Diestel Matthias Kriesell Rudi Pendavingh Paul Wollan Abstract We give axiomatic

Testaus 2014: Paul Gerrard - The Changing Role of Testers

Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to Renovate - EuroSTAR 2012

Story-Based Test Automation Using Free Tools @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com

The Pursuit Of Quality: Chasing Tornadoes Or Just Hot Air?' by Paul Gerrard