test process improvement – how hard can it be?

Private & Confidential Experimentus Ltd 85 Tottenham Court Road London W1T 4TQ T: +44 (0)870 770 6099 www.experimentus.com

Assess | Visualise | Transform | Manage | Train

Test Process ImprovementHow hard can it be?

17th May 2017

Geoff Thompson

Agenda

How did we get here? Defining a test process Why does Process change fail? Challenges

– People/Culture– Communications– Other SDLC processes

We have come a long way…

How did we get here?

IT is a relatively new industry – but growing very fast

Testing is perhaps the least mature part of the lifecycle?

A lot of testers ‘fell’ into the role

It’s still a craft – not a profession!

Defining a Process…

Level 0 – process-to-process high-level integration diagram

Level 1 – sub-process definition diagram

Level 2 – high level activity diagram with integration and primary roles

Level 3 – detailed activity and steps diagram with integration

“Snake”

“Swim lanes”

Level 0 process area

Validation and Testing

Defect Management

Test Environment Management

Business Analysts

Configuration Management

Development

System Design

Design Authority

Level 2 Process area

Level 3 process area

Why does process change fail?

1. No sense of urgency

2. No guiding team

3. No change vision and strategy

4. No communication for Understanding and Buy In

5. No one is empowered to act

6. No Short term wins

7. No pressure to deliver

8. No one understood the need to change culture

8 Step Process to Successful Change Set the stage

1. Create a sense of urgency

2. Pull together the guiding team

Decide what to do3. Develop the change vision and strategy

Make it happen4. Communicate for Understanding and Buy In

5. Empower others to act

6. Produce Short term wins

7. Don’t let up

Make it stick8. Create a new culture

The change plan (Vision and Strategy)

Lets talk about People and Culture

Gartner Hype Cycle

Change Trigger

Peak of Inflated Expectations

Trough of Disillusionment

Slope of Enlightenment

Plateau of Productivity

Old Status Quo

Find your way or RIP

Dunning Kruger effect

The unskilled suffer from illusory superiority, rating their own ability as above average, much higher than it actually is

While the highly skilled underrate their abilities, suffering from illusory inferiority

How is this reflected?

Tendency to overestimate ones own level of skill

Failure to recognise genuine skill in others

Fail to recognise the extremity of their inadequacy

Only recognize and acknowledge their own previous lack of skill, if they can be trained to substantially improve

The utter confidence of those who, with no expertise, remain stubborn in their views regardless of overwhelming evidence

Those with the least knowledge and the lowest level of skill tend to be the loudest and most confident

Organised/Dis-organised teams

Which one is better at accepting change?

The one dissenter

Not everyone will make the journey

Develop a Communications plan

Develop a Process Interaction diagram

We have come a long way

We have over 450,000 testers certified by ISTQB

3500 test resources see Process Improvement as the major way forward in 2016 (ISTQB)

29 TMMi certified organisations, 9 at level 5

EuroSTAR has been going for 23 years (nearly 24)!

2012 2013 2014 2015

TMMI Certification Trends

Level 2 Level 3 Level 4 Level 5

Experimentus Software Testing Maturity Survey

• Yearly online survey undertaken by Experimentus

• 250 respondents from across the globe

• Most IT Sectors represented

Where are we?

2.1 Test Policy and Strategy

2.2 Test Planning

2.3 Test Monitoring and Control

2.4 Test Design and Specification

2.5 Test Environments

3.1 Test Organisation

3.2 Test Training program

3.3 Test Lifecyle and Integration

3.4 Non Functional Testing

3.5 Peer Reviews

Where are we?

2.2 Test Planning

3.5 Peer Reviews

Telecommunications Sector Results

2015 2014

Where are we?

2.2 Test Planning

3.5 Peer Reviews

IT Service Provider Sector Results

2015 2014

Closer look

Test Policy and Strategy

Test Organisation

Test Process

Test Monitoring & Control

Test Planning

Test Specification

Test Execution

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Last Year

Fully Achieved Partially Achieved Not Achieved

Closer look

Test Policy and Strategy

Test Organisation

Test Process

Test Monitoring & Control

Test Planning

Test Specification

Test Execution

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

This Year

Fully Achieved Partially Achieved Not Achieved

How do you compare against the industry?

Your resultsSector benchmark

Take our surveyand benchmarkyour company.

www.experimentus.com

Summary

Process change is 20% of the change People and culture are everything Remember the eight step change process Key success factors can be found in:

– People – Communication– Understanding how you integrate with other SDLC processes

Thank you

www.experimentus.com

+44 (0)207 871 2300

geoff.thompson@experimentus.com

test process improvement – how hard can it be?

Software

improvement of test automation - theseus

improvement of hard cider production

finding success with test process improvement

test process improvement; measurement is critical to - uksma

hard soil/soft rock triaxial test procedure

camp fire usa quality improvement field test report camp...

ideas for test improvement in postgresql

test process improvement (tpi) by kj ross

test driven development and quality improvement

real world environmental test and evaluation of hard blue

2004 11 17 test process improvement

change package - aap.org€¦ · improvement repeated...

ni-hard-class cast irons, prospects for their improvement

test process improvement in agile

test improvement in our rapidly changing world

failure analysis/test and trust/rad-hard assessment

leakage test stand improvement marie rohrbaugh

test improvement for agile/scrum

international benchmarking for school improvement - … test...

yuma area office water quality improvement center test