what’s in a role? - stuart reid...stuart reid ©stuart reid, 2015 sigist scope •introduction to...

44
Motivating Testers – What’s in a Role? Stuart Reid ©Stuart Reid, 2015 SIGiST

Upload: others

Post on 15-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Motivating Testers –

What’s in a Role?

Stuart Reid

©Stuart Reid, 2015

SIGiST

Page 2: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Scope

• Introduction to Motivation

• Outline of the Motivation Survey

• Survey analysis and results

– What factors correlate best with motivation?

– Do existing theories work for testing?

– How does motivation change for different roles?

• Conclusions & recommendations

2

Page 3: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Defining Motivation

• a reason or reasons for acting or behaving in a particular way - Oxford Dictionaries

• internal and external factors that stimulate desire and energy in people to be continually interested and committed to a job, role or subject, or to make an effort to attain a goal– http://www.businessdictionary.com

3

Page 4: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Motivation 101

4

Page 5: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Investigation Approach

• Questionnaire

– Paper-based

– SurveyMonkey

• 40 Questions

– Demographic

– Motivation-related (Likert-scale)

– Open-ended

– Qualitative & quantitative data

• Responses from around the world (over 600)

• Thanks to Tafline Murnane

– KJ Ross – Australia

5

Page 6: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Respondents by Region

6

Page 7: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Industry Sectors

Finance, Insurance

Communications

IT

Utilities

Health Care

Government

Services

Transportation

Media

Non-profit

Retail, Wholesale

Construction

Internet

Manufacturing

Other

7

Page 8: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Organization Types

IT Organization

Self-employed Consultant

Self-employed Contractor

Testing Services

IT Department within an

Organization

Other

8

Page 9: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Company Size

9

Page 10: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Life Cycles

10

Page 11: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Testing Roles

11

Page 12: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Specified Variety - Test Analyst

0%

20%

40%

60%

80%

100%

Exploratory

Test Design

Execution

Automation

Reviewing

Management

Improvement

Env't Support

12

Page 13: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Jobs…

0%20%40%60%80%

100%Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Head of Testing

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Test Manager

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Developer/Tester

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Test Analyst

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Test Lead

0%20%40%60%80%

100%

Exploratory

TestDesign

Execution

Automation

Reviewing

Management

Improve-ment

Env't Support

Test Consultant

13

Page 14: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Motivation Theories

• Hierarchy of Needs – Maslow, 1943

• Motivation-Hygiene Theory – Herzberg, 1959

• Theory X & Theory Y – McGregor, 1960

• Expectancy Theory – Vroom, 1964

• Equity Theory – Adams, 1965

• Job Characteristics Model (MPS) – Hackman & Oldham, 1976

• Three Needs Theory – McClelland, 1988

• Temporal Motivation Theory (TMT) - Steel and Konig, 2006

• Motivation 3.0 (MAP) – Pink, 2010

14

Page 15: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

0

50

100

150

200

250

300

stronglydisagree

disagree neitheragree nordisagree

agree stronglyagree

Perceived Motivation

“I am highly motivated to do my

job in testing”

15

Page 16: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Perceived Motivation - Roles

120117109

10310199

0

20

40

60

80

100

120

140

Head ofTesting

TestConsultant

Test ManagerTest LeadTest AnalystDeveloper /Tester

Page 17: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

r = +0.70 or higherVery strong positive relationship

r = 0.85r = 1

0

20

40

60

80

100

120

140

160

180

200

0 5 10 15 200

20

40

60

80

100

120

140

160

180

200

0 5 10 15 20

17

Page 18: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

r = +0.30 to +0.39Moderate positive relationship

r = 0.35r = 0.55

r = +0.40 to +0.69Strong positive relationship

0

20

40

60

80

100

120

140

160

180

0 5 10 15 200

20

40

60

80

100

120

140

160

180

0 5 10 15 20

18

Page 19: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

r = 0 to +0.19Negligible positive relationship

r = 0.10r = 0.25

r = +0.20 to +0.29Weak positive relationship

0

20

40

60

80

100

120

140

160

180

0 5 10 15 20 250

20

40

60

80

100

120

140

160

180

0 5 10 15 20

19

Page 20: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

20

0

20

40

60

80

100

120

140

160

180

200

0 2 4 6 8 10 12 14 16 18 20

r = -0.71 (Very) strong negative relationship

Page 21: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

• Skill Variety (V)– range of different skills used

• Task Identity (I)– degree of completing a whole job

• Task Significance (S)– importance of the job

• Autonomy (A)– level of control of your own time

• Feedback (F)– degree of supervisory & results-based feedback

• MPS =

FASIV

**3

MPS from Hackman & Oldham, 1975.

Motivating Potential Score

Assign a score of 1 to 7 to

each attribute...

...and then calculate your

MPS

21

Page 22: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Feedback

22

(WORK ITSELF)

(COLLEAGUES)

(SUPERVISOR)

Page 23: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Variety

23

(# TASKS)

(# PROJECTS)

Page 24: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Significance

24

(# AFFECTCOLLEAGUES)

(AFFECT PROJECT)

Page 25: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Identity

25

(PROJECTS TO COMPLETION)

(TASKS TO COMPLETION)

Page 26: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Autonomy

26

(NEXT TASK)

(WORKING HOURS)

(WHO WITH)

(HOW TO DO)

Page 27: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

It works!MPS & Perceived Motivation

0

50

100

150

200

250

300

0 1 2 3 4 5 6 7

r = 0.40Strong positive relationship

27

Page 28: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Daniel Pink’s MAP

• Daniel Pink’s Motivation 3.0

Mastery

PurposeAutonomy

28

Page 29: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Mastery

29

(CHALLENGE)

(MASTERED SKILLS)

(IN THE FLOW)

Page 30: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Purpose

30

(WIDER COMMUNITY)

(PROFITS)

Page 31: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Environment

31

Page 32: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Multiple Motivation Factors

Motivation

Variety (0.29)

Feedback (0.30)

Mastery (0.28)

Purpose (0.22)

Autonomy (0.27)

Environment (0.38)

32

Significance(0.13)

Identity (0.18)

MPS

MAP

Page 33: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

MPS and MAP and Top 4

33

0.40

0.41

0.50

MPS

MAP

Top 4 ENV’T + VARIETY 2 + MASTERY 1 + MASTERY 3

Daniel Pink’s Motivation 3.0

Page 34: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

What (De)Motivates Testers?

34

Motivating Demotivating

#1 Challenges 17% Management 20%

#2 Feedback & Appreciation 15% Feedback & Appreciation 16%

#3 Making a Difference 15% Repetition 13%

#4 Team & Work Env’t 10% Changing Exit Criteria 11%

#5 Money 7% Team & Work Env’t 5%

#6 Meeting Targets 7% Developers 5%

#7 Autonomy 5% No Targets 5%

#8 Management 5% Process 4%

#9 Training / Career Path 4% Changing Requirements 4%

#10 New Technology 3% Money 3%

Page 35: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Life Cycles…

35

Page 36: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Organization Sizes…

36

Page 37: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Experience Levels…

37

Page 38: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Organization Types…

38

Page 39: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

0.09

0.51 0.010. 15

-0. 05

Salary, Experience & Education

Tester Experience

Perceived Motivation

Tester Salary

Tester Education

39

Page 40: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Outside Interests?

40

Page 41: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Conclusions

• Testers are special

– we can improve on the generic motivation theories

• Not all testers are the same

– We need to consider ‘smarter’ approaches to the motivation of testers

– Don’t treat everyone working in testing the same

• different roles require a different focus

• choose the most influential factors for the individual tester

• Feedback and appreciation both improves motivation and decreases demotivation

• Please compare yourself to the benchmark data to improve your motivation

41

Page 42: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

More information is available

– please email

[email protected]

Thanks for listening

Any Questions?

SIGiST

Page 43: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

1 FEEDBACK 1The work itself provides feedback on how well I am doing in

my job. (POSITIVE)

2 FEEDBACK 2My colleagues provide little or no feedback on how well I

perform. (NEGATIVE)

3 FEEDBACK 3My supervisor provides me with regular feedback on my

performance. (POSITIVE)

4 AUTONOMY 1Most of the time someone else decides what tasks I should do

next. (NEGATIVE)

5 AUTONOMY 2My job is flexible enough to allow me to decide which hours I

work most days. (POSITIVE)

6 AUTONOMY 3For most tasks I get to decide who I will work with.

(POSITIVE)

7 AUTONOMY 4I rarely get to choose the way that an activity is carried out.

(NEGATIVE)

8 SIGNIFICANCE 1My job is one that affects few other colleagues.

(NEGATIVE)

9 SIGNIFICANCE 2If not done well my job will have little impact on the project.

(NEGATIVE)

Page 44: What’s in a Role? - Stuart Reid...Stuart Reid ©Stuart Reid, 2015 SIGiST Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

10 IDENTITY 1My job allows me to see projects through to completion.

(POSITIVE)

11 IDENTITY 2I often start tasks but then pass them on to colleagues before I

finish them. (NEGATIVE)

12 VARIETY 1My job comprises a relatively small number of different tasks.

(NEGATIVE)

13 VARIETY 2In my job I get the chance to work on many interesting

projects. (POSITIVE)

14 MASTERY 1My job does not challenge or stretch me.

(NEGATIVE)

15 MASTERY 2I have mastered most of the skills required to perform my job.

(NEGATIVE)

16 MASTERY 3I often become so engaged in my work that I forget the time.

(POSITIVE)

17 PURPOSE 1My job includes the opportunity to work for the good of the

wider community (beyond my employer). (POSITIVE)

18 PURPOSE 2My organization is primarily focused on increasing its profits.

(NEGATIVE)

19 PERCEPTIONI am highly motivated to do my job in testing.

(POSITIVE)

20 ENVIRONMENTMy work environment encourages me to perform my job better.

(POSITIVE)