the 4-hour tester experiment

37
The 4-hour Tester Experiment (The Art of Bricolage) Helena Jeret-Mäe & Joep Schuurkes

Upload: helena-jeret-maee

Post on 13-Apr-2017

86 views

Category:

Software


0 download

TRANSCRIPT

Page 1: The 4-hour Tester Experiment

The 4-hour Tester

Experiment(The Art of Bricolage)

Helena Jeret-Mäe & Joep Schuurkes

Page 2: The 4-hour Tester Experiment

Helena Jeret-Mäe

@HelenaJ_M

thepainandgainofedwardbear.wordpress.com

Joep Schuurkes

@j19sch

testingcurve.wordpress.com

NO TESTERS WERE HARMED DURING THIS EXPERIMENT.

Page 3: The 4-hour Tester Experiment

Why the 4-hour tester?

Page 4: The 4-hour Tester Experiment

DS

S

S

Page 5: The 4-hour Tester Experiment

Selecting the skills

Page 6: The 4-hour Tester Experiment

Criteriaskill is central to testing

Criterion

Page 7: The 4-hour Tester Experiment

So where does this get us?

artist: s l scott

Page 8: The 4-hour Tester Experiment

But how to start?

Shu - follow the rule (obedience)

Ha - break the rule (divergence)

Ri - be the rule (transcendence)

Page 9: The 4-hour Tester Experiment

Skills - the survivorsInterpreting

Modelling

Test design

Note taking

Bug reporting

Page 10: The 4-hour Tester Experiment

Skills - the dropped onesTest reporting

Focus/defocus

Exploring

Generating test ideas

Thinking skills (critical, lateral, systems)

Visualisation

Kipling method of asking questions

Satir interaction model

Page 11: The 4-hour Tester Experiment

Why test reporting did not make it

test reporting

requires test framing

requires test mission

Page 12: The 4-hour Tester Experiment

Why focus/defocus did not make it

Page 13: The 4-hour Tester Experiment

Developing exercises

Page 14: The 4-hour Tester Experiment

Considerations...What does a useful exercise look like?

How to help the learner make sense of the experience?

How to make the exercise fit into 30 minutes?

Page 15: The 4-hour Tester Experiment

StructureBrief: what the exercise focuses on

Instructions: what to do

Evaluation: how to reflect on the exercise

Page 16: The 4-hour Tester Experiment

What to use for testing?Familiar concept

Quickly learnable

Sufficiently complex

Page 17: The 4-hour Tester Experiment

Summary of modelling exercise

Explanation: what are touring heuristics; examples

Instructions: do user, data, and configuration tour in Google calendar

Evaluation: think of how the tours help to come up with test ideas

Page 18: The 4-hour Tester Experiment

Other people's thoughts

Page 19: The 4-hour Tester Experiment

We asked some people what they would do

Thank you all!

Keith Klain KishenSimbhoedatpanday

Huib Schoots

James Lyndsay

Ben KellyRikard Edgren

Erik BrickarpAleksandra Casapu

Page 20: The 4-hour Tester Experiment

We asked some people what they would doWhat I’d like to ask of you is this: if you had 4 hours to teach someone testing, what would you teach them in that timeframe?

The outcome would be that this person is then able to to do testing using what was taught by you.

Page 21: The 4-hour Tester Experiment

Let's go meta

I’d want to teach them to think like a tester (understand what is important, then test it.)

the growing discovery ofwhat is in the system-under-test,and what is not

help them understand what it is that testers do

[...], the actual combination of skills we practice is not the most relevant. Any testing task should probably do.

Page 22: The 4-hour Tester Experiment

There's homework!

a list of blogs, books and open-source projects

to help them understand enough about testingto be able to further educate themselves

give them Perfect Software by Weinberg as homework

It’s important [...] to be open to continuous learning.

Page 23: The 4-hour Tester Experiment

Let's sit togetherI’m also going to frame this as one-to-one coaching.Sit together and [...]

I would sit next to them coaching them

If I had 4 hours to spend with someone who wanted to learn more about testing, [...]

Page 24: The 4-hour Tester Experiment

Euh… but it's a written, long-distance thing

Rikard Edgren

I believe feedback is essential to learning.

If you are aiming at a totally independent 4-hour

program,

I think it will be very difficult (it will work only for some.)Interesting project you are doing, and I look forward to see the results.

Page 25: The 4-hour Tester Experiment

Results

Page 26: The 4-hour Tester Experiment

Yes, the experiment showed that small exercises could help learn and illuminate testing skills to some degree.

No, you can’t become a tester in 4 hours...

Page 27: The 4-hour Tester Experiment

4 beginners

5 exercises

50 minutes

Page 28: The 4-hour Tester Experiment

3.2 Exercise was challenging

3.9 Exercise went in depth

4.4 Exercise fits in time limit

Page 29: The 4-hour Tester Experiment

3.8 Exercise was easy to evaluate

3.3 Likelihood of repeating

4.4 Skill clearly present in exercise

Page 30: The 4-hour Tester Experiment

What did they learn about note taking?Labeling is something I should think about using in my everyday note taking.

The next time I will write down all steps that were taken and clicks made on something, and if something worked or didn’t work. Also I’ll add comments about UI or about something else that is worth taking note of.

I learned that taking notes is more important than I thought before, especially to retrace my own steps.

Page 31: The 4-hour Tester Experiment

What did they learn about modelling?From this exercise I learned to look at testing the product in general and see the big picture.

Learned to explore the software from different points of view, to see different elements in software, to structure my test.

I learned that touring methods are easy to use to focus on different parts of the application.

Page 32: The 4-hour Tester Experiment

What we learned

Page 33: The 4-hour Tester Experiment

Both more and lessis possible

Page 34: The 4-hour Tester Experiment

What's next?

Page 35: The 4-hour Tester Experiment

fourhourtester.net

Page 36: The 4-hour Tester Experiment

Call to arms

Page 37: The 4-hour Tester Experiment

Thank you!

Helena Jeret-Mäe

@HelenaJ_M

Joep Schuurkes

@j19sch