The Tao of Testing

Emma ArmstrongWebsite: www.taooftesting.co.uk

@EmmaATester

Developers and Testers

http://www.snowsphere.com/special-features/snowboarding-vs-skiing-the-dying-feud by Sam Baldwin

Image from http://altitudeskiaccommodation.co.uk/resorts/switzerland/zermatt

Why test?

• Give insight into the state of the system• Conformance with product requirements – functional, performance,

reliability, security, usability• Usability of the product• Check compliance with regulations. Testing should verify that we are building the system right but equally that we are building the right system.

Requirements

Image from http://diykenya.files.wordpress.com/2010/08/tire_swing.gif

Tea

Image from http://www.telegraph.co.uk/science/science-news/8577637/How-to-make-the-perfect-cup-of-tea-be-patient.html Photo Alamy

Five W’s and a H

• Who?• Why?• What?• Where?• When?• How?

What do you need to make a cup of tea?

System Components – What?

• Cup• Spoon• Teabag• Milk• Water• Electricity• Surface• Honey, lemon

Storage – Where?

• Fridge• Tea holder• Water source• Cupboard

Environment-Where?

• Home• Office• Shop• Garage• Cafe

• Aeroplane

Interactions and Sequences – How?

How do you get the milk from the refrigerated section?

How does the tea need to be stored?How do you handle the tea after it has been

used?What is the sequence for making a cup of tea?

Who?

• A child• An adult

Quality – what or who determines if it is good Quality?

• Strength• Heat• Who made it• Cost

Compliance

• Iso 3103 (http://en.wikipedia.org/wiki/ISO_3103)• The pot should be white porcelain or glazed earthenware and have a partly serrated edge. It should have a lid that fits

loosely inside the pot.• If a large pot is used, it should hold a maximum of 310 ml (±8 ml) and must weigh 200 g (±10 g).• If a small pot is used, it should hold a maximum of 150 ml (±4 ml) and must weigh 118 g (±10 g).• 2 grams of tea (measured to ±2% accuracy) per 100 ml boiling water is placed into the pot.• Freshly boiling water is poured into the pot to within 4–6 mm of the brim. Allow 20 seconds for water to cool.• The water should be similar to the drinking water where the tea will be consumed• Brewing time is six minutes.• The brewed tea is then poured into a white porcelain or glazed earthenware bowl.• If a large bowl is used, it must have a capacity of 380 ml and weigh 200 g (±20 g)• If a small bowl is used, it must have a capacity of 200 ml and weigh 105 g (±20 g)• If the test involves milk, then it is added before pouring the infused tea.• Milk added after the pouring of tea is best tasted when the liquid is between 65 - 80 °C.• 5 ml of milk for the large bowl, or 2.5 ml for the small bowl, is used.

What has this got to do with us?

• Analogous to new features/bug fixtures• Areas of testing – unit level, integration• Ask the question

Deciding what to test

• Identify the red route(s) for the product• Identify the variables • Identify the storage• Identify the sequences and interactions• Identify how to vary them and at what level to vary/test them• Identify the quality• Identify compliance requirements

Takeaway

• Be prepared• Think about the big with awareness of the small• Don’t go it alone• Create your own reference guide• Know yourself• Ask the questions

We are all in it for the quality

</talk>Any Questions?

Emma Armstrong

@EmmaATester