test plan documentation strategies - mind maps, test scripts, and more
DESCRIPTION
Summary from the STP Con Testing Conference: Documenting Tester instructions – a Survey of Successful approaches Track: Test Process Justin hunter, CEO, Hexawise This session provides an overview of several different approaches that are successfully used by testers to address the questions of: What type of testing documentation should you create; and how much detail is appropriate to include in order to guide testers and/or satisfy compliance requirements? This session will discuss pros and cons of several approaches, including: • Checklists • Mindmaps • Test ideas • Specification by example • Detailed test scripts In some software testing presentations, the speaker will explain why they think one particular approach is particularly attractive. This won’t be one of those talks. Justin is a test design specialist who has enjoyed teaching testers how to improve the efficiency and effectiveness of their test case selection and documentation approaches.TRANSCRIPT
![Page 1: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/1.jpg)
Documenting Software Testing Instructions - A Survey of
Successful Approaches
STP Con October 25th, 2011Justin Hunter
![Page 2: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/2.jpg)
Topics
Tradeoffs
Considerations
Documents
Idea Triggers
Context Objectives
Mind Maps“Straw Man”
ChecklistsPersonas
“Kan Ban Cards”
Combinations
![Page 3: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/3.jpg)
Topics
3
![Page 4: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/4.jpg)
Context is Critical
4
Tester’s experience
level / Exploratory
Testing skills
Importance of keeping detailed records (e.g., for regulatory compliance or lawsuit defense)
![Page 5: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/5.jpg)
Context is Critical
5
Tester’s experience
level / Exploratory
Testing skills
Importance of keeping detailed records (e.g., for regulatory compliance or lawsuit defense)
Relatively littledetail
Enough detail to satisfy lawyers
Very detailed
Enough detail to avoid tester confusion
![Page 6: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/6.jpg)
Appropriate Amt. of Detail
6Sources: Key Terms (“Cloud Level” / “Clam Level”, etc.)
http://alistair.cockburn.us/Use+casesImage: accelerateddeliveryplatform.com
![Page 7: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/7.jpg)
Objectives
7
![Page 8: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/8.jpg)
Objectives & Assumptions
8
Who? W
hen?
Prescriptive vs. Exploratory?
![Page 9: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/9.jpg)
Tradeoffs
9
![Page 10: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/10.jpg)
Practical Tradeoffs
10
ManyFew
Reqs Docs and the SUT
Reqs Docs Only
Test ideas from
looking at...
Detailsin tests
![Page 11: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/11.jpg)
Practical Tradeoffs
11
ManyFew
Reqs Docs and the SUT
Reqs Docs Only
Test ideas from
looking at...
Detailsin tests
Prescriptive /Designed Before
Exploratory /Designed During
![Page 12: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/12.jpg)
Documentation Strategy
12
![Page 13: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/13.jpg)
“Straw Man”
13
Every test scriptMUST have:
• Test Name• Test Number• Tester’s Name • Tester’s Dept.• Type of Test • Requirement Number• Pre-conditions• Configuration Details• Test Data• Specific Steps• Designer• Approver• Execution Time (est.)• Expected Results
![Page 14: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/14.jpg)
Time Management
14
![Page 15: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/15.jpg)
Overly-Detailed Documentation
15
ActualTesting
![Page 16: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/16.jpg)
Mind Maps
16
![Page 17: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/17.jpg)
Mind Maps - Test Plan Template
17http://www.softwaretestingclub.com/forum/topics/the-two-
page-test-plan?commentId=751045%3AComment%3A105353
![Page 18: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/18.jpg)
18http://www.softwaretestingclub.com/forum/topics/the-two-page-
test-plan?commentId=751045%3AComment%3A105353
Clear Communication Example
![Page 19: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/19.jpg)
Evolution of a Mind Map
19
“1. Identify Properties you're interested in”
http://testerkiwi.blogspot.com/2011/04/building-exploratory-test-plan-redux.html
![Page 20: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/20.jpg)
Evolution of a Mind Map
20
“2. Start Collecting Intel”
http://testerkiwi.blogspot.com/2011/04/building-exploratory-test-plan-redux.html
![Page 21: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/21.jpg)
Evolution of a Mind Map
21
3. After Talking to Developer...
http://testerkiwi.blogspot.com/2011/04/building-exploratory-test-plan-redux.html
![Page 22: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/22.jpg)
Mind Maps
22
Benefits of mind maps so far... Benefits of mind maps so far...
Creation
Quick and Easy Maintenance
Quick and Easy Collaboration
Quick and Easy
Reporting
Quick and Easy
But would mind maps be detailed enough...
... For junior testers?
... For testers who will join team in six months?
![Page 23: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/23.jpg)
“MindMapping 101 for Testers”
23
http://www.bettertesting.co.uk/content/?p=956
![Page 24: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/24.jpg)
Test Details into Test Mgmt Tool
24
![Page 25: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/25.jpg)
25
Collaboration is Easy
![Page 26: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/26.jpg)
Planning & Prioritizing Risks
26
http://www.bettertesting.co.uk/content/wp-content/uploads/2011/01/Test-Phase-3.4.jpg
![Page 27: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/27.jpg)
27
http://www.bettertesting.co.uk/content/wp-content/uploads/2011/01/Test-Phase-3.4.jpg
Determining Scope - What’s In
![Page 28: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/28.jpg)
28
http://www.bettertesting.co.uk/content/wp-content/uploads/2011/01/Test-Phase-3.4.jpg
Determining Scope - What’s Out
![Page 29: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/29.jpg)
Documentation
29
![Page 30: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/30.jpg)
Kan Ban Boards
30
![Page 31: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/31.jpg)
31
http://www.flickr.com/photos/roxocubes/5786672702/
![Page 32: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/32.jpg)
Paul Holland - (Testing-Focused)
32
Paul HollandAlcatel-Lucent
(personal photo of histesting board, used with permission)
![Page 33: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/33.jpg)
Paul Holland - (Testing-Focused)
33
Each note represents a half-day of testing activity (via Session-Based Testing)
Highly recommended reading: For a detailed description of Paul’s experiences with this approach and his lessons learned, check out Michael
Bolton’s “A Sticky Situation” in an upcoming version of STP Magazine. Also, Google “Session-based Test Management”
![Page 34: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/34.jpg)
Kan Ban-ish Tool: Pivotal Tracker
34
![Page 35: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/35.jpg)
More Details on Hover-Overs
35
![Page 36: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/36.jpg)
More Detail Still by Clicking
36
![Page 37: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/37.jpg)
Including Recent Test Results
37
![Page 38: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/38.jpg)
Test Descriptions / Size Estimates
38
![Page 39: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/39.jpg)
39
![Page 40: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/40.jpg)
Soap Opera Testing
40
http://www.logigear.com/logi_media_dir/Documents/Soap_Opera_Testing.pdf
Tests should be fun and aggressive.
Write scenarios that are:
• Reality-based• Exaggerated, and • Condensed
![Page 41: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/41.jpg)
Soap Opera Testing
41
http://www.logigear.com/logi_media_dir/Documents/Soap_Opera_Testing.pdf
![Page 42: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/42.jpg)
42
http://www.logigear.com/logi_media_dir/Documents/Soap_Opera_Testing.pdf
Soap Opera Testing
![Page 43: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/43.jpg)
Soap Opera Example
43
http://www.logigear.com/logi_media_dir/Documents/Soap_Opera_Testing.pdf
![Page 44: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/44.jpg)
Personas and “Substruction”
44
http://www.software-testing.com.au/blog/2006/07/30/personas-substruction-and-other-trades-tricks/
![Page 45: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/45.jpg)
Behavior-Driven Development
45
![Page 46: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/46.jpg)
Behavior-Driven Development
46
![Page 47: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/47.jpg)
47
![Page 48: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/48.jpg)
How to Select?
48
![Page 49: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/49.jpg)
49
... How to Handle More Details?
![Page 50: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/50.jpg)
50
... and still MORE Details?
![Page 51: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/51.jpg)
How to Document?
51
Test inputs from all 3
mind maps are entered.
![Page 52: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/52.jpg)
jklhlkjhkjhkjh
52
Pairwise coverage in 19 highly-varied tests
![Page 53: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/53.jpg)
Auto-populate Mad Libs-like tests
53
![Page 54: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/54.jpg)
Turned into Detailed Test Scripts
54
Detailed test scripts: quickly generated by Hexawise.
![Page 55: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/55.jpg)
Checklists
55
![Page 56: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/56.jpg)
Checklists
56
• Cem Kaner - The Value of Checklists and the Danger of
Scripts: What Legal Training Suggests for Testers http://
www.kaner.com/pdfs/ValueOfChecklists.pdf
• Justin Hunter - http://hexawise.wordpress.com/2009/11/04/
checklists-good-test-scripts-bad/
• Thoughts from the Test Eye - Software Quality
Characteristics
• Michael Hunter, “You Are Not Done Yet”
• Elizabeth Hendrickson - Testing Cheat Sheet
![Page 57: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/57.jpg)
Software Quality Characteristics
57
http://thetesteye.com/blog/2010/11/software-quality-characteristics-1-0/
![Page 58: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/58.jpg)
Rapid Reporter (Free Tool)
58
http://testing.gershon.info/reporter/
![Page 59: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/59.jpg)
Checklists
59
www.kaner.com/pdfs/ValueOfChecklists.pdf
![Page 60: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/60.jpg)
“Easy-Access Executive Summary”
60
http://bitly.com/bundles/hexawise/2
An organized summary of all the links referred to in this presentation is
available in the link below:
![Page 61: Test Plan Documentation Strategies - Mind Maps, Test Scripts, and More](https://reader034.vdocuments.site/reader034/viewer/2022050808/547a4a6fb4795959098b49b5/html5/thumbnails/61.jpg)
Invitation to SlideShare Viewers
61
https://app.hexawise.com/signup-1-5
If you have read this far, odds are very good that you’re the kind of tester who is interested in trying out promising new testing tools.
Hexawise is a powerful test design tool that allows testers to zero in on a small set of unusually-powerful tests. We’d like you to try it and let us
know what you think about it.
We have an unusual - some have even said bizarre - pricing policy. While enterprise licenses of Hexawise start at $50,000 / year, we make fully-featured versions of Hexawise available at no cost for teams of 1 to 5
testers. It’s like having a rich uncle with a $50,0000 BMW who gave you the keys to his car indefinitely. And he wouldn’t get upset even if you kept it or ruined it. Wouldn’t you at least want to take it out for a test drive?
Sign up now