continuous testing - anztb · •continuous testing is about ensuring continuous quality, it’s a...
TRANSCRIPT
![Page 1: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/1.jpg)
Continuous Testing
Matt Belcher
![Page 2: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/2.jpg)
22
• What is Test Automation?
• How does it work?
• Reporting
• The build pipeline
• Framework and design
Lets get started…
![Page 3: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/3.jpg)
3
What is Test Automation?
Simulates actions performed by customers, systems and services
Traditionally used purely for regression testing once a system had been built
Used as a tool to measure the quality of a system and prove that it’s features are acceptable
![Page 4: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/4.jpg)
4
When should we Automate?
Automate from the beginning,rather than the end
Test early, test often
Implement your automation as part of the build pipeline as early as possible
![Page 5: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/5.jpg)
5
What should we Automate?
![Page 6: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/6.jpg)
66
Tips - Getting started
• Set team goals, such as 100% coverage of acceptance criteria
• Collaborate - 3 amigos
• APIs are great areas to focus on, as they are usually fast and reliable
![Page 7: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/7.jpg)
7
How does it work?
![Page 8: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/8.jpg)
8
How does it work?
![Page 9: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/9.jpg)
9
What if things change?
![Page 10: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/10.jpg)
10
Nuts and bolts
![Page 11: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/11.jpg)
1111
Tips - Day to day basics
• Use an automation tool which can be used by multiple team members in parallel
• Continuous testing is about ensuring continuous quality, it’s a team activity
• Automation never sleeps - wait for conditions and events, rather than pausing execution
![Page 12: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/12.jpg)
12
Reporting - Overview
![Page 13: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/13.jpg)
13
Reporting - Details
![Page 14: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/14.jpg)
1414
Tips - Reporting
• Focus on features and scenarios, rather than tests
• Visibility and simple understanding of reports is important to all members within and outside of the team
• Test data is sometimes less important than we are lead to believe - Generate data, but always verify
![Page 15: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/15.jpg)
15
Bamboo integration
![Page 16: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/16.jpg)
16
Jenkins integration
![Page 17: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/17.jpg)
1717
Tips - Pipeline
• Start small, start reliable, start early
• Aim for a single package/asset, which flows through environments
• The automation is an asset, look after it and it will look after you
![Page 18: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/18.jpg)
18
Model, View, Controller
Model View
Controller
Web App
API
Mobile App
![Page 19: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/19.jpg)
1919
Tips - Framework design
• Use relational data models - no more spreadsheets
• Use inheritance rather than copying and pasting
• Break down complexity into bite size chunks
![Page 20: Continuous Testing - ANZTB · •Continuous testing is about ensuring continuous quality, it’s a team activity •Automation never sleeps - wait for conditions and events, rather](https://reader036.vdocuments.site/reader036/viewer/2022081607/5ed0b3c4146b1a6dad4b9fd8/html5/thumbnails/20.jpg)
20
Next steps