what i've learned about test automation and devops
TRANSCRIPT
3 . 2
My Boss requested me to implement a Test AutomationCompetence to reduce Production Incidents...
4 . 2
AUTOMATION IS NO SILVER BULLET!It won't start delivering at day zer0It's no guarantee of qualityIt won't replace testers
4 . 6
But.. Unit Tests aren’t the Holy Grail...
Unit tests are not related to user/business requirementsDevelopers just want to prove that the code works!
4 . 9
With the help from the OPS team we devised a flexible testenvironment
Routing & Virtualization
4 . 12
THE PROBLEM IS THE NOT THE TECHNICALSTUFF!
Bussiness Logic? Specification? Test Conditions? Undestandthe Requirements! Environment...
4 . 15
All the applications that require integrated data for testingwill profit.
#1 Create a test data generation process
4 . 16
#2 Review and automate the manual regresion Test Set.
Shi the saved time for new features testing.
4 . 17
#3 THE AUTOMATION FRAMEWORK SHOULDALLOW THE QUALITY TEAM:
(1) Allow testers to automate tests without having to code(Keyword-driven FW)
(2) Performing data-driven tests (using the same test withdiverse input data)
(3) Easy mantainance by using an object repository (tostore object properties)
4 . 18
Test Framework Design Approaches
KEYWORD DRIVEN+DATA DRIVEN
Readability; Reuse; Flexibility; Loosely Coupled
4 . 20
PAIRWISE TESTING
Exaustive Testing: 2^9 * 5 = 2.560 tests!
Pairwize test generation: 12 tests
5 . 2
SHIFT LEFT SHOULD BE BY NOW A REALITY
Begin Testing Activities as soon as the dirst dra arrives!
5 . 3
BUT A NEW 'SHIFT-RIGHT' IS EMERGING
Shi -Right: Test in Production
A/B Testing, Feature Flags, Actionable Analytics, Bug FindingChallenge