agile test strategy - final - testing in south africa · testing env02 integration testing system...
TRANSCRIPT
Location: Johannesburg
Date:26May2017
NameoftheSpeaker:WayneSinclair
waynesinclair.co.za @Tester_RSA
CompanyName:ThoughtWorks
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
Agile Test Strategy for Digital Assurance
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Why a Test Strategy?
• Establishes plan of action, long term
• It’s actually intended to drive quality thinking and testing activity
across the entire agile team.
• Determines customer expectations
• Understanding, best practices, structured
• Information Radiator
• Static, but evolving.
• Across projects
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Before
Awaiting Test In Test Test CompleteStory 4 Story 2 Story 1Story 5 Story 3Story 6
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
AfterDev
Done In Test Awaiting Test In Test Test Done Performance Testing
Story 4 Story 2 Test Data Story 1Story 5 Functional
Exploratory
E2E
Integration
Analytics
Cross Device
Cross Browser
Regression
PO
Story 3
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
The Big Shift
QA
Shift Up
Shift RightShift Left
Shift Down
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
ITAutomationSummit2016
AgileTestingAndTestAutomation
???
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Loyalty
Progress
LoyaltyLoyalty
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Manifesto for Agile Software Development
Individuals and interactions over processes and tools
Working software over comprehensive documentation
Customer collaboration over contract negotiation
Responding to change over following a plan
CoreTesting
SMAC
IOT
Multi-Channel
DigitalContent/DigitalMedia
Customer Sentiment Analysis
(A/B Testing)
BusinessProcessValidation
QualityAttributes
ValueChainAssurance
https://www.slideshare.net/CAinc/digital-assurance-develop-a-comprehensive-testing-strategy-for-digital-transformations
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Manifesto for Agile Software Development
Individuals and interactions over processes and tools(Created by team, foundational)
Working software over comprehensive documentation(Guide, outline)
Customer collaboration over contract negotiation(Adjust, based on collaboration)
Responding to change over following a plan(Not fixed, roadmap, guide, baseline, but allows flexibility)
Mission Statement
Approach: Tools and Techniques
UI
SYSTEM
INTEGRATION
UNIT
To constantly deliver working software that
meets customer’s requirements by means
of providing fast feedback and
defect prevention, rather than defect detection
ManualAutomated
JiraSelenium
+ve, -ve,Boundary
Approach Tools Techniques
ManualAutomated
JiraSelenium
Business Processes
Automated SOAPUI +ve, -ve
+ve, -veAutomated Junit in IDE
Testing Scope
ApplicationsNon-Functional
Functional
Performance
SecurityApp1
App2
DefectsStories
ChangeRequests
Cross-OSCross-BrowserCross-DeviceTechDebt
Cross-Functional
Team Makeup
Login&Registration
Payments
Beneficiaries
Out ofScope
ATMIntegration
DebitOrderIntegration
Non-Functional Requirements
Performance at 1000 volumesHigh availability
Security – OWASP top 10
Test Environments
ENV01
Nightly Builds
FunctionalTesting
Defect Testing
ENV02
IntegrationTesting
System Testing
ENV03
SmokeTesting
Non-FunctionalTesting
ENV04
Business Acceptance Testing
Testing Process
Testing Analysis Testing Design Peer Review DoneExecute
ReviewEstimationAddanyfurtherinfo
PositiveNegativeBoundaryvaluesTestscriptsVersioncontrol
ReviewUpdate
Run testsUpdateLog defects
UpdatestatusAddextrainfoLinkdefects
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Mission Statement
To constantly deliver working software that meets customer’s
requirements by means ofproviding fast feedback and
defect prevention, rather than defect detection
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Testing Scope
ApplicationsNon-Functional
Functional
Performance
SecurityApp1
App2
DefectsStories
ChangeRequests
Cross OS
Cross Browser
Cross DeviceTechDebt
Cross-Functional
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Team Makeup
Login&Registration
Payments
Beneficiaries
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Approach: Tools and Techniques
UI
SYSTEM
INTEGRATION
UNIT
ManualAutomated
JiraSelenium
+ve, -ve,Boundary
Approach Tools Techniques
ManualAutomated
JiraSelenium
Business Processes
Automated SOAPUI +ve, -ve
+ve, -veAutomated Junit in IDE
http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//
AgileTestingAndTestAutomation
Out ofScope
ATMIntegration
DebitOrderIntegration
Testing Process
Testing Analysis
Testing Design
Peer Review DoneExecute
ReviewEstimationAddanyfurtherinfo
PositiveNegativeBoundaryvaluesTestscriptsVersioncontrol
ReviewUpdate
Run testsUpdateLog defects
UpdatestatusAddextrainfoLinkdefects
Non-Functional Requirements
Performance at 1000 volumes
High availability
Security – OWASP top 10
Test Environments
ENV01
Nightly Builds
FunctionalTesting
Defect Testing
ENV02
IntegrationTesting
System Testing
ENV03
SmokeTesting
Non-FunctionalTesting
ENV04
Business Acceptance Testing
Mission Statement
Approach: Tools and Techniques
UI
SYSTEM
INTEGRATION
UNIT
To constantly deliver working software that
meets customer’s requirements by means
of providing fast feedback and
defect prevention, rather than defect detection
ManualAutomated
JiraSelenium
+ve, -ve,Boundary
Approach Tools Techniques
ManualAutomated
JiraSelenium
Business Processes
Automated SOAPUI +ve, -ve
+ve, -veAutomated Junit in IDE
Testing Scope
ApplicationsNon-Functional
Functional
Performance
SecurityApp1
App2
DefectsStories
ChangeRequests
Cross-OSCross-BrowserCross-DeviceTechDebt
Cross-Functional
Team Makeup
Login&Registration
Payments
Beneficiaries
Out ofScope
ATMIntegration
DebitOrderIntegration
Non-Functional Requirements
Performance at 1000 volumesHigh availability
Security – OWASP top 10
Test Environments
ENV01
Nightly Builds
FunctionalTesting
Defect Testing
ENV02
IntegrationTesting
System Testing
ENV03
SmokeTesting
Non-FunctionalTesting
ENV04
Business Acceptance Testing
Testing Process
Testing Analysis Testing Design Peer Review DoneExecute
ReviewEstimationAddanyfurtherinfo
PositiveNegativeBoundaryvaluesTestscriptsVersioncontrol
ReviewUpdate
Run testsUpdateLog defects
UpdatestatusAddextrainfoLinkdefects
AgileTestingAndTestAutomation
http://www.unicomlearning.com/2016/Agile_Testing_and_Test_Automation_Johannesburg/
SpeakerName:WayneSinclair
EmailID:[email protected]
OrganizedbyUNICOMTrainings&[email protected]