agile test strategy - final - testing in south africa · testing env02 integration testing system...

23
Location : Johannesburg Date : 26 May 2017 Name of the Speaker : Wayne Sinclair waynesinclair.co.za @Tester_RSA Company Name : ThoughtWorks http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg// Agile Test Strategy for Digital Assurance

Upload: others

Post on 22-May-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Location: Johannesburg

Date:26May2017

NameoftheSpeaker:WayneSinclair

waynesinclair.co.za @Tester_RSA

CompanyName:ThoughtWorks

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

Agile Test Strategy for Digital Assurance

Page 2: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Why a Test Strategy?

• Establishes plan of action, long term

• It’s actually intended to drive quality thinking and testing activity

across the entire agile team.

• Determines customer expectations

• Understanding, best practices, structured

• Information Radiator

• Static, but evolving.

• Across projects

Page 3: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Before

Awaiting Test In Test Test CompleteStory 4 Story 2 Story 1Story 5 Story 3Story 6

Page 4: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

AfterDev

Done In Test Awaiting Test In Test Test Done Performance Testing

Story 4 Story 2 Test Data Story 1Story 5 Functional

Exploratory

E2E

Integration

Analytics

Cross Device

Cross Browser

Regression

PO

Story 3

Page 5: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

The Big Shift

QA

Shift Up

Shift RightShift Left

Shift Down

Page 6: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

ITAutomationSummit2016

AgileTestingAndTestAutomation

???

Page 7: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Loyalty

Progress

LoyaltyLoyalty

Page 8: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Manifesto for Agile Software Development

Individuals and interactions over processes and tools

Working software over comprehensive documentation

Customer collaboration over contract negotiation

Responding to change over following a plan

Page 9: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

CoreTesting

SMAC

IOT

Multi-Channel

DigitalContent/DigitalMedia

Customer Sentiment Analysis

(A/B Testing)

BusinessProcessValidation

QualityAttributes

ValueChainAssurance

https://www.slideshare.net/CAinc/digital-assurance-develop-a-comprehensive-testing-strategy-for-digital-transformations

Page 10: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Manifesto for Agile Software Development

Individuals and interactions over processes and tools(Created by team, foundational)

Working software over comprehensive documentation(Guide, outline)

Customer collaboration over contract negotiation(Adjust, based on collaboration)

Responding to change over following a plan(Not fixed, roadmap, guide, baseline, but allows flexibility)

Page 11: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Mission Statement

Approach: Tools and Techniques

UI

SYSTEM

INTEGRATION

UNIT

To constantly deliver working software that

meets customer’s requirements by means

of providing fast feedback and

defect prevention, rather than defect detection

ManualAutomated

JiraSelenium

+ve, -ve,Boundary

Approach Tools Techniques

ManualAutomated

JiraSelenium

Business Processes

Automated SOAPUI +ve, -ve

+ve, -veAutomated Junit in IDE

Testing Scope

ApplicationsNon-Functional

Functional

Performance

SecurityApp1

App2

DefectsStories

ChangeRequests

Cross-OSCross-BrowserCross-DeviceTechDebt

Cross-Functional

Team Makeup

Login&Registration

Payments

Beneficiaries

Out ofScope

ATMIntegration

DebitOrderIntegration

Page 12: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Non-Functional Requirements

Performance at 1000 volumesHigh availability

Security – OWASP top 10

Test Environments

ENV01

Nightly Builds

FunctionalTesting

Defect Testing

ENV02

IntegrationTesting

System Testing

ENV03

SmokeTesting

Non-FunctionalTesting

ENV04

Business Acceptance Testing

Testing Process

Testing Analysis Testing Design Peer Review DoneExecute

ReviewEstimationAddanyfurtherinfo

PositiveNegativeBoundaryvaluesTestscriptsVersioncontrol

ReviewUpdate

Run testsUpdateLog defects

UpdatestatusAddextrainfoLinkdefects

Page 13: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Mission Statement

To constantly deliver working software that meets customer’s

requirements by means ofproviding fast feedback and

defect prevention, rather than defect detection

Page 14: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Testing Scope

ApplicationsNon-Functional

Functional

Performance

SecurityApp1

App2

DefectsStories

ChangeRequests

Cross OS

Cross Browser

Cross DeviceTechDebt

Cross-Functional

Page 15: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Team Makeup

Login&Registration

Payments

Beneficiaries

Page 16: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Approach: Tools and Techniques

UI

SYSTEM

INTEGRATION

UNIT

ManualAutomated

JiraSelenium

+ve, -ve,Boundary

Approach Tools Techniques

ManualAutomated

JiraSelenium

Business Processes

Automated SOAPUI +ve, -ve

+ve, -veAutomated Junit in IDE

Page 17: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

http://www.unicomlearning.com/2017/Agile_Testing_and_Test_Automation_Johannesburg//

AgileTestingAndTestAutomation

Out ofScope

ATMIntegration

DebitOrderIntegration

Page 18: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Testing Process

Testing Analysis

Testing Design

Peer Review DoneExecute

ReviewEstimationAddanyfurtherinfo

PositiveNegativeBoundaryvaluesTestscriptsVersioncontrol

ReviewUpdate

Run testsUpdateLog defects

UpdatestatusAddextrainfoLinkdefects

Page 19: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Non-Functional Requirements

Performance at 1000 volumes

High availability

Security – OWASP top 10

Page 20: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Test Environments

ENV01

Nightly Builds

FunctionalTesting

Defect Testing

ENV02

IntegrationTesting

System Testing

ENV03

SmokeTesting

Non-FunctionalTesting

ENV04

Business Acceptance Testing

Page 21: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Mission Statement

Approach: Tools and Techniques

UI

SYSTEM

INTEGRATION

UNIT

To constantly deliver working software that

meets customer’s requirements by means

of providing fast feedback and

defect prevention, rather than defect detection

ManualAutomated

JiraSelenium

+ve, -ve,Boundary

Approach Tools Techniques

ManualAutomated

JiraSelenium

Business Processes

Automated SOAPUI +ve, -ve

+ve, -veAutomated Junit in IDE

Testing Scope

ApplicationsNon-Functional

Functional

Performance

SecurityApp1

App2

DefectsStories

ChangeRequests

Cross-OSCross-BrowserCross-DeviceTechDebt

Cross-Functional

Team Makeup

Login&Registration

Payments

Beneficiaries

Out ofScope

ATMIntegration

DebitOrderIntegration

Page 22: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

Non-Functional Requirements

Performance at 1000 volumesHigh availability

Security – OWASP top 10

Test Environments

ENV01

Nightly Builds

FunctionalTesting

Defect Testing

ENV02

IntegrationTesting

System Testing

ENV03

SmokeTesting

Non-FunctionalTesting

ENV04

Business Acceptance Testing

Testing Process

Testing Analysis Testing Design Peer Review DoneExecute

ReviewEstimationAddanyfurtherinfo

PositiveNegativeBoundaryvaluesTestscriptsVersioncontrol

ReviewUpdate

Run testsUpdateLog defects

UpdatestatusAddextrainfoLinkdefects

Page 23: Agile Test Strategy - Final - Testing in South Africa · Testing ENV02 Integration Testing System Testing ENV03 Smoke Testing Non-Functional Testing ENV04 Business Acceptance Testing

AgileTestingAndTestAutomation

http://www.unicomlearning.com/2016/Agile_Testing_and_Test_Automation_Johannesburg/

SpeakerName:WayneSinclair

EmailID:[email protected]

OrganizedbyUNICOMTrainings&[email protected]