how devops was killing test automation...how devops was killing test automation vincent wijnen...

How DevOps Was Killing Test

Automation

Vincent Wijnen

Sogeti, Netherlands.

Test Automation?

Automated execution of testcases to verify the quality of delivered software

DevOps & Test Automation

Testing QualityDelivered Software

Development

DevOps Team

How does Test Automation look?

Which one was from a Test Automation Engineer?

DevOps Team

PO Dev

Engineers

Ops

Engineers

Test

Engineers

Scrum

Master

TATA

AdaptersPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Core FunctionalityPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Payment EnginesPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Database & PlatformPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Test Automation

≠

Automated Testing

Test Tooling as API Traditional TA Tools TA for Everyone

± 1 year ± 6 months± 2 years

Business Dev Test Operations

Production

Business Dev Test Operations

Production

AdaptersPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Core FunctionalityPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Payment EnginesPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Database & PlatformPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

DevOps Team

PO Dev

Engineers

Ops

Engineers

Test

Engineers

Scrum

Master

TATA

DevOps Team

PO Dev

Engineers

Ops

Engineers

Test

Engineers

Scrum

Master

ATATAT AT AT AT AT AT

Payment EnginesPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

Database & PlatformPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

AdaptersPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

Core FunctionalityPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

Where does Test Automation go?

Focus & Scope

Normal DevOps Team Test Automation DevOps Team

Live Environment

Low Quality

End Users

Distance to End Users

Production Test

Production Incidents Reduced Velocity

Clients Normal DevOps Teams

High None

Focus

KPI

New Feature Hotfix Stability Performance

Test Automation

Perf. Testing Test DataDeployment Automation

ToP

rod

uct

ion

To T

est

Bu

sin

ess

Fac

ing

Team

Fac

ing

Focus

Scope

Dev Test Ops TA

1 Sprint

Scope

Dev Test Ops TA

Scope

Dev Test Ops TA

Scope

Dev Test Ops TA

Scope

Dev Test Ops TA

Scope

Dev Test Ops TA

DevOps Team 1 DevOps Team 2 DevOps Team 3 DevOps Team 4

Test Automation Team

PO Ops

Stories

Test Automation Software

Payment EngineMainframe Order Manager

TA Guild

Copyrights: Martin Fowlerhttps://martinfowler.com/bliki/TestPyramid.html

Question Time!

Scaling Cost Governance Work Distribution

Tooling Choice CD / CI Required SkillsetApproach to Test

Automation

Vincent Wijnen+31650853457vincent.wijnen@sogeti.com

Team Roles Guilds Testing Pyramid