advanced application integration testing early in the
TRANSCRIPT
Advanced Application Integration Testing Early in the Software Development Lifecycle
Rosalind Radcliffe, Distinguished EngineerChief Architect for DevOps for Enterprise Systems Suman Gopinath, STSMArchitect for zDevOps
22
Modern Development Practices
Analyze
Code Build
Analyze
Feedback,approvals
LEGEND
+
Provision Deploy
CI/CD Pipeline
Monitor ReleasePlan
Test
Note: Starting from the upper left, products and significant
capabilities appear once, the first time they are used in the
pipeline. Products and capabilities are used at
multiple points.
3
What tools and practice does IBM offer to fit in with The Test Pyramid?
Unit test
Application Integration test
The Testing Pyramid
User Acceptance Test
System Test System(Integration, API,UI)
Unit
Application Integration
User Acceptanc
e
Pre-Deployment
Post-Deployment
Unit test
Actual users test the software to ensure the change meets business requirement
Code
Code ChangePersonal build Unit test with ZUnit
BYOI
Build and Test
IDz(Zunit)Wazi VTP
Pre deployment
Unit TestingApplication Integration Test
(Isolated integration test)
Pipeline Build Unit testing with ZUnitAppl Int Test with VTP
IBM Infosphere Optim products
Optim Test data ManagementOptim Test data fabrication
Other Optim products
Prod/Prod-Clone
Test Data
Galasa test automation framework
Provision Deploy
Post deployment
Lpar with deployed App
Test
Rational Test WorkBench (RTW)( RPT, RFT and RIT)
Rational Test Virtualization Server
Build and Execute Functional TestsBuild and Execute Performance TestsBuild and Execute Integration TestsReview and manage test reports
System test User Acceptance Test
End user test
Test
End user test
The Testing Pipeline
CICS Db2
IMS/DB WebSphere MQ
User applications
Configuration File
Collection/Capture Recorded Data
Data from subsystem calls
Data from program interception
Replay
Callouts to optional access points
User applications
Configuration File
Part 1 – Capture or Collection Part 2 – Replay
How Application Integration Tests work with Wazi Virtual Test Platform
Dynamic Test Runner:Record Dynamic Test Runner:Replay
Running Application Integration Tests
Scenario – Everyday development for Business change
Makes application code changes
Creates/modifies Unit Test(zUnit) cases
Runs build with tests and code coverage
Repeats process till changed code is tested and passed
Check in code and tests to the SCM
Has the ability to download & run the transaction level tests from a recording
Deb,The Developer
Verify if mismatches are as expected – If required, re-record
What can Deb verify?• The impact of her change before deployment
• The mismatches that will indicate where the mismatch is – and if that is expected. E.g. Program B gets a mismatch because of a change and Deb expects a mismatch only in Program A and Program D
Code
Code ChangePersonal build Unit test with ZUnit
BYOI
Build and Test
IDz(Zunit)Wazi VTP
Pre deployment
Unit TestingApplication Integration Test
(Isolated integration test)
Pipeline Build Unit testing with ZUnitAppl Int Test with VTP
IBM Infosphere Optim products
Optim Test data ManagementOptim Test data fabrication
Other Optim products
Prod/Prod-Clone
Test Data
Galasa test automation framework
Provision Deploy
Post deployment
Lpar with deployed App
Test
Rational Test WorkBench (RTW)( RPT, RFT and RIT)
Rational Test Virtualization Server
Build and Execute Functional TestsBuild and Execute Performance TestsBuild and Execute Integration TestsReview and manage test reports
System test User Acceptance Test
End user test
Test
End user test
The Testing Pipeline