Leverage Service Virtualization on Your Roadmap for Success
Kazi Whitfield
DevOps: API Management and Application Development
MUFG Union Bank
Director of Quality Engineering
DO3T23S
#CAWorld
2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation
3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
Development and testing tool choices can be overwhelming. What tools are the right tools? When to use them? When not? This session will be a review of how organizations can take on the challenges of overcoming development and testing constraints while being able to keep or improve timelines. Session discusses service virtualization implementation models, proper success measurements, challenges addressed and achievable successes.
KaziWhitfield
MUFG Union Bank
Director of Quality Engineering
4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
QA CAPABILITIES & GOALS
DEFINE THE PROBLEM
Q & A
CLEAR ENGAGEMENT MODEL
CHALLENGE AND RESULTS
CA TEST CASE OPTIMIZER USERS
1
2
3
4
5
6
5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
QA Capabilities
Portal development; metrics analysis BUSA intake/fulfillment solutions Developing custom testing solutions Middleware solutions to integrate
w/vendor products
Issue coordination & resolution Configuration management More availability Less defects on environments
Metrics scorecard Defect Analysis Working early in the SDLC phases IMR RCA Compliance/ Develop Standards/practices Process Improvements Testing/QA expertise Tools evaluation
QA organization addressed development needs to improve it’s project delivery process by improving the quality, lowering the cost and shortening the timeline of development. The focused services provided results in improved availability of production environments and greater release velocity.
Test Management
Functional Testing
Test Data Management &
Automation
Tools & Capabilities
Test Environment Management
Quality Assurance
Centralized Quality
Functional automation Performance testing SOA testing Utility tools development Test Data coordination Test Data Bed creation
AT Support SIT testing +ve & -ve test scenarios Regression testing Integration testing UAT support
Test Strategy Definition Test Planning Risk Based Analysis Traceability matrix Clarity management Reporting/Risk management/ coordination within stake holders
7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
All These Terms
Disruptive Thinking
A g i l e
Kan
ban
Continuous Integration
Continuous Delivery
DevOps
Au
tom
atio
n
Del
iver
y Tr
ansf
orm
atio
n
Configuration Management
Iterative DevelopmentP i p e l i n e
Service Virtualization
A3
Pro
cess
Time to market
Met
rics
Lean Thinking
Pro
cess
Flo
w
Qu
alit
y
S h i f t L e f t
8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Define the Problem
Constraints of dependent systems needed to move the SDLC forward
Increasing Complexity of today’s heterogeneous enterprise IT architectures
Lack of Collaboration creates scheduling conflicts and buffers from development through operations
Need Complete visibility into what happens in production
11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Clear Engagement ModelP
roje
ct T
eam
SV T
eam
Request SV services through GSQO Engagement
DB
Review discovery documentation submitted
by project
Set up Feasibility Meeting with Project Team
Feasibility Meeting to understand SV
requirements, complexity of requirements and
finalize scope
Create SV sizing and send to PM
Obtain alignment from QA & SA to use SV on project
PM Approves SV sizing
Plan for service virtualization & setup
Deploy services and communicate setup ready
for validation
12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Clear Engagement Model
-
1,000,000
2,000,000
3,000,000
4,000,000
5,000,000
6,000,000
7,000,000
8,000,000
9,000,000
0
1000000
2000000
3000000
4000000
5000000
6000000
7000000
8000000
9000000
Jan-14 Feb-14 Mar-14 Apr-14 May-14 Jun-14 Jul-14 Aug-14 Sep-14 Oct-14 Nov-14 Dec-14 Jan-15 Feb-15 Mar-15
2014 Total – $6,961,471
2015 Q1 Total - $7,417,622
Virtual Services Transaction count – Time graph
13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Challenge #2
56% of software defects can be traced back to ambiguities in requirements
Detecting and resolving production defects is over 40x more expensive than in requirements
Industry standard for manual test case design coverage is between 10-20%
Over-testing of some functions by factors of 40 is not uncommon
Change requests to existing software requirements can take up to as much as 60% of the SDLC
If I make a change I have no idea the effect this will have on up stream or downstream systems
14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Results
Requirements 30% improvement
Test Case Creation Time 95% reduction
Functional Coverage 80% improvement
Over Testing 4 times reduction
Change Request 90% reduction in the time spent manually editing existing test cases
Cost Savings per Project 20 to 30% - varies by complexity of the projects
Quality 100% functional test coverage
CA Test Case Optimizer enables testers to create better test cases directly from requirements faster
Requirement Test Cases Design Time % Coverage % Over Testing
Test Cases Design Time % Coverage % Over Testing
Waterfall Project 1 14 5:00 16% 0% 17 2:00 100% 0%Agile Project 1 40 4:00 100% 1029% 8 0:30 100% 0%Waterfall Project 2 150 5:00 80% 1900% 19 0:50 100% 0%Agile Project 2 3 4:00 5% 0% 12 0:30 100% 0%
207 18:00 56 3:50
Baseline Agile Designer
15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Who Would use CA Test Case Optimizer
Business Users
Business Analyst
Programmers Testers Outsourcing Partners
Clearly define a process as they think of it
Define the process, which will be verified by the user, create logic flows for programmers and test cases for testers
Verify the process with the Business Analyst before coding and Testers with test cases
Quickly define functional logic flows and verify them with the Programmer, as well define the smallest set of test cases to verify the program
Get stable requirements and clearly defined work packages, which result in lower ongoing costs
17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO4T05S The CA Roadmap for Test Data Management 11/18/2015 at 1:00 pm
DO3T06SThe CA Roadmap for Service Virtualization and the Dev
and Test Portfolio11/18/2015 at 2:00 pm
DO3T24SAccelerate DevTest with Microsoft® Azure™ and Service
Virtualization on Demand11/19/2015 at 3:00 pm
18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
Test Data ManagementEmbrace Test Data Management
Theater 4
DevOps Sim
DevOps Simulation Experience
Theater 3
Continuous App InsightAutomate Tests for Better Apps
Theater 4
Service VirtualizationDeliver Better Apps Faster with SV
Theater 3
19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Follow On Conversations At…
Smart Bar
Theaters 3 & 4
Tech Talks
Theaters 3 & 4
20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15