CSC Proprietary and Confidential 1

Testing as a Service - New Realities and Perspectives to address Quality

and Agility challenges in BFSI Testing

Amiruddin Syed Mohammed

CSC Proprietary and Confidential 2

BFSI Test Offerings

Regulatory & Compliance

Integration with Channel Partners / 3rd Party Systems

Security – Application / Network / Data

Migrations, Conversions, Consolidations & Legacy Modernization

Global Adaptations

Data Warehousing / BI

The Sectoral Challenge

BFSI Corporate strategies…

Mergers &

AcquisitionsInnovative Products

New

TechnologiesMarket Concentration

and Globalization

…Sectoral challenges…..

CSC Proprietary and Confidential 3

The Need : Do More with Less

Business and Operational Risk

Security, audit and reporting requirements

Functionality, Non-functionality, Predictability and

Reliability

Assurance of External & Internal Quality

Lower TCOMove from CAPEX to OPEXPredictability of Testing and software costsScalable resources and Economies of scaleEliminate Overhead cost on under-used capacityStandardization through industrialized service delivery

ROI and Cost Control

Market Agility and Responsiveness

Faster time to market for New products and services

Realize benefits from Distruptive and Emerging technologies ( Cloud, Mobile , etc)

Empower business with modernized applications

New ways to collaborate with customers & partners

New business models

CSC Proprietary and Confidential 4

So What is Testing as a Service (TaaS)?

Testing of IT applications ( Custom, Enterprise, Business apps) leveraging Cloud for virtualized , scalable ,on-demand test labs that provide self-

provisioning and management of multi-platform environments. These are similar to traditional 3rd-party testing services such as dedicated testing centers of

excellence but executed and managed in Cloud based.*

• Testing tools

• Test scripts

• Test standards

• The work flow

• The standard applications that are being tested (like SAP or Oracle or point solution)

• Test metrics

• The test environment (Platform, architecture and the applications them selves)

What is Same….

What is New….

• Complete utility model for platform, test experts and tools

• Predictable End-to-end cost

• Access to variety of tools.. In some cases more test coverage because of multiple tools testing

• One stop solution possible for all testing .. Option to change the tools selection, when not satisfied (Try and use)

• Verify architectural / design level – using new generation performance tools – before going live.

* Adapted from IDC definition of TaaS

CSC Proprietary and Confidential 5

Overview of ‘ As a Service ‘ from a Testing point of view

• Functional Testing as a Service• Performance Testing as a

Service • Mobile Testing as a Service• Test Automation as a Service • Security Testing as a Service • .......

• Test Environment (Servers / Desktops/ Configurations)on demand to support

• New Develpment / Enhancement • Patches / Hot Foixes • Migrations / Upgrades

• ASQ Tools in alternate licensing models • Test Management Tools • Automation tools • Performance Testing tools • LCQM tools• Open Source Tools

Capability-as-a-Service (CaaS)

Software as a Service (SaaS)Platform-as-a-Service (PaaS)

CaaS

PaaS SaaS

Testing

CSC Proprietary and Confidential 6

How is TaaS different from Traditional Testing Models ?

Labour Arbitrage as key lever Business Value + Cost Reduction as key lever

Craftsman Approach Industrialized

Input based pricing Output / Outcome based pricing

Rigid Flexible and Scalable on Demand

Testing seen as a tactical activity Testing seen as a strategic enabler

Limited collaboration with ASQ partners

High on collaboration with ASQ partners

Resource ( People ) focus Services ( Assets) focus

A paradigm market shift underway — from labour arbitrage and process efficiency to service arbitrage and business assurance

Traditional Testing TaaS

CSC Proprietary and Confidential 7

Insurance

On-Demand Resourcing

Output Based Pricing

Service Performance

Metrics

Global Process Framework

Reusable Asset

Repository

SHAPE - Test Process Management

-Cloud Enablement Mobility

Choice of Engagement & Global Delivery Models with alternative Pricing Options

Virtual Teams using Collaboration tools & platforms

Alliances - VMWare , Citrix , IBM Rational, HP Mercury, Segue, Compuware, Work soft, and ITKO

Pay as you go Service arbitrage

Ubiquitous Access Geography independent

Sourced on DemandImproved utilization

Elastic Usescale-up / scale-down

Enhanced Quality Faster time to market

TRANSFORM

- Hybrid TCoE - Web Apps. Perf. Testing

- Cloud Certification

MANAGE Industrialized Testing Services

Functional Testing Non Functional Testing

ERP Testing Specialized Validation

Key drivers for testing in cloud

Banking and Financial Services

CLOUD LAB

Testing Offerings

TaaS in Cloud for BFSI – SHAPE , TRANSFORM and MANAGE your portfolio

Business Drivers • Pressure to reduce operational

spending• Faster time to market

• Emergence of global workforce • Meet dynamic resource requirements

• Move towards variable cost structure for testing services and even ASQ tools

IT Drivers• Need to support strategic initiatives

• Multi-site delivery and 24X7 operations • Focus on first-time-right

• High incidence of production issues and higher cost of rework

• Keep pace with technology

CSC Proprietary and Confidential 8

Platforms

Windows (Multilingual, Multi CPUs)

Linux (Red hat, Linux, Debian)

MS-SQL. Oracle, DB2, Informix, MySQL,

TeradataSun Solaris

Elastic servers (Tomcat, My

SQL combinations)

Mobile Platform simulators

Borland ES, Cold fusion, Tomcat, Web logic, Web

Sphere, Web Application server

(SAP), ATG Dynamo, JBOSS

Tools Sandbox

Apps& Services

Client / Server

Enterprise Applications – SAP, Oracle,

Cadence, PTC, Sugar CRM

Web Applications

Service Virtualization

SAAS (Software as a Service)

Functional Testing Non Functional Testing Mobile Testing

Cloud Certification

TaaS Ecosystem – A snapshot

CSC Proprietary and Confidential 9

CustomerTest Requirements &

Application

Components

TaaS in Cloud

FTP / URL / VPN

Cloud lab

Database serversWeb Server Application Servers

Application Under Test

Automated Software Quality Tools

Infrastructure Stabilization

Test Strategy & Planning

Test Execution Test Summary Reports

Certify Application

Customer requests Testing from

Provider

Provisioning / Scheduling of Tests

Provider conducts Testing

Provider publishes Test Results &

Reports

Collaboration

Customer

Sign-off

Cloud Orchestration

Provider

Customer

Provider & Customer

Mobile SimulatorsService virtualization

Provider

TaaS – Delivery Model

CSC Proprietary and Confidential 10

Traditional Testing Vs TaaS Comparisons

TraditionalLab

TestPlanning

Test Case/DataDevelopment

ConfigureEnvironment

TestExecution

ResolveDefects

Dramatic reduction in test cycle time Significant reduction in total cost of operation

TestPlanning

Test Case/DataDevelopment

ConfigureEnvironment

TestExecution

ResolveDefects

Config. 1

Config. 2

TaaS – Cloud Lab

Test Pass 1 Test Pass 2

Config. 1

Config. 2

CSC Proprietary and Confidential 11

The Challenge

– Concerns on Security in Cloud

– Lack of Test Environment management expertise

– In efficient test automation

– Beyond Testing – complimentary services ( ADM etc)

– Evaluating the right tools

– Lifecycle quality management

– Integration with non-virtualizable components

– Additional Skills for Testers

CSC Proprietary and Confidential 12

Critical factors an enterprise should consider while evaluating test vendors for TaaS

• TaaS is evolving – hence Providers should offer customers flexible buying options – discrete vs bundled

• High Value Test assets owned by the provider – reusable assets, accelerators and frameworks

• Technical resource expertise in test automation • Lifecycle quality management tools and capabilities • Experience managing Security of data and TaaS environment • SLA based delivery • Automatic backup and recovery • Dashboards and tracking tools • Larger portfolio of offerings – benefit from ADM , SOA, Security offerings

CSC Proprietary and Confidential 13

Building Roadmap Towards TaaS

Phase 1

Phase 2

Phase 3

Cloud Testing Strategy

Pilot first application on Cloud

Cloud Testing Services

• Cloud Testing assessment • Detailed transition Plan identifying priority applications • Identify test types – functional, automation ,

performance, security ….

• Set up Cloud environment• Carry out Proof of Concept • Enhance Cloud Testing framework based on Pilot

results

• Replicate for other applications • Optimize tools and licenses• Extend to other testing types • Measurement & Ongoing Improvements

Sh

ape

Tran

sfo

rmM

anag

e

CSC Proprietary and Confidential 14