introducing ibm rational's new integration testing and...
TRANSCRIPT
Introducing IBM Rational's New Integration Testing and Virtualization Solution
Pallavi Bhosale
Client Technical Specialist, Software Quality
© 2012 IBM Corporation 2
The Premier Event for Software and Systems Innovation
2
Balancing
Quality and Speed
Increasing
Cost of Quality
Increasing
Development Complexity
What is driving the need for a change?
* Source:http://www.sei.cmu.edu/about/message/
Heterogeneous Environments
Public Cloud Private Cloud
Data Warehouse Mainframe Enterprise Service Bus
Directory Identity
File systems
Collaboration
Web/ Internet
Routing Service
Third-party Services Portals
Content Providers
EJB
Shared Services Archives
Business Partners
Messaging Services
Traditional
Testing
Other costs
Testing costs
30-50% The average amount of time
testing teams spend on setting up
test environments, instead
of testing c
13% The forecasted increase
in wages for India IT
workforce in 2011a
$5-30 million The typical investment to build
a single test lab for a Fortune 500
company. Most have dozens b…
© 2012 IBM Corporation 3
The Premier Event for Software and Systems Innovation
As the Role of Testing is Changing…
Techniques to make Your Testing more agile
© 2012 IBM Corporation 4
The Premier Event for Software and Systems Innovation
Technique #1: Continuous and Incremental Integration Testing
Integration Testing: The ability to Test your application across all
components/service boundaries
– Injecting stimuli and check reactions and side effects, validating that
components/services meet specifications
Test components at the API level – reduce delays (no need to wait for UI)
Benefits of Continuous Integration Testing
Earlier and less costly defect detection
Accelerated resolution
Reduction of overhead (defect raising, prioritization) for regression issues
Full approach enables parallel development of components with minimal
integration issues
© 2012 IBM Corporation 5
The Premier Event for Software and Systems Innovation
Technique #2: Virtualization Physical Test Environment
Database / JDBC
Server/ Web Services
Mainframe / MQ/CICS
Smart Device / SD-IO System Under Test
© 2012 IBM Corporation 6
The Premier Event for Software and Systems Innovation
Technique #2: Virtualization Virtual Test Environment
[Server]/ Web Services
[Mainframe] / MQ/CICS
[Smart Device] / SD-IO System Under Test
[Database] / JDBC
© 2012 IBM Corporation 7
The Premier Event for Software and Systems Innovation
Benefits of Test Virtualization
Personal Integration Environments
Remove dependencies on other applications through virtualization – avoid late stage integration issues
Deliver testing environments in minutes instead of days
Power in the hands of the testers
Reduction in need for application domain skills
Visibility
Lack of reliance on individual developer or tester
Delays reduced waiting for development resource
Standardization
© 2012 IBM Corporation 8
The Premier Event for Software and Systems Innovation
Continuous Integration Testing with Test Virtualization
C1 C2 C3 ERP WSDL 3rd party EJB Pass/Fail Time
Real V V V Test my
own piece
By SUT I also mean custom code…
• Integration Testing requires components that may not be ready/available yet, or expensive to use - Test Virtualization enables replacing them with a virtual component.
• Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion.
Example:
• Test C1 with three virtualized services.
• Can use simple or complex integration scenarios.
• Quick to setup and low-cost.
© 2012 IBM Corporation 9
The Premier Event for Software and Systems Innovation
Continuous Integration Testing with Test Virtualization
Pass/Fail Time
Real V V V
Real V V V R
Test my
own piece
Integrate
w/another
• Integration Testing requires components that may not be ready/available yet, or expensive to use - Test Virtualization enables replacing them with a virtual component.
• Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion.
• Integrate with C2…
• Can use more complex integration scenarios.
• Quick to setup and low-cost.
• OOPS !
C1 C2 C3 ERP WSDL 3rd party EJB
© 2012 IBM Corporation 10
The Premier Event for Software and Systems Innovation
Continuous Integration Testing with Test Virtualization
Pass/Fail Time
Real V V V
Real V V V R
Real V V V V
Test my
own piece
Integrate
w/another
This won’t
slow me down!
• Integration Testing requires components that may not be ready/available yet, or expensive to use - Test Virtualization enables replacing them with a virtual component.
• Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion.
• C2 introduced some defects – replace it with a virtual service!
• A defect in C2 doesn’t stop testing of those who depend on it!
• Quick to setup and low-cost.
C1 C2 C3 ERP WSDL 3rd party EJB
© 2012 IBM Corporation 11
The Premier Event for Software and Systems Innovation
Continuous Integration Testing with Test Virtualization
Pass/Fail Time
Real V V V
Real V V V R
Real V V V V
Real V V V V V V
Test my
own piece
Integrate
w/another
This won’t
slow me down!
First Complete
System Test
• Integration Testing requires components that may not be ready/available yet, or expensive to use - Test Virtualization enables replacing them with a virtual component.
• Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion.
• First complete system test: Everything but C1 is Virtual!
• Enables Testing with enterprise integration scenarios.
• Add testing scenarios to Build Verification Testing (BVT)
• Quick to setup and low-cost.
C1 C2 C3 ERP WSDL 3rd party EJB
© 2012 IBM Corporation 12
The Premier Event for Software and Systems Innovation
Continuous Integration Testing with Test Virtualization
Pass/Fail Time
Real V V V
Real V V V R
Real V V V V
Real V V V V V V
Real V V V V R R
Test my
own piece
Integrate
w/another
This won’t
slow me down!
First Complete
System Test
All SUTs –
Integrated!
• Integration Testing requires components that may not be ready/available yet, or expensive to use - Test Virtualization enables replacing them with a virtual component.
• Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion.
• Integrate C2 and C3… with virtualized backend systems
• Use enterprise integration scenarios for Testing, inc BVT!
• Quick to setup and low-cost.
C1 C2 C3 ERP WSDL 3rd party EJB
© 2012 IBM Corporation 13
The Premier Event for Software and Systems Innovation
Continuous Integration Testing with Test Virtualization
Pass/Fail Time
Real V V V
Real V V V R
Real V V V V
Real V V V V V V
Real V V V V R R
Real R R V V R R
Real R R R R R R
Test my
own piece
Integrate
w/another
This won’t
slow me down!
First Complete
System Test
All SUTs –
Integrated!
The expensive
backend
All Systems UP!
By SUT I also mean custom code…
• Integration Testing requires components that may not be ready/available yet, or expensive to use - Test Virtualization enables replacing them with a virtual component.
• Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion.
• Gradually integrate with expensive backend
systems.
• Minimize use of backend systems for testing
purposes
• Process offers easy and cost effective defect
isolation
C1 C2 C3 ERP WSDL 3rd party EJB
© 2012 IBM Corporation 14
The Premier Event for Software and Systems Innovation
14
You’ve heard…. IBM Rational Acquired Green Hat !
Green Hat VIE is a server solution that:
– Provides a central environment to virtualize heterogeneous
hardware, software and services to provide 24x7 testing capabilities
– Reduces infrastructure costs of traditional testing
environments
Green Hat Tester is a desktop solution that
enables testers/developers to:
Capture and model virtual services
Test services and applications before their user interfaces
becomes available and do integration testing
Combined with IBM Quality Management solutions, Green Hat capabilities
dramatically improve Agile Development:
– Improve development and test cycle time by making test environments readily available
– Share test environments across teams enabling parallel development
– Employ traceability and collaborate in-context across development domains
© 2012 IBM Corporation 15
The Premier Event for Software and Systems Innovation
15
Test Virtualization with Green Hat
Virtual Services can be created from
– Service specifications or,
– From recording actual traffic to existing
services/applications
Virtual Services can be further customized
– To simulate simple to complex behaviors (e.g.
negative testing)
– To simulate latency, performance profiles, etc.
Virtual Services are published for consumption by
developers, testers
– Testing can start earlier: Testers can now create
their tests against virtual services
– Systems can be incrementally tested as sub-
systems become available
Virtual
Virtual
© 2012 IBM Corporation 16
The Premier Event for Software and Systems Innovation
Accelerate test development
Synchronize your test project
with your application
environment
Create an architectural view of
your system to accelerate the
development of test assets
Supported resources include
WSDL, webMethods
Integration Server, TIBCO
BusinessWorks, SAP systems,
and Oracle Fusion
© 2012 IBM Corporation 17
The Premier Event for Software and Systems Innovation
Code-free Test Development
Create tests using
– Recorded messages from a live system
– Message ‘requirements’ defined in the
project architecture
– Forms and wizard-driven UI
Build your own transports and
formatters to deal with your
project’s custom messages
Leverage our library of industry
standards for SWIFT, IATA, EDI,
HL7 and more
© 2012 IBM Corporation 18
The Premier Event for Software and Systems Innovation
Flexible Test Execution
Isolate test execution focusing on
specific areas of your composite
application
Monitor events and messages in
real-time for troubleshooting
Repair Wizard helps correct
validation errors
Command line execution enables
integration with build environments
and other systems
Integrates with Rational Quality
Manger (oh, and HP Quality Center
too)
© 2012 IBM Corporation 19
The Premier Event for Software and Systems Innovation
Assess System Performance
Reuse integration tests to develop
real-world load scenarios
Examine system health through a
variety of probes
Combine performance
measurements with probe data to
identify performance bottlenecks
© 2012 IBM Corporation 20
The Premier Event for Software and Systems Innovation
Create Virtualized Test Environments
Code-less virtualized applications
help eliminate test dependencies
Create virtualized services from
your exiting test messages
Centrally manage virtualized
applications for each environment
Make changes without having to
modify the system under test
Enable earlier testing across all
phases of development
© 2012 IBM Corporation 21
The Premier Event for Software and Systems Innovation
21
Supported Integration Environments & Technologies
• ActiveMQ
• Email (SMTP, IMAP)
• Files
• FTP/S
• HTTP/S
JMS (JBOSS et al)
IBM WebSphere MQ
• JBoss MQ
• SAP IDoc, BAPI, RFC & XI/PI
• Software AG’s IB & IS
• Solace
• Sonic MQ
• TCP
TIBCO Rendezvous, Smart
Sockets & EMS
• Custom
• CentraSite
• Oracle Fusion
• SCA Domain
• Software AG IS, BPMS
• Sonic ESB
• TIBCO ActiveMatrix
• UDDI
• Web Services
• WebSphere RR
• WSDL
• BPM
• Databases
• Log Files
• .Net Objects
• Bytes
• COBOL Copybook
• ebXML
• EDI
• Fixed Width
• HL7
• IATA
• Java Objects
• MIME
• OAG
• SOAP
• Software AG Broker Docs
• SWIFT
• TIBCO ActiveEnterprise
• XML (DTD, XSD, WSDL)
• Custom
Messaging Protocols SOA, ESB, Others Message Formats
© 2012 IBM Corporation 22
The Premier Event for Software and Systems Innovation
22
Green Hat Test virtualization capabilities extend IBM Application Lifecycle Management
Application Lifecycle Management
Defect and Change
Management Rational Team Concert
Quality Management Rational Quality Manager
Requirements Management Rational Requirements
Composer
IBM Rational Solution
for Collaborative Lifecycle Management
Trace test execution to defects
Trace test execution
to defects
Manage test
automation
Analyst Developer Quality Professional
Deployment Engineer Project Manager
Architect
Administration and Configuration
Console
GH Tester
IBM Services
Virtual Integrated Environment GH VIE
© 2012 IBM Corporation 23
The Premier Event for Software and Systems Innovation
IBM Rational Test Automation Solutions
IBM Rational Test Workbench End-to-end functional, integration, and
performance testing throughout your
integration project lifecycle
IBM Rational Performance
Test Server
Service and application-level performance
testing for your integrated application
environment
IBM Rational Test
Virtualization Server
Leverage application virtualization to
increase agility and deliver cost-effective
24x7 test environments
© 2012 IBM Corporation 24
The Premier Event for Software and Systems Innovation
For more information
To learn more about IBM Rational software quality solutions, please contact your IBM sales
representative or IBM Business Partner, or visit:
http://www.ibm.com/software/rational/offerings/quality
See also:
IBM Rational Test Workbench: http://www.ibm.com/software/rational/products/rtw
IBM Rational Performance Test Server: http://www.ibm.com/software/rational/products/rpts
IBM Rational Test Virtualization Server: http://www.ibm.com/software/rational/products/rtvs
© 2012 IBM Corporation 25
The Premier Event for Software and Systems Innovation
www.ibm.com/software/rational
© 2012 IBM Corporation 26
The Premier Event for Software and Systems Innovation
© Copyright IBM Corporation 2012. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.
www.ibm.com/software/rational