SV-SAP Test Cases

From Design to ProductionPracticing what we preach at HP

Shane Evans Product ManagerOded Keret Functional Architect#DesignDevelopFunctional/UXDeliveryMonitoringSecurityPerformanceModern App LifecycleReuse Unit Tests throughoutAutomate test execution and analysisReuse test scripts for monitoringCapture Real User behavior/conditionsVirtualize Services for ease of deploymentLeverage virtual services and network for realistic results#2AUT #1 HP TruClient#Demo#Challenges#Strategies#

#

#Additional tools#How would you test such a tool?#CI System Flow2. Report resultsCode

Code

Commit

Build

Build:Get latest codeCompileRun Unit testsVerifyDeployRun Automation tests1. Execute relevant test bundleTestTruClient Service detects new build available

Report

#Core Bundle quick executionCore

Execute a small bundle of scripts to test only core functionalities.Launching multiple browser processes (IE/FF/Chrome) to execute all scripts in a short time (200 scripts in under 3 minutes)We can easily scale up more browsers to reduce test timeBundle is executed for each code change#Core BundleCore

#Nightly BundleExecute a large number of scripts to cover the entire product (UI, API,Core, and more).Bundle is executed every 3 hours (time interval can be configured).Can launch multiple browser processes (IE/FF/Chrome) to execute all scripts in a short timeCoeNightly

#Nightly BundleNightly

Nightly

#Performance BundleExecute 1 Vuser scenario for FF, IE and Chrome to take footprint measurementsScript runs iteratively for 2H in each browser, to make sure we have no leaks.Repeat for 51 concurrent Vusers, to make sure performance scales up as expected.Performance

#Performance BundleFootprint

PerformancePerformance#Performance BundlePerformance

#Single user performance is nice.But how would you scale up?Introducing StormRunner LoadJust Load#

AUT #2 HP StormRunner Load

Application Under TestLoad Generators are provisioned per Load Test

Results and Analysis are displayed in real time

User creates and executes Load Test

Load is Generated from multiple Geographies

AUT is monitored by HP SiteScope#20Simple. Fast. Scalable.Introducing: StormRunner

#Demo#

How would you test such a tool?#

#

#Monitoring production

#Monitoring production#And now, a message from our sponsor:

#

"Build it, test it, and fix the things that go wrong.

Repeat the process until the desired reliability is achieved.

It is a feedback process and there is no other way."David PackardJuly 1972

#Thank You#