New Approaches to Real-Time Application Testing and Performance Monitoring

December 15, 2011

Agenda

• Best practices for holiday performance testing• New testing and monitoring techniques• Demo• Q&A

The Online Market

You are here!

Cyber Monday 2011

• $1.3B • 33% y/y growth in traffic• 10.8% is Mobile (3.9% last year)

iCommerce: Biggest Mobile Influence

The IT Landscape Has Changed

What is “Peak Load”?• 100%, 200%...500%+?• How much mobile traffic should we prepare for…and how?

What Are The Most Important Transactions?• What are the most profitable paths users follow?• What is the affect of non-buying “browsing” on paying customers?

What System Do You Test In?• Is the lab good enough?• Production testing is taboo (isn’t it)?

How Will You Find The Issues?• Complexity reigns • How do we see where issues are at load?

The IT Landscape Has Changed

What is “Peak Load”?• You must to test to new limits with a mix of web and mobile traffic

What Are The Most Important Transactions?• Those that you determine as profitable, complex and/or risky

What System Do You Test In?• Testing is a continuous process from the lab to live production

How Will You Find The Issues?• Monitoring during tests for the the end-to-end view while tests run

BEST PRACTICES

Monitoring best practice 1“Assume Nothing”

Oops. A production server!

UAT Environment topology autodetected

Monitoring best practice 2Visibility explains REAL phenomenas

Specific transaction type is failing

Specific location is failing

Monitoring best practice 2Visibility explains REAL phenomenas

When compared to % Time spent within the Data Center

Or the %Time spent rendering on the user’s device

You can see that the % Time spent between User and Data Center is the issue here

It is pretty easy to see the load balance mismatch

Monitoring best practice 3Baseline and compare

Compare application model of 100% load vs. 150% of load

Testing best practice 1

• Start early & test progressively.– Begin in development

– Run many iterative tests that address performance from code though infrastructure

– Finish in production (Live prod to really be sure)

Testing best practice 2

• Test realistically.– Model users acting like humans

– Stress & measure at a realistic pace

– Run at true scale

– From different locations and devices

Testing best practice 3

• Seek a single source of performance truth.– Get Dev & Ops on the same page. (Is 2 seconds okay?)

– Measure with the same tools in Dev, Test & Ops

– Correlate monitoring data with test data as tests run

Thankfully, There is a Solution

SharePath identifies critical transactions to test what matters most

CloudTest enables testing to any level with web or mobile traffic – in lab or production environments

Monitor critical metrics during and after tests to isolate and prevent production outages

Demo

Summary

• The IT Landscape has changed • Start your testing early, test progressively, and

test realistically• When monitoring critical applications, assume

nothing, look for root cause phenomena, use baselines, and compare

• SharePath and CloudTest provide an integrated solution

Questions

Get your free copy SharePath RUM!

http://www.real-user-monitoring.com/

Contact SOASTA:www.soasta.com/cloudtest/info@soasta.com866.344.8766Follow us:

twitter.com/cloudtest

facebook.com/cloudtest

Contact Correlsense:www.correlsense.com/demowww.real-user-monitoring.cominfo@correlsense.comFollow us:

twitter.com/correlsense

facebook.com/correlsense

Download CloudTest Lite - FREE!

www.soasta.com/cloudtest/lite/

GET STARTED TODAY!