introduction to mobile performance testing

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Introduction to Mobile Performance TestingWilson Mar, Angel Tran, Shlomi SalmaHOL330 in Sands 305, June 13, 2013

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2

Mobile apps are now:Why performance test mobile apps?

• how customers locate stores and information• how brands get exposure many times a day• the “face” of the organization


Slow app = Slow product?


Baseline vs. impact of network latency, etc.

[P01]from HP Network Virtualization by Shunra


Possible points of risk in landscape

StorageDB

ServersApp

ServersWeb

ServersLoad

Balancers

3rd Party Cloud Services

CDNs & CoLo.

Carriers InternetBrowsers

Platforms& Versions Firewalls

VPNsDevice Features

2G,3G,4GCellular

Mobile Components

ScreenSizes

Web Services

LANs

ISPs

DB Indexes& Logs

ResourceUsage

Latency& Loss

Pooling &Threading

ServerConfig.

SysAdmin: DBA:Back-end:Dev:Network:DataCaching

mDev:Encrypt,Compress.

Load Bal. Algorithm

Network:Network:


HP Live Network

Collaborate2

HP LoadRunner components and workflow

Virtualize Network5

End User Application Server(s)Internet/WAN Database

Analyze, Compare, Report8

Client(s)

Generate Load6

Author Scripts1

Measure Impact7

Test Scenario

Plan and Execute Tests3

Virtualize Services4


Scan for more information

LoadRunner

NetworkVirtualization

ServiceVirtualization

MobileTesting

HP Codescan app

http://www.hp.com/go/...

http://www.hp.com/go/loadrunner

http://www.hp.com/go/mobiletesting

http://www.hp.com/go/servicevirtualization


http://www.shunra.com/products/shunra-nv-hp-software


AppleApp

Store

Play.googl

e.com

iPhone, iPadAndroid“featurephones”

WindowsPC

Mobile technology terms

Safari browser

URL

m.ft.com

mobilesite

ft.com/wsweb

services

ft.comHTML5

responsive design

Native app

internetexplore

r

ft.comHTML4

URL

minimal

browserURL

Hybridapp

Chromebrowser


Mobile LoadRunner Scripting Demos

https://connections.houston.hp.com/docs/DOC-15086




http://code.google.com/p/android-screen-monitor/Android Screen Monitor

Download to folder …\sdk\platform-tools\ASM.jarWithin Windows Explorer, double click on ASM.jar


Create a New Script, Mobile Category

HP LoadRunner VuGen 11.5 SP1+


Multiple Approaches Available

Browser or hybrid app:Ajax? > TruClient Ajax Mobile scripting protocol using User Agent

spoofing in FirefoxSimple > Mobile HTTP/HTML scripting protocol

Native app: > Mobile HTTP/HTML scripting protocolAndroid:

No device > Record Emulator using Android Virtual Device (AVD)

Have rooted device > Mobile Recorder generate lrpcap to Analyze

iOS & others:> LoadRunner Proxy on same subnet/Wi-Fi hub

(the newest technique) > Record & Analyze WinPcap capture on the

mobile app server


Recording Method TruClient Ajax

TruClient Ajax HP LoadRunner VuGen 11.51+

App web server

User Agent in Firefox >


TruClient recording

HP LoadRunner VuGen 11.51+


Devices with User Agent strings

Count: 27

HP LoadRunner VuGen11.52


Sample User Agent for Samsung Galaxy S3User Agent string example

Mozilla/5.0 (Linux; U; Android 4.0; xx-xx; GT-I9300 Build/IMM76D) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30

HP LoadRunner VuGen11.52More at http://www.useragentstring.com/

http://www.useragentstrings.com/




Android Versions

4.1 (16)4.2 (17)

2.3 (9,10)

4.0 (15)


Mobile Device Manager Tool in VuGen


VuGen Scripting Process

from HP Virtual User Generator User Guide 11.52 page 73

1. Configure recording settings2. Consider run-time settings3. Object identification using

script levels4. Specify Transaction Names 5. Specify Completion End

Events Logic6. Insert flow control7. Run-time logic8. Vary data based on

parameters9. Using C script functions in a

library


Random Think-time in TruClient

Arguments:

http://www.perftesting.co.uk/ajax-truclient-tips-and-tricks-part-ii/2012/05/02/

Math.floor( 11 * Math.random()+5 );




TruClient Toolbox drag and drop

window.alert( “randWait=” + randWait );

Arguments:


Math.floor( 11 * Math.random()+5 );

var randWait =




HTTP/HTML Mobile Recording





Mobile HTTP vs. HTML

HP LoadRunner VuGen

mode=“HTML”mode=“HTTP”Parse HTML to automatically identify additional resources to download

For use with web services calls.Does not parse for resource requests.

• CSS• JavaScript


Record Mobile HTTP/HTML



HTTP/HTML

TruClient

HTTP/HTML Recording Methods Wizard

Proxy Recordi

ng

Record Emulato

r

AnalyzeTraffic

Record &

Analyze Traffic



Proxy Recording





HTTP/HTML

TruClient


Proxy Recordi

ng



Proxy Recording

Android

LoadRunner

Proxy

HTTP/HTML

Proxy Recordi

ng

HP LoadRunner VuGen11.5x

App web server

Port 80/443

VuGenProxy IP:Port 8080

APK

iOS IPA


Proxy Recording


HTTP/HTML

Proxy Recordi

ng


Proxy Recording Setup on iOS

1.

Source: http://www.amsys.co.uk/2012/blog/how-to-setup-proxy-servers-in-ios/

4.3. Scroll down2.

Eleanor

Password: ncjm-q3ey-t1dd

Eleanor 192.168.1.2255.255.255.0

192.168.1.1

192.168.1.38080


Proxy Recording Setup on Android Galaxy S3 (4.1.2)1. 4.3.2. Long press

Eleanorncjm-q3ey-t1dd


Record Emulator





HTTP/HTML


Record Emulato

r



Record Emulator Android Recording Method

Android

deviceemulator

HTTP/HTML

Record Emulato

r

APK


App web server

Async.

APK

@device ADT file

Android… \sdk\tools

File manager

Backup

Play.Google.com

Install

Copy


Record Emulator Requirements

1. USB cable to device2. USB driver for device 3. Android app APK file for Android app under test4. Android file download manager app to extract APK file from device

5. JDK (Java Development Kit)6. ADT (Android Development Toolkit) plug-in for Eclipse7. AVD (Android Virtual Device) within Eclipse for device under test8. JAVA_HOME and PATH Windows environment variables

9. HP LoadRunner 11.50 and SP2 patch to upgrade to 11.52

HTTP/HTML

Record Emulato

r


Emulator


Record & Analyze Traffic





HTTP/HTML


Record &

Analyze Traffic



Record & Analyze Traffic

Androidnetworksniffer

iOS

HTTP/HTMLRecord

& Analyze Traffic

Ad hoc network

.cap,.pcap


App web server

APK

IPA


Analyze Traffic





HTTP/HTML


AnalyzeTraffic



Analyze Traffic

MobileRecorder

Android

.lrpcap

HTTP/HTML

AnalyzeTraffic

Android 4.1+(rooted)

App web server


APK


Android Mobile Recorder1. Start Recording 3. Stop and send email2.

Perform user steps.


Android Mobile Recorder Settings


Recording Methods Recap

MobileRecorder

Android

.lrpcap

LoadRunner

Proxy

deviceemulator

networksniffer

iOSVuGenProxy IP:Port 8080

HTTP/HTML

Proxy Recordi

ng

Record Emulato

r

AnalyzeTraffic

Record &

Analyze Traffic

Port 80/443

User Agent in Firefox >

Android 4.1+(rooted)

Ad hoc network

APK

APK

.cap,.pcap

TruClient Ajax HP LoadRunner VuGen11.52

App web server

@device ADT file IPA

Play.Google.com


Mobile scenarios





How can we help?

Run test cases

Provision & deploy environment

Execute automated build

Application Security Assessment

Test results

Security Code ScanFortify Source Code Analysis

UFT / BPTLoadRunner

WebInspect

Continuous Delivery Automation (CDA)

(Jenkins)

HP integrated testing suite

ALM Analysis

Executive Scorecard

Performance Center

Service VirtualizationNetwork Virtualization

DevelopmentAgile Manager

Business Service ManagementMonitoring &

Diagnostics

Analytics

App. Lifecycle Intelligence

ALM Lab Management

Tear down environmentContinuous Delivery Automation

(CDA)


Shopping processInterconnected component services

PayBuy Ship Track

Product

Search

Customer profiles Payment Shipping

Composite

Managed cloud

Public cloud

Traditional

Track package

Privatecloud


Concurrency and rendezvous

[P10]Illustrative data


Key take-aways

• For mobile browser apps (jQuery Mobile, Sencha, PhoneGap, etc.), little scripting is needed using User Agent spoofing via Firefox TruClient Mobile

• JavaScript executes against a DOM for each virtual user• Traffic captured between native apps and server are converted to

VuGen scripts• Android native app traffic on rooted devices can be recorded

on device using LoadRunner Mobile Recorder

• iPhone and iPad (iOS) -- all non-rooted apps – can be recorded using LoadRunner Proxy

• Monitor and Diagnose using HP Business Service Management• Consider HP Network Virtualization and Services Virtualization


For more information

Attend these sessions

Mobile Performance Hands-on Lab HOL3330Sands Room 305

• Tuesday 1p – 3p• Thursday 3p-5p

After the event

• Contact your sales rep• Visit: http://

www.hp.com/go/mobiletesting http://www.hp.com/go/loadrunner

Your feedback is important to us. Please take a few minutes to complete the session survey.

Visit these demos

Applications: mobile performance testing RT3112• Wednesday June 12, 1030 am

Lido 3101A• Thursday June 13, 930 am

Lido 3101B







Thank you

introduction to mobile performance testing

Documents

mobile networks

shunra copyright

b copyright

mobile scenarioshttps

impact of network latency

local networks

private networks

mobile forced traffic