mobile testing2013/03/14 · uft mobile -automated functional testing -manual testing -performance...

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Mobile Testing Pontus Thell

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2

Mobile success and failure is very visible

Very poor app ranking in Google play

Competitors have 4 star apps Where is your app?

April 2012


Could better mobile testing have prevented this?

A very public launch

With very public quality issues led to …

public apologies and executive turn over


Why is mobile testing so difficult?

1. User expectations are exceedingly high… it must work right the first time

- Incredibly competitive market

2. Real devices are critical

- Test results can be dependent on device, OS, and network provider

3. Speed and velocity is essential

- Pace of change in mobile platforms and devices is incredibly fast

- Mobile development projects must be agile in fast and frequent sprints

4. Mobile is not an isolated effort.

- Must be integrated in normal deliver processes

- Full lifecycle approach leads to quality outcomes


Is this your mobile test lab? Rea devices, but how will it scale?

• Automation • Security • Location • Change mgt • Governance • Risk exposure • Cost


Testing mobile applications on real devices, in real locations, across real carrier networks

HP Mobile Testing Solution

HP Service Features • Real Device Testing

• Device Compatibility Testing

• Mobile Application Test Automation

• Mobile Usability Testing

• Mobile Performance Testing

• Mobile Network Testing

• Mobile Security Testing

• Localization Testing

• Monitoring

Unified Mobile Testing

Real Devices • Real Locations • Real Carrier Networks

HP ALM/Quality Center


UFT Mobile

- Automated Functional Testing

- Manual testing

- Performance testing

BOTH Private and Public Cloud

HP UFT HP UFT Mobile

Private cloud of dedicated real devices

Web, DB, and other servers

Mobile functional test

Public cloud of shared real devices


Integrated test automation solution

Real Device / Device Compatibility Testing

HP QuickTest Pro Test Automation

MobileCloud Platform

Script once, test many


Globalization and localization of applications and content

Localization Testing

Globalization, localization, language translation


Test Automation ScriptOnce™

MobileCloud integrated test automation solution

Mobile Application Test Automation

The Perfecto Cradle

Internet / LAN

HP ALM/Quality Center QTP integration

Interactive Manual Testing

Access to Real Devices

The Perfecto Cradle

Pe

rfe

cto

Mo

bile

Se

rve

r

© Copyright 2012 Hewlett-Packard Development Company, L.P.

The information contained herein is subject to change without notice.

11

REAL Mobile devices Intuitive-driven cloud service

UFT Natural Extension

ScriptOnce – Any business process on any device - One Script

© Copyright 2012 Hewlett-Packard Development Company, L.P.

The information contained herein is subject to change without notice.

12

Mobile Platform Support Example

• Supported Operating Systems: • Android – all versions • iOS

• Up to version 6.0 • Version 6.0 – supported*

• BlackBerry – up to version 10 (expected to be supported on release) • Symbian • Windows Mobile • WP 7.5 – LG platform • Meego, Limo

• Supported manufacturers:

Nokia, Samsung, Motorola, SonyEricsson, LG, Apple, HTC, RIM,

Huawei, Acer, Asus, HP, Dell, Alcatel, Sharp, Toshiba, ZTE, Panasonic


Performance optimization for a positive end user experience

Mobile Performance Testing

HP LoadRunner

Performance optimization, network emulation


Why worry about the network? By not considering actual network conditions, testers can get trapped

VS. Capacity > 500+ users

Without real network conditions

False sense of security

Capacity < 200 users

With real network conditions

Realistic expectations


Two mobile protocols for mobile performance testing

Mobile TruClient

• For browser-based applications

• Based on HP’s TruClient technology

• Records through browser and behaves like a true browser

• Captures at the business process level

Mobile Applications

• For native and browser-based applications

• Based on Web (http/html) script

• Records through emulator or mobile device

• Analyzes network traffic

Both included in Web 2.0 Bundle


End to end network performance optimization

Mobile Network Testing

App. server

App. server

The complete solution for performance testing mobile applications

Device-side Functionality / Response: HP QuickTest Pro / Perfecto MobileCloud

Real World Network Conditions & Performance

Backend Monitoring: HP Sitescope / Diagnostics

Performance / Load Testing Mobile VU’s: HP Performance Center/ LoadRunner

www.shunra.com

Mobile Load Test

17

App Under Test

LR Generator

LR Generator

LR Generator

LR Generator

LR Generator

LR Controller

3G London

3G Singapore

2.5G Amsterdam

3G New York

Local

17

Shunra for HP

www.shunra.com

Shunra for HP

www.shunra.com

Analysis – SLO Compliance

19

www.shunra.com

Analysis – Deep Dive

20

www.shunra.com

Remediation & Optimization

21


Addressing the number one challenge to mobility

Mobile Security Testing

HP Fortify Scan apps, monitor threats

HP Arcsight


A complete mobile testing solution

HP UFT HP UFT Mobile

HP LoadRunner or HP Performance Center

HP ALM HP Service Virtualization

Private cloud of dedicated real devices

Web, DB, and other servers

Shunra Network Virtualization

Mobile functional test

Mobile load test


Example of HP Business Process Monitor monitoring mobile applications

Proactively monitor the mobile end-user experience

Proactive monitoring • Synthetic monitoring by emulating users, transactions and device

• Know before user’s are impacted

Global health • Monitor mobile application health from global locations


HP positioned in the “Leaders” Gartner Magic Quadrant

Source: Magic Quadrant for Integrated Software Quality Suites © 2011 Gartner, Inc. and/or its Affiliates. All Rights Reserved. Publication Date: 31 January 2011/ID Number: G00208975

“This Magic Quadrant looks at software quality from a suite perspective, including quality management and test execution tools.

Leading vendors have broader solutions encompassing requirements and change management, and, in general, provide ALM solutions.”

Gartner does not endorse any vendor, product or service depicted in our research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose

mobile testing2013/03/14 · uft mobile -automated functional testing -manual testing -performance...

Documents