mobile testing, agile methodologies & you! - · pdf fileissue: agile project, with...
TRANSCRIPT
Mobile Testing, Agile Methodologies & You!
&
Before We Begin...
• It's Quiet in Here
• Q&A at End of Webinar
• Contact Details Available
• Let’s Go!
Today’s Presenters
William AndersonGo2Group
Alan TrefzgerXBOSoft
Today’s Agenda
Mobile Testing
(Alan / XBOSoft)
Agile Methodologies
(William / Go2Group)
You (Q&A)
^
^
Mobile Testing
• Mobile Current Market Situation, Trends
• Mobile Application Challenges
• Mobile QA• Issues and solutions
• Mobile Testing Case Study
Current Situation, Trends
• 100 Android devices released in 2011
• 428 Million Mobile Communication Devices Sold Worldwide in Q1 2011
• More manufacturers, carriers, and 3rd party application aggregators will join the competition
Global SmartphonePenetration (by OS)
Source: Gartner
SmartphonePenetration
Source: comScore
0.00%$
5.00%$
10.00%$
15.00%$
20.00%$
25.00%$
30.00%$
35.00%$
40.00%$
45.00%$
United$Kingdom$
Spain$ Italy$ Canada$ United$States$
France$ Germany$ Japan$
Lots of Opportunity
• Lot of competition
• Quality and especially usability both more than ever take a front seat for user acceptance and usage
• Low usability and / or low quality applications may be only used once
• If the user cannot learn how to intuitively use in 30 seconds, forget it
Mobile Testing
• Mobile Current Market Situation, Trends
• Mobile Application Challenges
• Mobile QA• Issues and solutions
• Mobile Testing Case Study
Mobile App Challenges
• Limited display areas, miniature keyboards, less processing power and memory capacity
• Battery-power usage
• Lower bandwidth (but increasing)
• Proliferated mobile platform/OS combos
• Differences for the same application from different manufacturers and carriers
Mobile Networks andFeature Implementation
Mobile OS Features
Source: Tangerine Soup
Mobile Testing
• Mobile Current Market Situation, Trends
• Mobile Application Challenges
• Mobile QA• Issues and solutions
• Mobile Testing Case Study
Mobile Testing Typesand Peculiarities
• Testing• Functional Testing
• User Interface or Usability Testing
• Performance, Stress Testing, Compatibility Testing
• Publishing Compliance Testing
• Interruption Testing
• Negative Network Testing
• Peculiarities• Location based, Ad Hoc
Mobile Testing Tools
Choosing A Mobile Automation Testing Tool
Testing Strategy
Mobile QA Issues
• Proliferation of devices, networks, OS• Costs and complications
• Manual testing is easier yet more difficult: environment proliferation and replication
• Performance bottlenecks difficult to pinpoint
• Limits of automation tools
• Configuration Management
Mobile QA Issuesand Solutions
• Issue: Different tools to cover different test cases can be overwhelming and complicated to track results
• For instance, use adb (Android Debug Bridge) to test application installation on android mobile, and use another tool to do automation test against mobile application
• Tools need to be manually switched from one to another
Solution: AndroidDebug Bridge
• Use Windows framework to integrate tools• Develop a script or a batch file to trigger different
tools using the windows command line
• Build a mobile automation framework (based on Windows API as previous means); call different tools with certain sequence; interval time between two calls
• Can test application installation, application itself, un-installation with one executable file
• Example: Test browser installation, functions, un-installation in 1 run, with Windows API & MonkeyRunner integrated with Eclipse & Python
Issue: Agile Project, with Changing UI Styles
• Under time pressure, test task is intensive in the final phase of a release
• Solution: Prototype or UI design with fixed element ID or position is provided to testers
• Application is learned by testers, test tools in advance
• Tester can develop automation test easily with tool based on the prototype/design
• Apply test in various platforms or configurations, saving manual testing time
Mobile QAIssues & Solutions
• Issue: Configuration management for Apple applications via App Store
• Solution: App Store has version control• New downloads get the latest version
• Old users are prompted to upgrade via app store
• Incompatible versions are forced to upgrade
• Users forced to have either most recent, or a compatible version
Mobile QAIssues & Solutions
• When to test an actual device?• UI
• Location
• Multimedia
• Internet connectivity
Mobile Testing
• Mobile Current Market Situation, Trends
• Mobile Application Challenges
• Mobile QA• Issues and solutions
• Mobile Testing Case Study
Case StudyMobile Devices & Speed
• Please contact XBOSoft for more details!
Summary
• Mobile QA requires an adapted strategy
• Decompose where you can in order to gain efficiencies
• Manual testing and real devices are still necessary
• But needs can be reduced through selective automation and environment simulation
Let’s Talk Agile!
3 Steps toAgile Success!
• Fundamental understanding
• Which methodology?
• Find the right tools!
Fundamental Understanding
• Why the need for agile?
• Who benefits from agile?
• Is it just one-and-done?
Which Methodology Is Right For You?
• There are many!
• Benchmark, measure, discover
• Likely a hybrid approach is best
Find theRight Tools!
• Requirements, test management
• Software development
• Project management (ie, Scrum masters)
• Examples:• Atlassian JIRA, GreenHopper, Bonfire, Confluence
• Go2Group JaM Plugin, synapseRT, ConnectALL
• HP QC / ALM, Salesforce, SugarCRM
An Exampleof Agile
• Pre-Agile: Waterfall-based• Backlog of requirements not being developed
• Lots of missed deadlines!
• Why Agile?• Many bugs, parallel / distributed development
• It’s An Agile Life• Training: “Start thinking in stories, sprints, etc.”
• Periodic releases and iterative updates
Where ToGet Started
• One Day Agile Training from Go2Group• Includes Agile Tools Demonstration!
• Demo / example sprints and release cycles
• Great place to get your toes wet
Q&A
You Have Questions?We Have Answers!
Contact Us!
William AndersonGo2Group
Alan TrefzgerXBOSoft
Thank You!
Go2Group synapseRT WebinarTuesday, March 29 @ 11AM ET
Go2Group JaM Plugin WebinarWednesday, April 4 @ 10AM ET