build great apps with both real-world testing and test automation - michael weinberg, applause
TRANSCRIPT
|Michael Weinberg | VP and GM | Applause Israel | [email protected]
Building Great Apps with Both Real-World Testing & Test AutomationIsrael Mobile Summit 2016
|
POWER HAS SWITCHED TO THE USER
|
When You Delight, They Stay
3
44%48%
8%
Agree Neither Agreeor Disagree
Disagree
“I enjoy finding and trying new apps” (US)Don't know
7%
Reduced20%
Stayed the same
41%
Increased23%
Just began downloading
apps9%
User App Download HabitsCompared to a Year Ago (US)
SOURCE: Gartner Market Trends: Mobile App Adoption Matures as Usage Mellows
|
When You Don ’t, They Complain
4
|
Many Combinations To Test
BUT USERS ST ILL EXPECT THEIR APP TO WORK
|
How Do We Meet
Their Needs?
|
1. Instrument app for session/crash reporting
2. Leverage Automation – build often and run test suites
3. Test on real devices, under real-world conditions
4. Understand user sentiment pre & post launch (beta testing, app store analytics)
5. Use this to inform and speed up your development and testing efforts
Meeting Customer Needs: Gather Data, Make Quick Decisions
7
|
1. Instrument Your App for Session/Crash SDKs
8
|
• Establish automatic app quality checkpoints
• Test cross-platform at a much faster rate
• Tests can run across multiple devices at the same time
• Reduce test cycle times
• More testing, more often
• Create a consistent, repeatable testing process
• Especially when utilizing continuous integration
• Tests can be run at any time (over night) at any frequency
• Make resources available for other testing/development
• Improve efficiency of other testing efforts
2. Leverage Automation
9
|
3. Test on Real Devices, in Real -World Conditions
• Real People
• Real Devices
• Real-World Conditions
• Device coverage, network conditions, interoperability
10
|
4. Get Real User Input in Pre- and Post-Launch Sentiment Analysis
11
|
5. Use This Information to Drive All Stages of Development
Tester End UsersDeveloper
Build distribution1 In-app bug reporting 2
Crash log reporting
4
In-app user feedback 3
Product/
Marketer
Sentiment Analysis5
Builds
User Feedback Crash logs
BugsBugs & Crashes
Quality Dashboard
with Sentiment Analysis
