enough is not enough - test strategy for mobile
Post on 28-Jan-2015
Embed Size (px)
DESCRIPTIONThis talk was presented at VodQA Gurgaon 3rd edition (11 July 2013) Talk Abstract: No matter how many devices, platforms or screen-sizes you test your mobile app on, your testing may still not be enough. In this era of ever increasing mobile devices and varied platforms, this is bound to happen unless you have a test plan tailored for the mobile world. The intent of this talk is to brace ourselves for this challenge and envision a test strategy for mobile that covers these widespread avenues. About Speaker: Jatin has been breaking software systems and helping in re-building them better since last 5+ years. Having worked for clients ranging from small startups to big enterprises, he has worked on variety of domains including telecom, retail, e-commerce, mobile and consulting. He works as Senior Quality Analyst at ThoughtWorks, Gurgaon.
- 1. Enough is not enough Test Strategy for Mobile Jatin Bhasin @jatin_bhasin
2. Who am I ? ! Tester ! Agilist ! Learner ! Traveller ! ThoughtWorker 3. What is Test Strategy ? 4. Definition A test strategy is an outline that describes the testing approach of the software development cycle. It is created to inform project managers, testers, and developers about some key issues of the testing process. 5. Test Strategy ! Scope ! Roles and Responsibilities ! Environment ! Testing Tools ! Risks and Mitigation ! Schedule ! Priorities ! and more 6. Why all the buzz about Mobile? 7. Did you know? (Source: Mobile Marketing Association Asia) World Population ~ 7 Billion Toothbrushes ~ 4.2 Billion Cell Phones ~ 5.1 Billion 8. Yes, thats true! ! Smartphone usage grew by 50% from 2011 to 2012 ! 91% of Americans have their mobile device within reach 24x7 ! This year, mobile phones will surpass PCs as the primary means of accessing the internet ! In 2011, Apple sold 48m mobile devices V/S 4.9m desktops/laptops. ! Only 20% of businesses have invested in a mobile solution (Source: various) 9. Types of Mobile apps Native Hybrid Mobile Web 10. Big challenges on small devices ! Environment ! Application ! Users ! Devices ! Network ! Automation 11. Environment ! Frequent OS changes ! Domain Constraints 12. Application ! Native/web/hybrid Apps ! Behavior on different devices ! Tech stack differs for each OS ! Comparison with web counterparts 13. Users ! Intuitive UI ! Accommodating maximum functionality 14. Devices ! Browser limitations ! Touch and non-touch devices ! Memory Constraints ! Battery Drainage ! Keypad lock 15. Network ! Sans network ! Offline support ! Wi-Fi ! Interruptions 16. Automation ! Device OS specific tools ! Testing across platforms ! Who will do it? 17. Test thy app ! Physical Device ! Simulators ! Testing in the Cloud ! Crowd Source testing ! Automation 18. Physical Devices ! Benefits ! Challenges 19. Simulators ! Benefits ! Challenges 20. Testing in the cloud ! Benefits ! Challenges ! Examples ! Device Anywhere ! Perfecto Mobile ! Testdroid 21. Crowd Source testing ! Benefits ! Challenges ! Examples ! Mob4Hire ! uTest ! Testcovery 22. Automation - Android ! Robotium ! Bot-Bot ! Monkeyrunner ! DroidPilot ! AndroidDriver (Selenium/WebDriver) 23. Automation - iOS ! Frank ! KIF (Keep It Functional) ! UIAutomation ! Zucchini 24. Automation - cross platform ! Appium ! Calabash ! NativeDriver ! And many more 25. Types of testing ! Usability ! Performance ! Security ! Interface Testing ! Services Testing ! Low level resource testing ! Compatibility ! Operational 26. Usability Testing ! Ease of use ! Single handed use ! How intuitive is it 27. Performance Testing ! Need for speed ! Get real ! Business impact ! 3rd party integrations ! Performance tuning 28. Security Testing ! Penetration test ! Vulnerability Assessment ! Encryption 29. Mobile means faster feedback! ! User Ratings 30. Forget me not ! ! Budget ! Time to market ! Target users 31. Recap Challenges in Mobile Testing Test thy app Devices Application UsersEnvironment Network Automation Automation Tools Testing in Cloud Physical device Simulators Testing Types #2 #3 #4 #1 Crowdsourcing Performance Usability Security Cross-platform iOS Android 32. Questions