technical mobile testing - risks, issues and experiences (eurostar mobile deep dive 2015)
TRANSCRIPT
PayaEen@ontopaintoimproveprocess
• Gainsomeexperience• PayaBen.ontopain• Resolvepaintoimproveprocess• StatusQuo!=Dishwasher
Workaroundsaddrisk
• Adoptworkaround,andmi.gatetherisk• Communicatetherisk• Acceptrisksthroughknowledgenotfear(wherepossible)
@eviltester
MobileTechnicalandRiskBasedTes@ng
• OurtestapproachesareoNenbuiltaroundfearmi.ga.on– Lotsandlotsofdevices– Becausewedon’tbuildfordevicecompa.bility– Wecaveatforasubsetofdevices
TestLikeNormalUsers?
• DefaultBrowser?Dolphin,Chrome• LastPassPasswordManager• Auto-Comple.onOff• Alterna.veKeyboards–hacker’sKeyboard
Automa@ngTac@cally
• Screenshotsfordifferentscreensizes• Serverbasedresponsesfrommobiledeviceheaders• Notautomatedondevice• TargetTechnicalRiskTac.cally
ProxyToolsfoundPreloadcachingissue
• JavaScriptlibraryforpre-loadcaching• Observingtrafficthroughproxysawmul.pleloading
WifiHoopsandRoundabouts
• EnvironmentalSecurity• Tes.ngonwi-fi• LaptopHotspots• Wiresharkforna.veviawi-fihotspot
ProxyBenefits
• Isolatedevicefromserver• FeedinnewJSandCSSpriortorelease• Triggererrorsitua.onsondevicewithoutmessingwithserver
• Mul.plescenariosconfiguredbydatafedtodevicebyproxy
CheapErgonomicSolu@ons
• Tabletstands• Stylus• Keyboards• Risk?– Fearmi.ga.on,usephonetoo– EventhoughthisisbuiltinOSfunc.onality
Oldendaysinefficiency
Usephonetotakephotoofscreenshotofotherphoneforuploadingtodesktopforbugrepor.ng
Non-TechnicalRisks
• Phonesgowalking• Startwithsecurelibrarysystem• Endupwithcardboardboxfilledwithdevices
Listofhowtotestoneachdevice
• Eachdeviceisdifferent• Listthe‘shortcuts’andlessonslearned– Howtotakeascreenshot– Whattoolstouse
FinalNotes
• Tes.ngondeviceisarisk• Iden.fyTechnicalRisk– Targettoreduceplakormtes.ngscope
• Ifwewerereallyserious…