karl krukow - what's new and cool in xamarin test cloud - xamarin dev days singapore nov 2016
TRANSCRIPT
![Page 1: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/1.jpg)
What's New and Cool in XTC?
Karl Krukow, Microsoft Engineering Manager, Xamarin Test Cloud @karlkrukow
Xamarin Dev Day, Singapore 2016
Secrets of Xamarin Test Cloud
![Page 2: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/2.jpg)
Agenda
,
What is Xamarin Test Cloud? Top 5 Misconceptions New Stuff and Secret Stuff
![Page 3: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/3.jpg)
Automated Testing on thousands of mobile devices
![Page 4: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/4.jpg)
So how does it work?
![Page 5: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/5.jpg)
So how does it REALLY work?
Create Tests and run them locally on simulator or device right from the IDE.
Xamarin.UITest (C#) / Calabash (Ruby)
Automatically execute tests in the cloud in parallel from a pool of real iOS & Android devices.
Xamarin Test Cloud
![Page 6: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/6.jpg)
• Interact with UI controls in your app using gestures
• Declarative query language to identify views on screen
• Wait for events to occur (e.g., no spinner visible)
• Generate screenshots
• App-lifecycle APIs (start/stop, etc)
• Low-level APIs provides access to reflectively call methods on app objects
Automated UI Testing
//Example in C# using Xamarin.UITest app.Tap ("Help"); app.Tap (e => e.Id ("history-btn"));app.WaitForElement (e => e.Text ("Ink"));app.Screenshot ("View the purchasing history");
Tap Scroll Swipe Pinch Multi finger
Text Entry Rotation GPS
![Page 7: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/7.jpg)
Xamarin Test Cloud
DEMO (I'm a link!)
![Page 8: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/8.jpg)
Top 5 Common Misconceptions
![Page 9: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/9.jpg)
That's nice, too bad my App isn't built with Xamarin.
Misconception #5
![Page 10: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/10.jpg)
Xamarin Test Cloud works with every native and hybrid mobile app - it doesn't matter how it was built.
Xamarin / C# Xcode / Objective-C / Swift Android Studio / Java Cordova / JS React Native / JS ...
![Page 11: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/11.jpg)
Test Cloud is WAAAY too expensive!
Misconception #4
![Page 12: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/12.jpg)
Well, that's subjective :)
https://www.xamarin.com/test-cloud
Xamarin.UITest is completely free to use!
![Page 13: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/13.jpg)
Wow! Cool! I'd love to use it! Too bad we don't have time
to write tests...
Misconception #3
![Page 14: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/14.jpg)
We Understand!
"How can you afford not to test?" - Niels Frydenholm, eBay classified
If you think you don't have time, you're probably wrong ;) (I'm a link!)
![Page 15: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/15.jpg)
Also: How hard it is to get started with Continuous Delivery on Mobile?
https://www.youtube.com/watch?v=wXgnh2Q7Uv8
https://vimeo.com/155029659
Continuous Delivery for Mobile Apps: Yes We Can!
Also watch this space for announcements this month :)
![Page 16: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/16.jpg)
So these 'devices', they're emulators. ... Right?!?
Misconception #2
![Page 17: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/17.jpg)
NO! They're real non-jailbroken devices!
![Page 18: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/18.jpg)
![Page 19: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/19.jpg)
I can build my own Test Labs! How hard can it be?
Misconception #1
![Page 20: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/20.jpg)
So you want to build your own Test Cloud?
![Page 21: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/21.jpg)
Stable WiFi
Automated parallel execution infrastructurePop-Ups (e.g., update)
Device Stability (Unplugging/replugging devices, transparent reruns, cleaning)
Test Data aggregation, Crash detection, screenshots, video,...
Device automation
Managing Macs
Managing and Procuring Devices
Device Maintenance
Provisioning Profiles Google Play Services
![Page 22: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/22.jpg)
New Stuff & Secret Stuff
![Page 23: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/23.jpg)
New and Secret stuff
Android Fast Clearing of AppData Android Video recording (use: --test-param screencapture:true)
![Page 24: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/24.jpg)
New and Secret stuff
iOS: upload dSyms (without), UITest 2.0.0 / Calabash 0.20.0 / iOS10 / the Device Agent interface
![Page 25: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/25.jpg)
New and Secret stuff
UITest
Hyper-parallel runs vs serial, CLI runs (see demo)) UITest 2.0
![Page 26: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/26.jpg)
New and Secret stuff
New Frameworks: Appium, Espresso
![Page 27: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/27.jpg)
• Cross-platform C#-based API
• Run with NUnit
• Xamarin/Visual Studio or CLI
• SpecFlow support
Xamarin.UITest• Write Tests in Ruby
• Supports BDD, run with Cucumber
• RubyMine or CLI
Calabash
• Write Tests using Selenium/Webdriver
• e.g. Java, (Python, JavaScript, ...)
• Leverage Selenium resources
Appium Espresso (XCUITest?)• Official tools
• Java/Obj-C/Swift
• Not cross platform
![Page 28: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/28.jpg)
Thanks! Questions?
Happy to help people get set up with testing here today!
![Page 29: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/29.jpg)
ReferencesLinks
■ Xamarin Test Cloud: http://xamarin.com/test-cloud
• Xamarin.UITest: http://developer.xamarin.com/guides/testcloud/uitest/
• Calabash Guides: http://developer.xamarin.com/guides/testcloud/calabash/
• Test Recorder: https://www.xamarin.com/test-cloud/recorder (preview)
• Samples
• https://github.com/xamarinhq/app-acquaint
• (Tests to be open sourced soon)
![Page 30: Karl Krukow - What's new and cool in xamarin test cloud - Xamarin Dev Days Singapore Nov 2016](https://reader034.vdocuments.site/reader034/viewer/2022052405/5871568e1a28ab8e5b8b5447/html5/thumbnails/30.jpg)
Karl Krukow, Microsoft Engineering Manager, Xamarin Test Cloud @karlkrukow [email protected]
Xamarin Dev Day, Singapore 2016