mobile web test automation: to the desktop! - alexander bayandin - mobile test automation meetup...

Mobile Web: to the Desktop!Alexander Bayandin

Fun fact

Fun fact

✦ I’m Russian

Fun fact

✦ I’m Russian

✦ My name is “Alexander”

Fun fact

✦ I’m Russian


✦ My name in passport is spelled as “Aleksandr”

Fun fact

✦ I’m Russian


✦ My name in passport is spelled as “Aleksandr”

✦ You can call me “Sasha”

We’re

5Platforms

3TC agents

329mUsers

47Languages

350kMessages / day

10mPhoto / day

Platforms

✦ Desktop Web

✦ iOS

✦ Android

✦ Windows Phone

✦ Mobile Web

Platforms

✦ Desktop Web

✦ iOS

✦ Android

✦ Windows Phone

✦ Mobile Web

Mobile Test Automation

Platforms

✦ Desktop Web

✦ iOS

✦ Android

✦ Windows Phone

✦ Mobile Web


Me

Platforms

✦ Desktop Web

✦ iOS

✦ Android

✦ Windows Phone

✦ Mobile Web


Me

Viktar

Basic overviewof Mobile Test Automation

The Grand Badoo Hotel Party

Basic overview

✦ We do cross-platform test automation (Android, iOS, Mobile Web & Windows Phone)

Basic overview


✦ We use Ruby and Cucumber

Basic overview



✦ We use Calabash, Appium, Selenium & Winium.Mobile

Basic overview




✦ And TeamCity

Basic overview




✦ And TeamCity

✦ We’re cool 😎

A long time agoin a galaxy far, far away....

Star Wars Badoo Party

A long time ago

✦ Mobile Web — 3rd platform covered by automation

A long time ago


✦ Running tests on real Android devices

A long time ago



✦ Use ChromeDriver through Appium

A long time ago



✦ Use ChromeDriver through Appium

✦ All 300 tests take about 5 hours (parallel run on 4 devices)

Tests speed upSupport desktop Chrome

St. Patrick’s Day at Badoo

chromeOptions: { mobileEmulation: { deviceName: "Google Nexus 5" } }

Tests speed up (part 1)

✦ Make Appium Ruby library compatible with Selenium

… config_file = if desktop? 'desktop/appium.txt' else 'android/appium.txt' end …

… config_file = if desktop? 'desktop/appium.txt' else 'android/appium.txt' end

opts = Appium.load_appium_txt(file: config_file) …

… opts = Appium.load_appium_txt(file: config_file)

if desktop? opts[:caps] = WebDriver::Remote::Capabilities.chrome end …

… opts = Appium.load_appium_txt(file: config_file)

if desktop? opts[:caps] = WebDriver::Remote::Capabilities.chrome end

Appium::Driver.new(opts) …



✦ Fix tests (keyboard / photo upload / desktop Chrome is fast / animations)


Custom JS script




Use standard Selenium method




More waits






Use setTimeout instead of requestAnimationFrame




✦ Launch Selenium Grid on each TeamCity agent before tests (10 Chromes)

30 minutesPer tests run (300 tests)

Salvador Dalí. La persistencia de la memoria


✦ Move Selenium to Docker containers



✦ Run more Selenium Grid nodes



✦ Run more Selenium Grid nodes

✦ Parallelise in more threads

Run tests locally

Halloween Party at Badoo

Run tests locally (Android)


✦ Install Ruby Version Manager (RVM)



✦ Install Bundler



✦ Install Bundler

✦ `bundle install`



✦ Install Bundler


✦ Install Node.js



✦ Install Bundler


✦ Install Node.js

✦ `npm install`



✦ Install Bundler


✦ Install Node.js

✦ `npm install`

✦ Install Java



✦ Install Bundler


✦ Install Node.js

✦ `npm install`

✦ Install Java

✦ Install Android SDK



✦ Install Bundler


✦ Install Node.js

✦ `npm install`

✦ Install Java

✦ Install Android SDK

✦ INSTALL ONE MORE STRANGE TOOL

Run tests locally (Selenium)



✦ Install Bundler


✦ Install Java



✦ Install Bundler


✦ Install Java

✦ Download Selenium and ChromeDriver



✦ Install Bundler


✦ Install Java


✦ `java -jar selenium.jar -Dwebdriver.chrome.driver=./chromedriver`



✦ Install Bundler


✦ Install Java


✦ `java -jar selenium.jar -Dwebdriver.chrome.driver=./chromedriver`

✦ `cucumber -p web_badoo …` # Run test itself

Easy to install Easy to run

Docker

Run tests locally (Docker)

Tests


SeleniumTests


Selenium

Containers

Tests


Selenium

Containers

Tests

docker-compose


Selenium

Containers

Tests

to rule them alldocker-compose


✦ Install Docker & docker-compose


✦ Install Docker & docker-compose

✦ docker-compose run test …

Make TeamCity Friendly

LET THEM EAT CAKE!!!!!

------ LOCAL RUN: ------ docker-compose run -e APP=badoo -e BMA_SERVER=QA -e WEB_URL=MW-3287 test own_profile.feature:24 ------------------------

TypeError: Cannot read property 'getId' of undefined

TypeError: Cannot read property 'getId' of undefineddocker-compose run -e BMA_SERVER=DEV test own_profile.feature:24

Results

Midsummer Madness Party at Badoo

Results

3TC agents

3TC agents

700+tests

30runs / day

100+Selenium nodes

TC agents

30min / run

Results

✦ No manual regression testing

Results

✦ No manual regression testing (No boring stuff)

Results


✦ Developers & QA run tests locally

Results


✦ Developers & QA run tests locally

✦ Everyday releases

Some Future Plans

Back to the Future Day

Some future plans

✦ Run tests on iOS Safari / Windows Phone Browser

Some future plans


✦ Truly headless Chrome

https://bugs.chromium.org/p/chromium/issues/list?q=label:Proj-Headless

Some future plans


✦ Truly headless Chrome

✦ Better app debugging with tests (taking HAR, for example)

https://bugs.chromium.org/p/chromium/issues/list?q=label:Proj-Headless

Thank you!BadooTech

Badoo

techblog.badoo.com

https://twitter.com/badootech

https://github.com/badoo

http://techblog.badoo.com

Спасибо!abayandin

bayandin

alexander.bayand.in

https://twitter.com/abayandin

https://github.com/bayandin

http://alexander.bayand.in

The original, largest and leading dating network

mobile web test automation: to the desktop! - alexander bayandin - mobile test automation meetup...

Technology