ranorex research projects - · pdf filedocker –putting tests in a container what’s...

23
Ranorex Research Projects 28.09.2017

Upload: vukhue

Post on 15-Mar-2018

230 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Ranorex Research Projects

28.09.2017

Page 2: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Agenda

Research @Ranorex

Docker – putting tests in a container

What’s the “smell” of my tests?

What about robustness?

Page 3: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Research @Ranorex

Page 4: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank
Page 5: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Research @Ranorex

• Small prototypes

• POCs

• Tool integrations

Always trying to think outside the box

Page 6: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

DockerPutting tests in a container

Page 7: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Docker

Quick Intro

Anybody not familiar with docker/containers?

Page 8: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Two options

• Running Rx test in a container

• Mobile tests (POC with BitBar)

• Selenium tests

• Running SUT in container

• Web-apps

Page 9: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Limitations of Windows containers

• Native Windows apps supported by docker

Windows containers

• No GUI-apps supported yet

• No RDP (or similar) possible

It is on our radar

Page 10: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Quick Demo

• Run single web test locally

Automate Wordpress bootstrapping process

Can only be run once per WP instances

• Move to Containers

• Spawn Docker container with Ranorex

• Run test on Selenium Box

• Destroy Docker container

Multiple parallel executions possible

Page 11: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

What’s the “smell” of my tests?

An add-on provided by Qualicen

Page 12: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Ranorex test meta analysis

• Based on an add-on provided by Qualicen

https://www.qualicen.de

• Analysis of

• Recording modules

• Test suite

… more to come

• Webinar planned

Page 13: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Demo

Page 14: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

What about robustness?

Page 15: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

How to achieve robustness?

Page 16: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Multiple selectors

• „Fuzzy“ selectors

• Structural / positional /

attribute based

• Attribute matching• String distances

• Position• In tree

• On screen

Page 17: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Element not found…

Really?

• “Element not found” errors

“Earlier” error

Screen did not change

Consider whole UI

Remember automation “path”

Page 18: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Element not found…

Dynamic ID/label?

• Feature calculation on ID

• Numbers

• String-Lengths

Classification with SVM/LDA/…

• ID matching regex “growing”

80-90% accuracy

Page 19: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

@github

Page 20: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Things available @github

• Ranorex github repository

http://www.github.com/ranorex

• “Private” repo with Ranorex-projects

http://www.github.com/cbreit

… unofficial

Page 21: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

A few more things

Page 22: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Other experiments

• Centralized reporting

• Elasticsearch connection

• Appium

• JMeter/Gatling integration

Page 23: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank

Thank you

for your attention!

Questions?

[email protected]

Christian Breitwieser