qa lab in the cloud

QA LAB IN THE CLOUDDynacron GroupSlides from Jan 2013 Seminar

04/12/2023 1

Summary

• These slides are from a January 2013 seminar by Dynacron Group

• The slides were intended to be viewed as part of a demonstration• We’ll probably post video of it next time

• To stay in touch, sign up for our newsletter!• http://www.dynacrongroup.com/newsletter

04/12/2023 2

Cross Browser Visual Comparison

• Layout• Image Loading• JavaScript Errors• Smell test

04/12/2023 3

Browser Visual Diff Tools

•Browsera•BrowserBite• Browsershots• Adobe BrowserLab• Sauce Scout• ...and many more

04/12/2023 4

Key Features

• Local/Remote• Browser Selection• Public/Private• Authentication• Screenshot Comparison

• Side by side? Overlay? Highlighting? Manual?• Link Crawling• JavaScript Validation

04/12/2023 5

DEMONSTRATIONBrowsera and BrowserBite

04/12/2023 6

Cloud Infrastructure• AWS• Cloud Foundry• Heroku• CloudBees• … and many, many more

04/12/2023 7

CloudBees

• Complete Java Infrastructure Solution• Development Pipeline

• Source Control: svn or git• Build Server: Jenkins, Sonar• Binary Repository

• Production• Application Servers: Jboss, Tomcat, etc• Database: MySQL, Mongo, Couch, ProstgreSQL• Monitoring

04/12/2023 8

CloudBees - Integration

• Github• Cloud Services (AWS, Cloud Front, etc)• IDE, Maven plugins, or Native tools for deployment

04/12/2023 9

DEMONSTRATIONCloudBees

04/12/2023 10

Neustar Load Testing

About Neustar:

• Among other services, Neustar offers cloud-based load testing.

04/12/2023 12

Why choose cloud-based load testing?

• Identify bottlenecks/unusual performance issues before going live.

• Local load testing adds unnecessary load to network/cpu.

• Local load tests originate in one location.

04/12/2023 13

What does Neustar have to offer?

• Real browser tests Browser: Firefox

Asynchronous calls included or blacklisted

Screen shots, video playback of failures

• Basic tests Headless Http client

Ideal for testing web services

10x cheaper than real browser tests

Direct Http calls, faster performance

04/12/2023 14

What does Neustar have to offer?

• Schedule tests, ramp up users to peak load.

• Tests originate from multiple IPs/geographical locations.

• Integrated metrics/report publishing.

• Query and export test results.

• Local and UI script validation.

04/12/2023 15

Anatomy of a test script:

04/12/2023 16

Tests occurin a transaction

A transactionis comprisedof steps

Test scripts written in Javascript

Demo

04/12/2023 17

Gotchas

• File based test resources are unreliable.

• Limited script size (Too many instructions exception).

• Limited client-side SSL support.

• Heap size issues running basic tests.

04/12/2023 18

Gotchas

• No failure pagination (Large failure list causes logging page to become unresponsive).

• Firefox-only in browser tests (Chrome support on 2013 roadmap).

• Number of available agents dependent on origin datacenter (eg: more in DC than Oregon).

• Too many pauses/waits can cause transaction to fail.

04/12/2023 19

Questions?

04/12/2023 20