qa lab in the cloud
DESCRIPTION
Slides from a seminar done in January 2013 by Dynacron Group. Note that these slides are from a hands on presentation & demo - come to our next seminar to get the full effect. http://www.dynacrongroup.com/newsletterTRANSCRIPT
QA LAB IN THE CLOUDDynacron GroupSlides from Jan 2013 Seminar
04/12/2023 1
Summary
• These slides are from a January 2013 seminar by Dynacron Group
• The slides were intended to be viewed as part of a demonstration• We’ll probably post video of it next time
• To stay in touch, sign up for our newsletter!• http://www.dynacrongroup.com/newsletter
04/12/2023 2
Cross Browser Visual Comparison
• Layout• Image Loading• JavaScript Errors• Smell test
04/12/2023 3
Browser Visual Diff Tools
•Browsera•BrowserBite• Browsershots• Adobe BrowserLab• Sauce Scout• ...and many more
04/12/2023 4
Key Features
• Local/Remote• Browser Selection• Public/Private• Authentication• Screenshot Comparison
• Side by side? Overlay? Highlighting? Manual?• Link Crawling• JavaScript Validation
04/12/2023 5
DEMONSTRATIONBrowsera and BrowserBite
04/12/2023 6
Cloud Infrastructure• AWS• Cloud Foundry• Heroku• CloudBees• … and many, many more
04/12/2023 7
CloudBees
• Complete Java Infrastructure Solution• Development Pipeline
• Source Control: svn or git• Build Server: Jenkins, Sonar• Binary Repository
• Production• Application Servers: Jboss, Tomcat, etc• Database: MySQL, Mongo, Couch, ProstgreSQL• Monitoring
04/12/2023 8
CloudBees - Integration
• Github• Cloud Services (AWS, Cloud Front, etc)• IDE, Maven plugins, or Native tools for deployment
04/12/2023 9
DEMONSTRATIONCloudBees
04/12/2023 10
Neustar Load Testing
About Neustar:
• Among other services, Neustar offers cloud-based load testing.
04/12/2023 12
Why choose cloud-based load testing?
• Identify bottlenecks/unusual performance issues before going live.
• Local load testing adds unnecessary load to network/cpu.
• Local load tests originate in one location.
04/12/2023 13
What does Neustar have to offer?
• Real browser tests Browser: Firefox
Asynchronous calls included or blacklisted
Screen shots, video playback of failures
• Basic tests Headless Http client
Ideal for testing web services
10x cheaper than real browser tests
Direct Http calls, faster performance
04/12/2023 14
What does Neustar have to offer?
• Schedule tests, ramp up users to peak load.
• Tests originate from multiple IPs/geographical locations.
• Integrated metrics/report publishing.
• Query and export test results.
• Local and UI script validation.
04/12/2023 15
Anatomy of a test script:
04/12/2023 16
Tests occurin a transaction
A transactionis comprisedof steps
Test scripts written in Javascript
Demo
04/12/2023 17
Gotchas
• File based test resources are unreliable.
• Limited script size (Too many instructions exception).
• Limited client-side SSL support.
• Heap size issues running basic tests.
04/12/2023 18
Gotchas
• No failure pagination (Large failure list causes logging page to become unresponsive).
• Firefox-only in browser tests (Chrome support on 2013 roadmap).
• Number of available agents dependent on origin datacenter (eg: more in DC than Oregon).
• Too many pauses/waits can cause transaction to fail.
04/12/2023 19
Questions?
04/12/2023 20