practical experience in automated testing at pronto marketing
DESCRIPTION
Automated software testing is considered critical for software development organizations. It can save time by performing repetitive but necessary tasks, which are already in place, or some testing that is difficult to perform manually. It saves money as well because a time savings means cost savings. Automated testing can also improve accuracy performing the same steps precisely every time it is executed. More importantly, it can find defects in early stages so that we can quickly respond to them. In this talk, we first discuss our practical experience on using automated testing in our project. We present our process and tools to make test automation possible. Lastly, we discuss 7 deadly sins of automated testing.TRANSCRIPT
Practical Experience in Automated Testing at Pronto Marketing
Thailand Practical Software Engineering Conference 2013
Poomjai Saeyong ft. Kan Ouivirach, PhD
Speakers
Poomjai SaeyongAgile Tester at Pronto Marketing
Kan Ouivirach, PhDResearch and Development Engineer
at Pronto Marketing
Agile Testing Why Automated
Testing?
Automated Testing at Pronto
Marketing? Sins of Automation
Agile Testing
“Agile testing involves all members of a cross-functional Agile team, with special expertise contributed by testers, to ensure delivering the business value desired by the customer at frequent intervals, working at a sustainable pace.”
-- Wikipedia
What is Agile Testing?
Haruka Miyashita
Why Automated Testing?
Image credit: <a href='http://www.123rf.com/photo_23347055_close-up-image-of-human-hand-breaking-dollar-stone-symbol.html'>nexusplexus / 123RF Stock Photo</a>
Benefits
● Test faster● Consistency● Able to run over and over again with less
overhead (save time and money)● Improve accuracy, less human error● Increase test coverage
Automated Testing at Pronto Marketing
● Continuous Integration (CI)○ Buildbot
● Unit Test○ PHPUnit with WordPress Unit Tests http://core.
trac.wordpress.org/browser/tests● Functional Test
○ Selenium + Lettuce
Automated Testing Tools We Use
Continuous Integration Process
Buildbot for Continuous Integrationat Pronto Marketing
PHPUnit with WordPress Unit Tests
+
Functional Test
Seleniumhttp://seleniumhq.org
Lettucehttp://lettuce.it
● Test scripts are too fast.○ No problem for PHPUnit○ Big problem for Selenium + Lettuce
● Language we use in the features are too low level.
● Higher level language would cause a lot of duplicated and complicated steps.
Current Problems We Found
Trade Off
● Flawed comparison between manual test and automation
● Loving the UI so much that all tests are executed through the UI
● Too lazy to maintain automated tests
Sins of Automated Testing
Thank [email protected]@prontomarketing.com
● Content from ○ http://www.methodsandtools.com/archive/archive.php?id=33○ http://www.agileengineeringdesign.com/2012/01/7-deadly-sins-of-
automated-software-testing/● Images from
○ https://plus.google.com/+BrunoOliveira/posts/MGxauXypb1Y○ http://www.ranorex.com/blog/integrating-ranorex-automation-in-
jenkins-continuous-integration-process○ http://www.33rdsquare.com/○ http://www.greenfieldbelser.com/
Credits