practical experience in automated testing at pronto marketing

Practical Experience in Automated Testing at Pronto Marketing

Thailand Practical Software Engineering Conference 2013

Poomjai Saeyong ft. Kan Ouivirach, PhD

Speakers

Poomjai SaeyongAgile Tester at Pronto Marketing

Kan Ouivirach, PhDResearch and Development Engineer

at Pronto Marketing

Agile Testing Why Automated

Testing?

Automated Testing at Pronto

Marketing? Sins of Automation

Agile Testing

“Agile testing involves all members of a cross-functional Agile team, with special expertise contributed by testers, to ensure delivering the business value desired by the customer at frequent intervals, working at a sustainable pace.”

-- Wikipedia

What is Agile Testing?

Haruka Miyashita

Why Automated Testing?

Image credit: <a href='http://www.123rf.com/photo_23347055_close-up-image-of-human-hand-breaking-dollar-stone-symbol.html'>nexusplexus / 123RF Stock Photo</a>

Benefits

● Test faster● Consistency● Able to run over and over again with less

overhead (save time and money)● Improve accuracy, less human error● Increase test coverage

Automated Testing at Pronto Marketing

● Continuous Integration (CI)○ Buildbot

● Unit Test○ PHPUnit with WordPress Unit Tests http://core.

trac.wordpress.org/browser/tests● Functional Test

○ Selenium + Lettuce

Automated Testing Tools We Use

Continuous Integration Process

Buildbot for Continuous Integrationat Pronto Marketing

PHPUnit with WordPress Unit Tests

+

Functional Test

Seleniumhttp://seleniumhq.org

Lettucehttp://lettuce.it

● Test scripts are too fast.○ No problem for PHPUnit○ Big problem for Selenium + Lettuce

● Language we use in the features are too low level.

● Higher level language would cause a lot of duplicated and complicated steps.

Current Problems We Found

Trade Off

● Flawed comparison between manual test and automation

● Loving the UI so much that all tests are executed through the UI

● Too lazy to maintain automated tests

Sins of Automated Testing

Thank Youboss@prontomarketing.comkan@prontomarketing.com

● Content from ○ http://www.methodsandtools.com/archive/archive.php?id=33○ http://www.agileengineeringdesign.com/2012/01/7-deadly-sins-of-

automated-software-testing/● Images from

○ https://plus.google.com/+BrunoOliveira/posts/MGxauXypb1Y○ http://www.ranorex.com/blog/integrating-ranorex-automation-in-

jenkins-continuous-integration-process○ http://www.33rdsquare.com/○ http://www.greenfieldbelser.com/

Credits