Transcript
Page 1: Practical Experience in Automated Testing at Pronto Marketing

Practical Experience in Automated Testing at Pronto Marketing

Thailand Practical Software Engineering Conference 2013

Poomjai Saeyong ft. Kan Ouivirach, PhD

Page 2: Practical Experience in Automated Testing at Pronto Marketing

Speakers

Poomjai SaeyongAgile Tester at Pronto Marketing

Kan Ouivirach, PhDResearch and Development Engineer

at Pronto Marketing

Page 3: Practical Experience in Automated Testing at Pronto Marketing
Page 4: Practical Experience in Automated Testing at Pronto Marketing

Agile Testing Why Automated

Testing?

Automated Testing at Pronto

Marketing? Sins of Automation

Page 5: Practical Experience in Automated Testing at Pronto Marketing

Agile Testing

Page 6: Practical Experience in Automated Testing at Pronto Marketing

“Agile testing involves all members of a cross-functional Agile team, with special expertise contributed by testers, to ensure delivering the business value desired by the customer at frequent intervals, working at a sustainable pace.”

-- Wikipedia

What is Agile Testing?

Page 7: Practical Experience in Automated Testing at Pronto Marketing

Haruka Miyashita

Page 8: Practical Experience in Automated Testing at Pronto Marketing
Page 9: Practical Experience in Automated Testing at Pronto Marketing
Page 10: Practical Experience in Automated Testing at Pronto Marketing
Page 11: Practical Experience in Automated Testing at Pronto Marketing

Why Automated Testing?

Page 12: Practical Experience in Automated Testing at Pronto Marketing

Image credit: <a href='http://www.123rf.com/photo_23347055_close-up-image-of-human-hand-breaking-dollar-stone-symbol.html'>nexusplexus / 123RF Stock Photo</a>

Page 13: Practical Experience in Automated Testing at Pronto Marketing
Page 14: Practical Experience in Automated Testing at Pronto Marketing
Page 15: Practical Experience in Automated Testing at Pronto Marketing
Page 16: Practical Experience in Automated Testing at Pronto Marketing

Benefits

● Test faster● Consistency● Able to run over and over again with less

overhead (save time and money)● Improve accuracy, less human error● Increase test coverage

Page 17: Practical Experience in Automated Testing at Pronto Marketing

Automated Testing at Pronto Marketing

Page 18: Practical Experience in Automated Testing at Pronto Marketing

● Continuous Integration (CI)○ Buildbot

● Unit Test○ PHPUnit with WordPress Unit Tests http://core.

trac.wordpress.org/browser/tests● Functional Test

○ Selenium + Lettuce

Automated Testing Tools We Use

Page 19: Practical Experience in Automated Testing at Pronto Marketing

Continuous Integration Process

Page 20: Practical Experience in Automated Testing at Pronto Marketing

Buildbot for Continuous Integrationat Pronto Marketing

Page 21: Practical Experience in Automated Testing at Pronto Marketing

PHPUnit with WordPress Unit Tests

Page 22: Practical Experience in Automated Testing at Pronto Marketing

+

Functional Test

Page 23: Practical Experience in Automated Testing at Pronto Marketing

Seleniumhttp://seleniumhq.org

Page 24: Practical Experience in Automated Testing at Pronto Marketing

Lettucehttp://lettuce.it

Page 25: Practical Experience in Automated Testing at Pronto Marketing
Page 26: Practical Experience in Automated Testing at Pronto Marketing

● Test scripts are too fast.○ No problem for PHPUnit○ Big problem for Selenium + Lettuce

● Language we use in the features are too low level.

● Higher level language would cause a lot of duplicated and complicated steps.

Current Problems We Found

Page 27: Practical Experience in Automated Testing at Pronto Marketing

Trade Off

Page 28: Practical Experience in Automated Testing at Pronto Marketing

● Flawed comparison between manual test and automation

● Loving the UI so much that all tests are executed through the UI

● Too lazy to maintain automated tests

Sins of Automated Testing

Page 30: Practical Experience in Automated Testing at Pronto Marketing

● Content from ○ http://www.methodsandtools.com/archive/archive.php?id=33○ http://www.agileengineeringdesign.com/2012/01/7-deadly-sins-of-

automated-software-testing/● Images from

○ https://plus.google.com/+BrunoOliveira/posts/MGxauXypb1Y○ http://www.ranorex.com/blog/integrating-ranorex-automation-in-

jenkins-continuous-integration-process○ http://www.33rdsquare.com/○ http://www.greenfieldbelser.com/

Credits


Top Related