Mobiilipäivät 19.12.2005Jussi Niutanen

Selecting a Test Automation Tool for Symbian Environment

Jussi NiutanenPlenware Group Oy

Mobiilipäivät 19.12.2005Jussi Niutanen

Presentation Outline

This presentation bases mostly to my Master of Science Thesis: Test Automation of Symbian Applications

• Plenware• Testing and Symbian Testing • Testing tool evaluation• Generations• Verification• Quick tool check

Mobiilipäivät 19.12.2005Jussi Niutanen

Plenware Today

Turnover: 26 MEUR (estimate 2005)Personnel: 350 Offices:

• Tampere, Turku, Espoo and Oulu

Plenware’s service areas are:• Telecom, Media, Industry, Services and

Quality Assurance Services

More information: www.plenware.com

Mobiilipäivät 19.12.2005Jussi Niutanen

TELECOMMUNICATIONSymbian

• Innovative intelligent applications• Solutions to support the communication between mobile devices and various enviroments• Symbian solutions

– Exploiting the technologies of Series 60 platforms, e.g. Bluetooth communication with the devices in surroundings

– MONA: Motion detecting application– GINA: Password controlled data security

application

• Symbian Platinum Partner• Nokia Forum Pro Member

Mobiilipäivät 19.12.2005Jussi Niutanen

What is Testing?

• "Testing is the process of executing a program or system with the intent of finding errors." (Myers 1979)

• “Testing is the process of establishing confidence that a program or system does what it is supposed to.“ (Hetzel, 1973)

• Operating a system under specified conditions, observing or recording the result, and making an evaluation of some aspect of the system (IEEE, 1990)

[Jo02]

Specified functionality

Implementedfunctionality

Tested functionality

Mobiilipäivät 19.12.2005Jussi Niutanen

Testing Symbian Applications

• Number of phones, platforms etc.• Different types of UI• Sometimes it is impossible to test automatically

• GPRS applications• Microphone• Voice quality

• Changes during the devolopment

Mobiilipäivät 19.12.2005Jussi Niutanen

The Evaluation Process

Mobiilipäivät 19.12.2005Jussi Niutanen

The Five Generations of Testware Development [FeGr99]

1. Linear test scripts 2. Sructured test scripts3. Shared test scripts4. Data driven test scripts5. Keyword-driven test sripts

What means action word testing?

Mobiilipäivät 19.12.2005Jussi Niutanen

Verification Example in 6630

Test result is a picture that depends on:• Day• Time• Is sim card inserted • Is phone connected with USB• Language

Mobiilipäivät 19.12.2005Jussi Niutanen

System Testing Tools

• Nokia Testing Suite• Try (Mobileinnovations) • AppTest (Digia) • QTP & m-Test (Mercury) • Pro Script Recorder (TestQuest) • STS Master (Strategic Test Solutions)

Mobiilipäivät 19.12.2005Jussi Niutanen

Unit Testing Tools

• Eunit (Digia)• TestFrame example (Nokia SDK)• Symbian OS Unit (open source)• QTP & m-Test (Mercury) • Simple driver to one project

Mobiilipäivät 19.12.2005Jussi Niutanen

Summary

• Automation must be done as a project • Generation and verification

Mobiilipäivät 19.12.2005Jussi Niutanen

Thank you for listening.

[Jo02] Paul C. Jorgensen: Software Testing: A Craftsman’s Approach, second edition, CRC Press, 2002.

[FeGr99] Mark Fewster & Dorothy Graham: Software Test Automation. Effective use of test execution tools. Addison-Wesley, 1999.