jan 25 th 2013 test automation: coded ui test 1.introduction 2.internal class structure (generic...

45

Upload: payton-hopps

Post on 31-Mar-2015

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function
Page 2: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Jan 25th 2013

Test Automation:

Coded UI Test

Page 3: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 4: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 5: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Automated Testing

• Ensures you don’t miss out on running a test• Can actually enforce and drive clean design decisions• Have training value

Page 6: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Coded UI Test• Automated tests that drive your application through

its user interface (UI) are also known as coded UI tests (CUITs).

• These tests include functional testing of the UI controls. They let you verify that the whole application, including its user interface, is functioning correctly.

• Coded UI Tests are particularly useful where there is validation or other logic in the user interface, for example in a web page. They are also frequently used to automate an existing manual test.

Page 7: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Coding Process with Coded UI Test• Test Cases• Recording the actions• Coding with testing strategies• Auto-compile and run• If tests fail • Fault in test script-> make appropriate modifications• Bug in the application -> report (PF OOTB)

• If tests pass -> move aheadThey are fun and challenging to write

One has to carefully think of design for reusability and coverage

Page 8: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Recording the actionsCoded UI Test Builder

Start recording

Add assertionShow recorded steps

Generate code

The Coded UI Test builder enables you to record actions and add theminto your existing Coded UI Test

Page 9: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Test Window• Test View window• Test List Editor

Understanding the tests

Page 10: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Identify Portal Framework Defects

• Bugs can be identified by Coded UI Test

Habanero Portal Framework Out Of The Box

Page 11: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Identify Portal Framework Defects

• Bugs cannot be identified by Coded UI Test

Habanero PF Habanero OOTB

Page 12: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 13: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

UI Map Class• The real work takes place• An assortment of supporting classes are generated• Class diagram helps you to understand the relationships and the classes involved.

Page 14: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Generic Library

• Using the auto-generated code in designer.cs Class is very inefficient

• Construct an efficient, reusable, beautiful libraries

Page 15: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Even More Generic

Page 16: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Class Diagram• Document Library• List• Calendar• Page• Asset

Page 17: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 18: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

The Automated Test Framework

Page 19: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Program Pattern

Page 20: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 21: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Framework function

https://h.habaneros.com/teamsites/QA/Lists/Framework%20Functions/AllItems.aspx

or visit QA site:

• These framework functions will be documented in our Habanero QA site

Page 22: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 23: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Demo

• ContentPF• Test Cases: 1. Add content to a page

2. Edit the content of a page 3. Apply a markup style to content on a page 4. Edit the HTML of the content on a page

• ListInheritancePF• Test Cases: 1. Break inheritance on a list

2. Break inheritance on a single list item• ListWorkflowPF

• Test Cases: 1. Define a workflow for a list 2. Perform workflow on a list item

• PagePF• Test Cases: 1. Create new page

2. Modify page properties 3. Check in/ Check out a page 4. Delete a page 5. Email a link to a page

I will run the following tests if time permits:

Page 24: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 25: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Reliability• Controls & Actions

• Ensure the program find the correct controls• Ensure the actions get executed

• Unstable Tests• Some tests may wander between Pass and Fail

• Use Meaningful name • helps identify the purpose of the method

• Limit each recorded method to fewer than 10 actions• Makes it easier to replace a method if the environment changes

• Use the data from app.config file instead of hardcoding the data• Increase the reliability of making an assertion

Page 26: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 27: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Usability & Reusability

• Coded UI Tests are completely reusable• Need to setup a continuous integration server• Create libraries as the codebase

• Customize Search Properties• Overwrite Search properties with parameters

• Customize Complete Functions

• Atomic Tests• Tests are not depend on other tests

• Reusable modules (The BaseTest Class)• Common test functions

Page 28: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Customized Search Properties

Page 29: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Customized Search Properties

Page 30: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Customized Functions

Page 31: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Customized Methods

Page 32: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 33: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Efficiency

• Web Page Navigation

Page 34: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Efficiency

• Eliminate Delay

Page 35: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Efficiency• Add Delay

Sometimes, the control runs faster than the web browser

Page 36: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Page 37: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Test Cases

Coded UI Test

TFS

MTM

Client Projects

BuildProcess

Page 38: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Test Cases

Build Process

At this point, we have created numerous Test Cases.

We can execute a Coded UI Test Case simply by taking the compiled assembly and executing it with Visual Studio or MSTest from the command line,which require us to sit there and do nothing while the test executes

Another way:

Associate Coded UI Tests and Test CasesRun the tests from Microsoft Test Manager

Page 39: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

MSTest

Page 40: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Associating Coded UI Tests and Test Cases (TFS)

Page 41: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Microsoft Test Manager

Page 42: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Next Step ( a typical way)• Set Up Team Build

• With correct build definition and configuration• So that the automated test can be found in the share location for the

build definition and then it can be run from MTM

• Create Test Settings and Virtual (Physical) Environment• We cannot run Coded UI Tests using MTM without an

environment• Create an environment that contains the roles in the test

settings and then use this environment in the test plan

Page 43: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Sometimes, things don’t work the way you want it to be.

Page 44: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function

Thank you

If you have any comments on the coded UI test,feel free to let me know

Page 45: Jan 25 th 2013 Test Automation: Coded UI Test 1.Introduction 2.Internal Class Structure (Generic Structure) 3.Program architecture 4.Framework function