test principles and concepts 97

8/6/2019 Test Principles and Concepts 97

1/26

Test Principles and ConceptsTest Principles and ConceptsCSTE Body of KnowledgeCSTE Body of Knowledge

Category II: Test Skills/ApproachesCategory II: Test Skills/ApproachesDomain 5: Testing Principles andDomain 5: Testing Principles and

ConceptsConcepts


2/26

Testing Principles and ConceptsTesting Principles and Concepts

Definition of Test SpecificationsDefinition of Test Specifications Testing Techniques (Not covered)Testing Techniques (Not covered) Testing Methods (Not covered)Testing Methods (Not covered) Independent Testing (Not covered)Independent Testing (Not covered)

Commercial Off The Shelf (COTS)Commercial Off The Shelf (COTS)Software (Not covered)Software (Not covered)


3/26

Testing Principles and ConceptsTesting Principles and Concepts

Testing Code Developed Under OutsideTesting Code Developed Under OutsideContract (Not covered)Contract (Not covered)

Test Quality (Not covered)Test Quality (Not covered) Testing Life Cycle (Not covered)Testing Life Cycle (Not covered)VocabularyVocabulary


4/26

Definition of Test SpecificationsDefinition of Test Specifications

Establishing test objectivesEstablishing test objectives PurposePurposeApproachesApproaches Pass/fail criteriaPass/fail criteria

Entrance/exit criteriaEntrance/exit criteria


5/26

Establishing Test ObjectivesEstablishing Test Objectives

The process of exercising software toThe process of exercising software toverify that it satisfies specifiedverify that it satisfies specified

requirements and to detect errorsrequirements and to detect errors GlossaryGlossaryof The British Computer Society Specialist Interest Group inof The British Computer Society Specialist Interest Group inSoftware TestingSoftware Testing


6/26


Factors for determining objectivesFactors for determining objectives Nature of applicationNature of application

Code CoverageCode Coverage

TechnologyTechnology

PlatformPlatform

User RequirementsUser Requirements Government RegulationsGovernment Regulations


7/26


ExamplesExamples

To obtain a 85% passing rate on allTo obtain a 85% passing rate on allassigned tests casesassigned tests cases

To ensure software is compliant withTo ensure software is compliant withcurrent HIPPA codecurrent HIPPA code

To verify database access time is reducedTo verify database access time is reducedby 35%by 35%


8/26

Purpose of TestingPurpose of Testing

The purpose of testing is to discoverThe purpose of testing is to discovererrors. Testing is the process of trying toerrors. Testing is the process of trying to

discover every conceivable fault ordiscover every conceivable fault orweakness in a work product.weakness in a work product. The Art of SoftwareThe Art of SoftwareTesting, Glenford MyerTesting, Glenford Myer

The purpose of testing is to ensure theThe purpose of testing is to ensure thecustomers spoken and unspokencustomers spoken and unspokenexpectations are met.expectations are met. Mark Curtiss, VeriTestMark Curtiss, VeriTest


9/26


Detect the existence of defectsDetect the existence of defects Ensure functionality and usabilityEnsure functionality and usability Increase customer satisfactionIncrease customer satisfaction Reduce legal liabilityReduce legal liability

Ensure compliance with governmentEnsure compliance with governmentregulationsregulations


10/26


ExamplesExamples

To reduce support calls on new productTo reduce support calls on new productreleases by 25% over previous yearsreleases by 25% over previous years

Find and fix all critical defects prior toFind and fix all critical defects prior toreleaserelease

Verify boundary conditions are notVerify boundary conditions are not

exceeded on a given fieldexceeded on a given field


11/26

Testing ApproachesTesting Approaches

BlackBlack--box testingbox testing WhiteWhite--box testingbox testing Regression testingRegression testing Stress testingStress testing

Load testingLoad testing

Configuration testingConfiguration testing


12/26

Pass / Fail CriteriaPass / Fail Criteria

Ensure textbox will not recognize numbersEnsure textbox will not recognize numbers Ensure Next button will take user to theEnsure Next button will take user to the

next pagenext page

Ensure all components are removed afterEnsure all components are removed afteran Uninstallan Uninstall


13/26

Entrance / Exit CriteriaEntrance / Exit Criteria

Vendor Validation testing has beenVendor Validation testing has beencompleted without any failurescompleted without any failures

All tests have been run successfullyAll tests have been run successfully Code Complete has been reachedCode Complete has been reached


14/26

Sample Exam QuestionsSample Exam Questions

Critical Skills QuestionsCritical Skills Questions What is COTS?What is COTS?

Commerical offCommerical off--the shelf software (shrinkthe shelf software (shrink--

wrapped)wrapped)


15/26


Critical Skills QuestionsCritical Skills Questions The purpose of software testing is to :The purpose of software testing is to :

a)a) Demonstrate that the application worksDemonstrate that the application works

properlyproperlyb)b) Detect the existence of defectsDetect the existence of defects

c)c) Validate the logical designValidate the logical design


16/26


Critical Skills QuestionsCritical Skills Questions The purpose of software testing is to :The purpose of software testing is to :

a)a) Demonstrate that the application worksDemonstrate that the application works

properlyproperlyb)b) Detect the existence of defectsDetect the existence of defects

c)c) Validate the logical designValidate the logical design


17/26


Critical Skills QuestionsCritical Skills Questions For blackFor black--box testing:box testing:

a)a) The tester is completely unconcerned aboutThe tester is completely unconcerned about

the internal behavior of the programthe internal behavior of the programb)b) The tester is concerned with findingThe tester is concerned with finding

circumstances in which the program doescircumstances in which the program doesnot behave according to specificationsnot behave according to specifications

c)c) Test data is derived solely fromTest data is derived solely fromspecificationsspecifications

d)d) All the aboveAll the above


18/26


Critical Skills QuestionsCritical Skills Questions For blackFor black--box testing:box testing:

a)a) The tester is completely unconcerned aboutThe tester is completely unconcerned about

the internal behavior of the programthe internal behavior of the programb)b) The tester is concerned with findingThe tester is concerned with finding

circumstances in which the program doescircumstances in which the program doesnot behave according to specificationsnot behave according to specifications

c)c) Test data is derived solely fromTest data is derived solely fromspecificationsspecifications

d)d) All the aboveAll the above


19/26


Critical Skills QuestionsCritical Skills Questions Boundary value testing:Boundary value testing:

a)a) Is the same as equivalence partitioning testsIs the same as equivalence partitioning tests

b)b) Test boundary conditions on, above, andTest boundary conditions on, above, andbelow the edges of input and outputbelow the edges of input and outputequivalence classesequivalence classes

c)c) Tests combinations of input circumstancesTests combinations of input circumstancesd)d) Is used in whiteIs used in white--box testing strategybox testing strategy


20/26


Critical Skills QuestionsCritical Skills Questions Boundary value testing:Boundary value testing:

a)a) Is the same as equivalence partitioning testsIs the same as equivalence partitioning tests

b)b) Test boundary conditions on, above, andTest boundary conditions on, above, andbelow the edges of input and outputbelow the edges of input and outputequivalence classesequivalence classes

c)c) Tests combinations of input circumstancesTests combinations of input circumstancesd)d) Is used in whiteIs used in white--box testing strategybox testing strategy


21/26


Critical Skills QuestionsCritical Skills Questions Decision/branch coverage strategy:Decision/branch coverage strategy:

a)a) Always satisfies statement coverageAlways satisfies statement coverage

b)b) Is used in blackIs used in black--box testingbox testing

c)c) Means that every branch direction isMeans that every branch direction istraversed at least oncetraversed at least once

d)d) Is the same as condition coverageIs the same as condition coverage


22/26


Critical Skills QuestionsCritical Skills Questions Decision/branch coverage strategy:Decision/branch coverage strategy:

a)a) Always satisfies statement coverageAlways satisfies statement coverage

b)b) Is used in blackIs used in black--box testingbox testing

c)c) Means that every branch direction isMeans that every branch direction istraversed at least oncetraversed at least once

d)d) Is the same as condition coverageIs the same as condition coverage


23/26


Critical Skills QuestionsCritical Skills Questions Acceptance testing means:Acceptance testing means:

a)a) Testing performed on a single standTesting performed on a single stand--alonealone

module or unit of codemodule or unit of codeb)b) Testing after changes have been made toTesting after changes have been made to

ensure that no unwanted changes wereensure that no unwanted changes wereintroducedintroduced

c)c) Testing to ensure that the system meets theTesting to ensure that the system meets theneeds of the organization and the end userneeds of the organization and the end user


24/26


Critical Skills QuestionsCritical Skills Questions Acceptance testing means:Acceptance testing means:

a)a) Testing performed on a single standTesting performed on a single stand--alonealone

module or unit of codemodule or unit of codeb)b) Testing after changes have been made toTesting after changes have been made to

ensure that no unwanted changes wereensure that no unwanted changes wereintroducedintroduced

c)c) Testing to ensure that the system meets theTesting to ensure that the system meets theneeds of the organization and the end userneeds of the organization and the end user


25/26


Critical Skills QuestionsCritical Skills Questions Joe is performing a test to see that it compliesJoe is performing a test to see that it complies

with the user requirements that a certain fieldwith the user requirements that a certain field

be populated by using a dropdown boxbe populated by using a dropdown boxcontaining a list of values. Joe is performing:containing a list of values. Joe is performing:

a)a) WhiteWhite--box testingbox testing

b)b) BlackBlack--box testingbox testing

c)c) Load testingLoad testingd)d) Regression testingRegression testing


26/26


Critical Skills QuestionsCritical Skills Questions Joe is performing a test to see that it compliesJoe is performing a test to see that it complies

with the user requirements that a certain fieldwith the user requirements that a certain field

be populated by using a dropdown boxbe populated by using a dropdown boxcontaining a list of values. Joe is performing:containing a list of values. Joe is performing:

a)a) WhiteWhite--box testingbox testing

b)b) BlackBlack--box testingbox testing

c)c) Load testingLoad testingd)d) Regression testingRegression testing

test principles and concepts 97

Documents