cstm workshop

8/7/2019 CSTM workshop

http://slidepdf.com/reader/full/cstm-workshop 1/26

CSTM Course

Workshop Exercises

2007

STQC IT ServicesDepartment of Information Technology

Government of IndiaETDC, Bangalore



STQC IT SERVICES

CSTM Workshop Exercises Aug 2007 2

Contents

Workshop I Software Inspection of Software Bus Reservation System 01

Workshop II Black Box Testing of program 16

Workshop III Cause-Effect Graph 17

Workshop IV Functional Testing of Software Bus Reservation System 18

Workshop V State Transition Testing 19

Workshop VI Application of orthogonal arrays to GUI testing 20

Workshop VII Integration / System Testing 22

Workshop VIII Application of Risk Analysis to a Testing Project 25

Workshop IX Software Test Project Management 26



STQC IT SERVICES


Workshop I (Software Inspection of Software Requirement Specification)

The SRS of a program 'Bus Reservation System' is given in the following pages. Theexercise is to carry out a software inspection. The participants have to study the SRSand look for major non-trivial defects. All trivial defects may be listed and given directlyto the author, as they do not merit discussion. The 'logging meeting' will be held

facilitated by an Inspection Leader (IL). The IL will present the defects logged by thegroup in the format given.

Bus Reservation System - Software Requirements specificationReleased on 28 July, 2007

Version 1.0

1 Introduction

1.1 Purpose

The purpose of the Software Requirements Specification document is to define thesoftware functional requirements for reservation at a bus station. The document shallbe used as a baseline for development of the system. The SRS will describe therequirements for the client portion of the system. In addition the document will describehow the clients will be connected to the server.

1.2 Product perspective

Bangalore has found its growth is rapid phase. As the city grows, the requirement of thepeople also increases in every aspect of their life. The requirement may be big or smallbut Technology has provided solutions to every requirements. For example reserving a

bus ticket with ease is a crucial task in busy cities like Bangalore, but Bus Reservation System makes the task even simpler than imagined.

Bus Reservation System is a generalised software application, where the customerscan easily reserve tickets at different reservation centres commissioned in Bangalore.The system also provides a smooth interface to Booking Clerks and dynamicinformation’s are found with ease. Administrator can easily configure and maintain thesystem.

1.3 Project Scope

The bus reservation system shall be a multi-user client / server application designed for booking tickets by clerks of KSRTC, running buses to all the major destinations aroundBangalore. Using the BRS, Administrator can configure the Reservation system andeach booking clerk including Administrator can provide reservation services tocustomers.

The system supports Up to 91 users including the Administrator. They can makereservations, update it, delete it and prepare various types of reports.



STQC IT SERVICES


2.4.1 Server System Software

The system software required is Windows 2003, Oracle server 10G.

2.4.2 Client System Software

The system software required are Windows XP professional, .Net framework

2.5 Communication Interfaces

Central Server

Booking Office Server 1

BookingClerk 1

BookingClerk 10



Administrator LAN

WAN

BookingClerk 10

BookingClerk 10

BookingClerk 1

BookingClerk 1

LAN 1 LAN 2 LAN 9(Block diagram of network connectivity)

• Data transfer between the Central Server and Booking Office Server would bedone over WAN

• Data transfer between the Booking Office Server and Booking clerk would bedone over LAN

• Administrator will be monitoring the Central server and he can also book thetickets like a Booking clerk.



STQC IT SERVICES


The list of valid users created by the Administrator is viewed in a list box.3.2 Create a New order

The booking clerk or the administrator, when they are in the booking mode, create anew reservation for the customer as follows:



STQC IT SERVICES




STQC IT SERVICES


The customer gives the date, destination and bus type (ordinary/express). The clerkselects the date from the given calendar, routes from the routes table and fills thepassenger name and number of tickets. The total fare is automatically accounted. Theroute number appears and the reservation code appears automatically on pressing thereserve option.

NOTE: The reservation screen is divided into bus schedule section containing thecalendar and the route table and the Reservation Information section containing reservation information.

3.3 ERROR MESSAGES

(1) If number of tickets is more than 10 then message "Cannot reserve ticket(s) morethan 10"

(2) If date of journey before current date then message " Valid date of journey datesmust be on or after..."

(3) If Date/time of bus schedule is prior to current date/time then message "Thereservation date must be greater than the current date and current time"

3.4 Delete Order

To delete current order just press " delete" in Reservation information section. OnConfirmation of request the particular reservation with Reserve code id is deleted

3.5 Update Order

After reservation, the order can be updated by editing information’s like schedule and

name, number of tickets etc.

3.6 Open an Existing order

An existing order can be opened, updated or deleted.

To open an order, press open from main menu, then a search engine appears and youcan search the record by passenger name, date of journey or reservation code.

You can select the order or cancel the search .The process of update and deletes canbe done as before.

If a search is requested for an Invalid passenger then, error message "Record is notfound' ' appears.

If no record is found for a particular date of journey, message "Record is not found". If reservation code is not existing then message" Record is not found".

3.7 Administrator Functions



STQC IT SERVICES


• Administrator’s security validation is done through Admin validation Form

3.7.1 Add User



STQC IT SERVICES


The Administrator screen appears first and the administrator has to validate using hispassword. Once validated, he can add new user with User name and password .Onsuccessful user addition the message-" New user is successfully created" appears. Thenew user is added to list on right.

3.7.2 Delete User

The administrator security is first verified. Then the delete user screen appears and auser can be deleted. Confirmation is required before final deletion.

3.7.3 Edit User

This option shows list of existing users and only their name can be edited.

3.7.4 Change Password

The administrator can change the password for himself or any of the users after securityvalidation. The user list appears on the right side. The administrator password must be

alphanumeric and at least 5 characters long.

3.7.5 MODIFY & ADD NEW ROUTES



STQC IT SERVICES


On security validation, the administrator can modify and add new routes. The routeentry screen appears. The route number can be selected from a list box. On 'browse'all the trips on this route for type ordinary/Express with fare will appear. The cost of ticket also appears. The departure time and fare can be modified and updated onconfirmation. Any particular route can be selected and with proper departure time androute id, can be deleted. A new route can be added by writing a route number,Departure time, from/to travel type and price.

3.8 REPORTS

(1) Current year reservation report can be obtained on printer.

(2) Period wise reservation report can be obtained on giving starting date and endingdate. The reports will be Route NO wise, date wise or give total amount at end of report.

4 Non-functional Requirements

4.1 Performance

4.1.1 Response time of the Bus Reservation System should be less than 2 second .

Response time refers to the waiting time while the system accesses, queries and

retrieves the information from the databases (DB-user, DB-schedule etc) (A local



STQC IT SERVICES


copy of Bus schedule database is maintained as DB-schedule to reduce this

access time)

4.1.2 The server must be able to handle 10 simultaneous requests.

4.1.3 BRS shall show no visible deterioration in response time as the number of users

or bus schedule data increases

4.2 Reliability

4.2.1 BRS shall be available 24 hours a day, 7 days a week

4.2.2 BRS shall always provide real time information about bus availability information.

4.2.3 BRS shall be robust enough to have a high degree of fault tolerance. For

example, if the user enters a negative number of passengers or a value too

large, the system should not crash and shall identify the invalid input and

produce a suitable error message.4.2.4 BRS shall be able to recover from hardware failures, power failures and other

natural catastrophes and rollback the databases to their most recent valid state.

4.3 Usability

4.3.1 BRS shall provide a easy-to-use graphical interface similar to other existing

reservation system so that the users do not have to learn a new style of

interaction.

4.3.2 The WAN interface should be intuitive and easily navigable Users should be able

to understand the menu and options provided by BRS.

4.3.3 Any notification or error messages generated by BRS shall be clear, succinct,

polite and free of jargon.

4.4 Integrity

4.4.1 Only system administer has the right to change system parameters, such as bus

routes and pricing policy etc. The system should be secure and must use

encryption to protect the databases.

4.4.2 Users need to be authenticated before having access to any personal data.

5 Other requirements

5.1 Main Reservation Form



STQC IT SERVICES


The main reservation window is divided into two sections:

1. Bus schedule; and2. Order information

5.2 Description of fields

All read only fields are filled automatically from the route database after a particular journey detail is selected.

5.3 Routes Table

Pressing the Routes button in the main window can assess the route table. It containsall the routes with from and to destinations, cost per ticket, and timings. The selectedinformation will appear in the reservation read only edit fields.

6 Future Requirements6.1 Support for waiting list functionality

6.2 BRS shall be made more flexible in ticket reservation handling, and shall accept

waiting list for reservation.

6.3 BRS shall be made more dynamic and helpful to the users by enabling it to send

instant messages to the passengers, of a cancelled or rescheduled bus, through

email, phone, fax etc., informing them about the change, and providing them with

other feasible alternatives.

6.4 Provide service integration with auto rental agencies and hotel chains.

6.5 Interface for the travel agents shall be provided in the future versions with

additional features like informing them of any availability of seats on a bus

which was earlier booked to capacity.

6.6 Choices like aisle or window seats shall be provided to the users.

6.7 The BRS shall be able to handle the situation where bus services are availableto multiple bus-stations in a single city.



STQC IT SERVICES


Specification Review Check List

• Do stated goals and objectives for software remain consistent will system goals andobjectives.

• Have important interfaces to all system elements been described?• " Is information flow and structure adequately defined for the problem?• Are diagrams clear? Can each stand alone without supplementary text?• Do major functions remain within scope and has each been adequately described?• Is the behaviour of the software consistent with the information it must process and

the functions it must perform?• Are design constraints realistic?• Have the technological risks of development been considered?• Have alternative software requirements been considered?• Have validation criteria been stated in detail? Are they adequate to describe a

successful system?• Do inconsistencies, omissions, or redundancies exist?• Is the customer contact complete?• Has the user reviewed the preliminary user's manual or prototype?• How are planning estimates affected?• Be on the lookout for persuasive connectors (e.g., certainly, therefore, clearly,

obviously, it follows that), and ask 'why?"• Watch out for vague terms (e.g., some, sometimes, often, usually,

ordinarily, most, mostly); ask for clarification.•

Watch lists are given, but not completed, be sure all items are understood. Keys tolook for: 'etc., and so forth, and so on, such as."• Be sure stated ranges don't contain unstated assumptions (e.g., Valid codes range

from 10 to 100. Integer? Real? Hex?).• Beware of vague verbs such as "Handled, rejected, processed, skipped, eliminated.'

They can be interpreted in many ways.• Beware ambiguous pronouns (e.g., The I/O module communicates with the data

validation module and its control flag is set. Whose control flag?)• Look for statements that imply certainty (e.g., always, every, all, none, never), then

ask fur proof.• When a term is explicitly defined in one place, try substituting the definition for other

occurrences of the term.• When a structure is described in words, draw a picture to aid in understanding.• When a calculation is specified, work at least two examples.



STQC IT SERVICES

Workshop II (Black Box Testing)Bookman & Co offers trade discount to established booksellers and others for a newlyreleased best seller. The specification for discounts is as follows:For private customers or libraries:if mode of payment is cash, then, discount 20%;if mode of payment is credit card then, discount is 10%,

If order quantity is less than 6 and greater than 60 then there is no sale andappropriate messages are displayed for all types of customers.

For Book sellersIf order quantity is >= 6 and <= 20 and mode of payment is cash, then, discount 5% andif mode of payment is credit card, then discount 4%.If order quantity >20 and <=60 and mode of payment is cash, then discount 15%; if mode of payment is credit card, then discount 13%.

For this specification write test cases for:Equivalence partitioning and boundary value testing.

16



STQC IT SERVICES

Workshop III : Cause-Effect Graph.

A database management system requires that each file in the database have itsname listed in a master index which identifies the location of each file. The indexis divided into ten sections. A small system is being developed which will allow the

user to interactively enter a command to display any section of the index at histerminal. Cause – effect graphing is used to develop a set of test cases for thesystem.

The specification for this system is as follows:To display one of the ten possible index sections, a command must be enteredconsisting of a letter and digit. The first character entered must be a D (for display)or an L (for list) and it must be in column 1. The second character entered must be adigit (0 –9) in column 2. If this command occurs, the index section identified by thedigit is displayed on the terminal. If the first character is incorrect, error message A isprinted. If the second character is incorrect, error message B is printed. The error

messages are:A: INVALID COMMANDB: INVALID INDEX NUMBER

The causes and effects have been identified as follows. Each hasbeen assigned a unique number.

Causes1. Character in column 1 is D.2. Character in column 1 is L.3. Character in column 2 is a digit.

Effects50. Index section is displayed/listed.51. Error message A is displayed.52. Error message B is displayed.

17



STQC IT SERVICES

Workshop IV (Functional Testing of Software Bus Reservation System)

1.0 AimTo design test cases for the software Bus Reservation System using black boxtesting strategy.

2.0 Documents availableSRS DocumentUser Interfaces

3.0 ScopePrepare the black box test cases as per the given SRS and UI diagrams

Hint: Make the following Test ClustersLogin TestsDB Operations

Administrator functions

Modify & Add new routesReport Generation

18



STQC IT SERVICES

19

Workshop V : State Transition Testing

Write Test cases for the following State Transition Diagram.

Stop, resetStart

Start// Time=increasing value

Initial state //Time=0

resetReset

// Time=0

Start// Time=increasing value stop

Reset // Time=last value // Time=0

s

Paused

RunningIdle

Stop



STQC IT SERVICES

20

Workshop VI : Application of Orthogonal Arrays to configuration testing

The testing of a web site requires that it must operate correctly with:• Different browsers-Internet Explorer 5.0, 5.5, and 6.0. Netscape 6.0, 6.1,

7.0, Mozilla 1.1 and opera 7 ( 8 choices)• Different plug-ins-Real player, media Player or AV Rack (3 choices)• Running on different client operating system-Windows 95, 98, ME, NT,

2000, and XP (6 Choices)• Receiving pages from different servers-IIS, Apache and Web Logic (3

Choices)• Running on different server operating system-Windows NT, 2000 and

Linux.(3 choices)Given the following array how would you map the requirements to it. Give asample of 2-3 test configurations for this project.

Factor1 Factor2 Factor3 Factor4 Factor5Run1 1 1 1 1 1Run2 1 4 3 4 4Run3 1 4 2 4 4Run4 1 1 4 1 1Run5 1 3 5 3 3Run6 1 2 7 2 2Run7 1 2 6 2 2Run8 1 3 8 3 3Run9 3 4 1 3 3Run10 3 1 3 2 2Run11 3 1 2 2 2Run12 3 4 4 3 3

Run13 3 2 5 1 1Run14 3 3 7 4 4Run15 3 3 6 4 4Run16 3 2 8 1 1Run17 2 3 1 2 1Run18 2 2 3 3 4Run19 2 2 2 3 4Run20 2 3 4 2 1Run21 2 1 5 4 3Run22 2 4 7 1 2Run23 2 4 6 1 2Run24 2 1 8 4 3Run25 4 2 1 4 3Run26 4 3 3 1 2Run27 4 3 2 1 2Run28 4 2 4 4 3Run29 4 4 5 2 1Run30 4 1 7 3 4



STQC IT SERVICES

21

Run31 4 1 6 3 4Run32 4 4 8 2 1Run33 5 2 1 4 2Run34 5 3 3 1 3Run35 5 3 2 1 3Run36 5 2 4 4 2Run37 5 4 5 2 4Run38 5 1 7 3 1Run39 5 1 6 3 1Run40 5 4 8 2 4Run41 6 3 1 2 4Run42 6 2 3 3 1Run43 6 2 2 3 1Run44 6 3 4 2 4Run45 6 1 5 4 2Run46 6 4 7 1 3Run47 6 4 6 1 3



STQC IT SERVICES

22

Workshop VII Integration / System Testing

People’s Bank of India (PBI) is a commercial bank giving a varied services tothe customers both in India and abroad. Their services include FixedDeposits, Loans,

Savings account and current account, Demand Drafts, Clearing of LocalCheques/drafts, and clearing of outstation cheques , to mention a few. Their auxiliary services include safe Deposit Lockers, Standing instructions, Moneytransfers etc.

Salient Features :

A group in your company develops the SAVINGS BANK (Called SB) moduleof the Banking package. Following modules are to be made in SB:

• Master Creation of SB accounts.• Cheque Book Master Maintenance.• SB Transactions• Reports.

Other modules under preparation are current account, loan and deposits.

As a Software Test Professional, please provide the solution that you feel willbe the most appropriate for the following:

1.Your Project Manager asks you to test the functionality of the currentaccount module developed by others, without explaining the internal structure

of the module. What type of test will you do, Black box or White Box?

2. You are asked to check the functionality of savings Bank Transactionsscreen. What type of test will you do? Black Box or White Box?

3. For availing cheque book facility in the current account, a customer mustmaintain a minimum balance of Rs 5000. In the Black box testing, whichoptimization technique will you use to check the minimum balance?

4. In the cheque book maintenance problem referred above, the programworks well for the values of 1, 2500 and 5000 but not for a value of 5001.

Which particular range of the boundary value analysis is throwing theerror here?.

5. After fixing the problem of cheque books, that particular path works well,but a unknown problem has crept in suddenly. Will you be testing some of the already tested paths of this module after a defect has been fixed or only that particular path which was giving error?.

6. Customer complains that while accessing the cheque book module from SBtransactions, errors are thrown. But, transaction module and cheque book



STQC IT SERVICES

24

18. The client was planning to go for a P IV with 60 GB hard disk and 256 MB

RAM, at the time of placement of the order and the software development isproceeding under that assumption. Client now asks whether he can go for aP III with 20 GB hard disk and 64 MB RAM? Which test should the softwarepass to accept to this request?

19. You have completed all the modules in SB and want the customer’s feedback. Since, banking is a general product, you may like more than onebanker to look into that and get back to you, so that depending on thefeedback you expect to improve on the performance of the product. What isthe particular test called.?

20. Customers are invited to come to Developer’s site to test the product, beforeit is released. What is the particular test called.?

21. Client complains that whenever the system crashes, they are not able torecover the system and the data. Which test would have detected this

defect/?

**********************************



STQC IT SERVICES

25

Workshop VIII : Application of Risk Analysis to a testing ProjectA company had to test a retail banking software before delivery to a large bank.A risk-based approach was followed. A set of functions that were to be deliveredearly in the project was Interest calculation, penalty calculation and profitabilityanalysis. The following is an indication of cost of a fault (scale of 1-3 where 1 isminimum and 3 is maximum):Function

name

Maintenance

resourceallocation incase of fault

Legal

consequencesof faults

Economic

loss

Consequences

of reputation

InterestCalculation

3 2 3 3

Penaltycalculation

2 2 3 2

Profitabilityanalysis

1 1 1 2

Consider the probability of failure (scale 1-3, where 1 is minimum and 3 ismaximum) from the perspective of the following observations:

1.0 The project was mainly a re engineering effort and the three functionswere re written with varying degrees of change/creation of newfunctionality:

1.1 Interest calculation = 10%1.2 Penalty calculation = 15%1.3 Profitability analysis = 20 %

2.0 The number of change requests given for design of software was of thefollowing ratios:

2.1 Interest calculation = 52.2 Penalty calculation = 42.3 Profitability analysis = 11

3.0 The size of the different functions was of the order of:3.1 Interest calculation = 30FP3.2 Penalty calculation = 25FP3.3 Profitability analysis = 43 FP

4.0 The complexity of the software in terms of v (g) were:4.1 Interest calculation = 154.2 Penalty calculation = 204.3 Profitability analysis = 7

The indicator weights (1-5 where 1 is minimum and 5 is maximum) is used for each risk attribute is as follows:Changed or new functionality – 5

Design Quality – 5Size – 2Complexity – 4

Based on your understanding of Risk exposure as Probability of failure * Cost of failure rank the functions in order of decreasing risk.Hints:

1.0 Take the average cost for each module2.0 Scale the functions based on the probability of failure and obtain product

of probability of failure and weights)



STQC IT SERVICES Workshop IX : Software Test Project management

M/s Cybersec is a software company who has signed a contract for thedevelopment of a software project for an MNC. It is a very prestigious project andthe client is very strict about maintaining the shipping schedule and will giveawards if project is ready before time.

Assume that you are the Test Manager of that company in charge of runningSystem Tests and your team comprises the following persons:1. Test engineers: 22. Automation Expert: 13. Trainees: 5

As a test manager, you have created a WBS and assigned efforts & duration toeach task using Delphic Oracle or Three point Method. You have also identifieddependencies & the critical path.Write the best possible solutions for the following scenarios with

justification :1. Your most experienced automation expert goes on a fortnight long urgent

medical leave, and no one else in your organization knows how to doscripting. You have only 3 weeks to go before D-day and as a Test Manager what will you do?

2. The time taken for fixing the defects after test pass 1 is found to exceed theestimated time of 2 weeks. What could be the contingency plan?

3. The top management is keen on pre-poning the release date and your testingteam require another 2 weeks for completion.

1. Relax your entry criteria2. Adding more staff 3. Arbitrary reduction in test execution time4. Relax your exit criteria by way of cutting testing of some features in

the product5. Putting staff on overtime6. Removing the safety margins in estimation and setting a tight

schedule7. Forecasting of latent defects in the product8. Pressurize the management not to prepone

Of the options mentioned above, which is the best and for what reason? Asa Test Manager, can you think of any other option?