cste skill category 3 2014v03 - qaicampus.com€¦ · software testing projects •developers test...

CSTE – Skill Category 3 - 1 © Copyright 2014 / All rights reserved

Skill Category 3

Managing the Test Project

The following topics will be discussed in this Skill Category:

• Test Administration

• Test Supervision

• Test Leadership

• Managing Change


Test Administration

• Test Planning*

• Test Estimation

– Budgeting

– Scheduling

• Staffing

• Customization of the test process

* Test Planning will be covered in detail in Skill Category 5


Challenge of Estimation...

It's tough to make predictions, especially about the future.

Yogi Berra


What is the challenge of producing a reasonable budget and schedule?

The size of the work effort must be correctly estimated.

Estimating a Budget and Schedule


What Factors Influence Estimation?

• Development life cycle model used

• Requirements

• Past data

• Organization culture

• Selection of suitable estimation technique

• Test management experience

• Resources available

• Tools at our disposal


What Techniques are Usedto Estimate Budget?

• Expert judgment

• Top-down (cost, constraints, Function Points, COCOMO)

• Bottom-up (needs Work Breakdown Structure)


Top Down Estimation Techniques

• Analogous - The process of analogous estimating takes the actual time and/or cost of a historical project as a basis for the current project. The time cost of the historical project is applied to the current project with respect to the scope of the current project, its size, and other known variables.

• Parametric - Parametric Modeling uses a mathematical model based on known parameters to predict the cost/schedule of a test project. The parameters in the model can vary based on the type of project. For example, a parameter can be “years of experience of the test analyst”, or “years of experience with a programming language of the programmer”.


Expert Judgment Estimation

Expert judgment is the ability, based on experience, to compare historical figures with current project variables to make time and effort predictions.



• Source Lines of Code (SLOC) - Counting the source lines of code written for the application. However, SLOC is a resultant measure. It is a measure that is ultimately obtained after the application has been written or, at the very least, estimated with significant knowledge of the application’s structure.



Function Points• External inputs are largely data entry screens

• External interface files are file-based inputs or outputs

• External outputs are reports

• External queries are message or external function-based communication into or out of the application

• Logical internal tables are the number of tables in the database



• Use Case Points - Count Use Case Attributes

• Cost Models (e.g., COCOMO II Constructive Cost Model) - Combine estimated SLOC, five Scale Drivers, and fifteen Cost Factors to determine cost.


Bottom Up Estimation Techniques

• Work Breakdown Structure (WBS) - Defines the total project based on the product composed of hardware and software elements and service elements. The WBS does not break down to the smallest level.


Agile Estimation Techniques• Story Points - Measure relative story sizes

• Planning Poker - Individuals estimate the cost by ‘playing’ cards of their estimate that are then revealed and the estimate discussed

• Triangulation - Comparison between estimates with no set baseline

• Wideband Delphi - Everyone creates three estimates for the effort and then they are compared


Test Specific Estimation Techniques

• Analogous Percentage Method – An estimate based on previous efforts and a predicted Size Factor

• Test Point Analysis - similar to Function Points

• Development Ratio Method - Based on a ratio with the number of developers

• Test Condition Analysis - Use the number of test conditions and historical information


ExerciseThree methods of estimating budgets are :

a. Top Down, Bottom Up, Peer Reviewb. Past History, Expert Judgment, WBSc. Top Down, Bottom Up, Expert Judgmentd. Expert Judgment, Random Guessing, Stochastic Processes


Questions?


Budgeting

A budget is a plan for specifying how resources, especially time or money, will be allocated or spent during a particular period.


Budgeting

• A budget is not an estimate

• A plan based on the earlier size and effort estimates

• Should not be changed unless approved by the project stakeholders


Scheduling

A schedule is a calendar-based breakdown of tasks and deliverables.

The schedule answers the following questions:

• What tasks will be done?

• Who will do them?

• When will they do them?


ResourcingSoftware Testing Projects

• Developers test

• Independent testers

• Non-IT testers

• Combination of above

It is not necessary for every member of the test team to possess all the skills, but in total the team should have all the needed skills.

If the test team does not possess the necessary skills, it is the responsibility of the test manager to teach those individuals the needed skills.


Software Testing Staffing Matrix

Skills Needed

Staff Planning Test Data Generation

Tool X Tool Y

A

B

C

D


What Causes the Need for the Test Process to be Customized?

• Release cycle schedules

• Software development methodology

• User schedules

• Project status reporting

• Interfacing with other projects

• Interfacing with enterprise-wide databases

• Different naming conventions/data definitions


Customization Includes

• Adding new test tasks

• Deleting test tasks

• Adding or removing test tools

• Supplementing skill sets of testers


Software Development Constraints

Budget Schedule

QualityStaffing

Changes to one of the constraints will cause one or more of the other constraints to also change


Essay (5 minutes):

Assume you are a test manager for an online order entry system that is a web-based system in which customers enter their orders over the internet. Your challenge is how to staff the project. It is a large project and you will be assigned 4 testers. For this project, indicate the testing skills that you believe are needed on this project and explain why those skills are necessary.


Essay (5 minutes):

Assume you are a test manager for an online order entry system that is a web-based system in which customers enter their orders over the internet. Your challenge is how to staff the project. It is a large project and you will be assigned 4 testers. For this project, indicate the testing skills that you believe are needed on this project and explain why those skills are necessary.

EXAM HINT

When answering essay questions, don’t be long winded!


Questions?


Test SupervisionSupervision is a combination of the supervisor possessing the skill sets needed to supervise, and the tasks that contribute to successful supervision.

• Communication

• Negotiation

• Project relationships

• Motivation, mentoring, recognition


Communication Skills

• Written & oral communications

• Listening skills

• Interviewing skills

• Analyzing skills


3 Step Listening ProcessOral communication (which includes listening) is rated as the number one skill for the tester.

The listening process involves three separate steps:

• Hearing the speaker

• Attending to the speaker

• Understanding the speaker


3 Step Listening ProcessStep 1. Hearing the speaker.

Hearing the speaker requires an understanding of the five channels of communication incorporated into speech:

• Information Channel - The speaker’s subject.

• Verbal Channel - The words used by the speaker.

• Vocal Channel - The tone of voice associated with the various words.

• Body Channel - The body movements and gestures associated with the information being conveyed.

• Graphic Channel - The pictures, charts, etc. that the speaker uses to emphasize or illustrate the material being discussed.


3 Step Listening Process

Step 2. Attending to the Speaker (sometimes referred to as being an active listener).

Some suggestions to help in attending to the speaker are:

• Concentrate on the speaker.

• Maintain eye contact (80%).

• Provide feedback.

• Restate what you heard.


3 Step Listening ProcessStep 3. Understanding the Speaker

There are five types of listening. The type chosen will have an impact on the ability to understand what the speaker is saying.

• Type 1: Discriminative Listening

• Type 2: Comprehensive Listening

• Type 3: Therapeutic Listening

• Type 4: Critical Listening

• Type 5: Appreciative or Enjoyment Listening


Interviewing Skills

A software tester will use interviewing skills for fact-finding and to convey information

• A finding – identifies a difference between what is and what should be.

When documenting a finding, it should include:

• Fact

• Cause

• Significance


Analyzing Skills and the Analysis Process


Negotiations

Conflict can be defined as a breakdown in the decision-making process.

Some sources of conflict requiring negotiations are:

• Project Priorities

• Administrative Procedures

• Technical Opinions and Performance Trade-Offs

• Human Resource

• Cost

• Schedule

• Personality


Negotiation Resolution Methods

• Forcing

• Withdrawal

• Smoothing

• Compromise

• Problem solving


Resolving ComplaintsResearch shows that complaints must be resolved within four minutes.*

4-Step Complaint-Resolution Process

Step 1: Get on your customer’s wavelength

(Establish physical parity. Show empathy.)

Step 2: Get the facts

Step 3: Establish and initiate an action program

Step 4: Follow up with your customer

* Contact: The First Four Minutes, Dr. Leonard Zunin


Judgment

Judgment is a decision made by an individual.

Judgment is normally a decision based on three criteria which are:

• Facts

• Standards

• Experience


Constructive Criticism

Constructive criticism should incorporate the following tactics:

• Do it privately

• Have the facts

• Be prepared to help the worker improve his performance

• Be specific on expectations

• Follow a specific process in giving criticism


Project Relationships


Project Relationships

Listening

+ Interviewing

+ Resolving

+ Criticism

Relations


Motivation

The Four Most Common Motivators

• Personal challenge

• Respect

• Rewards

• Recognition

Motivation has been defined as getting individuals to:

• Do work tasks they do not want to do

• Perform those work tasks in a more efficient or effective manner.


MentoringMentoring is helping or supporting an individual in a non-supervisory capacity. Mentoring can occur in any of the following three areas:

• Career counseling

• Work tasks

• Professional advancement

Recognition• A key concept in supervision is that recognition is

important.

• People like to be recognized for the contribution they make to a project.


ExerciseNegotiation Resolution Methods include all of

the following except :a. Forcingb. Smoothingc. Problem Solvingd. Competitione. Compromise


Essay (8 minutes):

Assume you are a test manager and you have noticed during meetings with clients that one of your mid-level test analysts often interrupts the client when the client is explaining an issue they are having. While the client is gracious and doesn’t say anything you see that the client is angered by this behavior. After today’s meeting you call the test analyst into your office to discuss this problem. Describe what you are going to say to the analyst regarding listening skills and follow a good “constructive criticism” process.


Questions?


Supervisor Leader

All test managers are part manager and part leader.

In discussing leadership, we will address these areas:

• Chairing Meetings

• Team Building

• Quality Management Organizational Structure

• Code of ethics

Test Leadership


Team Building

Team building needs to focus on the following items that an individual can achieve from working on a specific project:

• Challenge

• Growth

• Credit

“New loyalty is not to the boss or to the company, but to projects that actualize the mission and offer challenge, growth, and credit for results.”

R.M. Kanter


Team DevelopmentThere are seven guidelines that are helpful in developing

compatibility and motivation of a software project team:

1. Communicate

2. Define roles and responsibilities

3. Empower team members

4. Hold team members accountable

5. Ensure skills are present

6. Provide training

7. Reward successes


Team Ethics

The following attributes of the team are associated with ethical team behavior:

• Customer relations that are truthful and fair to all parties

• Protecting company property

• Compliance with company policies

• Integrity of information

• Attendance

• Redefine standards of quality


Quality Management Organization Structure

The quality revolution significantly impacted the traditional hierarchical structure.

• The structure was flattened

• Employees were empowered to make more decisions

• New approaches to management were introduced.


Traditional vs Quality Management Philosophy

Traditional Management Philosophy Quality Management Philosophy

Controls each result Use the process

Who made the error? What allowed the error?

Correct the error Reduce variation and prevent the error

Employees are the problem Refine the process

Management accountable to their manager Management accountable to the customer

Competition between organizations Teamwork

Motivation from fear of failure Motivation from within (self)

Management of outputs (results)—focusing on detection of defects

Management of process inputs—methods or sources of variation that focus on preventing defects

Fire fighting Continuous process improvement

Accomplishment from meeting quotas, the monthly or quarterly bottom line

Accomplishment from long-term impact of improving processes


Why a Code of Ethics is Important

• Differentiates a profession from a job

• Teaches how to conduct oneself as a professional

• When followed, it gains the respect of colleagues


DiscussionWhat are three differences between a Leader

and a Supervisor (manager).


Questions?


Managing Change

• Managing change is a process.

• The process of managing change is a primary responsibility of all IT staff.


Test Manager Must Manage Change

• Software Configuration Management: Controlling change over project artifacts (e.g. test cases)

• Software Change Management: Changes to software

• Software Version Control: Changed versions of software


Software Configuration Management

The entire Test Environment and all its project artifacts must be managed including:

• Source code

• Requirements

• Analysis models

• Design models

• Test cases and procedures

• Automated test scripts

• User documentation, including manuals and online Help

• Hardware and software configuration settings


Software Change ManagementThe testers need to know two aspects of change:

• The characteristics of the change so that modification to the test plan and test data can be made to assure the right functionality and structure are tested.

• The version in which that change will be implemented.


Software Version Control• Once dynamic testing begins, the project team must ensure

that the appropriate versions of the software components are being tested.

• The Configuration Manager must develop both migration and back-out procedures to support this process. These processes can be either manual or automated.

• Often, the CM tool selected will support the creation of automated build procedures that reduce the level of risk associated with migration.


ExerciseWhen people are presented with new ideas, their most common reaction is:

a) Accept the ideab) Object to the new ideac) Ask for more information about the idead) Ask to be trained in the concepts related to the new idea

Which of the following is NOT the type of project artifact that must be managed and controlled in configuration management environment?

a) Source codeb) Requirementsc) Name of the project teamd) Test case and procedures


ExerciseWhen people are presented with new ideas, their most common reaction is:

a) Accept the ideab) Object to the new ideac) Ask for more information about the idead) Ask to be trained in the concepts related to the new idea

Which of the following is NOT the type of project artifact that must be managed and controlled in configuration management environment?

a) Source codeb) Requirementsc) Name of the project teamd) Test case and procedures

EXAM HINTOnce you have gone through the test

twice, see if any of the questions asked can help you answer those really difficult questions.

This is a little used trick. Sometimes questions asked are answered in later questions asking for different things


Questions?


Skill Category 3 - Summary

Managing the Test Project

The following topics were discussed in this Skill Category:

• Test Administration

• Test Supervision

• Test Leadership

• Managing Change

cste skill category 3 2014v03 - qaicampus.com€¦ · software testing projects •developers test...

Documents