testing job family

Testing Job Family Goals & Objectives 2012-13

G&O of roles in Testing job family Band Unique Role Repeat Role name Level G&O template

TRB/WASE/A1/A2/A3 Engineer Test Engineer Level 1 Click here

Band Unique role Repeat Role Name Level G&O template

B1 / WASE / Engineer Test Engineer Level 2 Click here

Band Unique Role Repeat Role Name Level G&O template

B2 Engineer Test Engineer Level 3 Click here


B3 Lead Test Lead Level 1 Click here


C1 Project Manager Test Project Manager Level 2 Click here

C1 Architect Test Architect Level 1 Click here

C1 Consultant Test Consultant Level 1 Click here


C2 Architect Test Architect Level 2 Click here

C2 Consultant Test Consultant Level 2 Click here

C2 Delivery Manager

Testing Practice Delivery Manager

Level 1 Click here


D1 Delivery Manager Testing Practice Delivery Manager

Level 2 Click here


Goals and Objectives

Test Engineer L1 Objectives 2012-13

Objectives Measurement Criteria Weight

Customer Focus

Timely Response to customer requests - Answering query state of FRs/SRs, responses for traces/reproduction.

Measure of regularity and on timeliness of updates of test execution results to the repository & defect reporting tools as per schedule decided by Project/Team Lead

10%

Test Design and Execution

Effective execution of test cases, test scripts; logging and tracking of own defects.

On time deliveries - WSRs, updation of status in tools, updation of accurate effort in Ecube, TMS etc as per schedule decided by Project/Team lead.

Achieve TC execution productivity expected by the program.

Ensure that the number of invalid defects raised, are as per the norm defined for project/program/account.

Ensure there are zero test escapes and defect slippages from the tests executed.

No instances of rejection/slippage of delivered work items or within the Wipro / Customer SLA / norms.

40%

Process Compliance

Adherence to Test process in the program (Test Execution, Fault reports, reviews, test audits, logging of results, etc)

Adherence to Wipro Quality Process

Zero instance of repeated violation of standards or test process

10%

Teamwork

Participation in team activities & initiatives 20%

Competency & Self Development

Measure on # of mandatory trainings attended for the year

Measure of # of relevant certifications and achievement of the target CPI in the stipulated time period


Test Engineer L2 Objectives 2012-13


Customer Focus

Timely Response to customer requests: Answering query state of FRs/SRs, responses for traces/reproduction.

Regular and on time updates to test repository/status reporting tools visible to customer

No instances of complaints at work from Internal/External customer and peer.

15%

Quality of interaction with customer (e-mail content etc)

Providing information with all relevant data points and clarity

Confidently communicate with the client in an unambiguous manner maintaining proper mail /teleconference etiquettes.

Understand and appreciate the cultural differences in communication

Test Design and Execution

Effective test case, automated test script development and execution; Enhancement of manual/automated test cases/script, logging and tracking of defects and end to end support for simple applications.

Measure on # of alternatives considered during Test Design or Scenarios for Test Design (Testing)

On time deliveries- reports, status update, effort log ins etc

Measure on achievement of TC execution productivity expected by the program.

Ensure number of invalid defects raised, are as per the norm defined for project/program/account.


No instances of rejection/slippage of delivered work items. Rework should be attributable to only customer requested changes and project requirement changes.

35%

Process Compliance



10%

Teamwork

Contributions towards other modules/features through effective review, resolving problems, helping in test execution.

Measure on # of new joinees and juniors mentored.

20%


Measure of # of KSS within own stream and across work streams

Measure of # of value-added contributions to the project demonstrating domain knowledge

Attend the required trainings related to the project and participate in knowledge sharing sessions.

Measure of # of relevant certifications and achievement of the target CPI in the stipulated time period

20%


Test Lead L1 Objectives 2012-13 Objectives Measurement Criteria Weight

Delivery/Customer Satisfaction 45%

Performance Feedback received from customer (for onsite members)

Timely response to customer requests/clarifications


Ensure the preparation of Bi-directional Traceability matrix with 100% coverage to requirements

Achieve Test case development productivity expected by the program; % productivity improvement should be above project norms





Health Proactively analyzing the field bugs & defect slippage and proving the action plan - Provide numbers analyzed and TCs added

Ensure >30% defects raised are P1/P2s

Track self and team's failed/blocked test cases to closure.

Adherence to all metrics by self and team as per SLAs defined

Process Compliance 15%

Process Compliance Ensure team Weekly effort logging should be 100%. No schedule/effort deviation.

Ensure team contribution towards Review effort >10 %

Defect Rejection <5%; Defect slippage <1%

Timely Escalations and initiatives to overcome the challenges.

Implementation of SToRM tools (DSM, OA, etc)

Adherence to Test process in the program (Test Plan/design preparation, LAM, Test Execution, Fault reports, reviews, test audits, logging of results, etc). No process deviation

People 15% Manage employee morale, confront negative behavior and

handle nonperformance)

Contribution to TeS Confluence by self and team

Knowledge Management & Self Development 25%

Measure on # of KSS/Trainings attended and evaluated/conducted in the team Target: 95%

Contribution to team: Preparing project specific training materials / KM activities and maintaining a repository

Complete the mandatory training assigned in ITMS


Test Engineer L3 Objectives 2012-13 Objectives Measurement Criteria Weight

Customer Focus

Timely Response to customer requests - Answering query state of FRs/SRs, responses for traces/reproduction.


No instances of complaints at work from Internal/External customer and peer.

Measure on work done towards PCSAT enhancements ( > 6 on a scale of 7)

20%





Test Design and Execution: Works independently to analyze test requirements, product specifications and test tools. Develop test case/automated test script based on impact analysis. Provide end to end support for applications. Provide technical guidance to the team and solves test bed issues and technical issues.

Prepare and review traceability matrix and ensure requirements coverage in test plans/test cases. Identify reusable TCs; Highlight individual project risks to lead/PM

Measure on # of alternatives considered during Test Design or Scenarios for Test Design (Testing)

On time deliveries - WSRs, analysis reports, updation of status in tools, updation of accurate effort in Ecube.

Contribution to cycle time reduction in activities involving preparation of scenarios, test cases, test data documentation, conducting Reviews and QA/Stage test execution.

Measure on achievement of TC execution productivity expected by the program.

Ensure number of invalid defects raised, are as per the norm defined for project/program/account.


No instances of rejection/slippage of delivered work items. Rework should be attributable to only customer requested changes and project requirement changes.

30%

Processes/Value Additions



20%

Teamwork

Attend Team meetings regularly and contribute with ideas and suggestions.

Contributions towards other modules/features through effective review, resolving problems, helping in test execution.

Measure on # of new joinees and juniors mentored.

Demonstrate Understanding of the project (foresee interface issues and contribute effectively in other’s reviews)

Exploring new tools / new ideas useful for the project

Contribution in activities like Web page maintenance / Configuration manager / System admin for the project

Measure of # of presentations and participation in internal/external Tech Forums

20%




Measure of # of value-added contributions to the project demonstrating domain knowledge.

Measure of # of required trainings attended

Measure of # of relevant certifications obtained and achievement of the target CPI in the stipulated time period

10%


Test Architect L1 Objectives 2012-13 Objectives Measurement Criteria Weight

Test solution / Test Design Understand customer requirements at system level and Define and deliver Test Requirements at System level. Test estimates, overall Test strategy and solution. Preparation and articulation of technical issues/status during client interactions

Timely Response to customer’s technical requests or queries

Measure of # of continuous improvement in the project (for e.g. analyzing the field bugs to enhance the test coverage, look at automation possibilities, any tools that can enhance the productivity etc.)

Measure on work done with the DM/PM towards improving the customer perception with value adds and improve PCSAT score ( > 6.3 on a scale of 7)

Addresses and Resolves all Customer/Project technical Issues

30%

Technical Leadership

Contribution to effectively review the test deliverables from the team

Measure of # of team members mentored

Measure of # of presentations / participation in internal / external forums

30%

Test Deliverables Understanding the test requirements and preparation of the test strategy

Accuracy of test estimation, keeping overall project in view

Quality of test plan/strategy; number of reviews errors, missing scenarios, risks, mitigation plan, etc

Contributions towards the complete project through effective review, resolving problems

Measure of # of quality improvement initiatives conducted/participated - LAM, test audits, RCA

Measure of # of Solutions - Automation / Test Improvements suggested and implemented

20%

Business Development & Support

Create value propositions in terms of existing capabilities and new technologies

Measure of # of opportunities identified in & around the current engagement

Provide required support for estimation & development of solution for new opportunities

10%


Pro-activeness in knowledge acquisition/sharing to help in problem resolution

Demonstrate acquisition of specialist knowledge in testing tools/ any aspect of technology/architecture.


Measure of # of value-added contributions to the project demonstrating domain knowledge.

Measure of # of relevant certifications obtained and achievement of the target CPI in the stipulated time period

10%


Test Project Manager L2 (Band C1, Equivalent to PM) Objectives 2012-13 Objectives Measurement Criteria Weight

Financial 15%

Performance Gross margin achievement of the project Bonus/penalty from/to the customers

% Adherence to project cash flow schedule

Delivery & Customer Satisfaction

Performance Delivery quality compliance = average of assessment on the four metrics below

1) Effort performance indicator = (Actual effort spent (A) - Planned effort (B))/ Planned effort (B) 2) Schedule performance indicator = (Actual date of project or milestone completion (C) - Planned date of milestone completion (D)) / Planned days for the project or milestone (E) 3) DRFT score = DRFT score of the role holder for the measurement period (F) 4) SLA performance (Applicable to all MS projects) = Number of instances of SLA compliance (H) / Total number of instances where SLA is measured (I)Maintain metrics and perform trend analysis on the data captured and highlight the data to customer

Timely submission of EBS/Invoice inputs

No major or minor NCs. Ensure time closure of audit findings Measure on Unplanned & Unmapped Effort = 0, accuracy of billing inputs

100%. PM effort logged in for entire month. Achieve a CSAT of >=6.2 /7 & consistent improvement in CSAT YoY by >=

20%

Customer satisfaction score = (0.5* (NPS rating in PCSAT(A))) + (0.5 * (NPS rating in Pulse (B) or ACSAT(C) as applicable in that quarter))

35%

Health % of Bulge, % of Billable rookie ratio, Average Per Person Cost % indents cancelled or issued during SLA lead time to CRD, % of ERD

compliance PEI score of project

Ensure appropriate backup and recovery process of all artifacts

Measure on # of tools implemented/used by the team Target > 2 per year

Measure of # of value-adds generated and Implemented towards the customer

30%

Offering/Competency [ Manager can add more Practice Initiatives] 10%

Run at least 1 Six Sigma or LEAN. Conduct Periodic LAM/Project kickoff meetings/Milestone review meetings, as expected by SEPG

Contribution of utilities / tools developed in the project (non-customer IP) / best practices into Knet > 2 per year

Conceive ideas for POC and Support the COE in development of POC , Case studies

Architect and support the development of at least 2 accelerator/tool/solutions

People 10%

Attrition target <>

Ensure that 100% CPI / UCF compliance levels of project team by end of each Quarter

Identify and conduct regular project and domain specific trainings


Test Architect L2 Objectives 2012-13 Objectives Measurement Criteria Weight

Test solution / Test Design

Scope the testing activity by interacting with external and internal stakeholders.

Actively gather information to understand customer’s problems, needs, expectations and prospect for new projects; interact with customer to build understanding of issues and solutions

20%

Technical Leadership

Get in depth technical understanding of the complete project and be able to suggest improvements

Measure of # of value-adds generated and Implemented towards the customer

Measure of # of future technology / Technical needs identified for the account

20%

Business Development & Support

Contribute solutions / mentor outside project / account

Measure of # of Strong Differentiators created in the Services Offered that will enable business growth

Support for RFPs – Packaging and Positioning various solutions based on customer needs

30%

Innovation and Competency Building Spotting Industry wide trends and identify Processes,

Framework, Methodologies and Tools for - Evaluation - Facilitating Proof of Concepts and Pilots - Advising Delivery Teams on the adoption of the same - Advising Pre sales/sales teams on repositioning the

services accordingly

Measure on # of Papers submitted and/or presented at relevant Seminars and Conferences

Building solutions (combination of tools, methodologies, processes, technologies) for - Driving Non-Linearity - Improving Business Prospects - Identifying and building assets for reuse across projects

30%


Test Consultant L1 Objectives 2012-13 Objectives Measurement Criteria Weight

Test Consulting: Draw road map and recommendations for movement from ‘as-is’ to ‘would-be’ process levels and provide End to End Test Solutions aligned with client business and needs Provide Thought leadership & Strategic direction for Client / Wipro team

Document and analyze the current process, its effectiveness and make prioritized recommendations for improvements within the limits of scope, time and cost constraints.

Ensure reusability also ensure that the re-usable components available are utilized effectively to reduce the effort and time

Identify tools and licenses requirements ( existing and additional)

Handle and coordinate Proof of concept activities during the beginning of the project on new technologies

30%

Process & Quality Adherence

Prepare Requirements spec/Functional Spec without errors exceeding the Norm, as described by Wipro quality standards

Contribution of utilities / tools developed in the project/program (non-customer IP) / best practices into Knet > 2 per year

Define and create the measurement criteria for metrics at different stage of testing life cycle

Assist with Open source usage recommendation & adherence of the projects/programs involved with

20%

Customer Satisfaction

Measure on # of complaints on consulting quality, solution fitment, design/architecture, process adherence;

Effectiveness and timely resolution in case of a complaint: speed and the adequacy of resolution

First Time Right (Measured by specific question in PCSAT)

20%

Self & Team Development


Complete the required TeS CPI/UCF assessment/other relevant certifications/trainings mapped to Role and Career Group

15%

Contribution to TeS

Meet TeS level objectives on Whitepaper, Technical Talks and

participation in technical forums Effective Participation in taskforces/COE initiatives

15%


Test Consultant L2 Objectives 2012-13 Objectives Measurement Criteria Weight

Test Consulting: Draw road map and recommendations for movement from ‘as-is’ to ‘would-be’ process levels and provide End to End Test Solutions aligned with client business and needs Provide Thought leadership & Strategic direction for Client / Wipro team

Work out the business benefits of improvement; ROI; Review and sign off on the recommendations.

Business process analysis: Biz process and functional model. Map the Business process onto the application and identify gaps.

Actively participant in discussions for solution definition, coming up with suggestions for solution design.

Work with the Delivery manager to identify and proactively manage project/program level risks

Incorporate test optimization methodologies

Provide Product evaluations; Analyzes competitive products and technologies and makes appropriate suggestions (may use demos) to influence product / technology direction.

Measure on # of suggestions provided and implemented for Performance improvements

Proposal participation, Sizing and Pre-sales work, participate in Customer presentations

30%

Process & Quality Adherence

Guide the Delivery team to ensure that the application/tool/framework is developed as per customer requirement.

20%

Customer Satisfaction

Achieve a CSAT of >=6.2 /7 & consistent improvement in CSAT YoY by >= 20% on the Consulting engagement

Collaborate effectively, work across the company's test leadership and development and program management community to drive synergy and appropriate integration

ACSAT: NPS>=8 and Experience Index 100 to be ensured

20%

Self & Team Development


Enable Cross/Multi-Skilling by proactively identifying niche/new areas and getting trained or assist in training the other members

20%

Contribution to TeS

Proposals wins: >= 1 per year

Arrive at outcome based services, measure of success and value to the client & Wipro in achieving that success. Arrive at multiple pricing models based on the value of services rendered

Be able to suggest new solutions (tools, automation framework etc.) or provide feedback and work on enhancing the existing value

Identifying and creating new service lines within TeS

10%


Delivery Manager L1/ L2 Objectives 2012-13 Major difference between Delivery Manager L1 and L2 is the span of control. Refer role description for span details


FINANCIAL OBJECTIVES - Total weightage 20%

1 Performance Measures 20%

Revenue ($) Revenue ($) = Revenue achievement (A)

Gross Margins ($) Gross margin ($) = (Revenue (A) - Direct cost (B) - Loading (C))/ Revenue(A)

Bonus/penalty from/to the customers ($)

Bonus/penalty from/to the customers = Value of bonus received from customers (A) - Value of penalty paid to the customers during the same period (B)

Adherence to project cash flow schedule (%)

Adherence to project cash flow schedule = Actual billing done to the customer in the measurement period (A)/ Planned billing to be dome to the customer as per the project cash-flow projections (B)

DELIVERY/CUSTOMER SATISFACTION OBJECTIVES - Weightage 50%


Delivery quality compliance (Based on effort, schedule, DRFT, SLA) (rating)

Delivery quality compliance = average of assessment on the four metrics below 1) Effort performance indicator = (Actual effort spent (A) - Planned effort (B))/ Planned effort (B) 2) Schedule performance indicator = (Actual date of project or milestone completion (C) - Planned date of milestone completion (D)) / Planned days for the project or milestone (E) 3) DRFT score = DRFT score of the role holder for the measurement period (F) 4) SLA performance (Applicable to all MS projects) = Number of instances of SLA compliance (H) / Total number of instances where SLA is measured (I)Implement and close on ACSAT actions with Customer

Customer satisfaction score (rating)

Customer satisfaction score = (0.5* (NPS rating in PCSAT(A))) + (0.5 * (NPS rating in Pulse (B) or ACSAT(C) as applicable in that quarter))

Note: For accounts where customer runs its own survey and does not participate in Wipro

surveys, the supervisor shall set the target in terms of customer survey outcome.

Number of customer escalations (#)

Number of customer escalations = Number of customer escalations of High priority(A) + Number of customer escalations of Medium priority(B) + Number of customer escalations of Low priority©

% customer escalations with overdue resolution (%)

% customer escalations with overdue resolution = Number of customer escalations with target resolution date in the given period but still open (A) / total number of customer escalations with target resolution date in the given period (B)

Note: All customer escalations must be entered in the CRM/Quality system

2 Health Measures 30%

Bulge (%) Bulge (%) = (Number of people with <3 years of experience allocated to the project (A))/ (total number of resources allocated to the project (B))

Billable rookie ratio (%) Billable rookie ratio (%) = (Number of rookies (Fresher + <20Kpm salary)billed in the project (A)) / (total number of resources billed in the project (B))

Average Per Person Cost ($) Average per person cost = (Sum of salaries+RSU+Bonus of all resources allocated to the project) / (Total number of resources allocated to the project)

% of resources on progressive delivery models (flex) (%)

% of resources on progressive delivery model (flex) = Number of delivery resources billed in the account operating out of FLEX (A) / Total number of delivery resources billed in the account (B)

% indents cancelled or issued during SLA lead time to CRD

% indents cancelled or issued during SLA lead time to CRD = (Number of indents cancelled during SLA time to CRD(A) + Number of indents issued during SLA time to CRD (B)) / (Total number of indents with CRD in the given period (C))


ERD compliance (%) ERD compliance = (Number of project resources with ERD extended with <15 days lead time (A))/(Number of project resources with ERD falling within the measurement period (B))

PEI score of projects under role holder

Process Exception Index score of the project as per the internal quality standard (A)

OFFERING/COMPETENCY OBJECTIVES - Weightage 15%


% project effort charged to domain experts

% project effort charged to domain experts = (Effort/cost spent by domain experts on the project (A) / total effort/cost spent on the project (B))

No major NC’s during internal and external audits

Reusable Components idea generation

Delivery Model innovation o Implement factory model concepts covering at least 50 people

Usage of tools o Adoption of tools across the life cycle. o Adoption of Test tools


% of employees and contractors with contribution above X%

Contribution per billed employee and contractor = ((Revenue from projects (A) - salary cost of billed employees and contractors tagged to those projects (B)) / ((Revenue from projects (A)) % of employees and contractors with contribution above X% = (Number of employees and contractors with contribution percent above X% (C)) / (Total number of employees and contractor relevant to the role(D))

PEOPLE OBJECTIVES - Weightage 15%


Employee attrition rate (top bin and overall) (%)

Top bin attrition rate (%) = Number of employees with top bin rating who quit Wipro while tagged to the account (or project) (including the cool off period) (A) / average number of top-bin employees tagged to the account (or project) for the measurement period (B) - Overall attrition rate = Number of employees who quit Wipro while tagged to the account (or project)

(including the cool off period) (C) / average number of employees tagged to the account (or project) for

the measurement period (D)

- Average number of top-bin employees tagged to the account (or project) for the measurement period

(B) = (Total number of top-bin employees tagged to the account (or project) at the beginning of the

measurement period (E) + Total number of top-bin employees tagged to the account (or project) at the

beginning of the measurement period (F))/2

- Average number of top-bin employees tagged to the account (or project) for the measurement period

(D) = (Total number of employees tagged to the account (or project) at the beginning of the

measurement period (G) + Total number of employees tagged to the account (or project) at the

beginning of the measurement period (H))/2

- Cool off period (I) = Number of days after an employee is released from an account (or project) but

would be considered tagged to the account(or project) for the purpose of attrition calculation

(Note: Top-bin is an existing category defined by competency, criticality and performance rating of the

employee

Contribution to Wipro building (Hrs)

Contribution to Wipro building = Hours spent in delivering internal training to Wipro employees (A) + Hours spent in contributing to recruitment activities (B)


% of rotation eligible employees released for rotation (%)

% of rotation eligible employees released for rotation = Number of rotation eligible employees released (A) / Number of employees eligible for rotation during that time (B)

testing job family

Documents

test process

test design

test audits

test scripts

test escapes

test engineer l2 objectives

test execution results

program test execution