Page: 12012, All rights reserved. Biz3Template POT 1.6

Setting Process Improvement

Infrastructure

10th Workshop On Critical Software Systems (WOCS2)TOKYO - 28th September

~ RANJEET CHHABRA~Business Cube & Partners Inc.

Page: 22012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

Page: 32012, All rights reserved. Biz3Template POT 1.6

Model Representation (ASPICE)

ACQ (7)

ENG (10)

SUP (7)MAN (3)

Level 5 Optimizing

Level 4 Predictable

Level 3 Established

Level 2 Managed

Level 1 Performed

Level 0 Incomplete

PIM (1)

CAPABILITY Dimension

SPL (2)

REU (1)

PROCESS Dimension

Page: 42012, All rights reserved. Biz3Template POT 1.6

Deployment & Improvement CycleProcess Deployment Context

Process Deployment

InfrastructureProcess Deployment

Process Improvement Context

Process Improvement

InfrastructureProcess Improvement

• Planned and Organized approach is often visualized – Tools, Trainings etc.

• Management Support is readily available

• Planned and Organized approach is not visualized

• Management Support is difficult to obtain

Effort & Preparedness

Implementation

Effort & Preparedness

Page: 52012, All rights reserved. Biz3Template POT 1.6

Result…!!

Result Utilization

Planning

“Process improvement

without an appropriate

infrastructure is just a wishful

thought”

Page: 62012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 72012, All rights reserved. Biz3Template POT 1.6

Policy: QMS

Middle ManagementProcessPolicyDepartment

PolicyTechnical

Policy

Template

Management

Business Plan

Procedure ToolChecklist

Process DescriptionProcess Overview

Process Interaction

International StandardsISO 9001 ISO/TS 16949 ISO/IEC 15504 Automotive SPICE ISO/DIS 26262 ISO/IEC 15288 CMMI

Select standards according to the business needs and apply it to the standard processes

Page: 82012, All rights reserved. Biz3Template POT 1.6

Like other processes, OSSP shall address a process for‘Improvement’The improvement process shall typically address:

PlanningDeveloping Improvement Plans (Process Improvement, Process Actionetc.)

EvaluationImplementationMonitoringEtc…

Input/ Output, Entry/ Exit criteria, Responsibilities for activitiesetc.

Process Improvement Process

Page: 92012, All rights reserved. Biz3Template POT 1.6

Process Improvement (PI) PlanPlan for EPG to conduct improvement activitiesDeveloped for a wider scope and span

Organization LevelYearly / Six Monthly

Addresses organizational SPI Goals and objectives to be achievedBased on customer, market needs etc.

Process Action Plan (PAP)Plan for PAT (Process Action Team) to conduct particular improvementDeveloped for shorter scope and span

Project/ Task LevelOne week ~ Three months

Addresses SPI tasks to be achievedBased on SPI plan etc.Ex: Establishment of Traceability, CM Tool etc.

Planning

Page: 102012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 112012, All rights reserved. Biz3Template POT 1.6

Resources: Human

EPGGroup which acts as a focal point of improvementSelect persons with adequate skill, experience for form EPGProvide Adequate Authority and ResponsibilityDevelop EPG charter

Defines roles and responsibility of EPGDefine EPG organization chart

Provide adequate responsibility and authority to EPG personalsFormally publish charter, EPG Guideline and announce its existence androle to entire organization

Process Action Team (PAT)Logical Teams to carry out a particular improvement activityDisbands after completion of activitiesNormally, have a combination of SEPG, project members

Page: 122012, All rights reserved. Biz3Template POT 1.6

Resources: Data-Base

Organized repository to manage processes and processassets

Normally termed as “Process Asset Library” or PALCan Include ‘Reuse’ library, ‘Measurement’ Library

Central repository to manage all Processes, Process Assets,Measurement data etc.Organizes data for effective utilizationAct as a “Knowledge Base”

Page: 132012, All rights reserved. Biz3Template POT 1.6

Resources: Tools

Measurement toolsAudit and Trend analysis toolsAnalysis Tools

QualitativeQuantitativeStatistical

Page: 142012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 152012, All rights reserved. Biz3Template POT 1.6

Components of Measurement Framework

Process

• Measurement Process

Guideline

• Why measures and metrics

• Which Measures and metrics

• Rules for data collection & Analysis

• Utility of the indicators

Procedure

• Data Collection• Frequency,

source• Data Analysis

• Frequency, techniques

Repository

• Measurement Repository

Page: 162012, All rights reserved. Biz3Template POT 1.6

Measurement Definition

Measurement Specifications

Keep μ processor size within limit

Goal

IndicatorM

easuresQ

uestion

What is the μ processor size limit

What is the progressive size of ROM & RAM

What is total size of ROM & RAM

Size Deviation

@ Modules

Estimated RAM/ROM Size

Actual RAM/ROM size

Reduce schedule deviation

What is the planned dates of milestones

What is the actual dates of milestones

Schedule Variance

@ Milestones

Planned dates

Actual dates

Deliver High Quality product

How many defects are found by customer?

How many total defects found in project?

How is defect distributed?

Defect Distribution

@ Samples

Defects Open/Closed

Defect distribution

(Phase, Module)

Detect defects early in development life cycle

How many defects found in different reviews?

What is the defect removal efficiency of phases?

What is review efficiency?

Review Efficiency

@ Milestone reviews

Defects detected during review

Size of work product, effort expended

Page: 172012, All rights reserved. Biz3Template POT 1.6

Measures

Quality

Cost

DeliveryCustomer

Defects

Example Measures

17"Software Measurement" Module 1: General

(C) Cost

• Effort

• Other costs

(Q) Quality

• Defects delivered to customer

• No. of undelivered functions

(D) Delivery

• Planned Schedule

• Actual ScheduleClient (Project specific)

• CPU load

• Memory size (ROM/RAM)

(D) Defects

• DIR

• Defects estimated, found

Page: 182012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 192012, All rights reserved. Biz3Template POT 1.6

Evaluation Framework

• Frequency• Standards• Team

Assessment

• Projects• Processes• Team

Audit

• Feedback Collection• Project Closure Analysis• Lessons Learned

Others

Page: 202012, All rights reserved. Biz3Template POT 1.6

Assessments

The assessment framework shall address:Assessment Frequency / TimingsStandards against which assessment will be undertaken (ASPICE, ISO15505, ASPICE, ISO 26262* etc.)Scope (Organization Units, processes, levels etc.)Approach (Internal, External etc.)Reporting etc.

* ISO 26262 terminology in this context is ‘Audits’

Page: 212012, All rights reserved. Biz3Template POT 1.6

Audits

The audit framework shall address:Audit Frequency / TimingsAudit Criteria (Standards, Checklists, processes etc.)Scope (Projects, processes, work products etc.)ReportingEscalationEtc.

Page: 222012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 232012, All rights reserved. Biz3Template POT 1.6

Analysis

The analysis framework shall address:Analysis Frequency / TimingsData (From Evaluation Framework, Measurement Framework etc.)Type of Analysis to be performedTypes of reports/Indicators to be generatedThe results utilization (SPI, PAP etc.)Stakeholders Involved etc.

Mechanism shall be able to provide/derive adequate ‘INFORMATION’

Page: 242012, All rights reserved. Biz3Template POT 1.6

Communication

Indicators/ Analysis Results

Visibility

Planning

Tracking

Improvement

EPG

Senior Management

Project Management

Customer

When..?

What..?

How (Mode)..?

Who...?

Frequency…?

Page: 252012, All rights reserved. Biz3Template POT 1.6

Result Distribution

Distribute activities information to wide range of stakeholdersand build consensusReport improvement activities to senior management andobtain required supportVarious communication means can be through

EmailsNewslettersMail magazineMeetingsSeminarsTrainings

Page: 262012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 272012, All rights reserved. Biz3Template POT 1.6

Implementing It Together

Policy & Process

Evaluation Framework

Measurement Framework

Improvement Plan

Tools

Analysis & Communication

Framework

stakeholders

PROCESS GROUP

projects

Action

Plan

Based on

utilize Input to Input to

Communicate

Provides

Input ToBased on

Implemented by

Page: 282012, All rights reserved. Biz3Template POT 1.6

Implementation Pitfalls Observed

PolicyClear Definition and its Implementation

ResourcesHuman Resources

Authority, Getting the right persons, Visibility (Productivity) of SEPGTools

Justification of utility, Utilization, Integration of tools with RM, CM or othertools is not readily available

Data-BaseNormally established quite lately w.r.t to initiation of developmentactivities

Measurement FrameworkToo Many data, utilization not knownCollection and Analysis procedures

Page: 292012, All rights reserved. Biz3Template POT 1.6

Implementation Pitfalls Observed

Evaluation FrameworkEstablishment at organizational level

Analysis & Communication FrameworkSelection of Data to be utilizedFrequency of Monitoring

Page: 302012, All rights reserved. Biz3Template POT 1.6

Index

2) Setting Up Improvement Infrastructure

3) Implementing an Improvement Infrastructure

1) Improvement Infrastructure: The Need

4) Conclusion

1-1) Policy, Process & Plan

1-2) Resources

1-3) Measurement Framework

1-4) Evaluation Framework

1-5) Analysis & Communication Framework

Page: 312012, All rights reserved. Biz3Template POT 1.6

Conclusion

It is ‘extremely’ important to build an improvementinfrastructure before starting your improvement journeyCare shall be taken for its ‘appropriateness’ with regard to theorganizational contextRelevant Stakeholders shall be involved in understanding theoverall infrastructural requirements

Page: 322012, All rights reserved. Biz3Template POT 1.6

Please feel free to contact us.

BUSINESS CUBE & PARTNERS, INC.10F, Mitomi Bldg. Shinkan,1-20-18 Ebisu Shibuya-ku, TOKYO 150-0013Phone: +81-3-5791-2121 FAX: +81-3-5791-2122http://www.biz3.co.jphttp://blog.biz3.co.jpconsulting@biz3.co.jp

Thanks for your patient hearing……!!