01 critical lessons learned in the content and delivery of six sigma training

7/27/2019 01 Critical Lessons Learned in the Content and Delivery of Six Sigma Training

1/42

Critical Lessons

Content and Delivery

o x gma ra n ng

Dave Zubrow

June 30, 2010

SEI Webinar: Critical Lessons Learned in the

Content and Delivery of Six Sigma Training

30 June 2010

2010 Carnegie Mellon University



30 June 2010



2/42

NO WARRANTY

THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERINGINSTITUTE MATERIAL IS FURNISHED ON AN AS-IS" BASIS. CARNEGIEMELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHEREXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOTLIMITED TO, WARRANTY OF FITNESS FOR PURPOSE ORMERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USEOF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE

ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM, , .

Use of any trademarks in this presentation is not intended in any way toinfringe on the rights of the trademark holder.

, ,

freely distributed in written or electronic form without requesting formalpermission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute atermission sei.cmu.edu.

This work was created in the performance of Federal Government ContractNumber FA8721-05-C-0003 with Carnegie Mellon University for the operationof the Software Engineering Institute, a federally funded research and

-.government-purpose license to use, duplicate, or disclose the work, in wholeor in part and in any manner, and to have or permit others to do so, for government purposes pursuant to the copyright license under the clause at252.227-7013.

` SEI Webinar: Critical Lessons Learned in theContent and Delivery of Six Sigma Training

30 June 2010



3/42

The Co-Authors

Robert Stoddard

Senior Member of Tech Staff

Dave Zubrow

Senior Member of Tech Staff

SEI SEMA* SEI SEMA*

*SEI SEMA = Software Engineering Institute,

Software Engineering Measurement and Analysis


4/42

Polling Question 1

ow you ear a out t s we nar

.

2. SEI Website

3. Website with webinar calendar (ie www.webinar-directory.com)

4. Social Media site ( LinkedIn, Twitter)5. Other


5/42

Todays Talk

Introduction

Six Sigma Training Challenge

History of Six Sigma Training

Lessons Learned from SEI Research and Experience

Training Design

Training Implementation

SEI Six Sigma Training Solutions

Contact Info and Questions

5



30 June 2010



6/42

Introduction

A wide variety of sources of Six Sigma training abound making it difficult

for organizational leaders to identify which training and Six Sigma

implementations are best for their work situations.

Additional confusion arises due to different philosophies on how to best

.

6



30 June 2010



7/42

Six Sigma Training Challenge

Critical lessons learned, in both the content and delivery of Six Sigma

training, have been identified by SEI researchers from their experiences

with several large corporations.

The Challenge:

Successful adoption and usage of Six Sigmafor tactical process improvement

versus

a failed investment in Six Sigma training thats ess use u an ess prac ca n o ay s

fast-paced business environment.

7



30 June 2010



8/42

History of Six Sigma Training

1980s Traditional statistical training to manufacturing personnel; focus

on manufacturing operational scorecards

1990s Traditional statistical trainin with COTS statistical tools focusmoves beyond scorecards to improvement project methodology

-

domains; focus on new product design, development and transaction

a e s pp e s a s ca ra n ng w mo ern oo s o a w e

variety of domains; focus on training domain experts use of statistics

rather than training statisticians in domain knowledge

8



30 June 2010



9/42

Lessons Learned from SEI Research and

Critical lessons learned have been identified in both the content and

delivery of Six Sigma training

Identified u to 8 ears a o most or anizational de lo ment cham ionsand Six Sigma training providers seem to be unaware of the lessons

learned

As such, inferior training and improper use of Six Sigma methods and toolspersists in the community, resulting in false starts and disappointing

us ness resu s

9



30 June 2010



10/42

Polling Question 2

How would you characterize your organizations Six Sigma methods

and tools training?

1. Very good

2. Above Average

3. Below Average

4. Minimal

5. Dont know

10



30 June 2010



11/42

Training Design


30 June 2010



12/42

1) Theory & Formula vs What, When & Why

Traditional Approach:

Traditional Six Sigma training forces students to

learn the formulas and theory behind each.

Often, this can include details of the original

.

Lesson Learned:

-

coaching, Six Sigma training should properly focus class time on

connecting the business problem space with the appropriate technique orme o .

Experience has shown that busy practitioners will not use the methods if

12



30 June 2010


.


13/42

2) Statistical Purism vs Practical Use


Often, Six Sigma training still gets wrapped

around the axle regarding statistical purism.Thus, the training appears to ignore the fact that

we are training practitioners, not college

Lesson Learned:

to use the methods, with occasional help from a coach.

An exam le is the on- oin discussion within the Six Si ma communit

about how religious one treats the prerequisite of normality before using a

number of methods, including SPC.

13



30 June 2010



14/42

3) Theoretical Examples vs Real World Problems


Many Six Sigma courses primarily offer thought

experiments and theoretical examples related to the.

This behavior actually blurs the lines of distinction

awareness.

Lesson Learned:

Six Sigma training should focus on skill building through a combination of

real-world and realistic case studies.

Thus, the students can learn the skills in context of specific business

situations and problems.

14



30 June 2010



15/42

4) Manufacturing vs Software and Systems


Because Six Sigma training originated in the

manufacturing domain, many training providers

still teach the methods strictly in context ofmanufacturing.

Consequently, many organizations have seen their

so ware eng neers ques on e app ca y o

Six Sigma to their work.

Lesson Learned:

Six Sigma courses should stress the application of Six Sigma methods andoo s among a w e var e y o areas, suc as u no m e o: new

product development, research, transaction processing and service, as

well as, strategic planning and technical product marketing.

15



30 June 2010



16/42

5) Continuous Data vs Continuous & Discrete Data


Most Six Sigma training providers only teach methods

conducive for continuous data types while excluding

.

This arises because the original manufacturing application

had primarily continuous data (Interval or Ratio).

Lesson Learned:

- ,

systems-of-systems development need to deal with all types of data. In

fact, experience has shown that a majority of the data to be analyzedmay e ca egor ca om na or r na n na ure.

Examples: Defect type = Nominal; Severity score = Ordinal

16



30 June 2010



17/42

6) Domain Agnostic vs CMMI & Domain Specific


Some Six Sigma training providers create

training materials to be reused across.

As a result, the concepts and skills are not

Lesson Learned:

and, beneficially, against a backdrop of the CMMI constellations

(Development, Acquisition, and Services).

Case studies from a number of domains should be included to ensure

coverage of all students backgrounds.

17



30 June 2010



18/42

Polling Question 3

To what degree would these training content lessons-learned benefit

your organization?

1. Very much

2. Often

3. Somewhat

4. Minimal

5. Dont know

18



30 June 2010



19/42

Training Implementation


30 June 2010



20/42

1) One Instructorvs Two Instructor Paradigm


A majority of Six Sigma training conducted today is via a

single instructor and often via online or elearning.

,

constrained by the single instructors experience and

limited interaction with students, if any interaction at all!

Lesson Learned:

We believe a two-instructor a roach is su erior for several

reasons:

1) While one instructor is lecturing and leading the class, theo er ns ruc or can wa aroun o e p w oo use, an

2) The two-instructor approach dramatically enriches the learning

ex erience via com lementar instructor back rounds.

20



30 June 2010



21/42

2) Statistical Prerequisites vs No Prerequisites


Many Six Sigma training courses have a deeply-rooted

structure of prerequisite courses, often requiring

.

As such, many domain experts find themselves excluded

quality function.

Lesson Learned:

Because domain knowledge has been shown to be more important than

statistics in driving process improvement , we have seen organizationspr or ze e c ass sea s or e oma n s u en s w o may ave no pr or

knowledge of statistics.

21



30 June 2010



22/42

3) Manual Calculation vs Modern Tools


Most Six Sigma training offerings are still locked in the

past, e.g. 1980s.

They still teach students to perform heavy calculations

on calculators or program formulas in spreadsheets.

Lesson Learned:

A healthy set of modern tools are now available to conduct applied statistical

analysis and report the results.

A such, we believe that the teaching focus on manual calculations is aser ous s rac on rom e rea ocus: connec ng e pro em space

with methods and tools!

22



30 June 2010



23/42

4) Lecture vs Hands-on Practice


Much of todays Six Sigma training is still rooted in

traditional classroom lecture, or unassisted

.

Both approaches have been shown to be inferior

- , .

Lesson Learned:

We believe a combined use of lecture, individual and group exercises, and

interactive use of modern tools is superior for skill building.A seemingly superior class design guide is to limit lecture to no more than

30-40% of the class time.

23



30 June 2010



24/42

5) Use it or Lose it vs Self-Refresher Screen


Traditional Six Sigma training often includes training

materials that do not stand alone.

As such, students often find the need to retake the

training later on when the opportunity to apply a

Lesson Learned:

Six Sigma training should include rich information, decision flowcharts and

actual screen shots of the step-by-step process for each method using a

modern tool.

In this fashion, students may interactively follow along during class, as well

as, self-refresh on topics later on when needed.

24



30 June 2010



25/42

6) Memorization vs Laminated Color Job Aids


To this day, most Six Sigma training involves memorizing

formulas, as well as, which techniques to use in different

.

This memorization requirement continues to stall Six Sigma

.

Lesson Learned:

,

embody most of the decisions related to techniques based on the

situational factors.

At the SEI, we have created several laminated, color job aids that are in

great demand by our students.

25



30 June 2010



26/42

7) Standard Data Sets vsAdditional Student Data


It is common for Six Sigma training to provide data

sets to be analyzed as part of the skill building.

However, these data sets are often narrowly

constrained and unrealistic to the situations that

Lesson Learned:

Students should not only utilize prepared data sets to practice the different

techniques, but should be encouraged to bring their own organizational.

In this manner, students can build compelling predictive models for their

work lace needs durin the class!

26



30 June 2010



27/42

8) Book Knowledge vs Self-Sufficiency


Regretfully, many training providers, coaches and

practitioners seem to be only book knowledgeable of

.

As such, they are disadvantaged wrt the operation and

.

Lesson Learned:

-

students through the repeated practice of individual analytical techniques

and tools.

We believe skill building of this nature creates more self-sufficient students

who need less coaching and are more confident in applying the

27



30 June 2010


.

9) O ti t O i hi


28/42

9) One time event vs On-going coaching


Most Six Sigma training is designed as a one-time

training event, in which the students must go back to

.

Even the best training suffers without the appropriate

- .

Lesson Learned:

-

advice and help, as this psychologically promotes their use of the

methods without fear.

Superior Six Sigma deployments achieve coaching structures within each of

the major domains in their organization, such that practitioners are

28



30 June 2010


.

P lli Q ti 4


29/42

Polling Question 4

To what degree would these training implementation lessons-learned

benefit your organization?

1. Very much

2. Often

3. Somewhat

4. Minimal

5. Dont know

29



30 June 2010


SEI Si Si T i i S l ti


30/42

SEI Six Sigma Training Solutions

The SEI offers two courses that embody the lessons learned described in

this talk.

Designing Products and Processes using Six Sigma (DPPSS)

30



30 June 2010


IPPSS C D t il


31/42

IPPSS Course Details

Title: Improving Process Performance using Six Sigma (IPPSS) (5 days)

SEI url: http://www.sei.cmu.edu/training/p49b.cfm

Aka: Green Belt training for Software and Systems Engineers

Topics included:

1. Full treatment of the Six Sigma DMAIC process

2. Analysis using ANOVA and Hypothesis Testing

3. Sample size determination

4. Predictive modeling using Regression modeling

5. Role of these methods specifically related to the following CMMI-Dev

1.2 Process Areas: MA, QPM, OPP, CAR and OID

31



30 June 2010


DPPSS Course Details


32/42

DPPSS Course Details

Title: Designing Products and Processes using Six Sigma (DPPSS) (5 days)

SEI url: http://www.sei.cmu.edu/training/p56b.cfm

Aka: Black Belt training for Software and Systems Engineers

Topics included:

.

2. Voice of Customer techniques including KJ and Kano analysis

.

4. Predictive modeling using Dummy Variable and Logistic Regression modeling

.

6. Design of Experiments for practical, short experiments, and

7. Software Reliabilit Growth Modelin and rediction of latent defects.

32



30 June 2010


Polling Question 5


33/42

Polling Question 5

Which of these SEI courses seem attractive and t imely to meet your

organizations needs?

1. Improving Process Performance Using Six Sigma (IPPSS)

2. Designing Products and Processes Using Six Sigma (DPPSS)

3. Both of the above

4. Neither of the above

5. Dont know

33



30 June 2010


Open Question


34/42

Open Question

Any additional questions or comments on the critical lessons learned

in the content and delivery of Six Sigma training?

34



30 June 2010


Thank You for Your Attention!


35/42

Thank You for Your Attention!

Robert Stoddard U.S. mail:

. .

Dave Zubrow

Customer Relations

4500 Fifth Avenuema : z se .cmu.e uPittsburgh, PA 15213-2612

USA

World Wide Web: Customer Relations

www.se .cmu.e u ma : cus [email protected]

Telephone: +1 412-268-5800SEI Phone: +1 412-268-5800

SEI Fax: +1 412-268-6257

35



30 June 2010



36/42

Are ou measurin the data ou need?SEI Measurement and Analysis training

equ ps you w e s s nee e .

SEI Trainingwww.sei.cmu.edu/training

36



30 June 2010



37/42

Analyzing Project Management Indicators

Three-day course teaching managers and practitioners howto use measurement as the foundation for making informed

decisions about projects.

July 13 15, 2010 (SEI Arlington, VA)

Register Now:www.sei.cmu.edu/training/p07d.cfm

37



30 June 2010



38/42

es gn ng ro uc s an rocesses

Usin Six Si maFive-day course taking a hands-on, measurement-oriented approach toproduct development, providing participants with a toolkit of analysis

.

December 13 17, 2010 (SEI Arlington, VA)

Register Now:www.sei.cmu.edu/training/p56b.cfm

38



30 June 2010



39/42

Implementing CMMI for High Performance,

and Executive SeminarOne-day introductory course for executives and middle managerscovers the key concepts and strategy behind the SEIs new fast track

.

October 18, 2010 (SEI Arlington, VA)


39



30 June 2010



40/42

Implementing Goal-Driven Measurement-

identify and define indicators and measures that directly support an

organizations business, process improvement, and project goals.

September 21 23, 2010 (SEI Arlington, VA)

Register Now:www.sei.cmu.edu/training/p06.cfm

40



30 June 2010



41/42

Using Six SigmaFive-day course taking a hands-on, problem-solving approach todata analysis, providing participants with a toolkit of analysis

and Goal-Driven Software Measurement.

,


41



30 June 2010



42/42

Start here

Webinar start

42



30 June 2010


01 critical lessons learned in the content and delivery of six sigma training

Documents