lean quality assurance v3

8/3/2019 Lean Quality Assurance v3

1/50

www.Gilb.com 1Version 8- Sep. 2010

LeanQuality Assurance

by Gilb

Copyright: Gilb 2010,

Slide owner: [email protected] @kaigilb

[email protected] @imtomgilbwww.gilb.com

These slides will be at:

http://www.gilb.com/tiki-download_file.php?fileId=392


2/50


Main Take-away Points

Quality Assurance is far more than test,and it can be far more cost-effective

Quality is far more than bugs

You probably have a lot to learn,if you want real competitive quality


3/50


Quality Assurance

is far more than test

and it can be far more cost-effective


4/50


a story


5/50


Inspection Effectiveness

Capers Jones


6/50



7/50



8/50



9/50



10/50


All Defects

Desi

gn

Best Practice TestingCombined

Remaining Defects


11/50


Little hope of zero defectsBetween

8 and10defect removal

stages requiredto achieveremovaleffectiveness of

95%


12/50


Testing Capability (C. Jones)

0

20

40

60

80

100

120

1st year 2nd year 5th year

Test

In Field

%


13/50


Defect Detection Capability (C. Jones)

0

20

40

60

80

100

120


Inspection

Test

In Field

%


14/50


IBM Defect Avoidance Experience

0

20

40

60

80

100

120


Defect Prevention Effectiveness

Inspection

Test

In Field

%


15/50


Design Quality In


16/50



17/50


but by Engineering Quality In

Reliability

Performance

Security

Usability

Maintenance

Work hours

$ Kr.


18/50


Setting Quality Goals

Usability.LearnScale: average time to Learn how tooperate the computer, from .. to ..

Status [today] 3 hours

Goal [next year] 10 min.


19/50


Designing to meet Quality within Costs

Qu

alities

$

Design Ideas


20/50


Quality Assurance

is far more than test

and, QA can be far more cost-effective


21/50




22/50


a story


23/50


System Performance

Q u a l i t y

How Well

Resource

SavingEfficiency

Capacity

HowMuch


24/50


Qualities are many and variable

Learning Doing Error RateUsability Portability Enhancability CompatibilityAdaptability

Threat Type and Frequency Security MitigationIntegrity

Reliability Maintainability (fault fix speed)Availability


25/50


Quantify the Quality to Assure It

I often say that

when you can measurewhat you are speaking about,

and express it in numbers,

you know something about it;

but when you cannot measure it,

when you cannot express it in numbers,

your knowledge is of a meagre and unsatisfactorykind;

- Lord Kelvin, 1893


26/50




27/50


7Competitive Lean

QA methods

to Learn


28/50


Stakeholders Decide Qualities

Suzanne Robertson &James Robertson

1.


29/50


2.


30/50


Assuring that Designs give Qualities3.

Usability


31/50


Measure Quality Levels in

Specifications with Inspection4.


32/50


Numeric Quality Gateways5a.


33/50


Numeric Quality Gateways

Improve Quality of work

80 Majors Found (~160-240 exist!)

40

23

800

20

40

60

80

100

0 1 2 3 4 5

Defects/Page

February April

Inspections of Garys Designs

Gary atMcDonnell-Douglas

5a.


34/50


DPP Improves Quality by 10x: Raytheon

CONC

Cost of Rework

(non-conformance)

COC

Cost of

Conformance

43%

www.sei.cmu.edu/publications/%20documents/95.reports/95.tr.017.html

40%

35%

30%

25%

20%

15%

10%

5%

0%

5%

1st year 2nd year 4rd year 5th year 6th year 7th year 8th year

% CONC% COC

Start of Effort

The individuallearning curve ??

Bad ProcessChange

6


35/50


Frequent feedback and improvement

assure quality

2 Kinds of Feedback from Stakeholders, when value increment is reallyexploited in practice after delivery. Combined with other information from the relevant environment. Like budget, deadline, technology, politics, laws,

marketing changes.

Stake-

holdersPotentialValue

Plan Do

Act Study Perceived-ValueInfo

Realized

Value Stake-holders

Realized-ValueInforma5on

Stake-

holders

Stake-

holders

Stake-

holders

Stake-

holders

Other

Cri5calFactors

7a


36/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b

Value

ManagementProcess


37/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


38/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


39/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


40/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


41/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


42/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


43/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


44/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b


45/50


Stakeholders

Values

Solutions

DecomposeDevelop

Deliver

Measure

Learn7b

Value

ManagementProcess


46/50


7Competitive Lean

QA methods

to Learn


47/50


What you can do immediately

Identify the 5 most critical qualities ofyour system.

Quantify the 5 qualities.For each quality, set a Current level and a Goal level


48/50


Main Take-away Points

Quality Assurance is far more than test,and it can be far more cost-effective


You probably have a lot to learn,if you want real competitive quality


49/50


Thanks!

Thanks!Questions: now, briefly

After lecture, all during the conference.

[email protected] [email protected]: +47 920 66 705

www.Gilb.com

Copy of these slides will be in Downloads/Slides:

http://gilb.com/tiki-list_file_gallery.php?galleryId=14


50/50

www.Gilb.com 50Version 8- Sep 2010

The Lean Quality Assurance Methods

EverythingnotaddingvaluetotheCustomerisconsideredtobewaste.Thisincludes:

unnecessarycodeandfunc?onality DelayinthesoAwaredevelopmentprocess Unclearrequirements Bureaucracy Slowinternalcommunica?on

mplifyLearning Thelearningprocessisspedupbyusageofshortitera?oncycleseachonecoupledwithrefactoringandintegra?ontes?ng.Increasingfeedbackviashortfeedback

sessionswithCustomershelpswhendeterminingthecurrentphaseofdevelopmentandadjus?ngeffortsforfutureimprovements.

Decideaslateaspossible DeliverasfastaspossibleEmpowertheteamBuildintegrityin

separatecomponentsworkwelltogetherasawholewithbalancebetweenflexibility,maintainability,efficiency,andresponsiveness.Seethewhole

Thinkbig,actsmall,failfast;learnrapidly

lean quality assurance v3

Documents