actionable agile metrics for - agile socal€¦ · daniel s. vacanti actionableagiletm...

63
Daniel S. Vacanti ActionableAgile TM [email protected] @danvacanti Actionable Agile for Metrics Predictability

Upload: others

Post on 25-May-2020

169 views

Category:

Documents


29 download

TRANSCRIPT

Page 1: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Daniel S. Vacanti

ActionableAgileTM

[email protected]

@danvacanti

Actionable Agile

for

Metrics

Predictability

Page 2: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“When will it be done?”

@danvacanti – https://www.actionableagile.com

Page 3: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“When will it be done?”

Date (number of days)

Elapsed Time

@danvacanti – https://www.actionableagile.com

Page 4: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“When will it be done?”

Date (number of days)

Story Points / Velocity

@danvacanti – https://www.actionableagile.com

Page 5: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Stop me if you’ve heard this

one before…

@danvacanti – https://www.actionableagile.com

Page 6: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“Relative Complexity is the best

predictor of how long it takes

an item to complete”

@danvacanti – https://www.actionableagile.com

Page 7: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 8: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

I’m going to suggest

something radical…

@danvacanti – https://www.actionableagile.com

Page 9: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

As an example:

How long does it take you to get to

work in the morning?

@danvacanti – https://www.actionableagile.com

Page 10: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“It depends…”

@danvacanti – https://www.actionableagile.com

Page 11: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Here’s a spot!!

Page 12: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

4 4 2

Active Done

Testing DoneDoneActive

DevelopmentReady Analysis

3

Here’s a spot!!

Page 13: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Try an experiment for

me…

@danvacanti – https://www.actionableagile.com

Page 14: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Calendar Days

Elapsed Time

Page 15: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 16: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 17: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 18: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 19: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Try the same thing for

your process

@danvacanti – https://www.actionableagile.com

Page 20: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Backlog Analysis Develop Test Deployed

Start Timer Stop Timer

Page 21: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

This chart is called a (Cycle Time) Scatterplot

Page 22: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

If you track nothing else*,

track the date that an item starts and

the date that an item completes

(for all work items)

@danvacanti – https://www.actionableagile.com

Page 23: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

That will give you a

measure of the flow

metric of

Cycle Time

@danvacanti – https://www.actionableagile.com

Page 24: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Cycle Time

is the amount of

elapsed time

it takes for a given work

item to complete

@danvacanti – https://www.actionableagile.com

Page 25: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“When will it be done?”

(for a single item)

is best answered by

Cycle Time

@danvacanti – https://www.actionableagile.com

Page 26: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“Huh?”

@danvacanti – https://www.actionableagile.com

Page 27: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

How does generating a chart like this help us

answer “When will it be done”?

Page 28: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

How do we make sense of this randomness?

Page 29: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Your process is random.

Therefore, you can’t think

deterministically.

You need to think

probabilistically.

@danvacanti – https://www.actionableagile.com

Page 30: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

What does it mean to

think probabilistically?

@danvacanti – https://www.actionableagile.com

Page 31: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Let’s try another experiment…

@danvacanti – https://www.actionableagile.com

Page 32: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Thinking probabilistically means

acknowledging that there is

more than one

possible

future outcome

@danvacanti – https://www.actionableagile.com

Page 33: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

How many people can we “expect” to

be standing after 3 flips?

12.5%

Does that mean 12.5% was the only

possible outcome?@danvacanti – https://www.actionableagile.com

Page 34: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Backlog Analysis Develop Test Deployed

2

Start Timer Stop Timer

Page 35: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Backlog Design Develop Test Deployed

2

Exactly

this dot?

Exactly

this dot?

Or Exactly

this dot?

Will Item #3

end up as…

Page 36: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Backlog Design Develop Test Deployed

2

There is more than one possible outcome

for Item #3 while it is sitting in the backlog

Page 37: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

What are the possible

outcomes?

@danvacanti – https://www.actionableagile.com

Page 38: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

38

How do we make sense of this

“randomness”?

Page 39: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

39

50th Percentile = 6 days or less

Page 40: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

40

85th Percentile = 15 days or less

Page 41: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

41

95th Percentile = 22 days or less

Page 42: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

42

50th Percentile = 6 days or less

95th Percentile = 22 days or less

85th Percentile = 15 days or less

Scatterplot Percentiles (making a forecast)

Page 43: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

The answer to “When will it

be done?” is a percentile and

its associated range.

@danvacanti – https://www.actionableagile.com

Page 44: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 45: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

85th Percentile = 33 days or less

Page 46: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

85th Percentile = 13 days or less

Page 47: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 48: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 49: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

All of these dots are “done”.

Page 50: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

The most important chart you’ve

never heard of

@danvacanti – https://www.actionableagile.com

Page 51: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability
Page 52: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

To sum up…

@danvacanti – https://www.actionableagile.com

Page 53: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Customers care about

elapsed time

@danvacanti – https://www.actionableagile.com

Page 54: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

If you track nothing else, track

the date that an item starts

and the date that an item

completes

(for all work items)

@danvacanti – https://www.actionableagile.com

Page 55: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Calculate Cycle Time

from start and end

date data

@danvacanti – https://www.actionableagile.com

Page 56: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Use a

Cycle Time Scatterplot

to get a sense of

possible outcomes

@danvacanti – https://www.actionableagile.com

Page 57: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Use percentile lines on a

Scatterplot to help answer

“When Will It Be Done?”

@danvacanti – https://www.actionableagile.com

Page 58: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

Use a WIP Aging chart to

be proactive in managing

Cycle Time for greater

predictability

@danvacanti – https://www.actionableagile.com

Page 59: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

What does a 19th century

Yorkshire cotton industrialist

have to do with the

Manhattan Project?

For next time…

@danvacanti – https://www.actionableagile.com

Page 60: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“Actionable Agile

Metrics for

Predictability”

https://leanpub.com/actionableagilemetrics

Page 61: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

“When Will It Be

Done?”

https://leanpub.com/whenwillitbedone

Coming Soon….

Page 62: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

QUESTIONS?

Daniel S. Vacantihttp://www.actionableagile.com

[email protected]@danvacanti

Page 63: Actionable Agile Metrics for - Agile SoCal€¦ · Daniel S. Vacanti ActionableAgileTM daniel@actionableagile.com @danvacanti Actionable Agile for Metrics Predictability

All charts created by:

Thank-you!