data science meets lean & agile principles

15
Creating Authentic, Inspiring Data Organisations using Lean & Agile Principles @waynerpalmer

Upload: waynerpalmer

Post on 18-Jul-2015

104 views

Category:

Leadership & Management


3 download

TRANSCRIPT

Page 1: Data science meets Lean & Agile Principles

Creating Authentic, Inspiring Data Organisations using Lean & Agile Principles

@waynerpalmer

Page 2: Data science meets Lean & Agile Principles

•  Excited by exploring possibilities and redefining the status quo. •  Can feel weighed down by structure and details. •  Connects on a personal level using empathy and nuance, skilled at understanding

broader context of an issue. •  Takes time to consider everyone’s opinions before moving forward. •  Dismissive of concrete reality and risk, happy to pursue unproven ideas. •  Marathon P.B. of 3h 40m 27s

My Personality Type

Page 3: Data science meets Lean & Agile Principles

Wolf Pack

Army

Machine

Family

Living System

Fear / Power

Rigour / Stability

Profit / Growth

Culture

Purpose

Organisational Personality Types

Thanks to Laloux (2014)

Page 4: Data science meets Lean & Agile Principles

The Division of Labour

GM

Delivery Mgr.

Dev Lead

ETL Dev BI Dev

Arch. Mgr.

Arch. Lead

Info. Arch. Soln. Arch. ETL Dev

Test. Mgr.

Test Lead

Test Analyst Test Analyst

Idea

Brie

f

Def

ine

Requ

irem

ents

Prel

imin

ary

Arc

hite

ctur

e

Win

Pro

ject

App

rova

l

Reso

urce

Allo

catio

n

Det

aile

d A

naly

sis

Cod

e

Prom

otio

n to

Tes

t

Test

ing

Def

ect R

esol

utio

n

Prom

otio

n to

Pre

Pro

d

Def

ect R

esol

utio

n

Cut

over

Doc

s Pr

oduc

ed

Win

Cut

over

App

rova

l

Prod

uctio

n C

utov

er

Def

ect R

esol

utio

n

Resources or Craftsmen?

Page 5: Data science meets Lean & Agile Principles

Your firms are built on the Taylor model, and even worse so are your heads. With your bosses doing the thinking while workers wield the screwdrivers, you are convinced this is the right way to run a business.

Konosuke Matsushita

Taylorism Takes it Forward

Thanks to Joyce (2012)

Page 6: Data science meets Lean & Agile Principles

An Unfortunate Side Effect

The man whose life is spent in performing a few simple operations has no occasion to exert his understanding or to exercise his invention…the uniformity of his life corrupts the courage of his mind, and makes him regard with abhorrence an irregular, uncertain and adventurous life…

Adam Smith

Page 7: Data science meets Lean & Agile Principles

Flow Efficiency over Resource Efficiency

Efficient Islands

Perfect State (Lean)

Wasteland

Efficient Ocean

Resource Efficiency

Flow Efficiency

Ideal

Thanks to Modig (2013)

Page 8: Data science meets Lean & Agile Principles

Six Steps towards an Authentic Data Organisation

Clarify the Organisational Purpose Eliminate Handoffs Between the Functional Silos Grow Master “Data Craftsmen” Make Your Delivery Flow Visible Instill Continuous Improvement Challenge the Whole

1)

2)

3)

4)

5)

6)

Thanks to Marshall (2014)

Page 9: Data science meets Lean & Agile Principles

Clarify the Organisational Purpose

survive long term as a company by improving and evolving how we deliver good products for the customer

•  zero defects

•  100% value added

•  1x1 continuous flow, on demand, to the customer

•  security for its people

Thanks to Pink (2009)

Page 10: Data science meets Lean & Agile Principles

Eliminate Handoffs between Silos

Attach Work to People Resource Efficiency

Attach People to Work Flow Efficiency

BI Dev.  

ETL Dev.  

Tester   Customer  

Coach  ETL Resource  

Analyst  

Thanks to Modig (2013)

Page 11: Data science meets Lean & Agile Principles

Develop Master “Data Craftsmen”

Attach Work to People Resource Efficiency

Attach People to Work Flow Efficiency

Craftsmen  

Craftsmen  

Craftsmen   Customer  

Coach  

Craftsmen  

ETL Resource  

Thanks to Modig (2013)

Page 12: Data science meets Lean & Agile Principles

Make Your Delivery Flow Visible

Modelling   Development   Acceptance  CUSTOMER  

I would like <thing>  

Release  

Visualise Queues & Performance

Pull not Push

Keep your Unit of Work Small, and Limited

Information Flow

Value Flow

Thanks to Modig (2013)

Page 13: Data science meets Lean & Agile Principles

Instill Continuous Improvement

vision (∞)

challenge (2-3 years)

target state (3-6 months)

obstacles P   D  

C   A  

P   D  

C   A  

improvement PDCA cycles

current state

Thanks to Rother (2010)

Page 14: Data science meets Lean & Agile Principles

Challenge the Whole

Interior Exterior

Individual Peoples beliefs and mindset

Peoples behavior

Collective Organisational culture

Organisational systems (structures, process and practices)

Thanks to Laloux (2014), Dweck (2007), Argyris (1974)

•  Theory X vs. Theory Y •  Fixed vs. Growth

•  Double Loop Learning •  Action Theories •  Collaborative Communication

•  Self Management •  Wholeness •  Evolutionary Purpose

Page 15: Data science meets Lean & Agile Principles