was it worth it? measuring the success of an agility project in business terms - ethan ram at agile...
TRANSCRIPT
How to Measure Agility Project Success in Business Terms?
Agile Israel 2015
Ethan Ram
v1.1
© All rights reservedWant to use slides from this presentation? Ask for permission: [email protected]
11-Jun-15 2
Going Agile: Scrum, Kanban, CI, DevOPs
11-Jun-15 3
How to Measure? Number of code lines? Number of releases? Number of QA bugs opened? Need less support engineers?
Main operations KPIs– Support queue– Fault rate
Release cycle timeMeasure wasteEmployee gleeBottom lines: revenues
11-Jun-15 4
Support KPI: Open Escalations in R&D
• Number of support cases pending R&D resolution
11-Jun-15 5
Agile Injection
Agility Project
Support KPI: Fault Rate
• Oper1 fault rate is under SLA after 2 years above
11-Jun-15 6
Agile Injection
Agility Project
---- Oper1 daily/trend ---- SLA ---- Oper2 daily/trend
Waste KPI: Builds vs Deliveries
• QA builds vs. Customer deliveries• Build automation reduced miss-configs by 40%• Builds per delivery down from 2.2 to 0.8
11-Jun-15 7
Agile Injection
Agility Project
QA KPI: Bugs Resolution Turnaround
• Avg. days to resolve a QA bug is down from ~30 days to ~15 days
11-Jun-15 8
Agile Injection
Agility Project
QA KPI: Game Sign-offs per Month
• Games signed-off by QA• Games titles up from 15/m to 25/m (+60%)• Game variations up from 150/m to 260/m (+73%)
11-Jun-15 9
Agile Injection
Agility Project
• Game Dev Gantt 2012 – 22 weeks critical path
Release Cycle Time: Game Dev.
11-Jun-15 10
Scoping
Week
Math
Graphics HD
2 4 6 8 10 12 14 16 18 20 22
1
Graphics SD
Scene layout
Coding
QA
6
4
2.5
8
4
4Low-spec support
4
• 2013: from 22 weeks to 12 weeks
Release Cycle Time: Game Dev.
Week2 4 6 8 10 12 14 16 18 20 22
1
3
4
4
3
3
4
2
Scoping
Math
Graphics HD
Graphics SD
Scene layout
Coding
QA
Low-spec support
11-Jun-15 11
HR: Employee Survey
Dec. ’13
11-Jun-15 12
Processes and planning57% Improved37% Same6% Worse
Working Environment73% Improved25% Same2% Worse
Mar. ’13 TOP 5 DEMOTIVATORS
Revenues: Q2-12 >> Q2-13
• Customers: Up 30%
• Deployed terminals: Up +26%
• Headcount: no-change
• Revenues: Up 14%
11-Jun-15 14
How to Measure Agility Project Success in Business Terms?
Ethan [email protected]/in/ethanram@ethanram