emc world 2016 - devops-at-scale session
TRANSCRIPT
1© Copyright 2016 EMC Corporation. All rights reserved.
2© Copyright 2016 EMC Corporation. All rights reserved. 2© Copyright 2016 EMC Corporation. All rights reserved.
DEVOPS AT SCALEBART DRISCOLL
3© Copyright 2016 EMC Corporation. All rights reserved.
YOUR SPEAKER IT leader and evangelist within EMC Global Services Passionate about driving IT Performance through lean
and agile Focused on application development and deployment
operations (aka. DevOps)
R. Bart DriscollDirector, DevOps Services @bartdriscoll
https://infocus.emc.com/author/bart_driscoll/[email protected]
Austin, TX
4© Copyright 2016 EMC Corporation. All rights reserved.
DEVOPS IS …
…optimizing the flow of work to create products that create value faster and more reliably.
OPS
DEV
5© Copyright 2016 EMC Corporation. All rights reserved.
WHY IS THIS SO CHALLENGING?
PLATFORMS OPERATING MODEL TOOLS PROCESS STANDARDS
6© Copyright 2016 EMC Corporation. All rights reserved.
DEVOPS-AT-SCALE
APPLICATION
WORKING PROTOTYPE
ENTERPRISE PORTFOLIO
DESIGN STANDARDS FRAMEWORKS PRINCIPLES ARCHITECTURES
7© Copyright 2016 EMC Corporation. All rights reserved.
EPS Comparison• Enterprise Objective– Improve Earnings per Share
• Aligned IT Goals– Drive efficiency
• Improve Net Income by lowering net operating cost– Accelerate Time-to-Market
• Capture new (or reclaim) market share by providing new/update service to customers faster than competitors
– Improve Quality• Advance customer satisfaction by delivering
technically sound, fit for purpose solutions
• Software Delivery Management Program
GLOBAL BANKING CLIENT
Enterprise At-A-Glance
• 6,000+ active dev projects• 30,000+ IT Professionals• 7 Major Divisions• Globally distributed IT• Countless Partners• Heterogeneous platforms
8© Copyright 2016 EMC Corporation. All rights reserved.
• Focus– Pilot Continuous Integration and Delivery– Advise Infrastructure Provisioning and Management
• Influence– Integrating Lean SDLC (SAFe/Agile) initiative– Developing business case and roadmaps– Support development of Standardized Architectures
• Approach– Provide multi-level services– Develop internal champions and sponsors
EMC & GWB COLLABORATIONGLOBAL WHOLESALE BANKING DIVISION
9© Copyright 2016 EMC Corporation. All rights reserved.
1. Align2. Prove3. Radiate
ALIGN PROVE RADIATE
PATHWAY TO SUCCESS
10© Copyright 2016 EMC Corporation. All rights reserved.
ALIGNDEFINE DESIRED STATE
Cloud
DevOps
Agile
INDUSTRY TRENDS ENTERPRISE GOALS
• Drive efficiency• Accelerate TTM• Improve quality
DESIREDSTATE
11© Copyright 2016 EMC Corporation. All rights reserved.
DEVELOPMENTOPERATIONS
SECURITY
COMPLIANCE
INFRASTRUCUTRE
ARCHITECTURE TESTPRODUCT
ALIGNBE DEPLOYMENT-FOCUSED
DEPLOY
12© Copyright 2016 EMC Corporation. All rights reserved.
ACKNOWLEDGE CURRENT READINESSALIGN
13© Copyright 2016 EMC Corporation. All rights reserved.
MEASURE OUTCOMESALIGN
Processes& Models
3-5 Year Objectives/Outcomes
AnnualObjectives/Outcomes
Improvement Targets
Improve Earnings Per Share
Driv
e Effi
cienc
yAc
cele
rate
Tim
e-to
-Mar
ket
Impr
ove
Qual
ity
By E
OY 2
015,
ena
ble
busin
ess t
o ca
nary
test
UI
feat
ures
with
Pro
duct
ion
user
com
mun
ity
By E
OY 2
015,
feat
ure-
driv
en
deve
lopm
ent (
FDD)
pr
actic
es a
re S
OP fo
r pilo
t te
am(s
)
By E
OY 2
015,
team
can
de
ploy
into
pro
duct
ion
ever
y 30
day
s or l
ess f
or o
f pi
lot a
pplic
atio
n(s)
By E
OY 2
015,
ope
ratio
ns
team
s can
supp
ort a
uto-
scal
e up
/dow
n fo
r web
and
ap
plica
tion
tiers
of p
ilot
appl
icatio
n(s)
By E
OY 2
015,
dev
elop
men
t an
d te
st te
ams h
ave
desig
ned,
dev
elop
ed a
nd
impl
emen
ted
CD fo
r DBs
in
supp
ort o
f pilo
t ap
plica
tion(
s)
Application Architecture PracticesPlatform/Server Management ProcessDatabase Development LifecycleRelease Management ProcessDeployment & Provisioning ProcessSoftware Development Lifecycle
AffectedProcesses &
Practices
S.M.A.R.T.Improvement Targets
14© Copyright 2016 EMC Corporation. All rights reserved.
ALIGNORGANIZE AROUND VALUE
GROUPING DYNAMIC TEAMING MODEL
GOAL
Operational SilosCentralized Management
Cross-functional TeamSelf-managed; Product Aligned
GOAL
15© Copyright 2016 EMC Corporation. All rights reserved.
1. Align2. Prove3. Radiate
ALIGN PROVE RADIATE
PATHWAY TO SUCCESS
16© Copyright 2016 EMC Corporation. All rights reserved.
• Pilot JAVA application
• Develop/demo working prototype
• Build Champion(s)
• Train team
PROVEDEMONSTRATE VIABILITY
17© Copyright 2016 EMC Corporation. All rights reserved.
• Cross-functional• Collaborative• Transparent• Iterative• Courageous• Retrospective
PROVESEED CULTURE
“Why should we change?”
“Can’t do that because …?” “Impossible!”
“Can we do that?”
“Cool!”
CHAMPIONS
18© Copyright 2016 EMC Corporation. All rights reserved.
TAKE 2: DEVOPS & CD FOR CRM
What:Provide the culture, process automation, and tooling to improve development velocity, release frequency and software quality.
How: Lean Agile
DevOps/ Continuous Delivery
Cloud Infrastruc
ture *
Agility(Velocity
& Quality)
* Limited capability/influence
19© Copyright 2016 EMC Corporation. All rights reserved.
PROVETARGET VALUE STREAM
A frequently executed workflow like this…
enables a value stream like this...
20© Copyright 2016 EMC Corporation. All rights reserved.
PROVEEMBED TOOLING
21© Copyright 2016 EMC Corporation. All rights reserved.
PROVEITERATIVE ROADMAP
• Commit Stage Includes ETL• Acceptance Stage Includes•Dependency Management • Push-button Release Automation• Release Mgmt Simplification• Canary Deployments•Mule/CRM upgrades
• Commit Stage includes ADS DB• Acceptance Stage• Enhanced Dashboard / Feedback
• Source Control• Pre-Commit Stage for MS Dynamics & Integration Services• Commit Stage for MS Dynamics & Integration Services•Dashboard/Feedback Loop•Dedicated VM Environment
Q1 Q2 FUTURE
22© Copyright 2016 EMC Corporation. All rights reserved.
1. Align2. Prove3. Radiate
ALIGN PROVE RADIATE
PATHWAY TO SUCCESS
23© Copyright 2016 EMC Corporation. All rights reserved.
DEPENDENT SYSTEMS; SHARED STANDARDSRADIATE
CRM Functionality Removed from Navigator (Client/Contact/Activity), just Deal Management Remains.
CEDTX Data
Navigator Services
DEALSTX Data
GCIB MSCRMMS Dynamics CRM 2015
DACTX Data
GWB MSCRMMS Dynamics CRM 2015
The next Phase of the Sales Platform:
Navigator: All CRM functionality will be removed from Navigator which will retain only Deal Management functionality.
Informatica will no longer push Clients/Entities and will start pushing read-only Deal data.
CRM Integration Engine will add support for Client/Entity data and will not longer sync Activities or Contacts with Navigator. Its data services will be the provisioning point for this data.
GPDS will be refactored to not update CDB or the legacy CED Orgs. Downstreams must stop using legacy CED Orgs.
Client Plans must move to GCIB MSCRM.
Client/Entity updates are gathered from a CED MQ topic (must research what MRDS plans).
Sales ADS: Theoretically, if GWB MSCRM contains all contacts and activities, it could serve as the aggregation point for that data. However, the Sales ADS will eventually become the single provisioning point and we will incrementally build it to that point. Until GDH is replaced and its downstreams refactored, its data will still flow to GDH.
CRM Integration Engine
MULE
FAST Mart
SalesADS
Real-time inserts, updates, deletes: Activities, Contacts, Clients/Entities.
Deal & Admin Codes
DealsAssociates
GDH ProfitClient Financials
1x/month
4x/day
SOSRef DataClient 360
4x/day
GCIB Reporting Lines, Ref
Data
Manual Process
Web Service Direct Call
Informatica ETL
Legend
Out: Plug-inIn: CRM API
MS Dynamics MarketingCloud
Dynamics Marketing Connector
Azure Service Bus
GPBS
DACClient/Server
NavigatorWeblogic Portal
GCBRTX Data
GDHSales Referrals
Sales Data4x/day
GCB Referrals
GPBS MQ Topic
Sync Data and Aggregated
Contacts, Activities, Clients, Client Plans
Refe
renc
e Da
ta, R
efer
rals
, Clie
nt
Plan
s, D
eals
& C
lient
360
24© Copyright 2016 EMC Corporation. All rights reserved.
DEVELOP LAYERED GOVERNANCE MODELSRADIATE
ENTERPRISE
PORTFOLIO (L.O.B.)
ARCHITYPE
APPLICATION
TEAM
DEV TEST STAGE PRODQU
ALIT
Y ST
ANDA
RDS
POLI
CY-D
RIVE
N PI
PELI
NES
25© Copyright 2016 EMC Corporation. All rights reserved.
CREATE AN EXTENSIBLE AGILE PLATFORMRADIATE
Deployment Environments Management & Monitoring
Version Control Build Tools Continuous Integration Tools Test Frameworks
TestManager
ACCEPTANCE STAGINGPRE-COMMIT DEV/COMMIT PRODUCTION
Configuration Managment Artifact Repositories
API FRAMEWORK & LIBRARIES
DevOps Workflow
TEST
API FRAMEWORK & LIBRARIES
26© Copyright 2016 EMC Corporation. All rights reserved.
DEVELOP A SUPPORT SYSTEM FOR CHANGERADIATE
EXTERNAL COACH(es)
INTERNAL CHAMPION(s)
TECHNICAL SME(s)
Industry ExpertiseBroad Experience
‘Outsider’ Perspective
• Recognized leader• Politically savvy• ‘Insider’ Perspective• Pragmatic thought-leadership
• Known technical expert• Deep subject matter expert• Innovator/Early Adopter
• • •
27© Copyright 2016 EMC Corporation. All rights reserved.
CREATE SPACERADIATE
APPAPP
APP
APP
CD PIPELINE CD PIPELINES
GOAL
TEAM
GOAL
GOAL
GOAL
Goal
TEAMS
TOOLS
PROCESS & BEST PRACTICE
STANDARDS & GUIDELINES
COACHING & CHAMPIONS O
NB
OA
RD
IN
G
Legacy Enterprise
28© Copyright 2016 EMC Corporation. All rights reserved.
CIO
PRODUCT MANAGEMENT
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
FUNCTIONALTEAM LEAD
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
FUNCTIONALTEAM LEAD
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
FUNCTIONALTEAM LEAD
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
FUNCTIONALTEAM LEAD
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
OTHER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
TEAM MEMBER
MANAGE BY PRODUCTRADIATE
METRICS
SKILLS
PRODUCT
29© Copyright 2016 EMC Corporation. All rights reserved.
SUMMARY
ALIGN PROVE RADIATE
TO OVERCOME INERTIA
TO CREATE LASTING CHANGE
30© Copyright 2016 EMC Corporation. All rights reserved. 30© Copyright 2016 EMC Corporation. All rights reserved.