breaking down enterprise silos in the cloud - jason bloomberg, intellyx, cloud expo june 2014
DESCRIPTION
Breaking Down Enterprise Silos in the Cloud Are you recreating existing technology silos in the Cloud? If so, your entire enterprise investment in the Cloud is at risk. From the perspective of IT, organizational silos seem to be the root of all problems. Every line of business, every department, every functional area has its own requirements, its own technology preferences, and its own way of doing things. They have historically invested in specialized components for narrow purposes, which IT must then conventionally integrate via application middleware --- increasing the cost, complexity, and brittleness of the overall architecture. Now those same stakeholders want to move to the Cloud. Save money with SaaS apps! Reduce data center costs with IaaS! Build a single Private Cloud we can all share! But breaking down the technical silos is easier said than done. There are endless problems: Static interfaces. Legacy technology. Inconsistent policies, rules, and processes. Crusty old middleware that predates the Cloud. And everybody still has their own data model and their own version of the truth. The Cloud alone can't solve these complex challenges. We need a better approach to implementing technology that brings silos together, while allowing the personalization and customization that meets stakeholder needs. It’s time to rethink how we handle both data and code to align with the storage and processing model of the Cloud: distributed, horizontally scalable, and event-driven. We need an intelligent, active approach to building and running applications that is both dynamic and inherently Cloud-friendly. Attendees of this session will learn: * How organizational silos, application silos, and infrastructure silos limit business agility * Why moving existing applications to the Cloud won't break down silos, and in fact, will often make them worse * A novel, holistic approach for resolving the technical challenges with breaking down silos as enterprises move to the CloudTRANSCRIPT
Copyright © 2014, Intellyx, LLC
1
Breaking Down Enterprise Silos
in the Cloud
Jason BloombergPresident
@theebizwizard
About Jason Bloomberg
• President of Intellyx, Global Advisory Firm focused on Architecting Agility– Formerly with ZapThink 2001 - 2013
• Global thought leader in the areas of Agile Architecture, Cloud Computing, EA, & SOA
• Created the Licensed ZapThink Architect (LZA) SOA course & associated credential
• Run the Bloomberg Agile Architecture Certification Course around the world
• Buy my newest book, The Agile Architecture Revolution
• Include @theebizwizard in tweetsCopyright © 2014, Intellyx, LLC2
Problems of Organizational Silos
• Every line of business, department, functional area has its own requirements, its own way of doing things
• Must invest in specialized components for narrow purposes
• IT must integrate everything, increasing cost, complexity, & brittleness
Copyright © 2014, Intellyx, LLC3 Phot
o Cre
dit:
Doc
Sea
rls,
htt
ps:/
/ww
w.f
lickr
.com
/pho
tos/
docs
earl
s/55
0011
8475
/siz
es/o
/
Silos on Top of Silos
• Organizational silos– Lines of business,
departments, geographic locations, etc.
• Application silos– COTS apps / bespoke
apps for different departments
• Infrastructure silos– Varied data centers &
rooms, heterogeneous platforms, & Cloud!
Copyright © 2014, Intellyx, LLC4
Phot
o Cre
dit:
Cal
Del
linge
r ht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/cs
tree
tus/
3381
2851
99/s
izes
/o/
It’s Time to Take Down the Silos!
Phot
o Cre
dit:
Sav
anna
h Riv
er S
ite, ht
tp:/
/ww
w.f
lickr
.com
/pho
tos/
5100
9184
@N
06/
Copyright © 2014, Intellyx, LLC5
Cloud is No Panacea
• Move to the Cloud! Save money!• But…problems with technical silos persist:
– Apps that aren’t architected for Cloud– Static interfaces– Legacy technology– Inconsistent policies,
rules, & processes – Crusty old middleware
that predates Cloud – Diverse versions of
truth– Semantic interoperability
issues Copyright © 2014, Intellyx, LLC6 Ph
oto
Cre
dit:
Phi
lip L
eara
http
s://
ww
w.f
lickr
.com
/pho
tos/
phill
eara
/704
6670
573/
size
s/l
The Cloud Agility Challenge
• Application silos in the Cloud are still silos
• “Cloud” more than IaaS + PaaS + SaaS– Extend to mobile,
Internet of Things, etc.• Enterprise context
– Dealing with legacy– Hybrid scenarios– Complex governance &
compliance challenges
Copyright © 2014, Intellyx, LLC7
Phot
o Cre
dit:
Mar
io G
iam
batt
ista
http
s://
ww
w.f
lickr
.com
/pho
tos/
mar
iogi
amba
ttis
ta/3
8572
4418
7/si
zes/
l
Business Agility
• Responsiveness– Tactical value
• Resilience– Risk mitigation
• Innovativeness– Strategic value
Copyright © 2014, Intellyx, LLC8 Phot
o Cre
dit:
Mas
onite
Bur
n ht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/m
ason
ite-b
urn/
6273
6267
39/s
izes
/l
Ability to respond to change in the business environment and leverage change for competitive advantage
Ability to respond to change in the business environment and leverage change for competitive advantage
Enterprise as Complex Adaptive System
• Business agility is property of organization as a whole, hence an emergent property of the organization
• Enterprise is system of systems that exhibits emergent properties
• System of people and technology– Traffic jams– The wave
Copyright © 2014, Intellyx, LLC9
Phot
o Cre
dit:
agu
2000
_de
http
s://
ww
w.f
lickr
.com
/pho
tos/
3812
3550
@N
00/1
6693
0597
/siz
es/o
/
The Secret to Emergence
• Rules that affect behavior of component systems can be very simple
• Emergent behaviors often unpredictable
• Try something, see what happens, repeat
• Feedback loops & iterative approaches
Copyright © 2014, Intellyx, LLC10
Phot
o Cre
dit:
Jua
n Le
is h
ttps
://w
ww
.flic
kr.c
om/p
hoto
s/ka
ibar
a/46
3238
4645
/siz
es/l
Sound Agile to You?Sound Agile to You?
Governance as Agility Enabler
• Simple rules & policies lead to complex emergent behavior– Which ones lead to agility?
• Agility vs. Chaos• Levels of governance
– Low-level rules & policies– Departmental– Organizational
• Governance has negative connotation– Reputation for limiting productivity– Governance, Risk, & Compliance tools integrated in
traditional mannerCopyright © 2014, Intellyx, LLC11
Phot
o Cre
dit:
Mik
e Le
win
ski h
ttps
://w
ww
.flic
kr.c
om/p
hoto
s/ik
ewin
ski/
9430
8875
61/s
izes
/l
Limitations to Business Agility
• IT as the “bad guy”• EA buried in the IT
department• Ivory tower architecture• Silo mentality
– Not invented here– Can’t wait for IT– BYOD to BYO-everything
• No Agile Architecture
Copyright © 2014, Intellyx, LLC12 Phot
o Cre
dit:
Har
ris
Wal
ker
http
s://
ww
w.f
lickr
.com
/pho
tos/
harr
isw
alke
rpho
togr
aphy
/334
0161
598/
size
s/l
What is Bloomberg Agile Architecture?
• Bloomberg Agile Architecture reinvents Enterprise Architecture (EA) to drive business agility across the organization
• NOT: software architecture compatible with Agile development methodologies – Won’t support the organization’s agility
requirements • New architecture paradigm• Style of EA focused on architecting agility
Copyright © 2014, Intellyx, LLC13
Bloomberg Agile ArchitectureMind Map
Copyright © 2014, Intellyx, LLC14
Cross-Cutting Architecture
• Organization, process, applications, data, infrastructure
• Role for Enterprise Architecture
• Wakeup call for EAs & their organizations
• Essential for addressing silos
Copyright © 2014, Intellyx, LLC15
Phot
o Cre
dit:
pen
guin
cake
sht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/pe
ngui
ncak
es/2
8316
6280
3/si
zes/
l
Extending the Agile Manifesto
• Individuals and interactions over processes and tools– As a system of people & technology,
the enterprise is more about people• Working software over comprehensive
documentation– Technology must actually work to
enable agility• Customer collaboration over contract
negotiation– Slice across the silos
• Responding to change over following a plan– Architect for change
Copyright © 2014, Intellyx, LLC16
Phot
o Cre
dit:
Mar
y M
argr
et h
ttps
://w
ww
.flic
kr.c
om/p
hoto
s/do
uble
-m2/
4384
5785
34/s
izes
/l
The Transformative Role of Automation
• Cloud automates operational environment
• DevOps as automation-driven organizational change
• Big Data automation• SOA Governance
automation
Copyright © 2014, Intellyx, LLC17
Phot
o Cre
dit:
wired
forleg
oht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/w
ired
fors
ound
23/6
8132
6498
8/si
zes/
l
DevOps as Model for Cross-Cutting Architecture
DevOps as Model for Cross-Cutting Architecture
From DevOps to “BizOps”
• Before: dev chucking code to test, then over wall to ops
• Now: continuous test, continuous deployment• In progress: responsiveness to continuous
requirements change & variation
Copyright © 2014, Intellyx, LLC18
Phot
o Cre
dit:
fde
com
iteht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/fd
ecom
ite/1
2598
5056
95/s
izes
/l
Avoiding the Overbuilding Problem
• The challenge of minimum viable design• Code to metadata to unified system abstraction• If you have an overbuilding problem, you’re
doing Agile Architecture wrong!
Copyright © 2014, Intellyx, LLC19
Phot
o Cre
dit:
dal
veja
hht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/da
lven
jah/
3356
0737
/siz
es/l
What are You Writing?
• Code?– Least flexible, most susceptible
to overbuilding, reuse always a challenge• Metadata via declarative programming?
– Abstracts code, but leads to complexity shell game• Abstract models?
– Essential for implementable Agile Architecture, but vendors largely fall short
Copyright © 2014, Intellyx, LLC20
Phot
o Cre
dit:
dav
idd
http
s://
ww
w.f
lickr
.com
/pho
tos/
puui
kibe
ach/
6989
1792
73/s
izes
/l
Assembling the Pieces of Agile Architecture
• Architecting for change requires working at higher levels of abstraction
• Abstract models resolvable to capabilities at run time– Dynamic coupling– Dynamic schemas– Extreme late binding
Copyright © 2014, Intellyx, LLC21
Architect for ChangeArchitect for Change
Phot
o Cre
dit:
Pau
lioG
4eor
dio
http
s://
ww
w.f
lickr
.com
/pho
tos/
paul
ioge
ordi
o/23
0870
3486
/siz
es/l
Dynamic Coupling
• Tight coupling– Must code all nodes at
once• Loose coupling
– Interfaces abstract underlying code
• Dynamic coupling– Interfaces resolved at run
time
Copyright © 2014, Intellyx, LLC22
Phot
o Cre
dit:
Gor
don
Rob
erts
on h
ttps
://w
ww
.flic
kr.c
om/p
hoto
s/go
rdon
_rob
erts
on/5
5076
4573
8/si
zes/
l
Dynamic Schemas
• Rigid data schemas– Entity-Relational
Model, XML Schemas• Schemaless data
– Problem of implied schemas
• Dynamic schemas– Metadata modeled at
design time, resolved at run time
Copyright © 2014, Intellyx, LLC23
Phot
o Cre
dit:
Juh
anSon
inht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/ju
hans
onin
/231
7185
234/
size
s/l
Extreme Late Binding
• Early binding– Traditional integration
• Late binding– Web Service discovery– Content-based routing on
ESBs– DNS resolution for RESTful
endpoints• Extreme late binding
– Fully dynamic discovery– Resolve URIs & metadata
references in real timeCopyright © 2014, Intellyx, LLC24
Phot
o Cre
dit:
Ral
ph R
epo
http
s://
ww
w.f
lickr
.com
/pho
tos/
ralp
hrep
o_ph
otol
og/4
0792
8557
4/si
zes/
l
Dynamic Constraint Satisfaction
• Governance as layers of policies & rules• Need to calculate effective policy• Cross-process, cross-organization, in & out of Cloud• In real time
Copyright © 2014, Intellyx, LLC25
Process “A” Team “C”Division “B”
Cross-ProcessGovernance
No Excuses!
• Business Agility platforms are now available
• Business wants agility• IT can provide agility• Architects should know
how to architect agility– Take my class!
Copyright © 2014, Intellyx, LLC26
Phot
o Cre
dit:
Jos
eph
Bre
mso
nht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/ex
citin
gsou
nds/
9908
0528
65/s
izes
/l
