© Eckerson Group LLC www.eckerson.com
The New BI/Analytics Synergy: How to Align Business and IT Around Data
Wayne EckersonJuly 30, 2015
© Eckerson Group LLC www.eckerson.com
• The data world has changed
• BI is one of many players
• BI still has a critical role to play
Objectives
© Eckerson Group LLC www.eckerson.com
The Center of the Universe
Claudius Ptolemy90-168 AD
Ptolemaic System
Geocentrism
Copernican System
Nicolaus Copernicus1473-1543 AD
Heliocentrism
© Eckerson Group LLC www.eckerson.com
BIcentrismBusiness Intelligence
Reports and Dashboards
Data warehouse
Relational (Integrated)
End-User Tools
Architecture
Data
ReportingMonitoring
AnalysisExploration
Mining
Bill Inmon Ralph Kimball
BI/DW Team
© Eckerson Group LLC www.eckerson.com
Continuous IntelligenceD
ashboards and Alerts
Complex event
processing &
streaming analytics
Event and m
achine data
Business Intelligence
Reports and Dashboards
Data warehouse
Relational (Integrated)
End-User Tools
Architecture
Data
Anal
ytica
l Eco
syst
em
Non-relational q
ueries
Keyword search & faceted
navigation Operational D
ashboards
(DW-driv
en dashboards )
Decision Automation
Analytics Intelligence
Spreadmarts, data silos, analytical sandboxes
Relational (Non-integrated)
Excel, OLAP, SQL, visual discovery tools, machine learning
Cont
ent I
ntel
ligen
ceKe
ywor
k se
arch
, Xqu
ery,
Hiv
e,
Java
, Pyt
hon,
Pig
, Per
l
Had
oop,
XM
L en
gine
s, S
earc
h en
gine
s
Non
-rel
ation
al,
mul
tistr
uctu
red
Casual Users
Power Users
Top-downBottom-up
Driven by ITBuilt around EDW
Answers known questionsFor Casual Users
To monitor processesUsing certified data
Driven by Business UnitsBuilt for power users
To meet needs of the BUBy answering new questions
Using uncertified data
ReportingMonitoring
AnalysisExploration
Mining
Power User
Casual User
IT-drivenCertified data
Predefined KPIs
Business-drivenAd hoc queriesNew insights
Source Data
Staging Area,
Hub and Archive
Business Intelligence (Reporting &
analysis - DW)
Analytics Intelligence
(Exploration & Discovery)
Ad hoc Query, Visualization, and Predictive
Tools
Corporate Dashboards &
Reports (Web and mobile)
Continuous Intelligence
(Alerting)
Analytics/Search
Streaming ETL QueryKey:
Rules
Conceptual Architecture – The New Analytical Ecosystem
Query Processing Systems
Intelligence Tools
Analytic Functions
Operational Reporting
Business Users
Data Capture and Pre-processing Systems
Operational Systems
Content Intelligence
Sem
antic
Lay
erSemantic
LayerD
ata
Dire
ctor
y
RelationalData
(ERP, CRM, Legacy)
Non-relational
Data(Files,
Images, Text, etc.)
On Premise, Cloud, or Hybrid
© Eckerson Group, 2015
© Eckerson Group LLC www.eckerson.com
The New Analytical Organization
BI/DW Team
Functional Analytic ManagersInfrastructure Administration
Business Unit Heads
Business Analysts
Advanced Analytics Team
ReportingMonitoring
AnalysisExploration
Mining
Business Analytics Center of
Excellence
Business Unit CIOs
Chief Data Officers
Security/Audit
MDM Team
© Eckerson Group LLC www.eckerson.com
Technology Revolution1993 –DW for a Pharmacy Chain
10 Pentium CPUs 2 GB RAM 1 TB disk
$1.6 million
2009 – Typical Desktop 4 core CPU 6 GB RAM 750 GB disk
$600
2015 – DW on a phone?64-bit, 128 GB
$60/month
Performance
Price
CPU, Memory, Disk storage
Waves of Computing1970s – Mainframes, Minis1980s – Client/server, Desktops1990s – Web/Internet2000s – E-commerce/Social media2010s – Mobile, Cloud, Big data
© Eckerson Group LLC www.eckerson.com
Analytical RevolutionOld World New World
Enterprise Data WarehouseIT-drivenReactive
SlowStatic
Hard to useTabular
ReportingDesktop
On premiseTransactional data
Business vs IT
Big Data EcosystemSelf-serviceProactiveFastInteractive Easy to useVisualAnalytics MobileCloudMulti-structured dataBusiness and IT
© Eckerson Group LLC www.eckerson.com
1990-20001980-1990
Ideal?
Power Struggle
2000-2010 2010-2020
Top Down BIIT-driven
Focus on standardsFor casual users
To monitor processesAnswer known questions
Using certified data From the DW
GOVERNED
Bottom-up BIBU-drivenFocus on speedFor power usersTo find new insightsAnswer new questionsUsing non-certified dataFrom any data source
UNGOVERNED
© Eckerson Group LLC www.eckerson.com
• Deliver certified, trustworthy data– Build and manage the “data warehouse”– Create and maintain data dictionary – Build and monitor analytic sandboxes
• Support business analysts– Train to use self-service BI tools– Help them navigate the data warehouse– Convert ad hoc reports into production reports
• Support business unit report developers– Matrix to BI team and train in BI tools and processes– Collaborate to build robust departmental dashboards
and scorecards
Role of BI Team
© Eckerson Group LLC www.eckerson.com
• Create BI/Analytics Center of Excellence– Identify the players – Create shared vision & infrastructure– Facilitate hand-offs between groups
• Create a federated BI organization – Matrix BI/data pros in each business unit– Manage steering committees (BI Council)– Go from order takers to consultants
• Evangelize value of business analytics– Brand and market analytics – Sell up, down, and across– Run internal conferences
• Spearhead data governance initiatives
Role of the BI Leader
Business Analytics Center of Excellence
Federated BI Organization
© Eckerson Group LLC www.eckerson.com
Foster convergence
Business Intelligence
Advanced Analytics
Data Management
• LOB Partnership • AA Partnership • BI Self-service• KPI Dashboards• Visual Discovery
• Data science• Data engineering• Data analysis • Data directory• Exploration
• DW Modernization• Hadoop, NoSQL, and Spark systems• Real-time streaming • Analytic sandboxes
Drive business valueAnalytical ecosystem and team
© Eckerson Group LLC www.eckerson.com
• The data world has changed
• BI is one of many players
• BI still has a critical role to play
Summary
© Eckerson Group LLC www.eckerson.com
Wayne EckersonHingham, MA
[email protected](781) 740-9504
Wayne Eckerson
• Principal Consultant, Eckerson Group• 20+ year thought leader in BI and analytics• Sought-after speaker and consultant• Former director of research at TDWI• Author of hundreds of articles and reports
Performance Management
BI/Analytics Data Governance (2016)