seven styles of data integration
DESCRIPTION
Seven Styles of Data Integration. Michael Corcoran Vice President & CMO October 13, 2014. Pervasive Business Intelligence Opportunity for Improvement. Most organizations access and analyze less than 20% of their data assets, minimizing the return on their overall IT investment. - PowerPoint PPT PresentationTRANSCRIPT
Michael CorcoranVice President & CMO
April 20, 2023
Seven Styles of Data Integration
Copyright 2007, Information Builders. Slide 2
Pervasive Business IntelligenceOpportunity for Improvement
Most organizations access and analyze less than 20% of their data assets, minimizing the return on their overall IT investment.
Most organizations have deployed BI capabilities to fewer than 10% of their internal users.
Applications
Transactions
Databases
Messages
Documents
Services
Copyright 2007, Information Builders. Slide 3
Enterprise Business IntelligenceThree Levels
CUSTOMERSPARTNERS
DISTRIBUTORDISTRIBUTOR
AGENTSAGENTSSERVICESERVICE
CEO/CEO/PRESIDENTPRESIDENT
INFORMATIONTECHNOLOGYINFORMATIONTECHNOLOGY
FINANCEFINANCE MARKETINGMARKETING PRODUCTSPRODUCTSSALESSALES HUMANRESOURCES
HUMANRESOURCES
SUPPLIERSUPPLIER
OperationalData Store
OperationalData
Process/Transaction/Web Service/Documents
RFID
DataWarehouse
Copyright 2007, Information Builders. Slide 4
Information BuildersOur Solutions
Because Everything Should Work Together
Because Everyone Makes Decisions
The Cost of Delivering Information
Up to 80% of the cost of implementing business intelligence is attributed to data integration.
Enterprise Business IntelligenceSeven Styles of Data Integration
DataMarts
DataWarehouse
OperationalData Store (ODS)
OperationalData
Process/Transaction/Web Service/Documents
Pointin Time
RealTime
1. Data Warehouse
2. Operational Data Access
3. Real-time Data Warehouse
4. Enterprise Information Integration & Drill-Through
5. Web Services
6. Process-Driven BI
(Alerts, BAM, and Embedded)
7. Enterprise Search
1. Data Warehouse
2. Operational Data Access
3. Real-time Data Warehouse
4. Enterprise Information Integration & Drill-Through
5. Web Services
6. Process-Driven BI
(Alerts, BAM, and Embedded)
7. Enterprise Search
Data Integration RequirementsTraditional Data Warehousing
BenefitsBenefits Data qualityData quality ConsolidatedConsolidated Data consistencyData consistency No operational system impactNo operational system impact
ChallengesChallenges Data LatencyData Latency High costHigh cost Implementation time and Implementation time and
maintenancemaintenance
ETLETL
DATAWAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Data Integration RequirementsOperational Data Access
BenefitsBenefits Zero data latency Zero data latency Lower costLower cost Detail dataDetail data Reduced implementation timeReduced implementation time
ChallengesChallenges Data qualityData quality Operational system impactOperational system impact Data aggregationData aggregation
DATAWAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Data Integration RequirementsReal-Time Data Warehouse
BenefitsBenefits Zero data latency Zero data latency Consolidated data modelConsolidated data model No operational system impactNo operational system impact
ChallengesChallenges Transaction volumeTransaction volume
How Do we Do ItHow Do we Do It Real-time TransformationReal-time Transformation Packaged application interfacesPackaged application interfaces Works with all brokers, msg Works with all brokers, msg
queues and TP monitorsqueues and TP monitors Integrated with ETLIntegrated with ETL
- Common process flow- Common process flow
- Embed ETL jobs in process - Embed ETL jobs in process flowsflows
DATAWAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Process/Transaction/Web Service/Documents
Real-TimeReal-TimeTransformationTransformation
BrokerTP Monitor
Data Integration RequirementsEnterprise Information Integration
BenefitsBenefits Consolidated view Consolidated view Cross-business functionsCross-business functions Executive portalsExecutive portals Reduced implementation timeReduced implementation time
ChallengesChallenges PerformancePerformance Non-similar data keys Non-similar data keys
DATAWAREHOUSE
DATAWAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Data Integration Requirements EII Drill-Through Data Warehousing
BenefitsBenefits Detail analysis Detail analysis Financial analysisFinancial analysis Data Warehouse validationData Warehouse validation
ChallengesChallenges Data synchronizationData synchronizationDATA
WAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Data Integration RequirementsWeb Services
BenefitsBenefits Standard interfacesStandard interfaces Simplifies B2B data accessSimplifies B2B data access
ChallengesChallenges Performance ?Performance ?DATA
WAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
FIREWALL
Supplier 3
JAVA
Supplier 2
.NET
Supplier 1
VB
DB2DB2IMSIMS
OracleOracle
SQLSQLServerServer
Process-Driven Business IntelligenceAlerts
BenefitsBenefits True Real-TimeTrue Real-Time AlertsAlerts Business Activity MonitoringBusiness Activity Monitoring Embedded BI into any Embedded BI into any
operational business process or operational business process or workflow. workflow.
ChallengesChallenges ??
DATAWAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Process/Transaction/Web Service/Documents
ESBBroker
TP MonitorApplcation
Process-Driven Business IntelligenceBusiness Activity Monitoring
BenefitsBenefits True Real-TimeTrue Real-Time AlertsAlerts Business Activity MonitoringBusiness Activity Monitoring Embedded BI into any Embedded BI into any
operational business process or operational business process or workflow. workflow.
ChallengesChallenges ??
DATAWAREHOUSE
OPERATIONAL DATAOPERATIONAL DATA
Process/Transaction/Web Service/Documents
ESBBroker
TP MonitorApplcation
Process-Driven Business IntelligenceEmbedded BI
ESBBroker
TP MnitorApplcation
Data Integration RequirementsEnterprise Search
Seven Styles Of Data IntegrationSummary
Today’s business requires new types of data. Information demand is driving lower latency of data. Enterprise Business Intelligence requires most, if not all, styles of
data integration.