the impact of soa on traditional middleware technologies
DESCRIPTION
This presentation addresses the broad differences between traditional middleware and SOA and identifies how SOA renovates the approach to integration taken by traditional middleware technologies. Learn how to create an SOA adoption roadmap to existing customers of traditional middleware.TRANSCRIPT
The Impact of SOA on Traditional Middleware Technologies
Jim GreenCEO Composite Software
April 29 2008
Agenda
bull Integration Itrsquos Why We Do Middlewarebull SOA What Makes It Differentbull Applications Integration Middleware Traditional
vs SOAbull Data Integration Middleware Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Statement of the ProblemElectronics Company IT Architecture
Application Integration and Data Integration
File Systems Databases
CustomApplications
PackagedApplications
Application Integration and Data Integration
Data Integrationbull Periodicbull Large Data Setsbull BatchOn Demandbull Data Manipulation
Application Integrationbull Transactionalbull High Volumebull Real-timebull Interface focused
Common Patterns of IntegrationAggregationbull Many to one
Sequential Processbull Multi-step
Propagationbull One to Many
Managed Processbull BPM
Synchronizationbull One-waybull n-way
Document Exchangebull TN EDI etc
Invocationbull Request-reply
Shared Processbull Multi-Org BPM
Federated Querybull Portalbull Virtual Data Mart
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Agenda
bull Integration Itrsquos Why We Do Middlewarebull SOA What Makes It Differentbull Applications Integration Middleware Traditional
vs SOAbull Data Integration Middleware Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Statement of the ProblemElectronics Company IT Architecture
Application Integration and Data Integration
File Systems Databases
CustomApplications
PackagedApplications
Application Integration and Data Integration
Data Integrationbull Periodicbull Large Data Setsbull BatchOn Demandbull Data Manipulation
Application Integrationbull Transactionalbull High Volumebull Real-timebull Interface focused
Common Patterns of IntegrationAggregationbull Many to one
Sequential Processbull Multi-step
Propagationbull One to Many
Managed Processbull BPM
Synchronizationbull One-waybull n-way
Document Exchangebull TN EDI etc
Invocationbull Request-reply
Shared Processbull Multi-Org BPM
Federated Querybull Portalbull Virtual Data Mart
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Statement of the ProblemElectronics Company IT Architecture
Application Integration and Data Integration
File Systems Databases
CustomApplications
PackagedApplications
Application Integration and Data Integration
Data Integrationbull Periodicbull Large Data Setsbull BatchOn Demandbull Data Manipulation
Application Integrationbull Transactionalbull High Volumebull Real-timebull Interface focused
Common Patterns of IntegrationAggregationbull Many to one
Sequential Processbull Multi-step
Propagationbull One to Many
Managed Processbull BPM
Synchronizationbull One-waybull n-way
Document Exchangebull TN EDI etc
Invocationbull Request-reply
Shared Processbull Multi-Org BPM
Federated Querybull Portalbull Virtual Data Mart
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Application Integration and Data Integration
File Systems Databases
CustomApplications
PackagedApplications
Application Integration and Data Integration
Data Integrationbull Periodicbull Large Data Setsbull BatchOn Demandbull Data Manipulation
Application Integrationbull Transactionalbull High Volumebull Real-timebull Interface focused
Common Patterns of IntegrationAggregationbull Many to one
Sequential Processbull Multi-step
Propagationbull One to Many
Managed Processbull BPM
Synchronizationbull One-waybull n-way
Document Exchangebull TN EDI etc
Invocationbull Request-reply
Shared Processbull Multi-Org BPM
Federated Querybull Portalbull Virtual Data Mart
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Application Integration and Data Integration
Data Integrationbull Periodicbull Large Data Setsbull BatchOn Demandbull Data Manipulation
Application Integrationbull Transactionalbull High Volumebull Real-timebull Interface focused
Common Patterns of IntegrationAggregationbull Many to one
Sequential Processbull Multi-step
Propagationbull One to Many
Managed Processbull BPM
Synchronizationbull One-waybull n-way
Document Exchangebull TN EDI etc
Invocationbull Request-reply
Shared Processbull Multi-Org BPM
Federated Querybull Portalbull Virtual Data Mart
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Common Patterns of IntegrationAggregationbull Many to one
Sequential Processbull Multi-step
Propagationbull One to Many
Managed Processbull BPM
Synchronizationbull One-waybull n-way
Document Exchangebull TN EDI etc
Invocationbull Request-reply
Shared Processbull Multi-Org BPM
Federated Querybull Portalbull Virtual Data Mart
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
8
SOA and Web ServicesWhat is SOA
ldquoA service-oriented architecture is a software architecturethat uses loosely coupled software services to support the requirements of business processes and software usersrdquo
ldquoResources on a network in an SOA environment are made available as independent services that can be accessed without knowledge of their underlying platform implementationrdquo
ldquoArchitecture is not tied to a specific technologyrdquoSource Wikipedia
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Selecting Standards
Ow
nership
ETA
Alternate
Sources
Supplier
Inventory
Location
Materiel
Web ServiceConsumers
Provider Services
Transportbull Messaging (such as NCES or JMS)bull HTTP
Interfacebull WSDLbull URL
Securitybull WS-Securitybull None
Payloadbull SOAPbull Raw XML
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
SAP Transaction Example ndash Traditional
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
ChangeAddressFunction
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
SAP Transaction ndash Using a SOA Approach
CustomerTable 3
CustomerTable 4
CustomerTable 1
CustomerTable 2
Database Layer
BAPIRFC Interface
CustomerObject 1 Customer
Object 2
Packaged Application API
Business Logic and Security
OLTP BW
SAPBAPICall
WSDL Interface
SOAPChangeAddressService
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Not Good
Good
SOAP vs SAOP
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
The Basic Application Integration Components
Adapter
EAI Broker Hub
Adapter
Adapter
Adapter
Adapter
BPM
Developer Studio
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
The Differences
EAIBus Integration SOA
Pieces are integrated and tested Dependency on standards
More complete (eg auditing) Leverages the industry
Purchase all-at-once Incremental additions
Works with itself Combines multiple vendors
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Folklore Fact
EAI is expensive and complicated Over 1000 implementationsby each of the vendors
Standards are better in all ways Moves the QA to the customer
SOA is a technology advancement Nah
ESBrsquos are more powerful YesESBrsquos are as proprietary as EAI
SOA supports incremental developmentSOA leverages the computing community
Folklore vs Fact
YES
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional
vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Data Integration
Fin
DW
Inv
OD
S
Fin
DW
How do you combine disparate data
EM
EA
Ops A
P O
psV46C
V47
EM
EA
Sal
es AP
Sal
esV72
V62
V61N
A S
ales
NA
Ops
V45B
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
The Problem is Not a Simple One
SAP 46C
Siebel 752
PeopleSoft 8x
Oracle 11i
of Tables 24307 2338 30243 14598 of Views 17315 34991 3566 of Interfaces 1005 285 970 5535 of APIs 10303 813 1622 1336
Customers Are AfraidThey Will Pay to Fix This Problem
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
LegacyMainframes
Files Packaged Applications
Web Services
RDBMS
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
SourceData Siloed amp
Complex
ConstantChange
BusinessSolutions
Data IntegrationChallenge
ldquoWorldwide market for data integration andaccess middleware to grow to $29 billion by2011 Yet most projects are still done withcustom coderdquo Source IDC
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Source File Transfer and Database Replication Is Another Option
LegacyMainframes
Files Packaged Applications
RDBMS
Replication Toolsbull FTPbull Database
ReplicationWeb
Services
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
LegacyMainframes
Files Packaged Applications
RDBMS Web Services
Intermediate Storesbull Data Warehousebull Data Martbull Operational Data
Store
DI Middlewarebull ETL Physical
Data Consolidationbull EII Virtual
Data Federation
ODBC JDBCamp SOAP
Connectors
Data AccessConnectors
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Replication Toolsbull FTPbull Database
Replication
Dev Toolsbull Javabull SQLbull C++bull Visual Studio
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
ETL
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
PhysicalData Marts
Physical OperationalData Stores
VirtualData Marts
Virtual OperationalData Stores
Enterprise DataWarehouse
ETLEII
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
PhysicalData Marts
Physical OperationalData Stores
Virtual Data Layer
VirtualData Marts
Virtual OperationalData Stores
SOAData Services
Layer Web Data Servicesamp Relational Views
Enterprise DataWarehouse
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
Eg CompositeInformation
Server
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Physical Data Consolidation Layer
PhysicalData Marts
Physical OperationalData Stores
Enterprise DataWarehouse
Virtual Data Layer
Customers
Orders
Invoices
Trades
Positions
Vendors
Employees
POs
GLs
Virtualization
Abstraction
Federation
Eg InformaticaPowerCenter
Teradata
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Data Service Best Practices - Multi-level Services
PrimaryFunctions
Extraction
Composition
Application
Convert proprietary access to standards
Elevate from technical to business
Enable thinner simpler clientsconsumers
BI CPM andReporting
Custom and Composite Apps
Portals andDashboards
EnterpriseSearch
LegacyMainframes
Files RDBMS Web Services
Packaged Applications
Key Issuesbull Leveragebull Agreementbull Enablement
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware Traditional vs
SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
CompositeInformationServer
Use Case Single View of Payroll and Variances - Multi-site Retailer
bull Situation amp Requirementsndash Construction materials retailerwholesaler 25 stores
ndash Business requirement detect and address variances between planned and actual payroll expense
ndash Technical requirement Expose and combine SAP R3 and in-house budget data
bull Solution1 Create views to SAP payroll information
2 Create views to other payroll information
3 Build roll-up view for analysis
4 Expose view into budget system
bull Resultsndash More accurate variance information sooner
ndash Rapid application developmentLegacy
Rollup View
Local views normalize across different stores
and apps
Payroll data sources
Files
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
bull Situation and RequirementsDemanding business needs from research scientistsPrototyping Rapid Applications Development toolsComplex analytics delivered on-demand from many sources SOA compliance
ndash Share research data across the companyndash Structured and semi-structured data
bull Solution bull Scientific Workbench that combines disparate data
bull Resultsndash 50 reduction in development time for complex
data integration projectsndash SOA-compliance with data services
in the format required by data usersndash Data quality improved through Rapid prototypingndash Reduced cost of operational
infrastructure
XML data
Packaged AppsHTTP files
Historical Data
Composite Data Services Layer
Research Scientists WorkbenchDrug Discovery
ETL
Relational data
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
ETL Workflow Reusability
CompositeInformation
Server
Power Center
DWDM
Business PortalApp
Real-Time
ETL Job
NormFilt
Look
USPS
DQM Parse Agg
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Use Case Well Management and Reporting at Large Oil and Gas Producer
bull Situation and Requirementsndash 10000 wells 1800 ETL jobs with 110m records
moved nightly SLA window ndash 6pm to 6amndash Well Engineers are too burdened by data
search collection and reportingndash Wells are primary business assets ndash utilization
and revenue must increasendash Complex environment with massive data
volumes and many disparate data sourcesbull Solution
ndash Virtual view of well status rig status and financial information that improves real-time operational decisions
bull Resultsndash 10 increase in well revenue-performance and
efficiencyndash 50 reduction in development time for
complex integration projectsndash 20 improvement in individual field Engineer
efficiency
Reporting DM
ERP DW
Source Applications
ETL
Composite Data Virtualization Layer
ETL
Operational Store
BI Reporting
ETL
ETL
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
bull Situation and Requirementsndash Complex product and service offerings such
as IPTV DSL Local amp Long Distance Mobilendash Complex distributed environment with need
for global access from disparate sourcesndash Real time response for Customer Service
Representativendash Structured and semi-structured data
bull Solutionndash CSR Analytics that provides 360 view of the
account with real time service diagnostics
bull Resultsndash Increased customer satisfactionndash Reduced cost of operating infrastructure
Web Services
Historical Data
Composite Data Services Layer
CSR Analytics
ETL
ESB
Billing IPTV DSL
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Agenda
bull Integration Itrsquos Why We Do Middleware bull SOA What Makes It Differentbull Applications Integration Middleware
Traditional vs SOAbull Data Integration Middleware
Traditional vs SOAbull Bringing It Together Use Case Examplesbull Roadmap An Implementorrsquos Guide To SOA
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
The SOA Dilemma
SOA is Ramping FastldquoBy 2008 SOA will be the basis of 80 of new development projectsrdquo
Source Gartner Group
CIO Challenges
How do I bring my existing applications into a SOA
How do I enable my team to build reusable services
Where do I begin
CIO Challenges
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
An Implementorrsquos Guide to SOA
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
An Implementorrsquos Guide to SOAChapter 1 Getting It Right11 Purpose Of The Book12 How We Put The Book Together13 How To Study The Book14 A Few Comments On SOAs15 The Organization Of The Book16 Whatrsquos Not In The Book17 Conclusion
Chapter 2 Designing Services21 Services Introduction22 Data Services23 Transaction Services24 Service Interface Design25 Security Considerations26 Conclusion
Chapter 3 Registries and Repositories
31 The SOA System Of Record32 Buy Versus Build33 Getting Started34 SOA amp The Software Development
Lifecycle35 Conclusion
Chapter 4 Enterprise Service Buses
41 Introduction to ESBs42 When To Use An ESB43 Selecting An ESB Product44 Applications Of An ESB45 Mediation and ESBs46 Conclusion
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
An Implementorrsquos Guide to SOA
Chapter 5 Runtime Management51 Understanding Topologies52 Managing Operational Health53 Detecting And Diagnosing Exceptions54 Security55 Ensuring Operational Integrity56 Conclusion
Chapter 6 Organizing For Success61 Key SOA Success Factors62 The SOA Maturity Model to Facilitate
Business and IT Alignment63 Laying The Organizational Groundwork64 Establishing Basic Organizational Structures65 Implementing The Proper Service Discovery
Model66 Creating A SOA Roadmap67 Aligning Project Development Processes68 Conclusion
Chapter 7 Capability Development71 Getting Started72 Role Based Training73 Tailoring The Training Curriculum To Your
Environment74 Change Management75 Conclusion
Chapter 8 Pulling It Together81 Where To Start82 Scope Of Implementation83 How To Measure Success84 Summary Of Recommendations
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-
Composite Software At a Glance
bull Privately-held Silicon Valley firmndash Strong Business Model amp Team
bull Virtual Data Integration EIIndash Discover Virtualize Abstract Federate
bull Proven Business and IT Valuendash Increased Flexibility Greater Agility amp
Lower Costs
Public Sector
Financial Services Life Sciences
Top 5 I-Bank
Top 5 I-Bank
Top 5 CommBank
Top 5
Inv Ban
k
Top 5I-Bank
MutualFund
Life Sciences TechnologyFinancial Services ConsumerRetail
IE 2008Editorrsquos Award
Energy and Utility
- The Impact of SOA on Traditional Middleware Technologies
- Agenda
- Statement of the Problem
- Application Integration and Data Integration
- Application Integration and Data Integration
- Common Patterns of Integration
- Agenda
- SOA and Web Services
- Selecting Standards
- SAP Transaction Example ndash Traditional
- SAP Transaction ndash Using a SOA Approach
- Slide Number 12
- Agenda
- The Basic Application Integration Components
- The Differences
- Folklore vs Fact
- Agenda
- Data Integration
- The Problem is Not a Simple One
- Business Change is Accelerating New Solution Demand - Data Integration Agility a Must
- There Are Several Ways to Solve the Data Integration Problem - Apps Level Hand Coding
- Source File Transfer and Database Replication Is Another Option
- Intermediate Data Stores amp Data Integration Form the Data Middleware Solution
- Traditional Physical Data Consolidation using ETL Middleware is Proven and Robust
- Virtual Marts amp Operational Data Stores Using EII Middleware Adds Flexibility amp Agility
- Adding Shared Data Services amp Views Expands Data Virtualization amp Enables SOA
- Virtual Data Federation EII amp Physical Data Consolidation Middleware for SOA
- Data Service Best Practices - Multi-level Services
- Agenda
- Use Case Single View of Payroll and Variances - Multi-site Retailer
- Use Case Scientific Professional Workbench atGlobal Pharmaceutical Company
- ETL Workflow Reusability
- Use Case Well Management and Reporting at Large Oil and Gas Producer
- Use Case Service Delivery Diagnostics and Resolution at Nationwide Telecom Provider
- Agenda
- The SOA Dilemma
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- An Implementorrsquos Guide to SOA
- Composite Software At a Glance
-