soa connectivity and integration strategic vision 24 march 2010

© 2010 IBM Corporation

IBM Software Group

Connectivity and Integration Strategic Vision

Hubert LalanneDE – Technical Executive IBM SWG France

Study Tour Connectivity, Hursley, 24th March 2010

© 2009 IBM Corporation2 2Study Tour, Connectivity Hursley, 24th March 2010

Agenda

What is Connectivity?

IBM Connectivity Vision and Offering

IBM Connectivity Middleware Trends


Agenda





What is Connectivity about?

Allows for dynamic selection, substitution, and matching

Enables you to find both the applications and the interfaces for re-use

Decouples the point-to-point connections from the interfaces

Turn this…….

Enables more flexible coupling and decoupling of the applications

…into this

Connectivity Middleware

ApplicationService

ApplicationService

ApplicationService

ApplicationService

ApplicationService

ApplicationService

ApplicationService

ApplicationService

Application Application Application Application

ApplicationApplicationApplicationApplication

= interface

Consistent connectivity infrastructure provides a central point to reconfigure and monitor application interfaces


Project cost breakdown and how it relates to connectivity

80% Implementation of Application

software core capabilities

20%Integration(beyond core capabilities)

Hidden Costs•Maintenance and evolution•Operations•Lack of control and visibility•Lack of flexibility•….

We will focus on optimizing this


Connectivity is a matter of Architecture

Business Processes

Coverage of application or packages

Interfaces

Connectivity Layer

Integration Logic

Other Applications, Tools or Systems inside or outside of the scope of the business process

Isolation Layer

Control and reconfiguration

point

Observation point

New tool or application

New Business Partner

New Package


Maturing SOA Implementations

From SOA pilots…– SOA pilots focussed on specific business problems, tackling

aspects of SOA life cycle – SOA underpinnings often homogenous build from products

supporting specific scenarios

… to mainstream SOA– Large scale roll-out of SOA across the enterprise and across

user communities, often connecting “Islands of SOA” – Need for federated, governed, consumable SOA underpinnings

Foundational ExtendEnd-to-End

Transform AdaptDynamically


Enterprisewide Connectivity Is Multiowned and Multilayered

Enterprise Connectivity

Domain ConnectivityDomain Connectivity

Domain Connectivity

Domain "A"

SOA Domain "B"

Domain "C"

DomainRegistry

DomainRegistry

DomainRegistry

EnterpriseRegistry

Private service = consumed by one application

Local service = consumed by more applications in the same SOA domainPublic service = consumed by more applications from multiple SOA domains

Public Services

Local Services

Local Services

Local Services

Domain SOA COE

Domain COE

Domain COE

EnterpriseCOE


Need to extend scope of connectivity beyond the traditional boundaries of Enterprise to integrate the Physical World

Connectivity should be able to cope with Sensors, remote locations, B2B, Operating Infrastructures

Need to provide a flexible any-any connectivity with a wide range of “qualities of service” including real time or near real time connectivity

Connectivity At the Edge

Petrol Forecourt

Vehicle

Oil rig

Retail Store

Medical

PervasiveDevice

Sensore.g.

RFID

Enterprise

Traditional enterprise software is too heavy– Need to support constrained environments, with limited processing capacity– Need to integrate over fragile networks with sporadic connectivity– Need to support huge volumes of messages– Need to interface with operational systems (i.e. SCADA systems)


Connectivity Lessons Learned One size does not fit all

– Variety of products implementing ESB pattern, service metadata management & other facets of Connectivity

Things get easier– Years of experience in implementing SOA resulting in better understanding and

support of common patterns

Things get more dynamic– Towards a patterns-inspired declarative Connectivity programming model via policy

declarations and SLAs

Connectivity needs (the right level of) governance– Dynamic programming models need governance counter-balance – control who can

affect what kind of change

Towards ubiquitous Connectivity– Connectivity within business units, across the enterprise, between enterprises and into

Clouds


Agenda




© 2009 IBM Corporation12 12Study Tour, Connectivity Hursley, 24th March 2010IBM Confidential 12

IBM Connectivity Vision

Ubiquitous, intelligent inter-connectedness for a Smarter Planet

Connect services, applications and devices everywhere...

– ... at the right level of integration ...

– ... deriving business value from the interactions ...

– ... in a dynamic yet governed fashion ...

– ... simply, robustly and reliably


ESBService Enrichment

• Match & Route communications between services

• Converts between transport protocols• Transforms between data formats• Identifies and distributes bus events

Messaging

• Connect everything in your SOA• Leverage existing skills and assets• Support business growth and agility• Deliver fast ROI

IBM Connectivity Model

13

ESB can be the „nervous system“ of the connectivity infrastructure by enabling interface services or services to control interfaces

Messaging Backbone to address the full spectrum of transport requirements


IBM ESB Capabilities

JEE Platform Based

WebSphere Enterprise Service Bus

Optimized with WebSphere Application server for an integrated SOA platform

Shares common registry, security, administrative and development tools

Services hosted on the application server

Integration Based

WebSphereMessage Broker

Built for universal connectivity and transformation in heterogeneous IT environments

Message transformation developed to accommodate disparate service interfaces

Adapters, protocol bridges packaged with applications and legacy platforms

Appliance Based

WebSphere DataPower

Integration Appliance XI50

Hardware built for simplified deployment and hardened security

Functions developed in one device


Legacy Client-Server

Back office / Call Centre

Intranet / Extranet / Internet Portals

Legacy / System Z

Data Stores

Combining ESB Technologies: The “Hybrid Bus”

WMB - built for universal connectivity and transformation in heterogeneous

IT environments

WESB - optimized with WAS for an integrated SOA platform and BPM

WDP - purpose-built hardware for simplified deployment and hardened security

ESB


The Connectivity ‘Ecosystem’

Service Monitoring

Tivoli CAM for SOA

Publish Find Enrich GovernManage

Service Registry

WebSphere Services Registry and Repository

WebSphere MQ messaging backbone

MQI Java JMS XMS for .NET C# XMS for C/C++

Messaging Backbone for SOA

WebSphere MQ

WebSphere Process Server

Service Orchestrationand BPM

Universal Transformation

WebSphere Transformation Extender

Service Security

Tivoli Security Products

Business Rules

WebSphere iLog JRulesWebSphere Business

Event


Agenda



IBM Connectivity Middleware TrendsConnectivity Patterns Connectivity at the Edge Federated Connectivity Connectivity for the Cloud


Connectivity Middleware Trends Simplification

– From Highly Configurable Point Products to Pattern-driven Capability Mixes… exploiting lessons learned from years of experience in building SOA solutions

Scale– Smart Planer scenarios dramatically increasing # of connected

devices… Service Federation within the enterprise and beyond

Dynamic SOA Runtimes– Driving SOA Runtime behaviours from Service interaction

contracts… automating runtime provisioning and task flows in support of SLA-driven runtimes

Clouds– Connectivity to, between and in Clouds


Many Defined Patterns for ESB-based Solutions

http://www.ibm.com/developerworks/wikis/display/esbpatterns/

ServiceEnablement

Gateway

OROR

OR

Message-basedIntegration

File Processing

Event-drivenIntegration

ServiceVirtualization


Patterns & Templates Vision

Flows, Subflows, Modules, Schema,

WSDL, Maps, ESQL etc

1. Capture ‘pattern’

ESB Runtime:Deployed artefacts

3. Discover and apply ‘pattern’

5. Manage deployed ‘pattern’

2. Share ‘pattern’

Pattern ‘library’ (repository)Solutions, fragments, etc

Development artefacts- or –

Deployment artefacts

4. Deploy ‘pattern’

IBM Confidential


Connectivity Modeling 2.0


Patterns-Based DevelopmentAccelerate development productivity

Select pattern…Select pattern…

…Configure……Configure…

…Generate flow!…Generate flow!

Discover, Interact, Optimize

WebSphere Message Broker V7 and WebSphere Integration Developer V7

WebSphere Message Broker V7 and WebSphere Integration Developer V7


Agenda



IBM Connectivity Middleware Trends Connectivity PatternsConnectivity at the Edge Federated Connectivity Connectivity for the Cloud


Pattern Shift: Computing at the Edge

NetworkMonitoring & Analytics

Server

Back-End Server

Edge Servers

Application-Dependent processing

Real-World Aware Business Processing

Typical Smarter Planet Configuration – Dealing with the Physical World

• High volumes of data/events

Network

Load Balancing

Server

Back-End Server

Application

Server

• Database

PCs

Typical e-Commerce Application


Qualities-of-Service Delivery Styles

Transactional

Persistent

At-least-once

Best-Effort

Fire-and-Forget

Request-Reply

Replay

Guaranteed

At-Most-Once

Client-Server

Backbone

Point-to-Point

Peer-to-Peer

Publish/Subscribe

Grid

Bus

Fastest speed

Multicast

Lowest Latency

Unicast

Skills

Languages

Mindsets

Orientations

COBOL, C/C++, RPCJava, JEE, JMS.NET, C#, VB, WCFAJAX, Perl, Python…

ServiceBatchFileMessageResource…

WSDL, XML, WS-*REST, MEST, KISS

End-Points

Vendor Platforms

Applications

Operating Systems

Devices

Web services

Web 2.0

JEE, .NET, etc

Exploitation & Support

SAP, Siebel, etc…

Mobile, Wireless, PoS,Sensor, Actuator, RFID…

AppliancesHTTP, AJAX, REST,…

SOAP, WSDL, WS-RM, WS-N…

Extend the reach of the Universal Messaging Backbone

25

Business Data DeliveryMQI, JMS, XMS

and Web AccessMQ-TT

Non-persistentqueued

Persistent queued

Low-latency RMM HTTP

Non-persistentNon-queued


Agenda



IBM Connectivity Middleware Trends Connectivity Patterns Connectivity at the EdgeFederated Connectivity Connectivity for the Cloud


Federation Topology Patterns

No one topology works for all enterprises The topology can be fundamental to the success of the enterprise

Brokered

Parent/Child

Peer-to-Peer

Hiearchical

And more …


Connection of Services … not Service Bus

A’A’’ AA’

Delegation Delegation

Federated Service Registry

Federated Service Registry

A’ AA’’


Federated Service Management

Objectives Enable enterprise-wide service reuse seamlessly and transparently

Secure, Manage, Monitor and Govern one logical service connectivity fabric

A simple model for defining connectivity across heterogeneous domains

Provide IT flexibility that handles the necessary separation of concerns and responsibility required by the different service domains

Service Federation Management

GovernanceGovernanceManagementManagementSecuritySecurityVisibilityVisibility

Service Federation Management (SFM) enables a federated enterprise, allowing service reuse that spans domain boundaries. SFM manipulates the connectivity

infrastructure of the individual service domains to establish enterprise-wide service visibility, service

security, service management and service governance.


Manage service visibility and reuse across the enterprise Federated Service Management

Integrated solution across WSRR (console UI and registry) and the ESB family to enable service re-use across enterprise domains.

Provides a unifying view of federation relevant content

Web 2.0-based protocol to access the service connectivity and registry components supporting a domain

Easy configuration of best practice patterns for service sharing

WebSphere Message Broker V7, WebSphere Enterprise Service Bus V7, and

WebSphere Service Registry and Repository V7

WebSphere Message Broker V7, WebSphere Enterprise Service Bus V7, and

WebSphere Service Registry and Repository V7


Inter-domain Service Governance

Coordination of visibility, management and security to achieve business goals in the enterprise, by coordination of governance infrastructures within domains

Governance focused on sharing services not connecting service buses Must allow for adequate levels of domain autonomy

Service Bus

Service Governance Service Governance

Service Registry

Service Manager

Service Registry

Service Manager

Service Bus

Federated GovernanceFederated Governance

Service Security Service Security


Repository Federation across Topologies WSRR Metadata Promotion helps clients extend the governance to multiple environment

topology– Metadata relating to multiple deployment environments are managed in central WSRR

while allowing subsets to be copied to an environment-specific WSRR instance in response to lifecycle transitions

Governance WSRR

Domain-A WSRR

Domain-B WSRR

CommonMetadata

CommonMetadata

CommonMetadata

Domain-AMetadata

Domain-AMetadata

Domain-BMetadata

Domain-BMetadata

Service transitions to the

Domain-A Production

lifecycle state

Service transitions to the

Domain-B Production

lifecycle state


Contract / SLA Enforcement Pattern

(3) The ESB checks thatConsumer X has anSLA with Provider Y

Message

(1) A message isreceived fromConsumer X

SLAConsumer XProvider Y

(2) ESB for Provider Yretrieves valid SLAs

Service

Message

(5) ESB routes to service endpointwith suitable SLD

SLD

WebSphere Service Registry and Repository

(4) ESB retrieves the specific SLA policies

SLApolicies

GovernanceAudit

Repository

Application

SLA Compliance

(6) ESB records SLA Metrics in a database for later analysis


Agenda



IBM Connectivity Middleware Trends Connectivity Patterns Connectivity at the Edge Federated ConnectivityConnectivity for the Cloud


Connectivity for Hybrid Clouds

Off-Premiseoutside the Enterprise

On-Premisewithin the Enterprise

“How can I quickly and easily integrate my new off-premise solution with my existing on-premise

applications?” Public Clouds

Technologies

Packaged Applications

E-Business Suite

Databases, Web services,Messaging, App Servers, …


Connectivity Cloud Scenarios

Private Clouds

Traditional Apps

On-Premise within the Enterprise

Off-Premise outside the Enterprise

Public Clouds

soa connectivity and integration strategic vision 24 march 2010

Business

scope of connectivity

slas connectivity

sporadic connectivity

enterprisewide connectivity

connectivity lessons

facets of connectivity

physical world connectivity

application local service