colombo architecture meetup - enterprise architectural challenges in large enterprises

52
Colombo Architecture Meetup Enterprise Integration Architectural Challenges in Large Enterprises By Crishantha Nanayakkara Head of Technology, ICTA

Upload: crishantha-nanayakkara

Post on 29-Nov-2014

566 views

Category:

Technology


1 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

Colombo Architecture Meetup

Enterprise Integration ArchitecturalChallenges in Large Enterprises

By Crishantha NanayakkaraHead of Technology, ICTA

Page 2: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

Vs

Page 3: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

3

Enterprise Enterprise Application Application IntegrationIntegration

Page 4: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

4

The Information Silos

Systems that are not connected

Drawbacks:● Isolated without insufficient communication to the rest of the world

Page 5: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

5

The Enterprise Integration

Benefits:● Provides a way to connect each other

Drawbacks:● Extremely “Spaghetti” like architecture, create headaches

Page 6: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

The Enterprise Integration

Page 7: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

7

Enterprise Enterprise Application Application Integration Integration

Architectural Architectural ChallengesChallenges

Page 8: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

8

● Integration● Reliability● Mediation● Service Orientation● Interoperability● Security● Federated Identity

Page 9: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

9

1. Integration1. Integration

Page 10: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

10

Point-to-Point Integration

Page 11: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

11

Point-to-Point Integration

Specifically, linking every component to every other component will require N(N-1)/2 physical connections

N = Total Number of Components in the Network

e.g: If there are 10 components in the network,

Total number of physical connections = 10 (10-1)/2

= 45

Page 12: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

12

Point-to-Point Integration

● The value of the network increases linearly over time while its costs increase exponentially

Page 13: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

13

The SolutionA more centralized approached to the previous point-to-point approach

The Solution

Page 14: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

14

2. Reliability2. Reliability

Page 15: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

15

● This creates a loosely-coupled distributed system, which can continue to function reliably, without downtime, even when individual components or connections fail

Message Oriented Middleware

Page 16: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

16

● Supports Remote Communications● Integrating different language/platforms as a

Message Bus (Message Bus Pattern)● Supports Asynchronous Communication● Supports Throttling ● More reliable● Can be used for disconnected operations● Supports mediation

Message Oriented Middleware

Page 17: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

17

3. Mediation3. Mediation

Page 18: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

18

Page 19: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

19

Enterprise Integration Patterns

Page 20: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

20

Enterprise Integration Patterns

Message Router

Pipes and Filters

Page 21: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

21

Enterprise Integration Patterns

Content Based Router

Message Translator

Page 22: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

22

Enterprise Integration Patterns

Message Filter

Message Splitter

Page 23: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

23

Enterprise Integration Patterns

Message Aggregator

Message Resequencer

Page 24: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

24

Source: http://www.idevnews.com/views/images/uploads/general/talend_intfactory.jpg

Enterprise Integration Patterns

Page 25: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

25

The integrated SOLUTION

Page 26: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

26

5. Service 5. Service OrientationOrientation

Page 27: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

27

The SOA Environment

Source: Open Source SOA

Page 28: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

28

A typical SOA environment

● Service Interfaces/ Contracts● Service Transparency● Service Composition● Service Registry or Publication● Service Governance

Page 29: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

29

The Core Characteristics of SOA1) The Service Interface / Contract

Page 30: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

30

The Core Characteristics of SOA2) The Service Transparency What if you change

the IP of this address???

Page 31: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

31

The Core Characteristics of SOA2) The Service Transparency

Page 32: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

32

The Core Characteristics of SOA3) Service Composition

– There are two general types of composite services● Simple● Complex

– Simple: Simply wraps one or more lower­level services together into a more coarse­grained operation

– Complex: (Work Flow Type BPM)● WS­BPEL● Entry Point of invoking WS­BPEL is usally a web 

service

Page 33: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

33

The Core Characteristics of SOA3) Service Composition

Page 34: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

34

The Technologies of SOA

Page 35: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

35

Bottom Up Vs Contract First

● Why Contract First is better?

Page 36: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

36

6. Interoperability6. Interoperability

Page 37: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

37

Private Sector Companies

Services

ApplicationServices

Application

The Department of Motor Traffic

Vehicle Domain

Services

Application

The Department Registration of Persons

Personal Domain

Services

Application

The Land Ministry

Land Domain

Page 38: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

38

DMTDMT

Translationin the

Middleware

Translationin the

Middleware

WPDMTWPDMT

Owner First NameOwner Last NameOwner Address Line1Owner Address Line2Owner CityVehicle Reg NoFuel TypeWeightNumber of Seats

Owner First NameOwner Last NameOwner Address Line1Owner Address Line2Owner CityVehicle Reg NoFuel TypeWeightNumber of Seats

Owner Full NameOwner AddressVehicle Reg NoFuel TypeWeightNumber of Seats

Owner Full NameOwner AddressVehicle Reg NoFuel TypeWeightNumber of Seats

Page 39: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

39

The Need

● So many distributed & diverse systems,

– May have used various technologies

– May have used various data architectures

– May have used conflicting policies, procedures, guidelines

Page 40: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

40

The Solution

● Standardize data representation, formats and semantics on the wire by having an Interoperability Framework

● Use Open Standards

Services Oriented Architecture&

Web Services

Page 41: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

41

Interoperability Frameworks

Page 42: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

42

Enterprise Architecture

● Enterprise Architecture is the complete expression of the enterprise

● “Enterprise Architecture is about understanding all of the different elements that go to make up the enterprise and how those elements interrelate.” - The Open Group

Page 43: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

43

Enterprise Architecture Frameworks (EAF)

Page 44: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

44

7. Security7. Security

Page 45: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

45

Transport Vs Message Level Security

Page 46: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

46

Point to Point SecurityESB as a Security Gateway

Page 47: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

47

End to End Securitywith Pass Through

Page 48: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

48

End to End Security with Security Translantion at ESB Level

Page 49: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

49

Web Services Security Stack

Reference: Securing Web Services with WS-Security (Jothy Rsenberg, David L Remy)

Page 50: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

50

8. Federated Identity8. Federated Identity

Page 51: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

51

● SAML provides a loosely coupled identity management with the help of WS-Trust and WS-Fedeartion specifications.

Page 52: Colombo Architecture Meetup - Enterprise Architectural Challenges in Large Enterprises

52