Internal Grid experiences in Montepaschi Group

Internal Grid experiences in

Montepaschi Group

Agenda

Introduction

2001 SOA Architecture

2005 Internal Grid solution and applications

2008 Grid and Virtualization

Internal Grid experiences in Montepaschi Group

2009 Evolution

IL GRUPPO MONTEPASCHI

Up-to-date on 09.30.2008

Il Consorzio Operativo Gruppo Montepaschi

Il Consorzio Operativo è la società che svolge in accentrato per le aziende del Gruppo Montepaschi lo sviluppo e la gestione dell'Information & Communication Technology, i Servizi di Back Office ed i Servizi Ausiliari

Le Banche che costituiscono il Consorzio:

Introduction

2001 SOA Architecture

2005 Internal Grid solution and applications

2008 Grid and Virtualization

Internal Grid experiences in Montepaschi Group

2009 Evolution

Agenda

Corporate

Center

Società diprodotto

Societàdi servizio

BancheSistema

di Servizia valore aggiunto

Corporate

Center

Società diprodotto

Societàdi servizio

BancheSistema

di Servizia valore aggiunto

Corporate

Center

Società diprodotto

Societàdi servizio

BancheSistema

di Servizia valore aggiunto

Clienti

Banche esterne

Fornitori

Societàprodottoesterne

Corporate

Center

Società diprodotto

Societàdi servizio

BancheSistema

di Servizia valore aggiunto

Clienti

Banche esterne

Fornitori

Societàprodottoesterne

Group’s Information System

From Inside

To outside

Estended Multichannell Architecture

Server

Branch

Channels

CED

Mainframe

Services

ATM POS

Server

WEB Server

Call Centre

HB Internet

Autom. Branch

WAP GSM

CB Internet

ecc.

WEBServer (IIS)

Web Services

Broker

Piattaforma CICS TS 1.3 o succ.Piattaforma CICS TS 1.3 o succ.

Piattaforma CICS TS 2.2 o succ.

Piattaforma J2EE

Piattaforma Windows

Oggetti di Business COM/.NET

Oggetti di Business CICS

Client windows based

J2EE application

CICS programs

DCOM / .NET

IIOP

DPL

SOAP

JCA / IIOP

SOAP

DCOM /.NET

Oggetti di Business J2EE

IIOP

DPL

Broker Server .NET

Broker Server JCICS

Bro

ker

Se

rver

J2E

E

JCA

Layer Broker

Broker Gateway

JCA / IIOP

Batch Processing

Mainframe

• IBM Tivoli Workload Scheduler • CICS (PAF) Batch TP

• Flows Converter (BTS)

• GRID (AGA)

Introduction

2001 SOA Architecture

2005 Internal Grid solution and applications

2008 Grid and Virtualization

Internal Grid experiences in Montepaschi Group

2009 Evolution

Agenda

MPS Internal Grid

• Use idle resources for CPU intensive jobs• Interaction with heterogeneous systems (desktops,

servers, dedicated server farms or even Host) by means of standard or standards-to-be protocols.

• Evolution from Condor to a custom solution• Communication between nodes is performed using

Web Services

Accomplishments

• Current Accomplishments– Clickstream analysis (January 2005)– IAS 32-39 (August 2005)– Top Management Monitoring (January 2006)– Basel II (Algoritmics) (October 2005)– DOC1 (December 2006)– many other apps …. until today

• Next Steps– Host Batch downsizing – …….

Gartner’s vision on Grid ComputingSource Gartner Jul 2007

The GridComputing power

is everywhere,

we try to make it usable by anyone.Miron Livny

Average Mainframe usage: 80%

Average RISC Servers usage: 45%

Average Intel Servers usage: 10-15%

Average Client usage: lower than 10%

“Year 2008 will see a doubling in usage of Servers”

Source: Gartner

Server usage will further increase in the future

There’s a lot of space in the bottom

Richard P. Feynman

Server farm

• About 600 non-dedicated Windows and Linux servers• We expect to have 1.000 central servers with Windows 2003

Server• About 27.000 jobs every day (41.000 peach)

Realizations

• Clickstream analysis– In production since the start of

the year – About 50 sites– 476 instances on single servers

Job entity valued in 2-4 CPUs servers working for 8 hours

The same job requires 2 hours of our Grid infrastructure

Phase I. Open Source + Condor

Phase II. Open Source + AGA

Phase III. SQL Server (AS) + AGA

IAS 32-49

• First hypothesis on Mainframe (Cobol+ DB2)• Realization with GRID (Cobol + AGA + SQL Server)• In production since July 2005• Elapsed time less than 1 hour

Basel II

• Chosen the Algorithmics’s (Unix/Linux and Oracle) for Market Risks Analysis Job

• Supplier proposed a SUN machine or a Grid DataSynapse• Solution based on AGA.NET (on Windows Servers) with

Linux nodes (we are discussing the porting of Algoritmics on Windows), including data loading

• in production since 2005’ end

Top Management MonitoringDatawarehouse for compliance• First implementation dedicated scheduler and machines• Today Grid scheduler……

Microsoft Reporting Services• loading data with Grid

Generation of documents and account statements for Customers

• Formerly DOC1(PDF document generator) for z/OS was used• Effort estimated: 6 days of elapsed working time (of a 8.000 MIPS

machine). • Now 1 day.• Today all banks in production on GRID (6 hours on mainframe -> 2 hours

on a few Grid machines for the main bank).

Conversion of batch procedures from mainframe

• Currently testing the porting of batch procedure– Cobol– PL/1 -> rewriting

Murex Reporting

• Currently more than 150 reports on Grid

Introduction

2001 SOA Architecture

2005 Internal Grid solution and applications

2008 Grid and Virtualization

Internal Grid experiences in Montepaschi Group

2009 Evolution

Agenda

Grid and Virtualization

• Our goal is the Grid computing node virtualization

• We are experimenting both ThinApp by VMWare and Xenocode

• If the application environment is not present on the node, we download it dynamically (using streaming) with the application

• Finally we destroy the virtual environment

Task execution sketch

Real environment

Virtual environment

\\nasfi1.local\VirtualApps

How it works

Application to be executed in a virtual environment

Task execution sketch - continued

The virtualized Execution host is downloaded using streaming from the network share\\nasfi1.local\

VirtualApps

Task execution sketch - continued

\\nasfi1.local\VirtualApps Application is

downloaded from a central repository

Virtual execution environment is created and the application (also downloaded from a central repository) is executed within it

Task execution sketch - continued

\\nasfi1.local\VirtualApps Applicatiocn

When the task ends, the virtual environmment disappears with the application itself

Output

Introduction

2001 SOA Architecture

2005 Internal Grid solution and applications

2008 Grid and Virtualization

Internal Grid experiences in Montepaschi Group

2009 Evolution

Agenda

New areas

• Grid scheduling with virtualization also for real time infrastructure (using Linux Virtual Server for balancing)

• Use of eterogeneus environment (GPU, FPGA) for high intensive computing task– Es. Monte Carlo simulation in Nvidia GPU

• Grid Services• Semantic (Data, Web Services, Grid)

SOA architecture needs GRID• Business services are not only RPC calls• We need long running processes also• SOA is not only for internal use

Grid Services• Web Services allow integration of heterogeneous

systems to achieve A2A communication and for short-term transactions, involving the exchange of relatively small quantities of data.

• Grid Services will allow integration for more significant jobs, considering the CPU usage and also the quantity of data.

• GRID vision allows the network to evolve to an environment in which machines and human beings can collaborate.

Cloud Computing

• Cloud or Fog ?• Standards ?

• Information tecnology is not only support for business.• It’s changing our way of learn, exchange knowledge,

buy, work, etc.

« Croire tout découvert est une erreur profonde, c’est prendre l’horizon pour les bornes du monde ! »

 Camille Flammarion

Thanks

Piero PocciantiConsorzio Operativo Gruppo MontepaschiFunzione Osservatorio Tecnologico