Internal Grid experiences in Montepaschi Group

Size: px

Start display at page:

Download "Internal Grid experiences in Montepaschi Group"

Christina Banks
8 years ago
Views:

2 Internal Grid experiences in Montepaschi Group

3 Internal Grid experiences in Montepaschi Group

4 Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution

5 IL GRUPPO MONTEPASCHI About Employees > Branches in Italy 39 Foreign Branches and Offices Group s Head Banks Product Companies Service Companies Up-to-date on

000 Branches in Italy 39 Foreign Branches and

6 Il Consorzio Operativo Gruppo Montepaschi Il Consorzio Operativo è la società che svolge in accentrato per le aziende del Gruppo Montepaschi lo sviluppo e la gestione dell'information & Communication Technology, i Servizi di Back Office ed i Servizi Ausiliari Le Banche che costituiscono il Consorzio:

sviluppo e la gestione dell'information & Communication Technology, i

7 Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution

8 Group s Information System Corporate Center From Inside Banche Sistema di Servizi a valore aggiunto Società di prodotto Società di servizio Banche esterne Corporate Center Società prodotto esterne Banche Sistema di Servizi a valore aggiunto Società di prodotto To outside Clienti Società di servizio Fornitori

esterne Corporate Center Società prodotto esterne Banche Sistema di Servizi a

9 Estended Multichannell Architecture Mainframe Web Services CED Services WEB Server (IIS) Server WEB Server Channels Server ATM POS Branch Call Centre HB Internet Autom. Branch WAP GSM CB Internet ecc.

Server Channels Server ATM POS Branch Call Centre

10 Broker Layer Broker Piattaforma Windows Broker Server.NET DCOM /.NET DCOM /.NET Client windows based Oggetti di Business COM/.NET SOAP SOAP Piattaforma J2EE J2EE application IIOP rver J2EE Broker Se Broker Gateway IIOP Oggetti di Business J2EE JCA JCA / IIOP JCA / IIOP Piattaforma CICS TS 1.3 o succ. Piattaforma CICS TS 1.3 o succ. DPL DPL CICS programs Broker Server JCICS Piattaforma CICS TS 2.22 osucc succ. Oggetti di Business CICS

NET SOAP SOAP Piattaforma J2EE J2EE application IIOP rver J2EE Broker Se Broker Gateway IIOP Oggetti di

11 Batch Processing IBM Tivoli Workload Scheduler CICS (PAF) Batch TP Flows Converter (BTS) GRID (AGA) Mainframe

12 Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution

13 MPS Internal Grid Use idle resources for CPU intensive jobs Interaction with heterogeneous systems (desktops, servers, dedicated server farms or even Host) by means of standard or standards-to-be protocols. Evolution from Condor to a custom solution Communication between nodes is performed using Web Services

Host) by means of standard or standards-to-be protocols.

14 Accomplishments Current Accomplishments Clickstream analysis (January 2005) IAS (August 2005) Top Management Monitoring (January 2006) Basel II (Algoritmics) (October 2005) DOC1 (December 2006) many other apps. until today Next Steps Host Batch downsizing.

Monitoring (January 2006) Basel II (Algoritmics) (October 2005)

15 Gartner s vision on Grid Computing Source Gartner Jul 2007

16 The Grid Computing power is everywhere, anyone. we try to make it usable by Miron Livny Average Mainframe usage: 80% Average RISC Servers usage: 45% Average Intel Servers usage: 10-15% Average Client usage: lower than 10% Year 2008 will see a doubling in usage of Servers Source: Gartner Server usage will further increase in the future There s a lot of space in the bottom Richard P. Feynman

45% Average Intel Servers usage: 10-15% Average Client usage: lower than 10% Year 2008 will see a

17 Server farm About 600 non-dedicated Windows and Linux servers We expect to have central servers with Windows 2003 Server About jobs every day ( peach)

18 Realizations Clickstream analysis In production since the start of the year About 50 sites 476 instances on single servers Job entity valued in 2-4 CPUs servers working for 8 hours The same job requires 2 hours of our Grid infrastructure Phase I. Open Source + Condor Phase II. Open Source + AGA Phase III. SQL Server (AS) + AGA

working for 8 hours The same job requires 2 hours of our Grid infrastructure

19 IAS First hypothesis on Mainframe (Cobol+ DB2) Realization with GRID (Cobol + AGA + SQL Server) In production since July 2005 Elapsed time less than 1 hour

20 Basel II Chosen the Algorithmics s s (Unix/Linux and Oracle) for Market Risks Analysis Job Supplier proposed p a SUN machine or a Grid DataSynapse Solution based on AGA.NET (on Windows Servers) with Linux nodes (we are discussing the porting of Algoritmics on Windows), including data loading in production since 2005 end

21 Top Management Monitoring Datawarehouse for compliance First implementation dedicated scheduler and machines Today Grid scheduler Microsoft Reporting Services loading data with Grid

22 Generation of documents and account statements for Customers Formerly DOC1(PDF document generator) for z/os was used Effort estimated: 6 days of elapsed working time (of a MIPS machine). Now 1 day. Today all banks in production on GRID (6 BA(-01 hours on mainframe -> 2 hours on a few Grid machines for the main bank).

23 Slide 22 BA(-01 Slide modificata BIANCHI ALESSANDRO (MPS ), 1/13/2009

24 Conversion of batch procedures from mainframe Currently testing the porting of batch procedure Cobol PL/1 -> rewriting

25 Murex Reporting Currently more than 150 reports on Grid

26 Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution

27 Grid and Virtualization Our goal is the Grid computing node virtualization We are experimenting both ThinApp by VMWare and Xenocode If the application environment is not present on the node, we download it dynamically (using streaming) with the application Finally we destroy the virtual environment

28 Task execution sketch Real environment Virtual environment \\nasfi1.local\virtua lapps

29 How it works Application to be executed in a virtual environment

30 Task execution sketch - continued \\nasfi1.local\virtua lapps The virtualized Execution host is downloaded using streaming from the network share

31 Task execution sketch - continued \\nasfi1.local\virtua lapps Virtual execution environment is created and the application (also downloaded from a central repository) is executed within it Application is downloaded from a central repository

32 m1 Task execution sketch - continued Output When the task ends, the virtual environmment disappears with the application itself \\nasfi1.local\virtua lapps Applicatiocn

33 Slide 31 m1 Manca produzione output m006597, 12/29/2008

34 Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution

35 New areas Grid scheduling with virtualization also for real time infrastructure (using Linux Virtual Server for balancing) Use of eterogeneus environment (GPU, FPGA) for high intensive computing task Es. Monte Carlo simulation in Nvidia GPU Grid Services Semantic (Data, Web Services, Grid)

36 SOA architecture needs GRID Business services are not only RPC calls We need long running processes also SOA is not only for internal use

37 Grid Services Web Services allow integration of heterogeneous systems to achieve A2A communication and for shortterm transactions, involving the exchange of relatively small quantities of data. Grid Services will allow integration for more significant jobs, considering the CPU usage and also the quantity of data. GRID vision allows the network to evolve to an environment in which machines and human beings can collaborate.

38 Cloud Computing Cloud or Fog? Standards?

39 «Croire tout découvert est une erreur profonde, c est prendre l horizon pour les bornes du monde!» Camille Flammarion Information tecnology is not only support for business. Information tecnology is not only support for business. It s changing our way of learn, exchange knowledge, buy, work, etc.

40 Thanks Piero Poccianti Consorzio Operativo Gruppo Montepaschi Funzione Osservatorio Tecnologico

From Web Services to Grid: Internal ad esternal use

From Web Services to Grid: Internal ad esternal use Piero Poccianti Staff Pianificazione e Sviluppi Strategici Consorzio Operativo Gruppo MPS EGEE 2006 1 Agenda From Web services to Grid Introduction 2001