15 Years of Service Oriented Architecture at Credit Suisse

Similar documents
Service-Oriented Architecture and its Implications for Software Life Cycle Activities

Service-Oriented Architecture and Software Engineering

Service Oriented Architectures

Service Oriented Architecture (SOA) An Introduction

Service Oriented Architecture 1 COMPILED BY BJ

JOURNAL OF OBJECT TECHNOLOGY

An Oracle White Paper October Maximize the Benefits of Oracle SOA Suite 11g with Oracle Service Bus

Service Mediation. The Role of an Enterprise Service Bus in an SOA

Lesson 18 Web Services and. Service Oriented Architectures

A Quick Introduction to SOA

SOA and SaaS - new challenges

What You Need to Know About Transitioning to SOA

Sadržaj seminara: SOA Architecture. - SOA Business Challenges s: Billion Dollar Lock-In. - Integration Tools. - Point-to-Point Approach

Motivation Definitions EAI Architectures Elements Integration Technologies. Part I. EAI: Foundations, Concepts, and Architectures

JOURNAL OF OBJECT TECHNOLOGY

Enterprise Integration Architectures for the Financial Services and Insurance Industries

How To Build A Financial Messaging And Enterprise Service Bus (Esb)

SOA Fundamentals For Java Developers. Alexander Ulanov, System Architect Odessa, 30 September 2008

CSCI 5828 Spring 2010 Foundations of Software Engineering. - Arpit Sud

Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence

Enterprise Application Designs In Relation to ERP and SOA

Web Services - Consultant s View. From IT Stategy to IT Architecture. Agenda. Introduction

The Impact of PaaS on Business Transformation

Service Virtualization: Managing Change in a Service-Oriented Architecture

How To Understand A Services-Oriented Architecture

SOA Myth or Reality??

Enterprise Reference Architecture

Service Oriented Architecture

E-Business Suite Oracle SOA Suite Integration Options

A Unified Messaging-Based Architectural Pattern for Building Scalable Enterprise Service Bus

Oracle Service Bus. Situation. Oracle Service Bus Primer. Product History and Evolution. Positioning. Usage Scenario

Extend the value of your core business systems.

Prerequisites for Successful SOA Adoption

Service Oriented Architecture Case: IBM SOA Reference Architecture

SERVICE ORIENTED ARCHITECTURE

EAI OVERVIEW OF ENTERPRISE APPLICATION INTEGRATION CONCEPTS AND ARCHITECTURES. Enterprise Application Integration. Peter R. Egli INDIGOO.

Enterprise Application Integration

SOA and Web Services. Larry Kramer Principal Applied Technologist June 9, A PeopleTools and Fusion perspective

How To Create A C++ Web Service

SOMA, RUP and RMC: the right combination for Service Oriented Architecture

Enterprise SOA Strategy, Planning and Operations with Agile Techniques, Virtualization and Cloud Computing

Business Process Driven SOA using BPMN and BPEL

Introduction to Service-Oriented Architecture for Business Analysts

Service Oriented Architecture and the DBA Kathy Komer Aetna Inc. New England DB2 Users Group. Tuesday June 12 1:00-2:15

SOA IN THE TELCO SECTOR

Business Process Management Enabled by SOA

Table of Contents. 1 Executive Summary SOA Overview Technology Processes and Governance... 8

Combining Service-Oriented Architecture and Event-Driven Architecture using an Enterprise Service Bus

Enterprise IT Architectures SOA Part 2

Achieving business agility and cost optimization by reducing IT complexity. The value of adding ESB enrichment to your existing messaging solution

Sentinet for BizTalk Server SENTINET

Service-Oriented Architectures

The Application of BizTalk in Public Sector

SOA and Cloud in practice - An Example Case Study

MDM and Data Warehousing Complement Each Other

Enterprise Application Integration (EAI) Architectures, Technologies, and Best Practices

Service-Oriented Computing and Service-Oriented Architecture

Service-Oriented Architecture: Analysis, the Keys to Success!

Presentation Outline. Key Business Imperatives Service Oriented Architecture Defined Oracle SOA Platform SOA Maturity/Adoption Model Demo Q&A

2 (18) - SOFTWARE ARCHITECTURE Service Oriented Architecture - Sven Arne Andreasson - Computer Science and Engineering.

SOA REFERENCE ARCHITECTURE: WEB TIER

Business Process Management Tampereen Teknillinen Yliopisto

10 Years of Hype Cycles - Do We Forget Knowledge?

Oracle SOA Reference Architecture

An introduction to SOA and the HP NonStop server environment

SOA + BPM = Agile Integrated Tax Systems. Hemant Sharma CTO, State and Local Government

The Enterprise Service Bus

Tomáš Müller IT Architekt 21/04/2010 ČVUT FEL: SOA & Enterprise Service Bus IBM Corporation

Enterprise Application Integration (EAI) Architectures, Technologies, and Best Practices

Complementing Your Web Services Strategy with Verastream Host Integrator

Implementing efficient system i data integration within your SOA. The Right Time for Real-Time

Microsoft SOA Roadmap

Tech Note. TrakCel in the wider Clinical Ecosystem: Accelerating Integration and Automation

Service Oriented Data Management

ebay : How is it a hit

Figure 1: Illustration of service management conceptual framework

Transformation to a ITaaS Model & the Cloud

Distributed systems. Distributed Systems Architectures

SOA management challenges. After completing this topic, you should be able to: Explain the challenges of managing an SOA environment

Definition of SOA. Capgemini University Technology Services School Capgemini - All rights reserved November 2006 SOA for Software Architects/ 2

Research Statement. 2. SMU tbank shall align to, and inform, SMU s Unified Banking Process Framework.

Spring 2011 Conference Sandanski, May 13th 15th 2011 Oracle SOA Suite 11g Rapid service integration and process automation with a no-coding approach

Service Oriented Architecture

SOA Planning Guide The Value Enablement Group, LLC. All rights reserved.

Integration using IBM Solutions

API Architecture. for the Data Interoperability at OSU initiative

So You Want an SOA: Best Practices for Migrating to SOA in the Enterprise. Eric Newcomer, CTO

EII - ETL - EAI What, Why, and How!

INTEGRATING ESB / BPM / SOA / AJAX TECHNOLOGIES

BEA BPM an integrated solution for business processes modelling. Frederik Frederiksen Principal PreSales Consultant BEA Systems

Chapter 15. Web services development lifecycle

The webmethods ESB. The Foundation of your SOA. Jean-Michel Ghyoot, Principal Solution Architect, March 28, 2013

Service Oriented Architecture. 9. Integration Darmstadt University of Applied Sciences, Department of Computer Science Dr. Markus Voß (Accso GmbH)

IBM BPM Solutions Addressing the Enterprise Business Process Management

SOA and API Management

ETERNUS CS High End Unified Data Protection

IBM Business Process Manager

Federal Enterprise Architecture and Service-Oriented Architecture

Transcription:

Public 15 Years of Service Oriented Architecture at Credit Suisse Lessons Learned Remaining Challenges Keynote SATURN 2013 Minneapolis, USA Stephan Murer, Senior Advisor, KG 97 May 1, 2013

Information Technology at Credit Suisse What we do Information Technology is committed to fueling Credit Suisse s growth. Our objective in IT is to partner closely with the business to deliver innovative and cost-efficient results. In today s competitive environment, IT drives performance and revenue growth. By directly aligning our IT initiatives with the bank s overall business objectives, Information Technology helps provide Credit Suisse with a distinct competitive advantage. Who we are Investment Banking and Client Channels Technology IT: Partners with the Investment Banking Division to deliver integrated and innovative technology solutions Private Banking & Wealth Management and Shared Services IT: Partners with Private Banking & Wealth Management and all Shared Services divisions to provide exceptional technology to our clients and employees Technology Infrastructure Services: Provides our business partners global, standardized information technology infrastructure and systems KG 97/13-002104 May 1, 2013 2

Information Technology Facts and Figures 1 66,400 supported users in 550 locations 4 main hub Production Disaster Recovery pairs of data centers consuming 14.1 MW 2 of power Hardware 85,500 workstations/laptops 21,710 physical servers with more than 43 petabytes of storage 4 host/mainframe CPUs with 83,200 MIPS 3 provided Software ~6,021 applications Email 67,541 email accounts 5.5 m emails/day Helpdesk 416,760 tickets (2012) Print Center 198 million pages (2012) 1 As of March 2013 2 MW = Mega Watt 3 MIPS = Million Instructions per Second KG 97/13-002104 May 1, 2013 3

Common Services Securities OTC Banking Convergence to More Agile and Standardized Operating Model to Improve Our Capabilities Shared components Single sources of reference data Common Service Oriented Architecture (SOA) Common domain and business services model Common infrastructure Common infrastructure based on consistent architectural standards that support our systems in a scalable, agile, and cost-efficient manner Client Channel Processing Risk Finance Infrastructure Consistent client experience Single sign-on One portal, multiple solutions Product processing Shared, legal entityagnostic global processing platforms Risk management and financial control Unified risk and finance platforms, based on agreed front-office data KG 97/13-002104 May 1, 2013 4

Managed Evolution of Very Large Systems Requires Stable Interfaces Hard to replace a very large information system as a whole High cost (> CHF 1 bn, estimate for Swiss platform) Development time too high (> 5 years) High risk, as both technical and business prerequisites shift over time Managed evolution is the only feasible approach Stepwise transformation of landscape, renewing component after component Multi-year effort which gradually implements the target architecture Well encapsulated components exposing managed interfaces are a prerequisite for managed evolution Technically renew components, without affecting clients Consolidate redundant data and functionality behind common interfaces and simplify Seamlessly operate a technically heterogeneous system resulting from the evolutionary approach KG 97/13-002104 May 1, 2013 5

Service Oriented Architecture (SOA) Principles and Benefits Principles Benefits Service interfaces and contracts Loose coupling Service abstraction Reusability Benefits Discoverability Interoperability Reduced integration expense Increased asset reuse Increased business agility Reduction of business risk Benefits KG 97/13-002104 May 1, 2013 6

IFMS: Interface Management System OBPM: OneBank BPM Platform Credit Suisse exchange Bus (CSXB) User Group Specific Portals CSXB Portal Integration Interfaces Application Interfaces Application Application Interfaces Domains, Divisions, Regions Application Interfaces Interfaces Application Domains, Divisions, Regions Application Interfaces CSXB Service Integration Design Repository Runtime Environment Synchronous remote call (RPC) Asynchronous store-and-forward Bulk file transfer KG 97/13-002104 May 1, 2013 7

SOA Experience @ Credit Suisse Three Case Studies Credit Suisse Information Bus Opening the mainframe for modern front-ends Workflow as shared service Flexible business processes Global PB SOA Wrap diverse international banking backends 1998 2013 KG 97/13-002104 May 1, 2013 8

Case 1: Credit Suisse Information Bus (CSIB) Principles Facts Started in 1998. More than 1,200 services built up to now. All applications on the Swiss Platform offer and/or consume services today Principles Objectives Principles Technology Enable Managed Evolution of Mainframe Platform Component architecture for the Swiss Platform Reuse of core data&functionality (mainly) residing on the mainframe for modern front-ends Orbix CORBA for synchronous services, migrating to WebServices WebSphere MessageBroker/MQ for messaging Ftps for files ( Bulk Services ), File Broker for flow control, transformation, etc. Principles Footprint About 1,400 public services, 70 message publishers 400 mn CORBA calls and 120 mn messages delivered per month KG 97/13-002104 May 1, 2013 9

Different Life Cycles in Different Application Layers GUI, presentation, channel specific 2+ years Application logic, product specific 10+ years Core system, close to operational data, generic for the bank 30+ years KG 97/13-002104 May 1, 2013 10

Measure Progress Services Built as Needed Build services as they are needed Gradually decouple domains Use existing functionalities KG 97/13-002104 May 1, 2013 11

Measure Progress Use of Services Follows Availability Service Calls per Year * 10 9 200 services available 600 services available 800 services available 900 services available 1,100 services available Wide use of services follows a critical mass of available services Today ~5 billion service calls a year in Switzerland Fully decoupled platform some years ahead Core banking system on mainframe completely decoupled from remainder of platform KG 97/13-002104 May 1, 2013 12

Governance Bottom-up Requests, Top Down QA Project Initialization Design Implementation Service Development Request 2. Quality Check IDL/WSDL Specification Service Change Request Extended Design for reuse 3. Quality Check Complete Service Definition 1. Quality Check Basic Request Private service Reuse existing service Generate Service Documentation/ Code KG 97/13-002104 May 1, 2013 13

CIF CIFRelations OE_Data DI_CurrencyRate OE_Search CRE_Documents AZ_Polist RiskClass CIFS_DepositsForCifs IVN_TisControl RTT_PMProfile_Update ADAC_ReportingChecks EBVV_Service_Update IPC_Cluster PI_GetData RTT_Manage_Changes ZV_ScanningMis AZ_OrderWithPayments CRE_Autolombard DBH_SafekeepingAccounts EBVV_Customer_Update IPC_Request KAUF_CreditPayments OE_FunctionHolder_Update PROK_ProductRelations RTT_Pool_Order_Update ACCT_Prompt ADAC_RepoItemStructure CAS_ATMBooking_Update CAS_CashService CRE_Balance DADMIN_Order EBVV_History_Update ED_Deal_OutputRepeat HYP_Balance HYP_KEHAccount KAUF_Collateral KOSA_OrderStatus_Update NZV_PayPathPendSegUpd PARS_Partner2 PROK_PriceCompRelations RRA_Account RRA_Request_Update TFR_TradeFinance Measure Re-use Re-use Is Very Uneven 100 90 80 70 60 50 40 30 20 10 0 Re-use of services varies based on type of service. Reference Data Services have the highest re-use. About half of the services are reused Average re-use degree is 4 4 different client applications using a service KG 97/13-002104 May 1, 2013 14

Governance Interface Management System Searchable Service Catalog Data type repository with UM/ WSDL integration Governance workflows Lifecycle management Extensible code generator (MDA) Integration with other tools, like application repository or accounting KG 97/13-002104 May 1, 2013 15

Case 1: Credit Suisse Information Bus Experiences Principles Strengths Well-accepted, high proliferation, good re-use of services Solid middleware foundation Governance: Combination of bottom-up approach and top-down QA works Principles Challenges Principles Lessons Learned Management becomes difficult because of size (> 1,000 services) Business object model (BOM) required as a framework in which to manage the service landscape (currently in development) Long term migration towards Web Services, without compromising performance Strong governance is essential Organization needs time to learn (years for large organization) Bottom-up approach helped in gaining critical mass, but......supporting service design with common data model would greatly improve service quality and simplify QA Need improved interface management system (IFMS), market didn t deliver Formal service descriptions could be the basis for code generation Business rationale necessary Architectural beauty not good enough! KG 97/13-002104 May 1, 2013 16

Case 2: Global Private Banking SOA Principles Facts Principles Objectives Started in 2005 About 200 services built up to now Services implemented in different countries (Monaco, UK, Germany, Singapore, etc.) on top of different backends Re-use the same frontend applications with different local backends Initial driver: standardized front desk application Currently we see a wave of new frontend applications Web Services (only synchronous communication needed) Principles Technology Principles Footprint Small compared to CSIB Growth due to implementation of global strategy KG 97/13-002104 May 1, 2013 17

From Many Clients Using the Same Service to Many Providers Offering the Same Service Various sales channels Single global front-end Service provider defines semantics Implicitly defined with single service provider Challenging with multiple service providers Credit Suisse Information Bus International SOA Explicit semantics, especially explicit information model needed Swiss back-end International back-ends KG 97/13-002104 May 1, 2013 18

Business Object Model Common Federated Model Semantically Aligns Information Precise semantics of information exchanged through services needed SOA means many producers communicating with many consumers Bottom-up service design needs overarching information model to ensure semantic consistency Top-down approaches to service design require information model defining the overall structure Enterprise Domain Application Centrally managed Conceptual Business Object Model delivers Provides reference naming for data elements Typed data elements for correct representation Relationships and annotations give semantic clarity Used to define consistent service interfaces Used to map service interfaces onto different implementations Federated Governance Logical Physical KG 97/13-002104 May 1, 2013 19

Case 2: Global Private Banking SOA Experiences Principles Strengths Re-uses proven governance developed with the CSIB Adds business object model to improve transparency and quality Principles Challenges Dealing with the heterogeneity of different locations and their local backends Dealing with a large diversity of teams and responsibility in the different locations Long-term blur of distinction between Swiss and International platforms Principles Lessons Learned The business object model really helps. Need to introduce it for all SOA environments. We are still learning how to balance local agility needs and global coordination/ quality requirements KG 97/13-002104 May 1, 2013 20

Case 3: Workflow Infrastructure Process Integration Principles Facts Started in 2000 Currently broadly used internationally Principles Objectives Decouple process management from application logic Flexible service orchestration to support adaptation of application landscape to different business processes Principles Technology Oracle BPM (current technology), IBM MQSeries Workflow (past technology), based on BPMN Middleware migration successfully under way Principles Footprint In use in more than 30 applications globally, with about 150 processes types. About 100,000 process instances per month. KG 97/13-002104 May 1, 2013 21

Workflow Infrastructure Architecture Embedding Portal use Application use Input Worklist Process Portlets Process Services Output Authorization Process Authorization Workflow Infrastructure Directory User Details Process Events Data Warehouse Modeling Business Process Model use Java Application Platform use Usage Application Services KG 97/13-002104 May 1, 2013 22

Employee Onboarding Setting up IT Accounts Challenge: New hires could wait several days to begin work until they have access to all systems Hire new employee Create HR record Create user identity Set up IT accounts Create email account Issue smartcard KG 97/13-002104 May 1, 2013 23

Service Orchestration through Managed Interfaces In production since August 2011 Average turnaround time <1 hour HR Admin BPM Platform (Oracle BPM) Operator HR Process Dashboard MQ SOA-based integration MQ CORBA MQ Credit Suisse exchange Bus (CSXB) CORBA MQ User Identity IT Accounts 1 Manager 1 IT account provisioning is handled by several different systems, which are not shown here in detail KG 97/13-002104 May 1, 2013 24

Workflow as Shared Infrastructure KPIs Number of workflow applications 35 30 25 20 15 10 5 0 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 New Platform Shared infrastructure used by multiple applications Central engineering, support and consulting team Infrastructure available in all major hubs Since 2010 transition from legacy solution (IBM MQSeries workflow) to new technology (Oracle BPM) Decouple workflow apps from server product as much as possible Legacy Platform Key numbers (November 2012) Legacy platform New platform Total Applications 9 23 32 Process models 118 28 146 Process activities 748 159 907 Process instances per month 109,000 48,00 114,000 KG 97/13-002104 May 1, 2013 25

Case 3: Workflow Infrastructure Experiences Principles Strengths Widely accepted across the firm Clean isolation of workflow engine through robust APIs proved successful. Engine is being exchanged without too much impact on applications. Challenges Principles Principles Lessons Learned Often off-the-shelf applications come with built-in workflow capability and don t lend themselves for external orchestration Competition from domain specific orchestration tools, leading to early successes, but failing in enterprise-robustness and end-to-end orchestration Business architecture needed to transform high level business processes into executable workflows Properly encapsulate your infrastructure Work closely with business Potential identified to use infrastructure in straight-through process Even strategic products don t always live long enough. In middleware, we need a strategic life of 15 years. KG 97/13-002104 May 1, 2013 26

SOA is Everywhere in Credit Suisse Front-to-back integration Data quality through well-defined interfaces BIAN Market-wide service standardization E-Commerce portal, Global Front Systems Desktop Integration Financial Messaging Hubs Standardized message formats (SWIFT, ISO 20022, FPML, ) link internal and external applications Reference data distribution Consistent reference data across the application landscape Swiss platform renewal Replicated services for resilience and performance Data Warehouse Managed bulk services feed data into warehouses KG 97/13-002104 May 1, 2013 27

Where We Reach the Limits Areas for Research (1/2) Security remains a challenge Secure passing of the original initiator to all services involved (in the absence of sessions) Second line of defense: Application level firewalls analyzing service traffic, distributed logging of service invocation, service monitoring for unexpected use Fine-grained access control Managing large service networks Version/release management with 1,000s of services and 100,000s of clients, semantic compatibility System Management, service-level control, fault-tolerant designs, capacity management, service replication Testing of complex component networks Accounting of service use Development governance, balancing reuse with demand-driven development Cross platform interoperability KG 97/13-002104 May 1, 2013 28

Where We Reach the Limits Areas for Research (2/2) Semantic alignment Keeping large service landscapes semantically aligned, federation Semantics in dynamic service discovery Systematically linking integration architecture to business architecture (information model, process model, function model) Blending external standards with internal extensions High volume, low latency implementations Market data, 100,000s of messages per second, distributed to many clients, publish subscribe pattern, sub-ms latency expectation Special HW, FPGA Special Network-Devices Simplified protocols Cloud services Service markets Domain-based interface standardization Security Pricing KG 97/13-002104 May 1, 2013 29

Thank You! Questions KG 97/13-002104 May 1, 2013 30