Managing Sprawl of Cloud Services & Data Everywhere in an Enterprise Mazin Yousif, PhD. Cloud Forward 2015 October 7 th

Transcription

1 Managing Sprawl of Cloud Services & Data Everywhere in an Enterprise Mazin Yousif, PhD Cloud Forward 2015 October 7 th

2 WE CAN DIGITIZE ALMOST EVERYTHING. WE CAN CONNECT/ANALYZE EVERYTHING DIGITIZED 2

3 The Evolution Cloud 10s Internet 00s Efficiency, Agility Pay as you go Mainframes <80s Client-Server Huge Upfront CapEx 90s Perpetual Licensing Diversity, Agility 3

4 Happening Now TRENDS Industry 4.0; cross-industry integration; new business models IoT: integration of prosumers, businesses, partners, smart Cloud & data explosion MARKET POTENTIAL - EXAMPLES 50B connected devices by 2020 Cloud industry digitalization >100B market potential in 2017 CHALLENGES X-industry value chain integration Data-driven business models Multi-faceted eco-systems Process optimization beyond corporate boundaries Incorporation of prosumers, social media 4

5 The State of the Enterprise IaaS/PaaS Social media Apps SaaS Apps E2E Orchestration & Integration The need to seamlessly connect, integrate & orchestrate Mobile Apps/Devices Stateless User Experience Customer Environment Incumbents 5

6 What is a Presentation without citing Larry Ellison? 6

7 Just Few Challenges Survey: Connecting data, applications & processes b/w cloud & on-premise systems is immediate problem. Industry unlikely to standardize on architecture for that would make things easier Odd mix of legacy, mobile, cloud apps Conflict with dynamic resource assignment environment Integration very complex APIs not promised silver bullet for clear interaction b/w SaaS & on-premise. On-premise apps developed under different standards & often need custom-code to interact with SaaS environments Cloud providers have API, but app integration is not auto-magical. APIs aren't the answer in most cases, because they're frequently proprietary, long/complicated. Force.com APIs > 500 pages of specs. SaaS vendors don't provide complete integration solution - nasty surprise to early adopters of cloud apps. Old tools & ad-hoc methods won't stand to challenges in orchestration, security, data transformation and more. 7

8 & Few More Manual integration? Okay, but Location of resources not fixed in cloud - finding them difficult. Integration tasks (e.g., LB,) via messages & ESBs should be Cloud Applications. Performing them in specific place introduces SPOF, & unwanted network delays if integration elements aren't placed close applications components. Example challenges when integrating Ensure data go from one system to another - from on-premise to cloud; Orchestrating data flow to get the right data to the right system at the right time Maintain connections & data exchange with same level of security in the enterprise; Right types of connections to accommodate volumes of data & interactions b/w systems 8

9 The Future is Integrated Many Clouds & Data Everywhere Integrated Services Customer Value Business View Connected Car Public & Health Energy M2M/Industry 4.0 Data Orchestration Cloud Integration (ipaas) Data Virtualization Cloud Brokerage Management & Security IaaS/PaaS Social media Apps SaaS Apps Incumbents Mobile Apps/Devices Cloud Infrastructure Secure Network & Datacenters etc. 9

10 Broker your Clouds Brokers are Finding right cloud product to test/dev/deploy to meet business needs Middleman b/w providers & enterprises to help select the right cloud services. According to NIST Service intermediation: Enhance given service by improving some specific capability and providing valueadded services to cloud Consumers. Service aggregation: Combine/Integrate multiple services into one or more new services; includes service & data integration and ensures secure data movement. Service arbitrage: Similar to aggregation except that the services being combined/consolidated are chosen from multiple service providers. Still Maturing Negotiate & Renegotiate Agility: develop new interfaces in short time (e.g., days) Could help or hinder lock-in Not concept of different project stages needed for mission critical and transactional projects. Overarching security strategy Consistency: What & how brokers work 10

11 Broker your Clouds CLOUD BROKER DECISION ENGINE Management Private or Public Clouds Identity management Resource Selection Automated Provisioning Automated Scaling Granular Reporting Analytics/trend Analysis Financial Reporting Approval Workflow TRANSFORMATION ENGINE BASIC FEATURE SET Transparency for Customers Workload & Migration Management Performance Management Metering Service Catalogue Private or Public Clouds 11

12 ipaas Cloud Integration Platform as a Service We Managed to Make Cloud Integration a Cloud Service Only in the Age of Cloud ipaas* Functionality Supports application, data & process integration of cloud-based apps, APIs & onpremise systems. Delivers capabilities typically found in ESBs, data integration tools, B2B gateways, managed file transfer products & API mgmt platforms. Applications developers & business users leverage these capabilities to develop / execute/manage integration interfaces (or "integration flows") in the cloud. Support for (& bridging b/w) connectivity protocols & data/message delivery styles Data/message mapping and transformation Data quality Routing and orchestration Adapters for cloud-based & on-premises data sources, applications & technology environments On-premise S/W agents for secure communication between on-premise systems & ipaas environment Adapter developer toolkits Integration flow development & lifecycle mgmt tools; mgmt, administration & monitoring API management Reusable integration templates * Gartner 12

13 Features ipaas Cloud Integration Platform as a Service We Managed to Make Cloud Integration a Cloud Service Only in the Age of Cloud Connect: Robust connectors for cloud services Quick addition of new services. Support integration flows moving in both directions across cloud & enterprise Scale up as # of endpoints increase Open Allows build/customize integration solutions to address nuances of typical SaaS integration scenarios. Manageability & Ease of Use Familiar tools/processes to build/configure applications without changing the way they work. Monitoring capabilities to provide visibility/control over information flows, performance attributes, auditing & alerts Secure Allows authenticating/authorizing access to resources on premise & in the Cloud 13

14 Summary ipaas Cloud Integration Platform as a Service We Managed to Make Cloud Integration a Cloud Service Only in the Age of Its Foundation ipaas is a set of Connectors. On downstream side, connectors are linked to application components like Directory. When cloud component is loaded onto resources, it can be registered with ipaas and linked to a connector. Connector publishes API to users & other components on "upstream" side of connector. Applications can reference these upstream APIs & reach the components regardless of where they are connected. * Gartner 14

15 Data Everywhere IaaS/PaaS Social Media Apps SaaS Apps DOaaS Mobile Apps/Devices Cloud Infrastructure Secure Network & Datacenters etc. 15

16 Orchestration? Automation: workflows processed/completed as processes within single domain Orchestration includes workflow & provides directed action towards larger goals/objectives (e.g., Performance, SLA, QoS). Orchestration Orchestrator: Unit to manage cross domain (system, enterprise, firewall) processes, & handles exceptions. Cloud Services Orchestration Composing of architecture, tools and processes used by humans to deliver a defined Service. Stitching of software and hardware components together to deliver a defined Service. Connecting and Automating of work flows when applicable to deliver a defined Service. Cloud Services Orchestration is Critical Cloud services intended to scale-up arbitrarily/dynamically Cloud service delivery includes fulfillment assurance and billing. Cloud services delivery entails workflows in various technical and business domains. 16

17 Pay as you go Manageability & Security Data-Orchestration-as-a-Service Customer - Developers, Businesses, CB Self-Service Portal DOaaS Private/Public Cloud Services - IaaS/PaaS/SaaS Examples - Real-World Applications Link b/w Salesforce and SAP systems Data synch. for customer portal or mobile app Interface to social media Data collection for big data analysis Integration of suppliers into customer s own global supplier portal Implementation of test/dev for cloud providers Migration of data b/w cloud services (e.g., when moving to new cloud provider Replication of DBMS for security reasons Backup of cloud data - service outages Functionality Connect apps in customer datacenters with cloud applications. Seamless interplay for information in cloud (e.g., CRM, social media) & on-premise systems (e.g., ERP). Information available where needed Best utilized where needed rather than where created Business processes across apps borders. 17

18 Data Virtualization Reporting, Portals Web Users Mobile Enterprise Applications Data Virtualization Pdf, Docs, s, Index NoSQL Big Data Data SaaS Sources Collaboration XML, Excel, Flat files Web 2.0 DB & DW Enterprise Applications Data Virtualization? Abstracting data from its physical constraints o Format, Source, Physical Location, Integrates data from disparate sources & locations without replicating them Virtual Data Layer Faster access to data; Agility - Simplified, unified, & integrated view of data in real time or near real time. Faster access to data; Less Replication; Less Cost; More agility 18

19 IEEE Cloud Computing Magazine Published by IEEE Computer & Communication Societies 6 Issues/year EiC: Mazin Yousif Editorial Board & Advisory Board Regular paper & Special Issues Columns & Departments: StandardsNow; Economics; Government; BlueSkies; Tidbits; etc. Most Recent: Special Issue on Legal Clouds Next Issue: Cloud Engineering 19

20 Mazin Yousif, PhD VP of Architecture & CTO (RDS) T-Systems, International 20