Speeding Cloud Foundry with Open Source OpenPOWER Hardware

Transcription

1 Speeding Cloud Foundry with Open Source OpenPOWER Hardware Indrajit Poddar, STSM Systems Technical Strategy, IBM Andrei Yurkevich, Chief Technology Officer, Altoros

2 Please Note: IBM s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here. 1

3 How to empower Cloud Foundry? Brian Snelson 2

4 We will tell you about......cloud Native application development on Cloud Foundry PaaS 3

5 We will tell you about......cloud Native application development on Cloud Foundry PaaS...OpenPOWER infrastructure 4

6 We will tell you about......cloud Native application development on Cloud Foundry PaaS...OpenPOWER infrastructure...what are the advantages of OpenPOWER for running Cloud Foundry apps 5

7 We will tell you about......cloud Native application development on Cloud Foundry PaaS...OpenPOWER infrastructure...what are the advantages of OpenPOWER for running Cloud Foundry apps...what are the constraints 6

8 We will tell you about......cloud Native application development on Cloud Foundry PaaS...OpenPOWER infrastructure...what are the advantages of OpenPOWER for running Cloud Foundry apps...what are the constraints...efficient architectures of Cloud Foundry to run on OpenPOWER 7

9 Open Source Cloud Foundry Platform as a Service

10 Cloud Foundry. What is it? Cloud Foundry is an open source cloud computing Platform-as-a-Service (PaaS) that provides a choice of clouds, developer frameworks, and application services. Cloud Foundry makes it faster and easier to build, test, deploy, and scale applications. Commercial PaaS products based on open source Cloud Foundry: Pivotal Cloud Foundry, HP Helion, Predix 9

11 Altoros. Who we are. 70% Mal e +5 Join us on an average month 30% Femal e Sunnyvale, CA Altoros offices Altoros s delivery partner in APAC London Osl o Helsinki Minsk Singapore Tokyo 256+ Empl oyees 50% application developers, graphic designers and data scientists 30% Cloud Foundry & Cloud DevOps Santa Fe Zurich Buenos Aires Copenhagen

12 Altoros. What we do. Altoros brings software assembly lines into organizations through integration of solutions offered by the Cloud Foundry ecosystem. Delivered by Altoros: POPULAR POPULAR PROOF OF CONCEPT & IMPLEMENTATION APP DEVELOPMENT & MICROSERVICES DEVELOPER ADOPTION CONSULTING TRAINING: FOR OPERATORS AND DEVELOPERS Delivered by partners: Pivotal Cloud Foundry HP Helion

13 OpenPOWER Open Source hardware

14 An alternative system architecture for denser micro-services Datacenter Rack with OpenPOWER Traditional Intel x86 Systems E26xx V3 Haswell 1-2 CPU, GB RAM OpenPOWER Systems DOCKER 10,000 Docker containers on a single IBM Power System!!! 1 CPU with upto 12 cores and 96 hardware threads GB RAM 13

15 Moore s Law and Open Ecosystems Driving innovations beyond the chip Microprocessors alone no longer drive sufficient price/performance improvements System Stack innovations coupled with hardware acceleration are the future -law 14

16 OpenPOWER Worldwide Development Community OpenPOWER is an open development community, using the POWER Architecture 175+ members 20+ technologies revealed 24 countries 6 continents 100+ innovations under way 15

17 Accelerating Hardware Innovation New Chips & Components DMI connection between an Altera Stratix V FPGA accelerator and a POWER8 CPU Convey s CAPI developer kit based on the company s Xilinix-based co-processors First China local POWER derivative chip, CP1 Components & Systems First commercially available OpenPOWER third-party server New CAPI-based solution: the ConnectX-4 adapter card by Mellanox Nallatech s OpenPOWER CAPI Developer Kit New Systems & Platforms First Open server specification and motherboard combining OpenPOWER, Open Compute and OpenStack (moc k -up) First GPU-accelerated OpenPOWER developer platform Prototype of a new high-performance server on the path to exascale Bringing It All Together First commercially available OpenPOWER server RedPower, the first China OpenPOWER 2- socket system coming in 2015 Clustering Inspur 2-socket POWER8 Server Data Engine for NoSQL with 40TB CAPI-attached flash Open Source Redis 192 Vcores + CAPI ChuangHe China-branded OpenPOWER system with POWER8 40TB in 2U 24:1 Serv er consolidation f or 3x lower cost per user 16

18 First OpenPOWER systems available now 17

19 Accelerating Software Innovation Over 1,900 Linux ISVs developing on Power CHARMM GROMACS NAMD AMBER RTM GAMESS WRF HYCOM HOMME LES MiniGhost AMG2013 OpenFOAM HPC minidft CTH BLAST Bowtie BWA FASTA HMMER GATK SOAP3 STAC-A2 SHOC Graph500 Ilog Cloud Big Data & Machine Learning Mobile Enterprise Major Linux Distros 18

20 The Cloud Foundry ecosystem A typical CF user: # of developers 100s # of employees 1,000s to 100,000s # of apps 100s to 1000s 19

21 User base represented by Cloud Foundry POWER platform 20

22 User base represented by Cloud Foundry POWER platform Finance Telecom Automotive Pharmaceuticals Airlines Healthcare 21

23 User base represented by Cloud Foundry POWER platform Finance Telecom Automotive Pharmaceuticals Airlines Healthcare Finance Telecom Automotive Pharmaceuticals Airlines Healthcare 22

24 Cloud Foundry on OpenPOWER Sizing experiments and porting experience

25 Performance comparison POWER8 vs. x86 E5 IBM POWER8 core and system performance is 2x the x86 Xeon E v3 core performance Published Benchmarks ALL data is PUBLISHED x86 Haswell Intel Xeon E v3 (except w here noted) IBM POWER S GHz POWER8 vs. x86 Core Performance Ratio # Cores SAP 2-Tier SPECint_rate SPECfp_rate SPECjbb2013 (max-jops) SPECjEnterprise (24-core E v 2) Oracle ebs Payroll (24-core E v 2) (12-core) 2.1 Siebel CRM Release (16-core E5-2690) (6-core) ) IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD benchmark users, running AIX 7.1 and DB2 10.5, Certification # Source: All results valid as of October 3, ) Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory; 16,500 SD benchmark users, running RHEL 7 and SAP ASE 16; Certification # Source: 3) SPECcpu2006 results are submitted as of 9/8/2014. For more information go to 4) SPECjbb2013 results are submitted as of 9/8/2014. For more information go to 5) SPECjEnterprise2010 results are valid as of 9/8/2014. For more information go to 6) Oracle ebs Payroll Batch Extra Large Kit and are current as of 3/24/2014. For more information go to 7) Siebel PSPP Kit and are current as of 3/24/2014. For more information go to

26 OpenPOWER Cloud Foundry instances consume less CPU Preliminary sizing experiment conducted by Altoros CPU intensive workload - scale out condition cpu util > 75% VMs and containers of the same size CPU Consumed: Lesser is better

27 What were the obstacles in porting? Obstacle How to address Current status Lack of golang support Switching to gccgo (golang frontend for gcc) golang 1.6 will have full POWER LE/ppc64le support Outdated build configurations Update build configuration getting added upstream No BOSH stemcell bosh-agent interpretation of extra boot partition in ppc64le Buildpack binaries are built for x86 Missing CF stack for ppc64le Implement stemcell generator bosh-agent patching Creatу a buildpack binaries generator for Power Implementing rootfs generator for ppc64 stack build your own for github.com community source getting added upstream most runtimes e.g. Node.js, Ruby and Python run well on POWER LE getting added upstream 26

28 Next Steps... - Upstreaming code changes into latest community code - Concourse CI for OpenPOWER at OSU Open Source Lab

29 Known high performance cloud workloads on OpenPOWER Can be added as Cloud Foundry services This image cannot currently be displayed. Data Engine for NoSQL with Redis Labs Turbo LAMP on Linux on Power MariaDB on Linux on Power SAP HANA on Linux on Power Veristorm Data Integration & Open Source Apache POWER8 + CAPI FLASH as RAM 24:1 server consolidation Up to 3x lower TCA Next generation integrated LAMP stack Accelerated Dev/Ops for Mobile Apps 53% less $$ per user / hour with Magento running on Turbo LAMP Up to 2.2x better per core performance Up to 1.9x better per system performance Designed for mission critical 7X24 Enterprise customer operations Outstanding throughput per core Virtualization out of the box ETL warehouse data & x86 Hadoop data into Linux on Power Hadoop clusters Run Open Source Apache Hadoop optimized for faster insights 28

30 OpenPOWER - based architecture. Getting started Option 1

31 OpenPOWER - based architecture. Getting started Option 2

32 Conclusion Cloud Foundry runtimes and services can run on OpenPOWER systems OpenPOWER support in Cloud Foundry is coming upstream soon OpenPOWER systems are now available from Tyan or IBM OpenPOWER clusters are cost-performance efficient for CPU-intensive workloads at scale Reach out to Altoros if you want to try it out Github repo with getting started scripts: OpenPOWER Resources: Bare metal and virtual compute servers (beta) at IBM SoftLayer Open source development OpenStack environment at Oregon State University: SuperVessel OpenPOWER cloud: ptopenlab.com 31

33 Questions?

34 Notices and Disclaimers Copyright 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law 33

35 Notices and Disclaimers Con t. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera, Bluemix, Blueworks Live, CICS, Clearcase, Cognos, DOORS, Emptoris, Enterprise Document Management System, FASP, FileNet, Global Business Services, Global Technology Services, IBM ExperienceOne, IBM SmartCloud, IBM Social Business, Information on Demand, ILOG, Maximo, MQIntegrator, MQSeries, Netcool, OMEGAMON, OpenPower, PureAnalytics, PureApplication, purecluster, PureCoverage, PureData, PureExperience, PureFlex, purequery, purescale, PureSystems, QRadar, Rational, Rhapsody, Smarter Commerce, SoDA, SPSS, Sterling Commerce, StoredIQ, Tealeaf, Tivoli, Trusteer, Unica, urban{code}, Watson, WebSphere, Worklight, X-Force and System z Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: 34

36 Thank You Your Feedback is Important! Access the InterConnect 2016 Conference Attendee Portal to complete your session surveys from your smartphone, laptop or conference kiosk.