Open Source for Cloud Infrastructure June 29, 2012 Jackson He General Manager, Intel APAC R&D Ltd.
Cloud is Here and Expanding More users, more devices, more data & traffic, expanding usages >3B 15B Connected Users 1 Connected Devices 2 >11X Increase in global mobile data traffic 5 Expanding Media Usages Exabytes 100 80 60 40 20 0 670% GROWTH IN STORAGE CAPACITY SHIPPED 3 2009 2010 2011 2012 2013 2014 Forecast 2000 1500 1000 500 >1500 EXABYTES OF TRAFFIC 4 Forecast 1. Cisco Global Cloud Index Nov 2011 2. Intel ECG Worldwide Device Estimates Year 2020 - Intel One Smart Network Work forecast 3. IDC Worldwide enterprise storage systems forecast 2010-2014, Dec 2010 4. Cisco Global Cloud Index Nov 2011 5. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2011 2016, Feb 2012 2 0 Video Search Video Surveillance 70% of all Global Mobile Data Traffic will be Video 5 Live Broadcasts
Intel Open Cloud Vision FEDERATED Share data securely across public and private clouds AUTOMATED IT can focus more on innovation and less on management CLIENT AWARE Optimizing services based on device capability
Realizing Business Opportunities in Open Source INTEL INTERNAL CONFIDENTIAL
Platform of Choice in Open Source Open-source-based solutions, optimized for Intel architecture, unlock new business opportunities Reach new markets and expand existing markets Differentiate your offering atop a solid, standard platform Prosper in a unique, growing ecosystem Deliver exceptional experiences that delight end-customers INTEL CONFIDENTIAL
Advancing Open Source On Many Levels Technology Innovator Catalyst for innovation through advanced hardware and software technologies INTEL IN OPEN SOURCE Igniting the sparks of technology innovation across the computing landscape. Ecosystem Builder Helps create a vibrant, thriving open-source ecosystem Project Contributor Actively contributes to a breadth of open-source projects across every layer of the software stack Funding Support Strong financial position makes Intel a healthy, open-source contributor
Open source cloud SW Components (sample) Developer IDE IDE Eclipse Compilers GNU Tools Threading Languages C/C++ Java Ruby PHP Python Javascript Perl Scala Other OS Linux Tizen Load balancer Asd Security Snort/Base Tools Memcached Management Middleware Other Service Provider Monitoring Ganglia Nagios Cacti Zenoss Zabbix Cloud Operating Env. OpenStack OpenQRM Object Store Swift Hbase Cassandra MongoDB CouchDB Database Cassandra Message Queue RabbitMQ PaaS OpenShift Cloud Foundry Analytics Hadoop Billing jbilling Reporting Logwatch RRDtool
Open Source for Cloud Solution Stack Server Graphics Big Data LAMP Legacy Enterprise App OpenStack KVM Xen 8
OpenStack Test Bed 9
OpenStack Solution Exploraiton in China SHJTU research platform China Telecom GZ Research Institute test bed Wasu OpenStack test bed OpenStack solution interest group with Sina and Sohu 10
Intel Hadoop Distribution Sqoop (1.4.1) Structured Data Collector Flume (1.1.0) Log Data Collector Hadoop Manager Deployment, Configuration, Monitoring, Alerting and Kerberos Zookeeper (3.3.5) Coordination Pig (0.9.2) Data manipulation Hive (0.9.0) SQL-like Query Map/Reduce (1.0.3) Distributed Processing Framework HBase (0.90.7) Real-time Distributed Big Table HDFS (1.0.3) Hadoop Distributed File System Stable, Enterprise ready hadoop and HBase Adding features for vertical segments, initial focus on Telco, FSI, ITS, etc. Bring Real-time BigData analysis to Hadoop, by differentiating at HBase layer. Optimized for Intel Architecture HBase 0.94 upgrade in Q4, 2012 with specific feature additions for boosting Real-time analysis performance 1 1
Intel Hadoop: Optimized for Enterprise Performance comparison Performance number gathered from 8 node cluster Server Configuration: 2S E5-2680 8-core, 64GB RAM,8x 7200rpm SATA Disks, 1Gbps Ethernet query/s 3500 3000 2500 2000 1500 1000 500 0 700 Open Source HBase (0.90.3) 3500 Optimized HDFS I/O insertion/s 90000 80000 70000 60000 50000 40000 30000 20000 10000 0 25000 Open Source HBase (0.90.3) 82000 Advanced Region Balancing HBase as the data store Inserting 10000 records/second/server (2-way, 32GB) in average (record size: 1KB in average) Read from disk: >400 query/second/server, latency within one second (0.05s~0.8s under different load) A query is a scan to get all CDR within one month for one user. 1 2
Challenges for China Cloud Open Source SW Revenue model: through support rather than licensing Lead SI: Cloud solutions are often delivered through an SI, rather than an ISV need leading cloud open source SIs Unique ecosystem: Open source support models need to comprehend for China business environment Gaps: Ecosystem for open source cloud middleware, e.g. OpenStack SI for cloud solutions, e.g. Hadoop Big Data solutions
Igniting Sparks of Innovation through Open Source
Intel Open Data Center Vision (per DCSG) Open compute, storage, network, & comms infrastructure built from a converged platform architecture designed for security, efficiency, & automation Cloud Security Multi-tenant privacy, trusted execution, and seamless federation between public & private datacenters Cloud Management Maximum utilization efficiency & automation with coordinated workload placement, QoS, and power mgt. through common system mgt. APIs Open Compute Secure, efficient, & automated servers optimized for emerging cloud workloads Open Storage Immensely scalable storage platforms built on standard high volume hardware Open Networking Programmable network platforms built on standard highvolume hardware Open Communications Rapid SW-based commsinfrastructure innovation on standard high-volume hardware