Open Source for Cloud Infrastructure

Transcription

1 Open Source for Cloud Infrastructure June 29, 2012 Jackson He General Manager, Intel APAC R&D Ltd.

2 Cloud is Here and Expanding More users, more devices, more data & traffic, expanding usages >3B 15B Connected Users 1 Connected Devices 2 >11X Increase in global mobile data traffic 5 Expanding Media Usages Exabytes % GROWTH IN STORAGE CAPACITY SHIPPED Forecast >1500 EXABYTES OF TRAFFIC 4 Forecast 1. Cisco Global Cloud Index Nov Intel ECG Worldwide Device Estimates Year Intel One Smart Network Work forecast 3. IDC Worldwide enterprise storage systems forecast , Dec Cisco Global Cloud Index Nov Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, , Feb Video Search Video Surveillance 70% of all Global Mobile Data Traffic will be Video 5 Live Broadcasts

3 Intel Open Cloud Vision FEDERATED Share data securely across public and private clouds AUTOMATED IT can focus more on innovation and less on management CLIENT AWARE Optimizing services based on device capability

4 Realizing Business Opportunities in Open Source INTEL INTERNAL CONFIDENTIAL

5 Platform of Choice in Open Source Open-source-based solutions, optimized for Intel architecture, unlock new business opportunities Reach new markets and expand existing markets Differentiate your offering atop a solid, standard platform Prosper in a unique, growing ecosystem Deliver exceptional experiences that delight end-customers INTEL CONFIDENTIAL

6 Advancing Open Source On Many Levels Technology Innovator Catalyst for innovation through advanced hardware and software technologies INTEL IN OPEN SOURCE Igniting the sparks of technology innovation across the computing landscape. Ecosystem Builder Helps create a vibrant, thriving open-source ecosystem Project Contributor Actively contributes to a breadth of open-source projects across every layer of the software stack Funding Support Strong financial position makes Intel a healthy, open-source contributor

7 Open source cloud SW Components (sample) Developer IDE IDE Eclipse Compilers GNU Tools Threading Languages C/C++ Java Ruby PHP Python Javascript Perl Scala Other OS Linux Tizen Load balancer Asd Security Snort/Base Tools Memcached Management Middleware Other Service Provider Monitoring Ganglia Nagios Cacti Zenoss Zabbix Cloud Operating Env. OpenStack OpenQRM Object Store Swift Hbase Cassandra MongoDB CouchDB Database Cassandra Message Queue RabbitMQ PaaS OpenShift Cloud Foundry Analytics Hadoop Billing jbilling Reporting Logwatch RRDtool

8 Open Source for Cloud Solution Stack Server Graphics Big Data LAMP Legacy Enterprise App OpenStack KVM Xen 8

9 OpenStack Test Bed 9

10 OpenStack Solution Exploraiton in China SHJTU research platform China Telecom GZ Research Institute test bed Wasu OpenStack test bed OpenStack solution interest group with Sina and Sohu 10

11 Intel Hadoop Distribution Sqoop (1.4.1) Structured Data Collector Flume (1.1.0) Log Data Collector Hadoop Manager Deployment, Configuration, Monitoring, Alerting and Kerberos Zookeeper (3.3.5) Coordination Pig (0.9.2) Data manipulation Hive (0.9.0) SQL-like Query Map/Reduce (1.0.3) Distributed Processing Framework HBase (0.90.7) Real-time Distributed Big Table HDFS (1.0.3) Hadoop Distributed File System Stable, Enterprise ready hadoop and HBase Adding features for vertical segments, initial focus on Telco, FSI, ITS, etc. Bring Real-time BigData analysis to Hadoop, by differentiating at HBase layer. Optimized for Intel Architecture HBase 0.94 upgrade in Q4, 2012 with specific feature additions for boosting Real-time analysis performance 1 1

12 Intel Hadoop: Optimized for Enterprise Performance comparison Performance number gathered from 8 node cluster Server Configuration: 2S E core, 64GB RAM,8x 7200rpm SATA Disks, 1Gbps Ethernet query/s Open Source HBase (0.90.3) 3500 Optimized HDFS I/O insertion/s Open Source HBase (0.90.3) Advanced Region Balancing HBase as the data store Inserting records/second/server (2-way, 32GB) in average (record size: 1KB in average) Read from disk: >400 query/second/server, latency within one second (0.05s~0.8s under different load) A query is a scan to get all CDR within one month for one user. 1 2

13 Challenges for China Cloud Open Source SW Revenue model: through support rather than licensing Lead SI: Cloud solutions are often delivered through an SI, rather than an ISV need leading cloud open source SIs Unique ecosystem: Open source support models need to comprehend for China business environment Gaps: Ecosystem for open source cloud middleware, e.g. OpenStack SI for cloud solutions, e.g. Hadoop Big Data solutions

14 Igniting Sparks of Innovation through Open Source

15

16 Intel Open Data Center Vision (per DCSG) Open compute, storage, network, & comms infrastructure built from a converged platform architecture designed for security, efficiency, & automation Cloud Security Multi-tenant privacy, trusted execution, and seamless federation between public & private datacenters Cloud Management Maximum utilization efficiency & automation with coordinated workload placement, QoS, and power mgt. through common system mgt. APIs Open Compute Secure, efficient, & automated servers optimized for emerging cloud workloads Open Storage Immensely scalable storage platforms built on standard high volume hardware Open Networking Programmable network platforms built on standard highvolume hardware Open Communications Rapid SW-based commsinfrastructure innovation on standard high-volume hardware