Network Virtualization for Cloud Computing

Network Virtualization for Cloud Computing Ruay-Shiung Chang ( 張 瑞 雄 ) Department of Computer Science and Information Engineering National Dong Hwa University y( 國 立 東 華 大 學 ) June 29, 2010 1 Virtualization is hot! Cloud computing is hotter! But right now, the hottest is 2 1

Outlines Introduction What is network virtualization? Current systems in network virtualization Research directions in network virtualization Conclusions 3 4 2

Introduction Two key concepts in the title 5 Virtualization(1/2) Virtualization: Make abstractions of the resources Hide the physical hardware from the users Combine/Divide resources M-to-N mapping (M real resources, N virtual resources) For example, a partition is the logical l division i i of a hard disk to create multiple separate hard drives Greater resource utilization and flexibility 6 3

Virtualization(2/2) Time Sharing in Large Fast Computers, IFIP Congress 1959 (by Christopher Strachey, 1916 1975, a British computer scientist) Virtual memory (Tom Kilburn, 1921-2001, a British Engineer, developed Altas (paging) in1962) Virtual machine concept (~1980) Virtual circuits in networks X25, ATM, Frame Relay, MPLS, GMPLS. Key technology to build a cloud computing environment 7 Process of Virtualization Traditional Computer Architecture Virtualized Computer Architecture 8 4

Hypervisor Virtual machine manager (monitor) Allow multiple operating systems to share a single hardware host Each guest operating system appears to have the host's processor, memory, and other resources Make sure that the guest operating systems (called virtual machines) cannot disrupt each other 9 Hypervisor Two types of hypervisor Type 1 (or native, bare metal) hypervisors run directly on the host's hardware to control the hardware and to monitor guest operating systems. A guest operating system thus runs on another level above the hypervisor. This model represents the classic implementation of virtual machine architectures; the original hypervisor was CP/CMS, developed at IBM in the 1960s Type 2 (or hosted) hypervisors run within a conventional operating system environment. With the hypervisor layer as a distinct second software level, guest operating systems run at the third level above the hardware. 10 5

Types of Virtualization(1/2) Server virtualization One physical machine is divided many virtual servers VMware ESX, Citrix XenSever, MicroSoft Hyper- V Storage virtualization The pooling of physical storage from multiple network storage devices Storage area networks (SANs) 11 Types of Virtualization(2/2) Network virtualization Presents a customized network to each user by splitting up the available resources in a network Virtual Local Area Network (VLAN) Virtual Private Network (VPN) 12 6

What is cloud computing (1/2) A specialized distributed computing paradigm A pool of computing power, storage, platforms, and services to be used remotely Abstracted Virtualized Dynamically-scalable Managed 13 What is cloud computing(2/2) Users use web service interfaces to demand resources Pay only for the resources that one actually consumes (May even be free for personal use!) 14 7

Cost Shift 15 Services of Cloud Computing (1/4) Software as a Service (SaaS) Who is offering on demand software Salesforce.com Google NetSuite Taleo Concur Technologies Nexgen Software Inc. 16 8

Services of Cloud Computing (2/4) Platform as a Service (PaaS) Active platform Google - Apps Engine Amazon.com - EC2 Microsoft - Windows Azure Terremark Worldwide - The Enterprise Cloud Salesforce.com - Force.com Rackspace Cloud - cloudservers, cloudsites, cloudfiles Surge 17 Services of Cloud Computing (3/4) Infrastructure as a Service (IaaS) Infrastructure Vendors Google - Managed hosting, development environment International Business Machines - Managed hosting SAVVIS - Managed hosting Terremark Worldwide - Managed hosting Amazon.com - Cloud storage Rackspace Hosting - Managed hosting & cloud computing 18 9

Services of Cloud Computing (4/4) Cloud Computing Consulting ServiceMesh Agile IT operating model Cloud computing consultants I.T. simplified Booz Allen Hamilton Thomond Technology ENKI CloudTP Appirio 19 20 10

Why Network Virtualization? Ideally, all resources (compute, storage, and networking) would be pooled, with services dynamically drawing from the pools to meet demand. Virtualization techniques have succeeded in enabling processes to be moved between machines. Constraints in the data center network continue to create barriers that prevent agility, for example, VLANs, ACLs, broadcast domains, Load Balancers, Firewall/IPS Security settings and service-specific network engineering. 21 Forces Driving Network Virtualization Computing has always driven network design Mainframes drove SNA and analog multi-point wide area networks (WANs) during the 70s. Mini-computers drove peer-to-peer networking protocols like DecNet, OSI and TCP/IP in the 80s. Client-Server computing drove LANs and TCP into the mainstream in the early 90s. The Web drove the Internet in the 2000s And now server virtualization and cloud computing is once again changing fundamental networking requirements to make them more flexible. 22 11

Status Quo (1/4) Early virtualization is all about the servers. Innovation driven virtualization is holistic: Servers Storages Networks Network infrastructure must enable: Agility/elasticity Portability Replication Inflexible and costly network infrastructure is the greatest barrier 23 Status Quo (2/4) In virtualized and cloud environments, it s not an issue of where e the network is, it s where e it isn t. The network must be workload aware (vs. dumb plumbing) Workloads/VM s must express their policy requirements and the network must provide transit and enforcement regardless of physical or logical location. 24 12

Status Quo (3/4) The growing automation gap between network and application infrastructure u 25 Status Quo (4/4) The situation today: islands of management Fully virtualized with integrated management 26 13

Is Network Ready for Cloud Computing? 27 Role of NV for Cloud Computing If you take a computing device or server and run a virtualized server on it, without a properly virtualized network, the network just sees that it is connected to a physical computer or a server. It doesn't have the ability to see the virtual machines that are on that computer or server. Today with various applications we need a network that is intelligent and can also virtualize itself so that we can apply the right resources to the right types of applications. 28 14

Role of NV for Cloud Computing Challenges in managing virtual networks When you virtualize, you don't have full visibility. If you're a company and you've bought storage, they give you a box and it's got your name on it. You go to that data center and it's yours. When you virtualize, you're essentially being given a service contract that says you have the same amount of storage as if you had your own personal box, but now it could potentially be sitting on many different machines. 29 Role of NV for Cloud Computing Challenges in managing virtual networks With that it becomes much more complex to have visibility. The tools should be developed to enable better management. As you evolve and get into things like virtual machine mobility, it becomes even more about how you keep track of where things are. 30 15

Role of NV for Cloud Computing For good performance and efficiency, it is critical that cloud services are delivered from locations that are the best for the current (dynamically changing) set of users. To achieve this, we expect that services will be hosted on virtual machines in interconnected data centers and that these virtual machines will migrate dynamically to locations best suited for the current user population. A basic network infrastructure need then is the ability to migrate virtual machines across multiple networks without losing service continuity. 31 Role of NV for Cloud Computing Cloud Service Provider Network Virtualization 1.Connectivity Services 2.Network Infrastructure Services Network and IT Resource Pool 32 16

Connectivity Services Provide connectivity services to virtual hosts in Cloud computing Burst up and turn down bandwidth on demand Provide low latency throughput among storage networks, the data center and the LAN Allow for non-blocked connections between servers to enable automated movement of virtual machines (VMs) Function within a management plane that stretches across enterprise and service provider networks Provide visibility despite this constantly changing environment 33 Network Infrastructure Services Provide network infrastructures to users Customized topology Network components Router ---routing algorithm, routing algorithm Links --- bandwidth on demand 34 17

VMware Example 35 Cisco Nexus 100V 36 18

HP Network Automation 37 Force 10 38 19

Blade Network Technologies 39 Arista Networks 40 20

However But the problem gets bigger and more complex when distance dsa ceand dcoudpovde cloud provider entities es become engaged. None of the solutions above address moving a VM from one physical server to another over large distance, be it around town, across state lines, across the country or the globe. Also the problem of moving from one cloud to a different cloud! 41 What is needed? So how can data center networks become more flexible? e? A key element of the solution is the ability to dynamically grow and shrink resources to meet demand and to draw those resources from the most optimal location. Today, the network stands as a barrier to agility and increases the fragmentation of resources which leads to low server utilization and prevents portable or mobile workloads. 42 21

43 VIOLIN Virtual Internetworking on OverLay Infrastructure u -Purdue University VIOLIN: A VN (Virtual Network) for VMs Independent IP address space Invisible from Internet and vice versa Un-tamperable topology and traffic control Value-added d network services (e.g., IP multicast) t) Binary and IP compatible runtime environment 44 22

Architecture of VIOLIN Two mutually Isolated VIOLINs VM NMI:NSF Middleware Initiative NMI-based Grid infrastructure N M I N M I N M I N M I N M I N M I N M I Physical infrastructure Internet 45 PlanetLab Today s Network Applications Ask networks for a bit pipe from point A to point B; application logic runs at the edges Networks 46 23

PlanetLab Future s Network Applications Networks Ask networks for a logical subnet ; application logic runs on them 47 PlanetLab PlanetLab: an open, global network test-bed for pioneering po novel planetary-scale pa eaysca e services A model for introducing innovations into the Internet through the use of overlay networks A common software architecture Distributed virtualization Slice a network of virtual machines Isolation isolate services from each other protect the Internet from PlanetLab 48 24

Slices 49 Slices 50 25

Slices 51 VINI 52 26

VINI 53 CoreLab 54 27

CoreLab 55 CoreLab Deployment (on-going) 56 28

Comparisons 57 Global Environment for Network Innovations 58 29

Global Environment for Network Innovations GENI, a virtual laboratory for exploring future Internets e Experiments in end-to-end virtualized slices 59 MANTICORE II 60 30

FEDERICA http://www.fp7-federica.eu/ 61 FEDERICA 62 31

FEDERICA 63 Cabo Cabo: Concurrent Architectures are Better than One 64 32

65 A Virtual Network in Cloud Computing 66 33

Virtual Network Components Virtual Server Virtual link Virtual switch/bridge Virtual router Resource monitor Virtual network controller o User interface 67 Server Virtualization Full virtualization KVM VMware Paravirtualization (guest host OS may need to be modified) XEN Denali Performance issues Hardware utilization Instruction parallelism for multi-core CPU 68 34

Link Virtualization Time-division multiplexing (TDM) Multi-Protocol Label Switching (MPLS) Tunneling Generic Routing Encapsulation (GRE) Performance issues Simple Fast Flexible Isolated 69 Switch/Bridge Virtualization OpenFlow switch Ethernet switch with flow-table Run experimental protocols in real networks Decrease the work load of the router Embedded in Hypervisor or OS 70 35

Router Virtualization Logical routers (Cisco/Juniper) Run several logical routers in parallel Application Specific Routing Advantages Reconfigurability Mobility Nt Network kcustomization ti 71 Routing Issues Addressing Non IP routing Virtualized object addressing Routing policy Multiple routing paths Energy aware routing Fault lttolerance Multicast Routing protocol Customized routing protocol 72 36

Virtual Network Controller Virtual resource management Virtual resource allocation Virtual network provision Issues Security (Authentication, Authorization, Accounting) QoS Non-blocked connections (Fault tolerance) Visibility Resource utility rate (Load balance) 73 Virtual Network Provision Issues Isolated Resource utility rate (load balance) Non-block connections (Fault tolerance) Extendibility Energy aware (Green) 74 37

75 Conclusions Virtualization is a key-technology to build cloud computing Network Virtualization can support on demand, customizable networks for cloud computing Design Issues Complexity:Virtual lmachines x Virtual Networks Performance, security, privacy, policies, stability, scalability, mobility, interface, heterogeneity, resource discovery, OAM 76 38

Conclusions Networks are an essential part of business, education,,g government, and home communications. Many residential, business, and mobile IP networking trends are being driven largely by a combination of video, social networking and advanced collaboration applications, termed visual networking. The Cisco Visual Networking Index (VNI) is the company's ongoing effort to forecast and analyze the growth and use of IP networks worldwide. 77 Conclusions 78 39

Conclusions By 2014, annual global IP traffic will reach almost three-fourths of a zettabyte e (767 exabytes). A zettabyte is a trillion gigabytes. By 2014, the various forms of video (TV, VoD, Internet Video, and P2P) will exceed 91 percent of global consumer traffic. 79 Conclusions By 2014, global online video will approach 57 percent of consumer Internet e traffic (up from 40 percent in 2010). Globally, mobile data traffic will double every year through 2014, increasing 39 times between 2009 and 2014. 80 40

Conclusions What can we say about the Internet? 81 41