Reliable Distributed Systems

Size: px
Start display at page:

Download "Reliable Distributed Systems"

Transcription

1 Reliable Distributed ystems A glimpse into the world of ontent Distribution Networks Based on a slide set developed by Prof. Paul Francis

2 ontent Routing Principle (a.k.a. ontent Distribution Network) enter enter Backbone IP Backbone IP Backbone IP IP IP IP ite ites

3 ontent Routing Principle (a.k.a. ontent Distribution Network) enter enter O ontent Origin here at Origin erver Backbone IP Backbone IP Backbone IP IP ite IP IP ites ontent ervers distributed throughout the Internet

4 ontent Routing Principle (a.k.a. ontent Distribution Network) enter enter O Backbone Backbone Backbone IP IP IP IP IP IP ite ites ontent is served from content servers nearer to the client

5 Two basic types of DN: cached and pushed enter enter O Backbone Backbone Backbone IP IP IP IP IP IP ite ites

6 ached DN enter enter O 1. lient requests content. Backbone Backbone Backbone IP IP IP IP IP IP ite ites

7 ached DN enter enter O Backbone Backbone Backbone IP IP IP 1. lient requests content. 2. checks cache, if miss gets content from origin server. IP IP IP ite ites

8 ached DN enter Backbone Backbone Backbone IP IP IP enter O 1. lient requests content. 2. checks cache, if miss gets content from origin server. 3. caches content, delivers to client. IP IP IP ite ites

9 ached DN Backbone Backbone Backbone IP IP IP IP enter IP enter O IP ite ites 1. lient requests content. 2. checks cache, if miss gets content from origin server. 3. caches content, delivers to client. 4. Delivers content out of cache on subsequent requests.

10 Pushed DN enter enter O Backbone Backbone Backbone IP IP IP 1. Origin erver pushes content out to all s. IP IP IP ite ites

11 Pushed DN enter enter O Backbone Backbone Backbone IP IP IP 1. Origin erver pushes content out to all s. 2. Request served from s. IP IP IP ite ites

12 DN benefits ontent served closer to client Less latency, better performance Load spread over multiple distributed s More robust (to IP failure as well as other failures) Handle flashes better (load spread over IPs) But well-connected, replicated enters can do this too

13 DN costs and limitations ached DNs can t deal with dynamic/personalized content More and more content is dynamic lassic DNs limited to images Managing content distribution is non-trivial Tension between content lifetimes and cache performance Dynamic cache invalidation Keeping pushed content synchronized and current

14 DN example: Akamai Won huge market share of DN business late 90 s ached approach Now offers full web hosting services in addition to caching services alled edgesuite

15 Akamai caching services ARL: Akamai Resource Locator Host Part Akamai ontrol Part ontent URL /7/620/16/259fdbf4ed29de/ a620.g.akamai.net/ / Thanks to Ratul Mahajan, Univ of Wash, How Akamai Works

16 ARL: Akamai Resource Locator ontent Provider (P) selects which content will be hosted by Akamai. Akamai provides a tool that transforms this P URL into this ARL /7/620/16/259fdbf4ed29de/ a620.g.akamai.net/ /

17 ARL: Akamai Resource Locator This in turn causes the client to access Akamai s content server instead of the origin server. /7/620/16/259fdbf4ed29de/ a620.g.akamai.net/ /

18 ARL: Akamai Resource Locator If Akamai s content server doesn t have the content in its cache, it retrieves it using this URL. /7/620/16/259fdbf4ed29de/ a620.g.akamai.net/ /

19 ARL ontrol Part Type ode ustomer Number (different types (I.e. NN, Yahoo ) will have different contents)??? ontent hecksum (May be used for identifying changed content. May also validate content) /7/620/16/259fdbf4ed29de/ a620.g.akamai.net/ /

20 ARL Host Part But why such a complex domain name???? /7/620/16/259fdbf4ed29de/ a620.g.akamai.net/ /

21 ARL Host Part.net TLD Points to ~8 akamai.net DN servers (random ordering, TTL order of hours to days) akamai.net g.akamai.net a620.g.akamai.net Attempts to select ~8 g.akamai.net DN servers near client. (Using BGP? TTL order of 30 min 1 hour) Makes a very fine-grained load-balancing decision among local content servers. TTL order of 30 sec 1 min.

22 Other content routing mechanisms Dynamic HTML URL re-writing URLs in HTML pages re-written to point at nearby and non-overloaded content server In theory, finer-grained proximity decision Because know true client, not client s DN resolver In practice very hard to be fine-grained learway and Fasttide did this ould in theory put IP address in re-written URL, save a DN lookup But problem if user bookmarks page

23 Other content routing mechanisms HTTP 302 Redirect Directs client to another (closer, load balanced) server For instance, redirect image requests to distributed server, but handle dynamic home page from origin server ee draft-cain-known-request-routing-00.txt for good description of these issues But expired, so use Google to find archived copy

24 How well do DNs work? enter enter O Backbone Backbone Backbone IP IP IP IP IP IP ite ites

25 How well do DNs work? Backbone Backbone Backbone IP IP IP IP enter IP enter O IP ite ites Recall that the bottleneck links are at the edges. Even if s are pushed towards the edge, they are still behind the bottleneck link!

26 Elements of a web page Download DN round trip TP handshake (2 round trips) low-start ~8 round trips to fill DL pipe total 128K bytes ompare to 56 Kbytes for cnn.com home page Download finished before slow-start completes Total 11 round trips Example: U coast-to-coast propagation delay is ~15 ms 30 ms reduction in RTT means 330 ms total reduction ertainly noticeable o if we can reduce latency we can improve tcp (and thus http) performance

27 AT&T tudy Zhang, Krishnamurthy and Wills AT&T Labs Traces taken in ept and Jan ompared DNs with each other ompared DNs against non-dn sites

28 Methodology elected a bunch of DNs Akamai, peedera, Digital Island Note, most of these gone now! elected a number of non-dn sites for which good performance could be expected U.. and international origin U..: Amazon, Bloomberg, NN, EPN, MTV, NAA, Playboy, ony, Yahoo elected a set of images of comparable size for each DN and non-dn site ompare apples to apples Downloaded images from 24 NIMI machines Widely deployed measurement platforms

29 Response Time Results Including DN Lookup Time umulative Probability

30 Response Time Results Including DN Lookup Time About one second umulative Probability Author conclusion: DNs generally provide much shorter download time.

31 DNs out-performed non- DNs Why is this? Lets consider ability to pick good content servers using DN redirection Recall: short DN TTLs give DNs more control over which servers clients can use They compared time to download with a fixed IP address versus the IP address dynamically selected by the DN for each download

32 Effectiveness of DN load balancing

33 Effectiveness of DN load balancing Black: longer download time than fixed IP addr Blue: shorter download time, but total time longer because of DN lookup Green: same IP address chosen Red: shorter total time

34 DN load balancing not very effective

35 Other findings of study Each DN performed best for at least one (NIMI) client Why? Because of proximity? The best origin sites were better than the worst DNs DNs with more servers don t necessarily perform better Note that they don t know load on servers HTTP 1.1 improvements (parallel download, pipelined download) help a lot Even more so for origin (non-dn) cases Note not all origin sites implement pipelining

36 Ultimately a frustrating study Never actually says why DNs perform better, only that they do For all we know, maybe it is because DNs threw more money at the problem More server capacity and bandwidth relative to load

37 Another study Keynote ystems A Performance Analysis of 40 e-business Web ites Doing measurements since 1997 (All from one location, near as one can tell) Latest (publically available) measurement January 2001

38 Historical trend: lear improvement

39 Performance breakdown Basically says that smaller content leads to shorter download times (duh!) Average content size 12K bytes Average content size 44K bytes Average content size 99K bytes

40 Effect of DN: Positive (but again, we don t know why)

41 Most web sites not using DN (4-1) Note: non-dns can work well (DN not always better)

42 ummary DNs still used and still performing well On a par or better than best non-dn web sites DN usage not a huge difference We don t know why DNs perform well But could very well simply be server capacity Knowledge of client location valuable more for customized advertising than for latency Advertisements in right language

CSC2231: Akamai. http://www.cs.toronto.edu/~stefan/courses/csc2231/05au. Stefan Saroiu Department of Computer Science University of Toronto

CSC2231: Akamai. http://www.cs.toronto.edu/~stefan/courses/csc2231/05au. Stefan Saroiu Department of Computer Science University of Toronto CSC2231: Akamai http://www.cs.toronto.edu/~stefan/courses/csc2231/05au Stefan Saroiu Department of Computer Science University of Toronto Administrivia Project proposals due today!!! No lecture on Monday:

More information

How To Test Performance Of A Cdn Server

How To Test Performance Of A Cdn Server On the Use and Performance of Content Distribution Networks Yin Zhang Joint work with Balachander Krishnamurthy and Craig Wills AT&T Labs Research, WPI {yzhang,bala}@research.att.com, cew@cs.wpi.edu ACM

More information

Web Caching and CDNs. Aditya Akella

Web Caching and CDNs. Aditya Akella Web Caching and CDNs Aditya Akella 1 Where can bottlenecks occur? First mile: client to its ISPs Last mile: server to its ISP Server: compute/memory limitations ISP interconnections/peerings: congestion

More information

How To Understand The Power Of A Content Delivery Network (Cdn)

How To Understand The Power Of A Content Delivery Network (Cdn) Overview 5-44 5-44 Computer Networking 5-64 Lecture 8: Delivering Content Content Delivery Networks Peter Steenkiste Fall 04 www.cs.cmu.edu/~prs/5-44-f4 Web Consistent hashing Peer-to-peer CDN Motivation

More information

Measuring the Web: Part I - - Content Delivery Networks. Prof. Anja Feldmann, Ph.D. Dr. Ramin Khalili Georgios Smaragdakis, PhD

Measuring the Web: Part I - - Content Delivery Networks. Prof. Anja Feldmann, Ph.D. Dr. Ramin Khalili Georgios Smaragdakis, PhD Measuring the Web: Part I - - Content Delivery Networks Prof. Anja Feldmann, Ph.D. Dr. Ramin Khalili Georgios Smaragdakis, PhD Acknowledgement Material presented in these slides is borrowed from presentajons

More information

DATA COMMUNICATOIN NETWORKING

DATA COMMUNICATOIN NETWORKING DATA COMMUNICATOIN NETWORKING Instructor: Ouldooz Baghban Karimi Course Book: Computer Networking, A Top-Down Approach, Kurose, Ross Slides: - Course book Slides - Slides from Princeton University COS461

More information

Tema 5: Distribución de contenidos

Tema 5: Distribución de contenidos Tema 5: Distribución de contenidos 1. Introducción. 2. Arquitecturas. Cliente-Servidor Web proxies. Réplica de contenidos. 3. Caching y balanceado de carga 4. Un caso La red Akamai Bibliografía [GIL11]

More information

Content Distribu-on Networks (CDNs)

Content Distribu-on Networks (CDNs) Content Distribu-on Networks (CDNs) Jennifer Rexford COS 461: Computer Networks Lectures: MW 10-10:0am in Architecture N101 hjp://www.cs.princeton.edu/courses/archive/spr12/cos461/ Second Half of the Course

More information

Internet Content Distribution

Internet Content Distribution Internet Content Distribution Chapter 4: Content Distribution Networks (TUD Student Use Only) Chapter Outline Basics of content distribution networks (CDN) Why CDN? How do they work? Client redirection

More information

Communications Software. CSE 123b. CSE 123b. Spring 2003. Lecture 13: Load Balancing/Content Distribution. Networks (plus some other applications)

Communications Software. CSE 123b. CSE 123b. Spring 2003. Lecture 13: Load Balancing/Content Distribution. Networks (plus some other applications) CSE 123b CSE 123b Communications Software Spring 2003 Lecture 13: Load Balancing/Content Distribution Networks (plus some other applications) Stefan Savage Some slides courtesy Srini Seshan Today s class

More information

1. Comments on reviews a. Need to avoid just summarizing web page asks you for:

1. Comments on reviews a. Need to avoid just summarizing web page asks you for: 1. Comments on reviews a. Need to avoid just summarizing web page asks you for: i. A one or two sentence summary of the paper ii. A description of the problem they were trying to solve iii. A summary of

More information

Lecture 3: Scaling by Load Balancing 1. Comments on reviews i. 2. Topic 1: Scalability a. QUESTION: What are problems? i. These papers look at

Lecture 3: Scaling by Load Balancing 1. Comments on reviews i. 2. Topic 1: Scalability a. QUESTION: What are problems? i. These papers look at Lecture 3: Scaling by Load Balancing 1. Comments on reviews i. 2. Topic 1: Scalability a. QUESTION: What are problems? i. These papers look at distributing load b. QUESTION: What is the context? i. How

More information

CDN and Traffic-structure

CDN and Traffic-structure CDN and Traffic-structure Outline Basics CDN Traffic Analysis 2 Outline Basics CDN Building Blocks Services Evolution Traffic Analysis 3 A Centralized Web! Slow content must traverse multiple backbones

More information

From Internet Data Centers to Data Centers in the Cloud

From Internet Data Centers to Data Centers in the Cloud From Internet Data Centers to Data Centers in the Cloud This case study is a short extract from a keynote address given to the Doctoral Symposium at Middleware 2009 by Lucy Cherkasova of HP Research Labs

More information

Distributed Systems. 25. Content Delivery Networks (CDN) 2014 Paul Krzyzanowski. Rutgers University. Fall 2014

Distributed Systems. 25. Content Delivery Networks (CDN) 2014 Paul Krzyzanowski. Rutgers University. Fall 2014 Distributed Systems 25. Content Delivery Networks (CDN) Paul Krzyzanowski Rutgers University Fall 2014 November 16, 2014 2014 Paul Krzyzanowski 1 Motivation Serving web content from one location presents

More information

Distributed Systems. 24. Content Delivery Networks (CDN) 2013 Paul Krzyzanowski. Rutgers University. Fall 2013

Distributed Systems. 24. Content Delivery Networks (CDN) 2013 Paul Krzyzanowski. Rutgers University. Fall 2013 Distributed Systems 24. Content Delivery Networks (CDN) Paul Krzyzanowski Rutgers University Fall 2013 November 27, 2013 2013 Paul Krzyzanowski 1 Motivation Serving web content from one location presents

More information

On the Use and Performance of Content Distribution Networks

On the Use and Performance of Content Distribution Networks ACM SIGCOMM INTERNET MEASUREMENT WORKSHOP 2001 1 On the Use and Performance of Content Distribution Networks Balachander Krishnamurthy, Craig Wills, Yin Zhang Abstract Content distribution networks (CDNs)

More information

Request Routing, Load-Balancing and Fault- Tolerance Solution - MediaDNS

Request Routing, Load-Balancing and Fault- Tolerance Solution - MediaDNS White paper Request Routing, Load-Balancing and Fault- Tolerance Solution - MediaDNS June 2001 Response in Global Environment Simply by connecting to the Internet, local businesses transform themselves

More information

Distributed Systems 19. Content Delivery Networks (CDN) Paul Krzyzanowski pxk@cs.rutgers.edu

Distributed Systems 19. Content Delivery Networks (CDN) Paul Krzyzanowski pxk@cs.rutgers.edu Distributed Systems 19. Content Delivery Networks (CDN) Paul Krzyzanowski pxk@cs.rutgers.edu 1 Motivation Serving web content from one location presents problems Scalability Reliability Performance Flash

More information

Distributed Systems. 23. Content Delivery Networks (CDN) Paul Krzyzanowski. Rutgers University. Fall 2015

Distributed Systems. 23. Content Delivery Networks (CDN) Paul Krzyzanowski. Rutgers University. Fall 2015 Distributed Systems 23. Content Delivery Networks (CDN) Paul Krzyzanowski Rutgers University Fall 2015 November 17, 2015 2014-2015 Paul Krzyzanowski 1 Motivation Serving web content from one location presents

More information

Measuring CDN Performance. Hooman Beheshti, VP Technology

Measuring CDN Performance. Hooman Beheshti, VP Technology Measuring CDN Performance Hooman Beheshti, VP Technology Why this matters Performance is one of the main reasons we use a CDN Seems easy to measure, but isn t Performance is an easy way to comparison shop

More information

Global Server Load Balancing

Global Server Load Balancing White Paper Overview Many enterprises attempt to scale Web and network capacity by deploying additional servers and increased infrastructure at a single location, but centralized architectures are subject

More information

Content Delivery Networks (CDN) Dr. Yingwu Zhu

Content Delivery Networks (CDN) Dr. Yingwu Zhu Content Delivery Networks (CDN) Dr. Yingwu Zhu Web Cache Architecure Local ISP cache cdn Reverse Reverse Proxy Reverse Proxy Reverse Proxy Proxy L4 Switch Content Content Content Server Content Server

More information

CS514: Intermediate Course in Computer Systems

CS514: Intermediate Course in Computer Systems : Intermediate Course in Computer Systems Lecture 7: Sept. 19, 2003 Load Balancing Options Sources Lots of graphics and product description courtesy F5 website (www.f5.com) I believe F5 is market leader

More information

Overlay Networks. Slides adopted from Prof. Böszörményi, Distributed Systems, Summer 2004.

Overlay Networks. Slides adopted from Prof. Böszörményi, Distributed Systems, Summer 2004. Overlay Networks An overlay is a logical network on top of the physical network Routing Overlays The simplest kind of overlay Virtual Private Networks (VPN), supported by the routers If no router support

More information

Content Delivery Network. Version 0.95

Content Delivery Network. Version 0.95 Content Delivery Network Version 0.95 2014 CrownPeak Technology, Inc. All rights reserved. No part of this document may be reproduced or transmitted in any form or by any means, electronic or mechanical,

More information

AKAMAI WHITE PAPER. Delivering Dynamic Web Content in Cloud Computing Applications: HTTP resource download performance modelling

AKAMAI WHITE PAPER. Delivering Dynamic Web Content in Cloud Computing Applications: HTTP resource download performance modelling AKAMAI WHITE PAPER Delivering Dynamic Web Content in Cloud Computing Applications: HTTP resource download performance modelling Delivering Dynamic Web Content in Cloud Computing Applications 1 Overview

More information

The Measured Performance of Content Distribution Networks

The Measured Performance of Content Distribution Networks The Measured Performance of Content Distribution Networks Kirk L. Johnson, John F. Carr, Mark S. Day, M. Frans Kaashoek SightPath, Inc. 135 Beaver Street, Waltham, MA 02452, USA Abstract We have measured

More information

High volume Internet data centers. MPLS-based Request Routing. Current dispatcher technology. MPLS-based architecture

High volume Internet data centers. MPLS-based Request Routing. Current dispatcher technology. MPLS-based architecture MPLS-based Request Routing High volume Internet data centers MPLS-based Request Routing Arup Acharya, Anees Shaikh, Renu Tewari, Dinesh Verma IBM TJ Watson Research Center Web server cluster + front-end

More information

Final for ECE374 05/06/13 Solution!!

Final for ECE374 05/06/13 Solution!! 1 Final for ECE374 05/06/13 Solution!! Instructions: Put your name and student number on each sheet of paper! The exam is closed book. You have 90 minutes to complete the exam. Be a smart exam taker -

More information

Open Issues in Content Distribution

Open Issues in Content Distribution Open Issues in Content Distribution Pablo Rodriguez Systems and Networking Department Microsoft Research, Cambridge. UK pablo@microsoft.com Rodriguez 1 The Problem The Internet has been growing very fast,

More information

Homework 2 assignment for ECE374 Posted: 02/21/14 Due: 02/28/14

Homework 2 assignment for ECE374 Posted: 02/21/14 Due: 02/28/14 1 Homework 2 assignment for ECE374 Posted: 02/21/14 Due: 02/28/14 Note: In all written assignments, please show as much of your work as you can. Even if you get a wrong answer, you can get partial credit

More information

Content Delivery Networks

Content Delivery Networks Content Delivery Networks Hamid R. Rabiee Mostafaalehi, Fatemeh Dabiran, HodaAyatollahi We have used the resources mentioned in the Reference section of this presentation (on page 47) to prepare this lecture.

More information

Traffic delivery evolution in the Internet ENOG 4 Moscow 23 rd October 2012

Traffic delivery evolution in the Internet ENOG 4 Moscow 23 rd October 2012 Traffic delivery evolution in the Internet ENOG 4 Moscow 23 rd October 2012 January 29th, 2008 Christian Kaufmann Director Network Architecture Akamai Technologies, Inc. way-back machine Web 1998 way-back

More information

A Precise and Efficient Evaluation of the Proximity between Web Clients

A Precise and Efficient Evaluation of the Proximity between Web Clients A Precise and Efficient Evaluation of the Proximity between Web Clients and their Local DNS Servers Zhuoqing Morley Mao, Charles D. Cranor, Fred Douglis, Michael Rabinovich, Oliver Spatscheck, and Jia

More information

First Midterm for ECE374 02/25/15 Solution!!

First Midterm for ECE374 02/25/15 Solution!! 1 First Midterm for ECE374 02/25/15 Solution!! Instructions: Put your name and student number on each sheet of paper! The exam is closed book. You have 90 minutes to complete the exam. Be a smart exam

More information

Content Delivery Networks. Shaxun Chen April 21, 2009

Content Delivery Networks. Shaxun Chen April 21, 2009 Content Delivery Networks Shaxun Chen April 21, 2009 Outline Introduction to CDN An Industry Example: Akamai A Research Example: CDN over Mobile Networks Conclusion Outline Introduction to CDN An Industry

More information

Akamai CDN, IPv6 and DNS security. Christian Kaufmann Akamai Technologies DENOG 5 14 th November 2013

Akamai CDN, IPv6 and DNS security. Christian Kaufmann Akamai Technologies DENOG 5 14 th November 2013 Akamai CDN, IPv6 and DNS security Christian Kaufmann Akamai Technologies DENOG 5 14 th November 2013 Agenda Akamai Introduction Who s Akamai? Intelligent Platform & Traffic Snapshot Basic Technology Akamai

More information

Overview. Tor Circuit Setup (1) Tor Anonymity Network

Overview. Tor Circuit Setup (1) Tor Anonymity Network 8-345: Introduction to Telecommunication Networks Lectures 8: Delivering Content Web, Peer-Peer, CDNs Peter Steenkiste Spring 05 www.cs.cmu.edu/~prs/nets-ece Web Peer-to-peer Motivation Architectures TOR

More information

Rapid IP redirection with SDN and NFV. Jeffrey Lai, Qiang Fu, Tim Moors December 9, 2015

Rapid IP redirection with SDN and NFV. Jeffrey Lai, Qiang Fu, Tim Moors December 9, 2015 Rapid IP redirection with SDN and NFV Jeffrey Lai, Qiang Fu, Tim Moors December 9, 2015 Background Enabling ISP-CDN collaboration SDN, NFV, CDN Basics Client assumptions And breaking them The problem My

More information

The Value of Content Distribution Networks Mike Axelrod, Google axelrod@google.com. Google Public

The Value of Content Distribution Networks Mike Axelrod, Google axelrod@google.com. Google Public The Value of Content Distribution Networks Mike Axelrod, Google axelrod@google.com Introduction Well understood facts: o Fast is better than slow but it costs more to be fast o Network has to be fast and

More information

Internet Content Distribution

Internet Content Distribution Internet Content Distribution Chapter 2: Server-Side Techniques (TUD Student Use Only) Chapter Outline Server-side techniques for content distribution Goals Mirrors Server farms Surrogates DNS load balancing

More information

Front-End Performance Testing and Optimization

Front-End Performance Testing and Optimization Front-End Performance Testing and Optimization Abstract Today, web user turnaround starts from more than 3 seconds of response time. This demands performance optimization on all application levels. Client

More information

COMP 631: COMPUTER NETWORKS. How to distribute content without requiring centralized, heavy-duty servers? Peer-to-peer content distribution

COMP 631: COMPUTER NETWORKS. How to distribute content without requiring centralized, heavy-duty servers? Peer-to-peer content distribution Content Distribution How to distribute content without requiring centralized, heavy-duty servers? Examples: Ø Bittorrent Peer-to-peer content distribution Ø Akamai Content distribution service 20 Bottlenecks

More information

Content Delivery Networks

Content Delivery Networks Content Delivery Networks Terena 2000 ftp://ftpeng.cisco.com/sgai/t2000cdn.pdf Silvano Gai Cisco Systems, USA Politecnico di Torino, IT sgai@cisco.com Terena 2000 1 Agenda What are Content Delivery Networks?

More information

Computer Networks - CS132/EECS148 - Spring 2013 ------------------------------------------------------------------------------

Computer Networks - CS132/EECS148 - Spring 2013 ------------------------------------------------------------------------------ Computer Networks - CS132/EECS148 - Spring 2013 Instructor: Karim El Defrawy Assignment 2 Deadline : April 25 th 9:30pm (hard and soft copies required) ------------------------------------------------------------------------------

More information

ICP. Cache Hierarchies. Squid. Squid Cache ICP Use. Squid. Squid

ICP. Cache Hierarchies. Squid. Squid Cache ICP Use. Squid. Squid Caching & CDN s 15-44: Computer Networking L-21: Caching and CDNs HTTP APIs Assigned reading [FCAB9] Summary Cache: A Scalable Wide- Area Cache Sharing Protocol [Cla00] Freenet: A Distributed Anonymous

More information

The Effectiveness of Request Redirection on CDN Robustness

The Effectiveness of Request Redirection on CDN Robustness The Effectiveness of Request Redirection on CDN Robustness Limin Wang, Vivek Pai and Larry Peterson Presented by: Eric Leshay Ian McBride Kai Rasmussen 1 Outline! Introduction! Redirection Strategies!

More information

DNS ROUND ROBIN HIGH-AVAILABILITY LOAD SHARING

DNS ROUND ROBIN HIGH-AVAILABILITY LOAD SHARING PolyServe High-Availability Server Clustering for E-Business 918 Parker Street Berkeley, California 94710 (510) 665-2929 wwwpolyservecom Number 990903 WHITE PAPER DNS ROUND ROBIN HIGH-AVAILABILITY LOAD

More information

Demand Routing in Network Layer for Load Balancing in Content Delivery Networks

Demand Routing in Network Layer for Load Balancing in Content Delivery Networks Demand Routing in Network Layer for Load Balancing in Content Delivery Networks # A SHRAVANI, 1 M.Tech, Computer Science Engineering E mail: sravaniathome@gmail.com # SYED ABDUL MOEED 2 Asst.Professor,

More information

OpenFlow Based Load Balancing

OpenFlow Based Load Balancing OpenFlow Based Load Balancing Hardeep Uppal and Dane Brandon University of Washington CSE561: Networking Project Report Abstract: In today s high-traffic internet, it is often desirable to have multiple

More information

DNS, CDNs Weds March 17 2010 Lecture 13. What is the relationship between a domain name (e.g., youtube.com) and an IP address?

DNS, CDNs Weds March 17 2010 Lecture 13. What is the relationship between a domain name (e.g., youtube.com) and an IP address? DNS, CDNs Weds March 17 2010 Lecture 13 DNS What is the relationship between a domain name (e.g., youtube.com) and an IP address? DNS is the system that determines this mapping. Basic idea: You contact

More information

The Web History (I) The Web History (II)

The Web History (I) The Web History (II) Goals of Today s Lecture EE 122: The World Wide Web Ion Stoica TAs: Junda Liu, DK Moon, David Zats http://inst.eecs.berkeley.edu/~ee122/ (Materials with thanks to Vern Paxson, Jennifer Rexford, and colleagues

More information

GLOBAL SERVER LOAD BALANCING WITH SERVERIRON

GLOBAL SERVER LOAD BALANCING WITH SERVERIRON APPLICATION NOTE GLOBAL SERVER LOAD BALANCING WITH SERVERIRON Growing Global Simply by connecting to the Internet, local businesses transform themselves into global ebusiness enterprises that span the

More information

Hashing in Networked Systems

Hashing in Networked Systems LB Server Cluster Switches Hashing in Networked Systems COS 461: Computer Networks Spring 2011 Mike Freedman h@p://www.cs.princeton.edu/courses/archive/spring11/cos461/ 2 Hash funcion Hashing FuncIon that

More information

Load Balancing in Distributed Web Server Systems With Partial Document Replication

Load Balancing in Distributed Web Server Systems With Partial Document Replication Load Balancing in Distributed Web Server Systems With Partial Document Replication Ling Zhuo, Cho-Li Wang and Francis C. M. Lau Department of Computer Science and Information Systems The University of

More information

Update logo and logo link on A Master. Update Date and Product on B Master

Update logo and logo link on A Master. Update Date and Product on B Master Cover Be sure to: Update META data Update logo and logo link on A Master Update Date and Product on B Master Web Performance Metrics 101 Contents Preface...3 Response Time...4 DNS Resolution Time... 4

More information

Computer Networking LAB 2 HTTP

Computer Networking LAB 2 HTTP Computer Networking LAB 2 HTTP 1 OBJECTIVES The basic GET/response interaction HTTP message formats Retrieving large HTML files Retrieving HTML files with embedded objects HTTP authentication and security

More information

If you are considering a cloud infrastructure, your first questions should be:

If you are considering a cloud infrastructure, your first questions should be: Where is this cloud thing anyway? By Peter van Eijk, independent IT consultant. Introducing Cloud Performance. CMG has a long tradition of adapting to new technologies. The cloud is no exception. Computing

More information

bbc Adobe LiveCycle Data Services Using the F5 BIG-IP LTM Introduction APPLIES TO CONTENTS

bbc Adobe LiveCycle Data Services Using the F5 BIG-IP LTM Introduction APPLIES TO CONTENTS TECHNICAL ARTICLE Adobe LiveCycle Data Services Using the F5 BIG-IP LTM Introduction APPLIES TO Adobe LiveCycle Enterprise Suite CONTENTS Introduction................................. 1 Edge server architecture......................

More information

Indirection. science can be solved by adding another level of indirection" -- Butler Lampson. "Every problem in computer

Indirection. science can be solved by adding another level of indirection -- Butler Lampson. Every problem in computer Indirection Indirection: rather than reference an entity directly, reference it ( indirectly ) via another entity, which in turn can or will access the original entity A x B "Every problem in computer

More information

Dynamic Content Acceleration: Lightning-Fast Web Apps with Amazon CloudFront and Amazon Route 53

Dynamic Content Acceleration: Lightning-Fast Web Apps with Amazon CloudFront and Amazon Route 53 Dynamic Content Acceleration: Lightning-Fast Web Apps with Amazon CloudFront and Amazon Route 53 Constantin Gonzalez, Solutions Architect Amazon Web Services Germany GmbH 2014 Amazon.com, Inc. and its

More information

Advanced Computer Networks. Layer-7-Switching and Loadbalancing

Advanced Computer Networks. Layer-7-Switching and Loadbalancing Oriana Riva, Department of Computer Science ETH Zürich Advanced Computer Networks 263-3501-00 Layer-7-Switching and Loadbalancing Patrick Stuedi, Qin Yin and Timothy Roscoe Spring Semester 2015 Outline

More information

LOAD BALANCING TECHNIQUES FOR RELEASE 11i AND RELEASE 12 E-BUSINESS ENVIRONMENTS

LOAD BALANCING TECHNIQUES FOR RELEASE 11i AND RELEASE 12 E-BUSINESS ENVIRONMENTS LOAD BALANCING TECHNIQUES FOR RELEASE 11i AND RELEASE 12 E-BUSINESS ENVIRONMENTS Venkat Perumal IT Convergence Introduction Any application server based on a certain CPU, memory and other configurations

More information

SiteCelerate white paper

SiteCelerate white paper SiteCelerate white paper Arahe Solutions SITECELERATE OVERVIEW As enterprises increases their investment in Web applications, Portal and websites and as usage of these applications increase, performance

More information

EE 7376: Introduction to Computer Networks. Homework #3: Network Security, Email, Web, DNS, and Network Management. Maximum Points: 60

EE 7376: Introduction to Computer Networks. Homework #3: Network Security, Email, Web, DNS, and Network Management. Maximum Points: 60 EE 7376: Introduction to Computer Networks Homework #3: Network Security, Email, Web, DNS, and Network Management Maximum Points: 60 1. Network security attacks that have to do with eavesdropping on, or

More information

Akamai CDN, IPv6 and DNS security. Christian Kaufmann Akamai Technologies APNIC 36 26 th August 2013

Akamai CDN, IPv6 and DNS security. Christian Kaufmann Akamai Technologies APNIC 36 26 th August 2013 Akamai CDN, IPv6 and DNS security Christian Kaufmann Akamai Technologies APNIC 36 26 th August 2013 Agenda Akamai Introduction Who s Akamai? Intelligent Platform & Traffic Snapshot Basic Technology Akamai

More information

Web Page Response Time

Web Page Response Time Measurement & Analysis Web Page Response Understanding and measuring performance test results by Alberto Savoia 101 Human beings don t like to wait. We don t like waiting in line at a store, we don t like

More information

Web Application Hosting Cloud Architecture

Web Application Hosting Cloud Architecture Web Application Hosting Cloud Architecture Executive Overview This paper describes vendor neutral best practices for hosting web applications using cloud computing. The architectural elements described

More information

The Domain Name Service, Etc. Jeff Chase Duke University, Department of Computer Science CPS 212: Distributed Information Systems

The Domain Name Service, Etc. Jeff Chase Duke University, Department of Computer Science CPS 212: Distributed Information Systems The Domain Name Service, Etc. Jeff Chase Duke University, Department of Computer Science CPS 212: Distributed Information Systems Today 1. Domain Name Service (DNS) illustrates: issues and structure for

More information

Responsive Web Design: A Three-Screen Study in Site Performance

Responsive Web Design: A Three-Screen Study in Site Performance 1 June 17, 2014 Responsive Web Design: A Three-Screen Study in Site Performance Ken Harker Senior Consultant ken.harker@keynote.com Keynote Consulting Mobile Research Summit: Data & Insights 2014 June

More information

Load Balancing Web Applications

Load Balancing Web Applications Mon Jan 26 2004 18:14:15 America/New_York Published on The O'Reilly Network (http://www.oreillynet.com/) http://www.oreillynet.com/pub/a/onjava/2001/09/26/load.html See this if you're having trouble printing

More information

First Midterm for ECE374 03/24/11 Solution!!

First Midterm for ECE374 03/24/11 Solution!! 1 First Midterm for ECE374 03/24/11 Solution!! Note: In all written assignments, please show as much of your work as you can. Even if you get a wrong answer, you can get partial credit if you show your

More information

DNS records. RR format: (name, value, type, TTL) Type=NS

DNS records. RR format: (name, value, type, TTL) Type=NS DNS records RR format: (name, value, type, TTL) Type=A name is hostname value is IP address Type=NS name is domain (e.g. foo.com) value is hostname of authoritative name server for this domain Type=CNAME

More information

The State of the Email Address. Mike Afergan Rob Beverly January 27, 2005

The State of the Email Address. Mike Afergan Rob Beverly January 27, 2005 The State of the Email Address Mike Afergan Rob Beverly January 27, 2005 Emailtester - Outline Motivation/Goals/Background Methodology Results Questions Motivation/Goals/Background Motivation Electronic

More information

FortiBalancer: Global Server Load Balancing WHITE PAPER

FortiBalancer: Global Server Load Balancing WHITE PAPER FortiBalancer: Global Server Load Balancing WHITE PAPER FORTINET FortiBalancer: Global Server Load Balancing PAGE 2 Introduction Scalability, high availability and performance are critical to the success

More information

Homework Assignment #3 Due 11/20 at 5:00pm EE122 Fall 2012

Homework Assignment #3 Due 11/20 at 5:00pm EE122 Fall 2012 Homework Assignment #3 Due 11/20 at 5:00pm EE122 Fall 2012 Please submit your solutions using BSpace (https://bspace.berkeley.edu/). Log in to BSpace with your CalNet ID, click on the EL ENG 122 Fa12 tab,

More information

Department of Computer Science Institute for System Architecture, Chair for Computer Networks. Caching, Content Distribution and Load Balancing

Department of Computer Science Institute for System Architecture, Chair for Computer Networks. Caching, Content Distribution and Load Balancing Department of Computer Science Institute for System Architecture, Chair for Computer Networks Caching, Content Distribution and Load Balancing Motivation Which optimization means do exist? Where should

More information

How To Load Balance On A Bgg On A Network With A Network (Networking) On A Pc Or Ipa On A Computer Or Ipad On A 2G Network On A Microsoft Ipa (Netnet) On An Ip

How To Load Balance On A Bgg On A Network With A Network (Networking) On A Pc Or Ipa On A Computer Or Ipad On A 2G Network On A Microsoft Ipa (Netnet) On An Ip Globally Distributed Content (Using BGP to Take Over the World) Horms (Simon Horman) horms@vergenet.net November 2001 http://supersparrow.org/ 1 Introduction Electronic content is becoming increasingly

More information

Week 3 / Paper 2. Bernhard Ager, Wolfgang Mühlbauer, Georgios Smaragdakis, Steve Uhlig ACM IMC 2010.

Week 3 / Paper 2. Bernhard Ager, Wolfgang Mühlbauer, Georgios Smaragdakis, Steve Uhlig ACM IMC 2010. Week 3 / Paper 2 Comparing DNS Resolvers in the Wild Bernhard Ager, Wolfgang Mühlbauer, Georgios Smaragdakis, Steve Uhlig ACM IMC 2010. Main point How does ISP DNS compare with Google DNS and OpenDNS?

More information

The Effect of Caches for Mobile Broadband Internet Access

The Effect of Caches for Mobile Broadband Internet Access The Effect of s for Mobile Jochen Eisl, Nokia Siemens Networks, Munich, Germany Haßlinger, Deutsche Telekom Technik,, Darmstadt, Germany IP-based content delivery: CDN & cache architecture Impact of access

More information

COMP 361 Computer Communications Networks. Fall Semester 2003. Midterm Examination

COMP 361 Computer Communications Networks. Fall Semester 2003. Midterm Examination COMP 361 Computer Communications Networks Fall Semester 2003 Midterm Examination Date: October 23, 2003, Time 18:30pm --19:50pm Name: Student ID: Email: Instructions: 1. This is a closed book exam 2. This

More information

Project #2. CSE 123b Communications Software. HTTP Messages. HTTP Basics. HTTP Request. HTTP Request. Spring 2002. Four parts

Project #2. CSE 123b Communications Software. HTTP Messages. HTTP Basics. HTTP Request. HTTP Request. Spring 2002. Four parts CSE 123b Communications Software Spring 2002 Lecture 11: HTTP Stefan Savage Project #2 On the Web page in the next 2 hours Due in two weeks Project reliable transport protocol on top of routing protocol

More information

CDN Brokering. Content Distribution Internetworking

CDN Brokering. Content Distribution Internetworking CDN Brokering Alex Biliris, Chuck Cranor, Fred Douglis, Michael Rabinovich, Sandeep Sibal, Oliver Spatscheck, and Walter Sturm AT&T Labs--Research March 12, 2001 Content Distribution Internetworking Definition:

More information

Handling Flash Crowds From Your Garage

Handling Flash Crowds From Your Garage Handling Flash Crowds From Your Garage Jeremy Elson and Jon Howell Microsoft Research USENIX ATC 2008 Scaling For Many Users Scaling For Many Users... quickly Scaling For Many Users... quickly... on a

More information

First Midterm for ECE374 03/09/12 Solution!!

First Midterm for ECE374 03/09/12 Solution!! 1 First Midterm for ECE374 03/09/12 Solution!! Instructions: Put your name and student number on each sheet of paper! The exam is closed book. You have 90 minutes to complete the exam. Be a smart exam

More information

Drafting Behind Akamai (Travelocity-Based Detouring)

Drafting Behind Akamai (Travelocity-Based Detouring) Drafting Behind Akamai (Travelocity-Based Detouring) Ao-Jan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabián E. Bustamante Department of Electrical Engineering and Computer Science Northwestern

More information

1 Introduction to Internet Content Distribution

1 Introduction to Internet Content Distribution OS 521: Advanced Algorithm Design Hashing / ontent Distribution 02/09/12 Scribe: Shilpa Nadimpalli Professor: Sanjeev Arora 1 Introduction to Internet ontent Distribution 1.1 The Hot-Spot Problem 1 ertain

More information

Content Delivery Networks

Content Delivery Networks Content Delivery Networks Silvano Gai Cisco Systems, USA Politecnico di Torino, IT sgai@cisco.com 1 Agenda What are Content Delivery Networks? DNS based routing Server Load Balancing Content Routers Ethical

More information

1 Introduction: Network Applications

1 Introduction: Network Applications 1 Introduction: Network Applications Some Network Apps E-mail Web Instant messaging Remote login P2P file sharing Multi-user network games Streaming stored video clips Internet telephone Real-time video

More information

Global Server Load Balancing

Global Server Load Balancing White Paper Global Server Load Balancing APV Series Application Delivery Controllers May 2011 Global Server Load Balancing Access. Security. Delivery. Introduction Scalability, high availability and performance

More information

CDN Brokering. Alexandros Biliris, Chuck Cranor, Fred Douglis, Michael Rabinovich, Sandeep Sibal, Oliver Spatscheck, and Walter Sturm

CDN Brokering. Alexandros Biliris, Chuck Cranor, Fred Douglis, Michael Rabinovich, Sandeep Sibal, Oliver Spatscheck, and Walter Sturm CDN Brokering Alexandros Biliris, Chuck Cranor, Fred Douglis, Michael Rabinovich, Sandeep Sibal, Oliver Spatscheck, and Walter Sturm AT&T Florham Park, NJ Abstract Content distribution networks (CDNs)

More information

FortiGate Multi-Threat Security Systems I

FortiGate Multi-Threat Security Systems I FortiGate Multi-Threat Security Systems I Module 9: Web Filtering 2013 Fortinet Inc. All rights reserved. The information contained herein is subject to change without notice. No part of this publication

More information

Effect of anycast on K-root

Effect of anycast on K-root Effect of anycast on K-root Some early results 1 K root anycast deployment 3 global nodes (BGP transit) LINX... 5459 25152 25152 i AMS-IX... 25152 25152 25152 i Tokyo (since 5/2005)... 25152 25152 25152

More information

An In-depth study of Mobile Browser Performance

An In-depth study of Mobile Browser Performance An In-depth study of Mobile Browser Performance Javad Nejati jnejati@cs.stonybrook.edu Aruna Balasubramanian arunab@cs.stonybrook.edu ABSTRACT Mobile page load times are an order of magnitude slower compared

More information

How To Model The Content Delivery Network (Cdn) From A Content Bridge To A Cloud (Cloud)

How To Model The Content Delivery Network (Cdn) From A Content Bridge To A Cloud (Cloud) Kingston University London In network content caching contributing to the Future Internet Architecture Dissertation submitted for the Degree of Master of Science in Networking and Data Communications By

More information

Broadband Quality Test Plan

Broadband Quality Test Plan Broadband Quality Test Plan Version 1.2 December 2007 Page 1 Table of Contents 1 EXPERIMENT DESIGN... 3 1.1 METRICS... 3 1.2 DESTINATIONS...4 1.3 MEASUREMENT TECHNIQUES... 6 2 TEST SETUP... 7 2.1 ISPS

More information

EECS 489 Winter 2010 Midterm Exam

EECS 489 Winter 2010 Midterm Exam EECS 489 Winter 2010 Midterm Exam Name: This is an open-book, open-resources exam. Explain or show your work for each question. Your grade will be severely deducted if you don t show your work, even if

More information

Scaling with Zeus Global Load Balancer

Scaling with Zeus Global Load Balancer White Paper Scaling with Zeus Global Load Balancer Zeus. Why wait Contents Introduction... 3 Server Load Balancing within a Datacenter... 3 Global Server Load Balancing between Datacenters... 3 Who might

More information