Robust and Seamless Control Flow for Load Balancing in Content Delivery Networks



Similar documents
Efficient Parallel Distributed Load Balancing in Content Delivery Networks

AN EFFICIENT DISTRIBUTED CONTROL LAW FOR LOAD BALANCING IN CONTENT DELIVERY NETWORKS

Demand Routing in Network Layer for Load Balancing in Content Delivery Networks

Scheduling Allowance Adaptability in Load Balancing technique for Distributed Systems

DESIGN OF CLUSTER OF SIP SERVER BY LOAD BALANCER

Efficient DNS based Load Balancing for Bursty Web Application Traffic

How To Balance A Web Server With Remaining Capacity

AN EFFICIENT STRATEGY OF AGGREGATE SECURE DATA TRANSMISSION

CDN and Traffic-structure

ISSN Vol.04,Issue.19, June-2015, Pages:

G.Vijaya kumar et al, Int. J. Comp. Tech. Appl., Vol 2 (5),

LOAD BALANCING AS A STRATEGY LEARNING TASK

MAXIMIZING RESTORABLE THROUGHPUT IN MPLS NETWORKS

AN EFFICIENT LOAD BALANCING ALGORITHM FOR A DISTRIBUTED COMPUTER SYSTEM. Dr. T.Ravichandran, B.E (ECE), M.E(CSE), Ph.D., MISTE.,

Web Caching and CDNs. Aditya Akella

Overlay Networks. Slides adopted from Prof. Böszörményi, Distributed Systems, Summer 2004.

A Network Recovery Scheme for Node or Link Failures using Multiple Routing Configurations

Improving Performance and Reliability Using New Load Balancing Strategy with Large Public Cloud

International Journal of Combined Research & Development (IJCRD ) eissn: x; pissn: Volume: 2; Issue: 5; May -2014

Distributed Systems. 23. Content Delivery Networks (CDN) Paul Krzyzanowski. Rutgers University. Fall 2015

Performance Analysis of AQM Schemes in Wired and Wireless Networks based on TCP flow

Internet Content Distribution

The Effect of Caches for Mobile Broadband Internet Access

Data Center Content Delivery Network

Self Reconfigurable Distributed Load Balancing For Secure and Privacy-Preserving Information Brokering.

Content Delivery Networks. Shaxun Chen April 21, 2009

Measuring the Web: Part I - - Content Delivery Networks. Prof. Anja Feldmann, Ph.D. Dr. Ramin Khalili Georgios Smaragdakis, PhD

Protagonist International Journal of Management And Technology (PIJMT)

Optimizing Congestion in Peer-to-Peer File Sharing Based on Network Coding

Towards a Peer-to-Peer Extended Content Delivery Network

LOAD BALANCING IN WEB SERVER

Real-Time Analysis of CDN in an Academic Institute: A Simulation Study

Content Delivery Networks (CDN) Dr. Yingwu Zhu

Internet Content Distribution

International Journal of Advanced Research in Computer Science and Software Engineering

SHIV SHAKTI International Journal of in Multidisciplinary and Academic Research (SSIJMAR) Vol. 4, No. 3, June 2015 (ISSN )

High Performance Cluster Support for NLB on Window

Analysing the impact of CDN based service delivery on traffic engineering

Enhancing Data Security in Cloud Storage Auditing With Key Abstraction

Development of enhanced Third party Auditing Scheme for Secure Cloud Storage

A Comparison Study of Qos Using Different Routing Algorithms In Mobile Ad Hoc Networks

A Novel Approach for Load Balancing In Heterogeneous Cellular Network

Public Cloud Partition Balancing and the Game Theory

John S. Otto Fabián E. Bustamante

A Review on Efficient File Sharing in Clustered P2P System

EFFECTIVE DATA RECOVERY FOR CONSTRUCTIVE CLOUD PLATFORM

Distributed Systems. 25. Content Delivery Networks (CDN) 2014 Paul Krzyzanowski. Rutgers University. Fall 2014

A Fast Path Recovery Mechanism for MPLS Networks

Indirection. science can be solved by adding another level of indirection" -- Butler Lampson. "Every problem in computer

Content Delivery Networks

Load Balancing of Web Server System Using Service Queue Length

High volume Internet data centers. MPLS-based Request Routing. Current dispatcher technology. MPLS-based architecture

The International Journal Of Science & Technoledge (ISSN X)

Lecture 3: Scaling by Load Balancing 1. Comments on reviews i. 2. Topic 1: Scalability a. QUESTION: What are problems? i. These papers look at

Flexible Deterministic Packet Marking: An IP Traceback Scheme Against DDOS Attacks

ACL Based Dynamic Network Reachability in Cross Domain

CDN Brokering. Content Distribution Internetworking

A Novel Pathway for Portability of Networks and Handing-on between Networks

Evaluating Cooperative Web Caching Protocols for Emerging Network Technologies 1

Global Server Load Balancing

Distributed Systems 19. Content Delivery Networks (CDN) Paul Krzyzanowski

CURTAIL THE EXPENDITURE OF BIG DATA PROCESSING USING MIXED INTEGER NON-LINEAR PROGRAMMING

DATA COMMUNICATOIN NETWORKING

1. Comments on reviews a. Need to avoid just summarizing web page asks you for:

EFFICIENT DETECTION IN DDOS ATTACK FOR TOPOLOGY GRAPH DEPENDENT PERFORMANCE IN PPM LARGE SCALE IPTRACEBACK

A Comparative Study of Signalling Protocols Used In VoIP

An Active Packet can be classified as

Department of Computer Science Institute for System Architecture, Chair for Computer Networks. Caching, Content Distribution and Load Balancing

How To Understand The Power Of A Content Delivery Network (Cdn)

An Empirical Approach - Distributed Mobility Management for Target Tracking in MANETs

TCP, Active Queue Management and QoS

Network Mobility Support Scheme on PMIPv6 Networks

OpenFlow Based Load Balancing

MANAGING OF IMMENSE CLOUD DATA BY LOAD BALANCING STRATEGY. Sara Anjum 1, B.Manasa 2

ANALYSIS OF LONG DISTANCE 3-WAY CONFERENCE CALLING WITH VOIP

APPLICATION-AWARE ROUTING IN SOFTWARE-DEFINED NETWORKS

Recovery Modeling in MPLS Networks

Comparative Analysis of Congestion Control Algorithms Using ns-2

Request Routing, Load-Balancing and Fault- Tolerance Solution - MediaDNS

Varalakshmi.T #1, Arul Murugan.R #2 # Department of Information Technology, Bannari Amman Institute of Technology, Sathyamangalam

Content Delivery Networks

Load Balancing. Final Network Exam LSNAT. Sommaire. How works a "traditional" NAT? Un article de Le wiki des TPs RSM.

Globule: a Platform for Self-Replicating Web Documents

Abstract. 1. Introduction

Entropy-Based Collaborative Detection of DDoS Attacks on Community Networks

On Packet Marking Function of Active Queue Management Mechanism: Should It Be Linear, Concave, or Convex?

How To Model The Content Delivery Network (Cdn) From A Content Bridge To A Cloud (Cloud)

Mitigation of Random Query String DoS via Gossip

Transcription:

Robust and Seamless Control Flow for Load Balancing in Content Delivery Networks Gopu.Obaiah*1, S.Suresh Babu*2, S.Gopikrishna*3 1*M.Tech Scholar, Dept of CSE, SRI Mittapalli College of Engg, Tummalapalem, Dist: Guntur, AP, India 2*Assistant Professor, Dept of CSE, SRI Mittapalli College of Engg, Tummalapalem, Dist: Guntur, AP, India 3* Professor & HOD, Dept of CSE, SRI Mittapalli College of Engg, Tummalapalem, Dist: Guntur, AP, India ABSTRACT Time and Its Constraint has given the Technology a frame of Jewelry to the Industry of Information Technology. Typically, if we consider the best software in this current era, might be none of them cannot make sure 100 % efficient. Technology has its own significance to lay the foundation for the next level of journey where component model play the important role. In this Paper, we try to put the glimpse of the traditional technology and the modern technology giving a high citation to technological advancement to the technological terminology. If we consider the typical Parallel distributed network, where three most parameter we consider Security, Speed and Accuracy; among them Load balancing is one which would be appended method, cannot be ignored. In the Content Delivery Networks, Balancing the traffic is the typical, hence in this paper we try to put forward to explore of the dynamic queue concept, where based on priority we distributer the map based status queue. KEYWORDS: Content Delivery Network (CDN), control theory, request balancing. I.INTRODUCTION Content Delivery Networks (CDN) has been introduced to overcome the limitations of the aforementioned techniques, and offer the content providers 1 with a complete solution for their problems. They are now commonly deployed, the CDN provided by Akamai is perhaps the most famous, however many different CDN providers are operational today (see for a complete list). A CDN is a combination of

various subsystems the most important ones from our point of view are the replica infrastructure and the request distribution system. In the 2002 paper Globally Distributed Content Delivery, the authors disclose details about the actual implementation of the systems used by Akamai. According to them, Akamai uses a network of more than 12000 servers, spread over 1000 networks (as of a more recent whitepaper from the company s website, the network now comprises 25000 servers). They also say that Akamai allocates more replicas in the locations where the load is higher, not giving further details on this topic. Note that other CDNs use a much smaller amount of servers: for instance, Mirror Image in its whitepapers claims that owning only a few servers is an advantage as configuration and content changes can be deployed faster. The procedures followed by the RRS for selecting servers are not disclosed in, but they describe the goals of their redirection system. The claim is that it aims at redirecting every client request to a server that is close (as a function of the client location, the network conditions, and the dynamic loads of the servers), available and that is likely to already retain a copy of the requested content. II.RELATED WORK The experience of users when accessing web contents, as content is moved closer to the user, while meeting the Content Provider need for content distribution control. It is also easier to maintain statistics. The provider has full control over the replicas. Another advantage is that many non-cacheable objects can be replicated, so replicas can effectively serve more objects than caches do (see for a thorough analysis of the possible approaches to replicate dynamic contents for web applications). Finally, to ensure the freshness of the contents, content distribution sites may avoid using HTTP, and choose protocols which allow more efficient communication with the origin server. The recent work goes more in depth on the Akamai CDN. By taking accurate measurements from different hosts spread in the world, and decoupling network effects from server related effects, they were able to provide many interesting data. First, they confirm that clients in different locations are served by server sets of different size, containing different elements: during a single day, the RRS returned 20 different servers to some clients, while some other client resulted in as much as 200 different servers. Another important point is that Akamai exhibits different performance for different customers ( content providers ), some customer results in being hosted in more than 300 different servers, some other one in as few as out of the many thousands the CDN provider owns. 2

very long redirection times indeed occur, but these events are very rare and their occurrence is strongly related to the time-ofthe-day. For nodes located in Brazil redirection times are much longer. The last important finding is that the RRS usually routes the requests through a path that is less congested than the average (from the experiments, this is untrue only for requests coming from Brazil), thus supporting Akamai s claim of being able to make decisions based on both the network conditions and the server health. 3. PROPOSED METHODOLOGY Fig.2.1 Illustration of CDN The time delay before the RRS changes the selected server for a client varies for different geographic areas. For some client located in the United States, 80% of the redirections are shorter than 100 seconds; The request distribution system is in charge of intercepting user requests, selecting the replica most appropriate for serving the request, and directing the user request to it. This service should locate a replica that is as close as possible to the user, while avoiding replica performance degradation - e.g., by balancing the load among replicas. The interception and delivery of the requests can be done by means of a variety of mechanisms, the most commonly used ones being DNS redirection and URL rewriting, that are sometimes used in combination. In DNS redirection, the CDN provider manages the DNS for some domains (ADNS, Authoritative DNS), and when the user requests for a domain name managed by the CDN provider, the system translates the name to the IP address of the chosen replica. 3

different request: Despite this problem may at first seem very similar to the problem of filling up caches in the proxy scenario, it has some important differences. In caching the available disk/memory space is usually filled with contents until the storage limit is reached: it is not important to minimize the number of copies, it is more important to use all the available disk space in order to maximize the probability of retaining the requested contents. In CDNs instead, it is better to limit the number of different copies of the same object in order to save bandwidth (the more replicas the more updates) and CDN costs. Having many servers also negatively influences other processes, such as statistics collection, server maintenance, server software configuration IV.EVOLUTION AND ANALYSIS Fig.3.1 CDN Peering Flow in the Context Dynamic Acknowledgement Remember that when making a DNS resolution the client usually contacts its primary DNS server, that in turn contacts other DNS servers traversing the DNS hierarchy, and that DNS queries are usually cached by the DNS servers traversed by resolutions. The main drawbacks of this technique depend on the hierarchic structure of the DNS, and limit the capability of the DNS to perform different decisions for each In a distributed system, if some hosts remain idle while others are very busy, system performance can be affected drastically. To prevent this, a load balancing policy can be employed, that balances the workload of the nodes in proportion to their capacity, thus supporting the effort to minimize the user perceived latency.our heuristic strongly relies on the RR system. The RRS provides load balancing among the available replicas redirecting requests only to close-by replicas. 4

allocation should be proactively performed. Based on the findings obtained through the analytical model we derived a centralized heuristic which allocates and deallocates replicas to reflect the requests traffic dynamics, the costs of adding, deleting and maintaining replicas, the servers load and storage limits, and the requirements on the maximum distance of the users from the best replica. VI.REFERENCES Fig.3.1.1 Compression of the Error to Idle Time A replica can give the RRS a false feedback on its load (providing an inflated value) in order to give the information that it wants its load to be reduced, if this does not impair the system capability in serving requests. V.CONCLUSION AND FUTUREWORK Building on this new formulation, we have provided a framework for the design of replica allocation schemes dynamically placing and removing replicas in response to changing users demand. By assuming the users requests dynamics to obey to a Markova model we saw how to formulate the dynamic replica placement problem as a Markova decision process. This allowed identifying an optimal policy for dynamic replica placement that can be used as a benchmark for heuristics evaluation and provides insights on how allocation and de 5 [1] S. Manfredi, F. Oliviero, and S. P. Romano, Distributed management for load balancing in content delivery networks, in Proc. IEEE GLOBECOM Workshop, Miami, FL, Dec. 2010, pp. 579 583. [2] H. Yin, X. Liu, G. Min, and C. Lin, Content delivery networks: A Bridge between emerging applications and future IP networks, IEEE Netw., vol. 24, no. 4, pp. 52 56, Jul. Aug. 2010. [3] J. D. Pineda and C. P. Salvador, On using content delivery networks to improve MOG performance, Int. J. Adv. Media Commun., vol. 4, no. 2, pp. 182 201, Mar. 2010. [4] D. D. Sorte,M. Femminella, A. Parisi, andg. Reali, Network delivery of live events in a digital cinema scenario, in Proc. ONDM,Mar. 2008, pp. 1 6.

[5] Akamai, Akamai, 2011 [Online]. Available: http://www.akamai. com/index.html [6] Limelight Networks, Limelight Networks, 2011 [Online]. Available: http://.uk.llnw.com [7] CDNetworks, CDNetworks, 2011 [Online]. Available: http://www.us.cdnetworks.com/index.php [8] Coral, The Coral Content Distribution Network, 2004 [Online]. Available: http://www.coralcdn.org [9] Network Systems Group, Projects, Princeton University, Princeton, NJ, 2008 [Online]. Available: http://nsg.cs.princeton.edu/projects [10] A. Barbir, B. Cain, and R. Nair, Known content network (CN) requestrouting mechanisms, IETF, RFC 3568 Internet Draft, Jul. 2003 [Online]. Available: http://tools.ietf.org/html/rfc3568 [13] D. M. Dias, W. Kish, R. Mukherjee, and R. Tewari, A scalable and highly availableweb server, in Proc. IEEE Comput. Conf., Feb. 1996, pp. 85 92. [14] C. V. Hollot, V. Misra,D. Towsley, andw.gong, Analysis and design of controllers for AQM routers supporting TCP flows, IEEE Trans. Autom. Control, vol. 47, no. 6, pp. 945 959, Jun. 2002. [15] C. V. Hollot, V. Misra, D. Towsley, and W. bo Gong, A control theoretic analysis of red, in Proc. IEEE INFOCOM, 2001, pp. 1510 1519. [16] J. Aweya, M. Ouellette, and D. Y. Montuno, A control theoretic approach to active queue management, Comput.Netw., vol. 36, no. 2 3, pp. 203 235, Jul. 2001. [11] T. Brisco, DNS support for load balancing, IETF, RFC 1794 Internet Draft, Apr. 1995 [Online]. Available: http://www.faqs.org/rfcs/ rfc1794.html [12] M. Colajanni, P. S. Yu, and D. M. Dias, Analysis of task assignment policies in scalable distributedweb-server systems, IEEE Trans. Parallel Distrib. Syst., vol. 9, no. 6, pp. 585 600, Jun. 1998. 6