Load Balancing in Structured Peer to Peer Systems



Similar documents
Load Balancing in Structured Peer to Peer Systems

International journal of Engineering Research-Online A Peer Reviewed International Journal Articles available online

PEER-TO-PEER (P2P) systems have emerged as an appealing

INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY

Peer to Peer Networks A Review & Study on Load Balancing

International Journal of Scientific & Engineering Research, Volume 4, Issue 11, November ISSN

SOLVING LOAD REBALANCING FOR DISTRIBUTED FILE SYSTEM IN CLOUD

IMPACT OF DISTRIBUTED SYSTEMS IN MANAGING CLOUD APPLICATION

An Ants Algorithm to Improve Energy Efficient Based on Secure Autonomous Routing in WSN

Load Balancing in Structured P2P Systems

Survey on Load Rebalancing for Distributed File System in Cloud

New Structured P2P Network with Dynamic Load Balancing Scheme

LOAD BALANCING AND EFFICIENT CLUSTERING FOR IMPROVING NETWORK PERFORMANCE IN AD-HOC NETWORKS

Trace Driven Analysis of the Long Term Evolution of Gnutella Peer-to-Peer Traffic

Load Balancing in Peer-to-Peer Data Networks

Index Terms : Load rebalance, distributed file systems, clouds, movement cost, load imbalance, chunk.

Information Searching Methods In P2P file-sharing systems

How To Balance Network Load In A Wireless Sensor Network

Varalakshmi.T #1, Arul Murugan.R #2 # Department of Information Technology, Bannari Amman Institute of Technology, Sathyamangalam

AUTOMATED AND ADAPTIVE DOWNLOAD SERVICE USING P2P APPROACH IN CLOUD

LOAD BALANCING WITH PARTIAL KNOWLEDGE OF SYSTEM

Efficient File Sharing Scheme in Mobile Adhoc Network

Simulating a File-Sharing P2P Network

Self Reconfigurable Distributed Load Balancing For Secure and Privacy-Preserving Information Brokering.

International Journal of Advanced Research in Computer Science and Software Engineering

Load Balancing in Distributed Systems: A survey

Design and Implementation of Performance Guaranteed Symmetric Load Balancing Algorithm

Analysis on Leveraging social networks for p2p content-based file sharing in disconnected manets

International Research Journal of Interdisciplinary & Multidisciplinary Studies (IRJIMS)

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 3, May-June 2015

Super-Agent Based Reputation Management with a Practical Reward Mechanism in Decentralized Systems

Load Balancing in Structured Overlay Networks. Tallat M. Shafaat

Simple Load Rebalancing For Distributed Hash Tables In Cloud

Scheduling Allowance Adaptability in Load Balancing technique for Distributed Systems

Storage Systems Autumn Chapter 6: Distributed Hash Tables and their Applications André Brinkmann

A Content-Based Load Balancing Algorithm for Metadata Servers in Cluster File Systems*

Optimizing and Balancing Load in Fully Distributed P2P File Sharing Systems

An Empirical Study and Analysis of the Dynamic Load Balancing Techniques Used in Parallel Computing Systems

Secured Load Rebalancing for Distributed Files System in Cloud

Load Balancing Between Heterogenous Computing Clusters

MAXIMIZING RESTORABLE THROUGHPUT IN MPLS NETWORKS

QUALITY OF SERVICE METRICS FOR DATA TRANSMISSION IN MESH TOPOLOGIES

Load Balancing between Computing Clusters

Pipelining and load-balancing in parallel joins on distributed machines

ADAPTIVE LOAD BALANCING FOR CLUSTER USING CONTENT AWARENESS WITH TRAFFIC MONITORING Archana Nigam, Tejprakash Singh, Anuj Tiwari, Ankita Singhal

Locality Based Protocol for MultiWriter Replication systems

A Mobility Tolerant Cluster Management Protocol with Dynamic Surrogate Cluster-heads for A Large Ad Hoc Network

Load Rebalancing for File System in Public Cloud Roopa R.L 1, Jyothi Patil 2

ISSN Vol.04,Issue.19, June-2015, Pages:

High Performance Cluster Support for NLB on Window

An Empirical Approach - Distributed Mobility Management for Target Tracking in MANETs

Public Cloud Partition Balancing and the Game Theory

A Comparison Study of Qos Using Different Routing Algorithms In Mobile Ad Hoc Networks

Dept. of Computer Engg., Bhartia Vidyapeeth, Pune, India

Redistribution of Load in Cloud Using Improved Distributed Load Balancing Algorithm with Security

Load Distribution in Large Scale Network Monitoring Infrastructures

A Review on an Algorithm for Dynamic Load Balancing in Distributed Network with Multiple Supporting Nodes with Interrupt Service

D1.1 Service Discovery system: Load balancing mechanisms

AN EFFICIENT STRATEGY OF AGGREGATE SECURE DATA TRANSMISSION

Scalable Multiple NameNodes Hadoop Cloud Storage System

CHAPTER 8 CONCLUSION AND FUTURE ENHANCEMENTS

The Case for a Hybrid P2P Search Infrastructure

Ant-based Load Balancing Algorithm in Structured P2P Systems

A Comparison of General Approaches to Multiprocessor Scheduling

Efficient Parallel Processing on Public Cloud Servers Using Load Balancing

Load Balancing on a Grid Using Data Characteristics

A Novel Switch Mechanism for Load Balancing in Public Cloud

Distributed file system in cloud based on load rebalancing algorithm

ROUTE MECHANISMS FOR WIRELESS ADHOC NETWORKS: -CLASSIFICATIONS AND COMPARISON ANALYSIS

Implementation of P2P Reputation Management Using Distributed Identities and Decentralized Recommendation Chains

8 Conclusion and Future Work

RESEARCH PAPER International Journal of Recent Trends in Engineering, Vol 1, No. 1, May 2009

Using Peer to Peer Dynamic Querying in Grid Information Services

An Efficient Distributed Load Balancing For DHT-Based P2P Systems

A Review on Efficient File Sharing in Clustered P2P System

Adapting Distributed Hash Tables for Mobile Ad Hoc Networks

Comparison on Different Load Balancing Algorithms of Peer to Peer Networks

IMPLEMENTATION OF SOURCE DEDUPLICATION FOR CLOUD BACKUP SERVICES BY EXPLOITING APPLICATION AWARENESS

How To Balance In Cloud Computing

Multilevel Communication Aware Approach for Load Balancing

Path Selection Methods for Localized Quality of Service Routing

The International Journal Of Science & Technoledge (ISSN X)

LOAD BALANCING IN CLOUD COMPUTING

International Journal of Advance Research in Computer Science and Management Studies

Effective Load Balancing in P2P Systems

How To Create A Privacy Preserving And Dynamic Load Balancing System In A Distributed System

An Efficient Server Load Balancing using Session Management

Energy Efficient Load Balancing among Heterogeneous Nodes of Wireless Sensor Network

A UPS Framework for Providing Privacy Protection in Personalized Web Search

AN EFFICIENT DISTRIBUTED CONTROL LAW FOR LOAD BALANCING IN CONTENT DELIVERY NETWORKS

A Novel Approach of Load Balancing Strategy in Cloud Computing

Dynamic Load Balancing for Cluster-based Publish/Subscribe System

Efficient Load Balancing Routing in Wireless Mesh Networks

Improving Data Availability through Dynamic Model-Driven Replication in Large Peer-to-Peer Communities

Using Content-Addressable Networks for Load Balancing in Desktop Grids (Extended Version)

Efficient Content Location Using Interest-Based Locality in Peer-to-Peer Systems

IMPROVED PROXIMITY AWARE LOAD BALANCING FOR HETEROGENEOUS NODES

MINING THE DATA FROM DISTRIBUTED DATABASE USING AN IMPROVED MINING ALGORITHM

Object Request Reduction in Home Nodes and Load Balancing of Object Request in Hybrid Decentralized Web Caching

Transcription:

Load Balancing in Structured Peer to Peer Systems DR.K.P.KALIYAMURTHIE 1, D.PARAMESWARI 2 Professor and Head, Dept. of IT, Bharath University, Chennai-600 073 1 Asst. Prof. (SG), Dept. of Computer Applications, Jerusalem College of Engg., Chennai-600 100 2 ABSTRACT: Over the past few years, peer-to-peer (P2P) systems have rapidly grown in popularity and have become a dominant means for sharing resources. In these systems, load balancing is a key challenge because nodes are often heterogeneous. While several load-balancing schemes have been proposed in the literature, these solutions are typically ad hoc, heuristic based, and localized. In this paper, we present a general framework, HiGLOB, for global load balancing in structured P2P systems. Each node in HiGLOB has two key components: 1) a histogram manager maintains a histogram that reflects a global view of the distribution of the load in the system, and 2) a load-balancing manager that redistributes the load whenever the node becomes overloaded or under loaded. We exploit the routing metadata to partition the P2P network into no overlapping regions corresponding to the histogram buckets. We propose mechanisms to keep the cost of constructing and maintaining the histograms low. We further show that our scheme can control and bound the amount of load imbalance across the system. We propose a new framework, called Histogram-based Global Load Balancing (HiGLOB) to facilitate global load balancing in structured P2P systems. Each node P in HiGLOB has two key components. The first component is a histogram manager that maintains a histogram that reflects a global view of the distribution of the load in the system. The histogram stores statistical information that characterizes the average load of no overlapping groups of nodes in the P2P network. These nodes are connected to P through its neighbor nodes. The histogram information can be used for two purposes. On one hand, it is used to determine if a node is normally loaded, overloaded, or under loaded. On the other hand, it is used to facilitate the discovery of a lightly loaded node or a heavily loaded node for the load-balancing process when it is needed. The second component of the system is a load-balancing manager that takes actions to redistribute the load whenever a node becomes overloaded or under loaded. I. INTRODUCTION PEER-TO-PEER (P2P) systems have emerged as an appealing solution for sharing and locating resources over the Internet. Several P2P systems have been successfully deployed for a wide range of applications. The basic approach to load balancing is to find a pair of nodes one that is heavily loaded and the other lightly loaded and redistribute the load across these two nodes. However, it is far from trivial to (globally) balance the load in a P2P system. There are two main issues in P2P s load balancing: 1) how to determine if a node is overloaded or under loaded, and 2) if so, how to find a suitable partner node with which to redistribute the load. A popular solution is to let each node in the system query for the load of an arbitrary number of other nodes periodically. If the number of queried nodes is large enough, the node can approximate the average load of the system, and hence, it can determine if it is overloaded or under loaded. If the node is overloaded (or under loaded), it redistributes its load with the queried node having the lightest (or heaviest) load since that node should be a lightly (or heavily) loaded node. The main problem with this method is that it can only guarantee the global load balance of the system with some probability. On the other hand, we can use a separate DHT such as Skip Graph to maintain the nodes load distribution. Nevertheless, this solution still has a problem: it incurs a substantial cost for maintaining complete information about the load at every node in the system. In this paper, we propose a new framework, called Histogram-based Global Load Copyright to IJIRCCE www.ijircce.com 4227

Balancing (HiGLOB) to facilitate global load balancing in structured P2P systems. Each node P in HiGLOB has two key components. The first component is a histogram manager that maintains a histogram that reflects a global view of the distribution of the load in the system. The histogram stores statistical information that characterizes the average load of no overlapping groups of nodes in the P2P network. These nodes are connected to P through its neighbor nodes. The histogram information can be used for two purposes. On one hand, it is used to determine if a node is normally loaded, overloaded, or under loaded. On the other hand, it is used to facilitate the discovery of a lightly loaded node or a heavily loaded node for the load-balancing process when it is needed. The second component of the system is a load-balancing manager that takes actions to redistribute the load whenever a node becomes overloaded or under loaded. The load-balancing manager may redistribute the load both statically when a new node joins the system and dynamically when an existing node in the system becomes overloaded or under loaded. We exploit the routing metadata to partition the P2P network into no overlapping regions corresponding to the histogram buckets. We propose mechanisms to keep the cost of constructing and maintaining the histograms low. To summarize, this paper makes the following contributions:. It proposes a general framework that uses histograms to maintain a global view of the load distribution on structured P2P systems. II. MODULES There are the five modules present in the HI-GLOB framework. 1. Create Histogram 2. Send & get Request 3. Calculate load 4. Load Balance 5. Send & get Response 1. CREATE HISTOGRAM III. MODULE DESCRIPTION In this module, network is spited in to non-overlapping regions. Histogram Manager will maintain histogram for each peer. In that histogram, that statistical information of loads will be stored. Histogram of each peer contains the load values of neighbor peers. split peers in to regions get neibours get load details create Histogram FIG.1 CREATE HISTOGRAM 2 SEND AND GET REQUEST Using this module, each peer can request actions to another peer. The request may be like zip, unzip, compress, decompress and converting to document. The peer will get the request. This request will be considered as load. Before processing the request the load of the peer will be calculated. Copyright to IJIRCCE www.ijircce.com 4228

select peer Request get request calculate load FIG.2 SEND AND GET REQUEST 3 CALCULATE LOAD The load of the peer will be calculated before processing the request. The individual load of the peer will be calculated first. Then the average load the region will be calculated. If the individual load is greater than 2 times of average load then that peer will be considered as overloaded. Else the peer will be considered as normally loaded peer. After calculated load the load factor will be calculated. Load factor is the ratio between the previous load and current load. If the load factor is greater than 1 the histogram will be updated. To reduce the histogram maintenance cost, the histogram no needs to be updated for small changes in loads. So if the load factor is less than 1 the histogram will not be updated. Copyright to IJIRCCE www.ijircce.com 4229

calculate individual load calculate avg load if individual load > 2*avg load No Normally Loaded Yes over loaded calculate load factor load balance if loadfactor > 1.0 update histogram FIG 3-CALCULATING LOAD 4 LOAD BALANCE If the peer is normally loaded, the load will be handled by the same peer. Else if it is overloaded the number of peers in the region will be counted. If there is only one peer the load will be shared that peer. If the number of peers are even the peers will be split as pair of peers, and the load is shared to the pair, which is having low load. If the number of peers is odd then the peers will be split as pair of peers and there will be one more odd peer. The load will be shared to either peer pair or to the odd peer, which is having fewer loads. Copyright to IJIRCCE www.ijircce.com 4230

if peer overloaded peer handle request Yes count= number of peers load shared to single peer if only one peer if count is even number pairs of peers pairs of peer &1 odd peer if odd peer has more load load balanced to pair with less load load shared to odd peer FIG 4 LOAD BALANCE 5 SEND AND GET RESPONSE The response will be send to the peer. The response may be like decompressed file, compressed file, document, zipped folder or unzipped files. The response will be saved in the peer who sent request. Requested peer send response peer output will be saved FIGS 5 SEND AND GET RESPONSE Copyright to IJIRCCE www.ijircce.com 4231

IV. CONCLUSION In this paper, we proposed a framework, HiGLOB, to enable global load balance for structured P2P systems. Each node in HiGLOB maintains the load information of nodes in the systems using histograms. This enables the system to have a global view of the load distribution and hence facilitates global load balancing. We partition the system into nonoverlapping groups of nodes and maintain the average load of them in the histogram at a node. We also proposed two techniques to reduce the overhead of maintaining and constructing histograms. Even though the proposal is a general framework, it is possible to deploy different kinds of P2P systems on it. REFERENCES [1] D. Karger and M. Ruhl, Simple Efficient Load Balancing Algorithms for Peer-to-Peer Systems, Proc. ACM Symp. Parallelism in Algorithms and Architectures (SPAA), 2004. [2] S3: Scalable, Shareable and Secure P2P Based Data Management System, http://www.comp.nus.edu.sg/~s3p2p, 2008. [3] Madhukar and C. Williamson, A Longitudinal Study of P2P Traffic Classification, Proc. Int l Symp. Modeling, Analysis, and Simulation of Computer and Telecomm. Systems (MASCOTS), 2006. [4] S. Saroiu, P.K. Gummadi, and S.D. Gribble, A Measurement Study of Peer-to-Peer File Sharing Systems, Proc. MultimediaComputing and Networking Conf. (MMCN), 2002. Copyright to IJIRCCE www.ijircce.com 4232