Grid Computing FUNDAMENTALS OF. Theory, Algorithms and Technologies. Frederic Magoules. Edited by. CRC Press

Transcription

1 FUNDAMENTALS OF Grid Computing Theory, Algorithms and Technologies Edited by Frederic Magoules CRC Press Taylor & Francis Group Boca Raton London NewYork CRC Press is an imprint of the Taylor 8t Francis Croup, an Informa business A CHAPMAN St HALL BOOK

2 Contents List of figures xiii List of tables xvii Foreword xix Preface xxi Warranty xxiii 1 Grid computing overview 1 Fre'de'ric Magoules, Thi-Mai-Huong Nguyen, and Lei Yu 11 Introduction 1 12 Definitions 2 13 Classifying grid systems 3 14 Grid applications 4 15 Grid architecture 5 16 Grid computing projects Grid middleware (core services) Grid resource brokers and schedulers Grid systems Grid programming environments Grid portals Grid evolution Concluding remarks References 24 2 Synchronization protocols for sharing resources in grid envi ronments 29 Julien Sopena, Luciano, Arcmtes, Fabrice Legond-Aubry, and Pierre Sens 21 Introduction Token-based mutual exclusion algorithms Martin's algorithm Naimi-Trehel's algorithm Suzuki-Kasami's algorithm Mutual exclusion algorithms for large configurations Priority-based approach 36

3 to Composition-based approach Composition approach to mutual exclusion algorithms 241 Coordinator processes Composition properties and its natural effects Filtering and aggregation Preemption and structural effects Natural effects of composition Performance evaluation Experiment parameters Performance results: composition study The impact of the grid architecture Concluding remarks References 63 3 Data replication in grid environments 67 Thi-Mai-Huong Nguyen and Frederic Magoules 31 Introduction Data replication Replication in databases Replication in peer-to-peer systems Replication in web environments Replication in data grids System architecture Selective-rank model for a replication system Model assumptions Estimating the availability of files Problem definition Selective-rank replication algorithm Popularity of files Correlation of files MaxDAR optimizer algorithm Evaluation Grid configuration Experimental results Concluding remarks References 95 4 Data management in grids 101 Jean-Marc Pierson 41 Introduction From data sources to databases data sources Positioning the data management in grids within distributed systems Links with the other services of the middleware Problems and some solutions 107

4 451 Data identification, indexing, metadata Data access, interoperability, query processing, transac tions Transport Ill 454 Placement, replication, caching Security: transport, authentication, access control, en cryption Consistency Toward pervasive, autonomic and on-demand data manage ment Concluding remarks References Future of grids resources management 125 Fei Teng and Frederic Magoules 51 Introduction Several computing paradigms Utility computing Grid computing Autonomic computing Cloud computing Definition of cloud computing One definition Architecture Cloud services Three-level services Service characters Cloud resource management Comparison with grid systems Resource model Economy-oriented model Future direction of resource scheduling Scalable and dynamic Secure and trustable Virtual machines-based Concluding remarks References Fault-tolerance and availability awareness in computational grids 143 Xavier Besseron, Mohamed-SUm Bouguerra, Thierry Gautier, and Denis Trystram Erik Saule, 61 Introduction Background and definitions Grid architecture and execution model 147

5 622 Faults models Consistent system states Multi-objective scheduling for safety Generalities No duplication Using duplication Stable memory-based protocols Log-based rollback recovery Checkpoint-based rollback recovery Stochastic checkpoint model analysis issues Completion time without fault tolerance Impact of checkpointing on the completion time Implementations Single process snapshot Fault-tolerance protocol implementations Implementation comparison Concluding remarks References Fault tolerance for distributed scheduling in grids 177 Lei Yu and Frederic Magoules 71 Introduction Fault tolerance in distributed systems Distributed scheduling model MMS fault tolerance LMS/SMS fault tolerance CR fault tolerance Fault detection and repairing in the tree structure Notations Algorithms description Messages treatment analysis Distributed scheduling algorithm Distributed dynamic scheduling algorithm with fault tolerance (DDFT) Algorithm fault tolerance issues SimGrid and simulation design Evaluation Simulation setup Comparison with centralized scheduling Fault tolerance experiments Workload analysis Related work Concluding remarks References 201

6 Broadcasting for grids 207 Christophe Cerin, Luiz-Angelo Steffenel, and Hazem Fkaier 81 Introduction Broadcastings Heuristics for broadcasting Basic approaches for broadcasting in homogeneous en vironments Advanced approaches for heterogeneous clusters Grid aware heuristics New approach for broadcasting in clusters and hyper clusters Related work and related methods Broadcasting and dynamic programming Multi-criteria approach Broadcast for clusters Broadcast and heterogeneous systems Concluding remarks References 232 Load balancing algorithms for dynamic Jacques M Bahi, Raphael Couturier, networks 235 and Abderrahmane Sider 91 Introduction A taxonomy for load balancing Distributed load balancing algorithms for static networks Network model and performance measures Diffusion Dimension exchange GDE Second order algorithms Distributed load balancing algorithms for dynamic networks Adaption to dynamic networks Generalized adaptive exchange (GAE) Illustrating the generalized adaptive exchange most to least loaded policy on a dynamic network Implementation On synchronous and asynchronous approaches How to define the load for some applications Implementation of static algorithms Implementation of dynamic algorithms A practical example: the advection diffusion application Load balancing and the application Load balancing in a dynamic network Concluding remarks References 269

7 A Implementation of the replication strategies in OptorSim 273 Thi-Mai-Huong Nguyen and Frederic Magoules Al Introduction 273 A2 Download 274 A3 Implementation 274 A31 OptorSim implementation 274 A 32 MaxDAR implementation 275 A 4 How to execute the simulation 276 B Implementation of the simulator for the distributed schedul ing model 279 Lei Yu and Frederic Magoules B l Introduction 279 B2 Download B3 Implementation 280 B 31 Data structures 280 B32 Functions 280 B4 How to execute the simulation 282 ' 279 Glossary 283 Author Index 297