Supercomputing applied to Parallel Network Simulation

Similar documents
An Optimistic Parallel Simulation Protocol for Cloud Computing Environments

EXPERIENCES PARALLELIZING A COMMERCIAL NETWORK SIMULATOR

Cluster Computing at HRI

1 Bull, 2011 Bull Extreme Computing

Preferred citation style for this presentation

Optimizing Configuration and Application Mapping for MPSoC Architectures

Load Balance Strategies for DEVS Approximated Parallel and Distributed Discrete-Event Simulations

Lecture 2 Parallel Programming Platforms

Distributed communication-aware load balancing with TreeMatch in Charm++

Scalability and Classifications

An introduction to Fyrkat

Interconnection Networks

Client/Server Computing Distributed Processing, Client/Server, and Clusters

Using Fuzzy Logic Control to Provide Intelligent Traffic Management Service for High-Speed Networks ABSTRACT:

Preserving Message Integrity in Dynamic Process Migration

Module: Sharepoint Administrator

Recommended hardware system configurations for ANSYS users

Vorlesung Rechnerarchitektur 2 Seite 178 DASH

Performance Evaluation of Multi-Core Multi-Cluster Architecture (MCMCA)

Facility Usage Scenarios

Introduction to Cloud Computing

StreamStorage: High-throughput and Scalable Storage Technology for Streaming Data

MCSE Core exams (Networking) One Client OS Exam. Core Exams (6 Exams Required)

Time Management in the High Level Architecture"

IT 3202 Internet Working (New)

Windows Server 2008 R2 Hyper-V Live Migration

Recommendations for Performance Benchmarking

Parallel Databases. Parallel Architectures. Parallelism Terminology 1/4/2015. Increase performance by performing operations in parallel

RevoScaleR Speed and Scalability

Wide Area Networks. Learning Objectives. LAN and WAN. School of Business Eastern Illinois University. (Week 11, Thursday 3/22/2007)

USING OPNET TO SIMULATE THE COMPUTER SYSTEM THAT GIVES SUPPORT TO AN ON-LINE UNIVERSITY INTRANET

CHAPTER 4 PERFORMANCE ANALYSIS OF CDN IN ACADEMICS

Tools for Peer-to-Peer Network Simulation

Principles and characteristics of distributed systems and environments

APPENDIX - A. Tools Used. 1. Qualnet Simulator. 2. TRMSim-WSN Simulator. 3. SnetSim Simulator. 4. EDX SignalPro. 5.

SQL Server Business Intelligence on HP ProLiant DL785 Server

A Lab Course on Computer Architecture

Hardware Performance Optimization and Tuning. Presenter: Tom Arakelian Assistant: Guy Ingalls

Achieving Nanosecond Latency Between Applications with IPC Shared Memory Messaging

In Memory Accelerator for MongoDB

Muse Server Sizing. 18 June Document Version Muse

GEDAE TM - A Graphical Programming and Autocode Generation Tool for Signal Processor Applications

Load Balancing MPI Algorithm for High Throughput Applications

Cloud Panel Service Evaluation Scenarios

A Flexible Cluster Infrastructure for Systems Research and Software Development

Energy-aware job scheduler for highperformance

HP Serviceguard Cluster Configuration for Partitioned Systems

Traffic Prediction in Wireless Mesh Networks Using Process Mining Algorithms

VII ENCUENTRO IBÉRICO DE ELECTROMAGNETISMO COMPUTACIONAL, MONFRAGÜE, CÁCERES, MAYO

A New Mathematical Model for Optimizing the Performance of Parallel and Discrete Event Simulation Systems

How To Monitor Performance On Eve

Instruction scheduling

David Rioja Redondo Telecommunication Engineer Englobe Technologies and Systems

Berkeley Ninja Architecture

Course Syllabus. Fundamentals of Windows Server 2008 Network and Applications Infrastructure. Key Data. Audience. Prerequisites. At Course Completion

Load balancing in a heterogeneous computer system by self-organizing Kohonen network

OPNET - Network Simulator

Distributed Dynamic Load Balancing for Iterative-Stencil Applications

Designing a Microsoft SharePoint 2010 Infrastructure

A Comparison Study of Qos Using Different Routing Algorithms In Mobile Ad Hoc Networks

LLamasoft K2 Enterprise 8.1 System Requirements

22S:295 Seminar in Applied Statistics High Performance Computing in Statistics

Real-Time Analysis of CDN in an Academic Institute: A Simulation Study

Hardware Configuration Guide

Large-Scale Network Simulation: How Big? How Fast?

Performance advantages of resource sharing in polymorphic optical networks

Real-Time Monitoring Framework for Parallel Processes

How To Build A Supermicro Computer With A 32 Core Power Core (Powerpc) And A 32-Core (Powerpc) (Powerpowerpter) (I386) (Amd) (Microcore) (Supermicro) (

Computational infrastructure for NGS data analysis. José Carbonell Caballero Pablo Escobar

Overview: Load Balancing with the MNLB Feature Set for LocalDirector

IP Address Management and DNS Management

Design and Verification of Nine port Network Router

Control 2004, University of Bath, UK, September 2004

Network File System (NFS) Pradipta De

Lecture 02b Cloud Computing II

Amazon EC2 Product Details Page 1 of 5

HP reference configuration for entry-level SAS Grid Manager solutions

Updated November 30, Version 4.1

HARDWARE, SOFTWARE AND CONFIGURATION REQUIREMENTS

MOSIX: High performance Linux farm

SAN Conceptual and Design Basics

About this Course This 5 day ILT course teaches IT Professionals to design and deploy Microsoft SharePoint 2010.

THE AFFORDABLE SUPERCOMPUTER

Cray Gemini Interconnect. Technical University of Munich Parallel Programming Class of SS14 Denys Sobchyshak

Agenda. Michele Taliercio, Il circuito Integrato, Novembre 2001

2) What is the structure of an organization? Explain how IT support at different organizational levels.

Operating Systems for Parallel Processing Assistent Lecturer Alecu Felician Economic Informatics Department Academy of Economic Studies Bucharest

Graph Analytics in Big Data. John Feo Pacific Northwest National Laboratory

A Theory of the Spatial Computational Domain

The Complete IS-IS Routing Protocol

COMP 422, Lecture 3: Physical Organization & Communication Costs in Parallel Machines (Sections 2.4 & 2.5 of textbook)

Distributed Systems. REK s adaptation of Prof. Claypool s adaptation of Tanenbaum s Distributed Systems Chapter 1

Data Protection with IBM TotalStorage NAS and NSI Double- Take Data Replication Software

The big data revolution

Implementing an Automated Digital Video Archive Based on the Video Edition of XenData Software

Planning the Installation and Installing SQL Server

Middleware and Distributed Systems. Introduction. Dr. Martin v. Löwis

- An Essential Building Block for Stable and Reliable Compute Clusters

Planning and Maintaining a Microsoft Windows Server Network Infrastructure

What is VLAN Routing?

Transcription:

Supercomputing applied to Parallel Network Simulation David Cortés-Polo Research, Technological Innovation and Supercomputing Centre of Extremadura, CenitS. Trujillo, Spain david.cortes@cenits.es

Summary Introduction Problem Statement Parallel Network Simulators Parallel Execution in the Supercomputer Analysis of the Parallel Simulation Conclusions and Future Works

Introduction Simulation provides the basis to understand different system behaviors that are too complex. The actual research in networking requires a huge complexity in the models that must be simulated. The simulation usually are under conventional sequential simulation techniques. The capabilities of those techniques are inadequate to address large-scale simulation requirements, and the parallel simulation techniques must be brought to bear on these challenges.

Problem Statement Nowadays, large-scale network scenarios should be executed in a single processor with a single memory space. This is possible if the the scenario to resolve is a small and it does not have high traffic requirements or a large number of nodes in the simulated network. It is widely acknowledged that the capabilities of conventional sequential simulation techniques are inadequate to address the large-scale simulation requirements (memory and computation time).

Problem Statement Parallel and distributed approaches allow resolving large scenarios which cannot be resolved on a single machine (due to memory and computation time lacks). Parallel and distributed discrete-event simulations can be described in terms of logical processes that communicate with each other through message passing. To process the discrete-events produced in the simulation, the local processor implements a local clock witch execute the events according to it.

Problem Statement These synchronization mechanisms are divided in three categories: conservative - avoid the possibility of causality error occurrence. optimistic - allow for the occurrence of causality errors. lookback-based - allow considering only causality errors (require rollback but no anti-messages)

Parallel Network Simulators Nowadays, different network simulators offer the possibility to execute parallels or distributed simulations. The most extended simulators in the networking research are: NS-2 NS-3 Omnet++

Parallel Network Simulators NS-2 is an open source object-oriented network simulation tool, which is used in academic research widely. The Parallel and Distributed NS-2 (PDNS) is an extension to the NS-2 simulator for parallel and distributed simulation of wired networks. It divides a model of a network in to models of subnet works and assigns each subnet to a separate logical process (LP). The LPs use a conservative approach for synchronization. It is based in an implementation of the RTI libraries.

Parallel Network Simulators NS-3 is a discrete-event network simulator for Internet systems. It is a new simulator (not backwards-compatible with NS-2). The distributed and parallel implementation is based on the null message algorithm. Basically, the network is split in partitions which have their own event queues and clocks. The event queue of each partition can then be processed until the partition clock has advanced to a date which is defined as the maximum date before neighboring nodes may send the new events. It is based on MPI libraries.

Parallel Network Simulators Omnet++ is a discrete event simulation environment. It is used not only in communication networks simulations (mainly) but also it has been successfully used in other areas. The distributed and parallel implementation is based on the null message algorithm as well as ideal simulation protocol. It is based on MPI libraries. An alternative communication mechanism is based on named pipes, for use on shared memory multiprocessors without the need to install MPI. Additionally, a file system based communication mechanism is also available.

Parallel Execution in the supercomputer We have deployed the parallel network simulators presented on the last section in Lusitania Supercomputer. Lusitania is composed by 2 HP Integrity Superdome sx2000. Its main characteristics are: 256 Cores @ 1,6GHz 2 TB Ram memory 265 TB Disk memory

Parallel Execution in the supercomputer Lusitania is a shared memory supercomputer with architecture MIMD (Multiple Instruction Multiple Data). This implies that all the processors can direct to the whole memory installed to the supercomputer (2 TB). In this paper, we have made different simulations using NS-3 in Lusitania Supercomputer to study the impact of the supercomputers in the simulation.

Parallel Execution in the supercomputer

Analysis of the parallel Simulation The main objective of the analysis is to measure the benefit introduced when the simulation is parallelized, using different data conjuncts and distribution in the topology. To organize the results, we have compared: two routing methods: dynamic and static method. communication method between logical processes (LPs): communication in the same zone, communication between zones.

Analysis of the parallel Simulation The performance of the scenario parallelization hardly depends of the routing method chosen. static routing method calculate all the possible routes of the network scenario when it is loading in memory. dynamic routing method calculates all the routes of the packets in execution time and the resolution of the problem is faster.

Analysis of the parallel Simulation Static Routing execution time Static routing method increases the resolution of the simulation in large partitioned scenarios. 2 Zones 4 Zones 8 Zones 15 Zones 150000 112500 75000 37500 1 2 4 8 15 0

Analysis of the parallel Simulation Dynamic Routing execution time 2 Zones 4 Zones the resolution time in static routing is 8 Zones 15 Zones 500 larger due to the p r e - c a l c u l a t i o n 375 realized to obtain 250 the routing tables of all the nodes in the 125 scenario. 1 2 4 8 15 0

Analysis of the parallel Simulation Dynamic Routing; 4 Zones; 4 LANS; 15 Clients When the scenario grows, the time taken to resolve the simulation in the i n t e r - z o n e c o m m u n i c a t i o n grows. 1 Communication intra-zone Communication inter-zone 60 45 30 15 2 0 4

Analysis of the parallel Simulation Dynamic Routing; 8 Zones; 4 LANS; 15 Clients Communication intra-zone Communication inter-zone In this Figure the time have been increased due to the increment of interzone packets sent. 150 113 75 38 1 2 4 8 0

Analysis of the parallel Simulation Performance at inter-zone communication 1 Proc 2 Proc 3 Proc 4 Proc Impact of the communication 0% 6,49% 22,12% 27,02%

Analysis of the parallel Simulation Static Routing; 8 Zones; 15 LANS; 15 Clients In static routing method, the interzone and intra-zone communication are similar due to the penalty introduced by the calculation of the routes in the loading phase 1 Communication intra-zone Communication inter-zone 20000 15000 10000 5000 2 0 4 8

Analysis of the parallel Simulation Improvement at intra-zone communication Zone 1 Proc 2 Proc 4 Proc 8 Proc 15 Proc 2 0% 50,89% - - - 4 0% 51,16% 74,94% - - 8 0% 51,49% 75,12% 86,91% - 15 0% 48,57% 73,79% 85,99% 92,64%

Analysis of the parallel Simulation Improvement at inter-zone communication Zone 1 Proc 2 Proc 4 Proc 8 Proc 2 0% 44,89% - - 4 0% 42,59% 58,02% - 8 0% 44,53% 53,56% 65,49%

Analysis of the parallel Simulation

Conclusions and Future Works Traditionally, the researchers use the simulation as a method to validate their new protocols and proposals. With the parallel and distributed approach the simulation of a network scenario resolve the complexity of the problem. We have adapted and deployed NS-2, NS-3 and Omnet ++ in the Lusitania Supercomputer to make complex simulations. With the simulation platform deployed in the supercomputer, we want to develop a framework to predict the network usage in the future using the supercomputer and establish the technical and the investments needed to afford the requirements in the future Internet.

Thanks for your attention Questions?