Introduction to MPI Programming!
|
|
|
- Ursula Holmes
- 7 years ago
- Views:
Transcription
1 Introduction to MPI Programming! Rocks-A-Palooza II! Lab Session! 2006 UC Regents! 1!
2 Modes of Parallel Computing! SIMD - Single Instruction Multiple Data!!processors are lock-stepped : each processor executes single instruction in synchronism on different data! SPMD - Single Program Multiple Data!!processors run asynchronously a personal copy of a program! MIMD - Multiple Instruction Multiple Data!!processors run asynchronously: each processor has its own data and its own instructions! MPMD - Multiple Program Multiple Data! 2006 UC Regents! 2!
3 MPI in Parallel Computing! MPI addresses message-passing mode of parallel computation! Processes have separate address spaces! Processes communicate via sending and receiving messages! MPI is designed mainly for SPMD/MIMD (or distributed memory parallel supercomputer)! Each process is run on a separate node! Communication is over high-performance switch! Paragon, IBM SP2, Meiko CS-2, Thinking Machines CM-5, NCube-2, and Cray T3D! MPI can support shared memory programming model! Multiple processes can read/write to the same memory location! SGI Onyx, Challenge, Power Challenge, Power Challenge Array, IBM SMP, Convex Exemplar, and the Sequent Symmetry! MPI exploits Network Of Workstations (heterogeneous)! Sun, DEC, Hewlett-Packard, SGI, IBM, Intel and Pentium (various Linux OS)! 2006 UC Regents! 3!
4 What is MPI?! Message Passing application programmer Interface! Designed to provide access to parallel hardware! Clusters! Heterogeneous networks! Parallel computers! Provides for development of parallel libraries! Message passing! Point-to-point message passing operations! Collective (global) operations! Additional services! Environmental inquiry! Basic timing info for measuring application performance! Profiling interface for external performance monitoring! 2006 UC Regents! 4!
5 MPI advantages! Mature and well understood! Backed by widely-supported formal standard (1992)! Porting is easy! Efficiently matches the hardware! Vendor and public implementations available! User interface:! Efficient and simple (vs. PVM)! Buffer handling! Allow high-level abstractions! Performance! 2006 UC Regents! 5!
6 MPI disadvantages! MPI 2.0 includes many features beyond message passing! Execution control environment depends on implementation! 2006 UC Regents! 6!
7 MPI features! Thread safety! Point-to-point communication! Modes of communication! standard synchronous ready buffered Structured buffers! Derived datatypes! Collective communication! Native built-in and user-defined collective operations! Data movement routines! Profiling! Users can intercept MPI calls and call their own tools! 2006 UC Regents! 7!
8 Communication modes! standard! send has no guarantee that corresponding receive routine has started! synchronous! send and receive can start before each other but complete together! ready! used for accessing fast protocols! user guarantees that matching receive was posted! use with care!! buffered! send may start and return before matching receive! buffer space must be provided! 2006 UC Regents! 8!
9 Communication modes (contʼd)! All routines are! Blocking - return when they are locally complete! Send does not complete until buffer is empty! Receive does not complete until buffer is full! Completion depends on! size of message! amount of system buffering! Non-blocking - returns immediately and allows next statement to execute! Use to overlap communication and computation when time to send data between processes is large! Immediately returns request handle that can be used for querying and waited on,! Completion detected by MPI_Wait() or MPI_Test()! 2006 UC Regents! 9!
10 Point-to-point vs. collective! point-to-point, blocking MPI_Send/MPI_Recv! MPI_Send(start, count, datatype, dest, tag, comm )! MPI_Recv(start, count, datatype, source, tag, comm, status)! simple but inefficient! most work is done by process 0:! Get data and send it to other processes (they idle)! May be compute! Collect output from the processes! collective operations to/from all! MPI_Bcast(start, count, datatype, root, comm)! MPI_Reduce(start, result, count, datatype, operation, root, comm)! called by all processes! simple, compact, more efficient! must have the same size for count and datatype! result has significance only on node 0! 2006 UC Regents! 10!
11 MPI complexity! MPI extensive functionality is provided by many (125+) functions! Do I Need them all?! No need to learn them all to use MPI! Can use just 6 basic functions! MPI_Init MPI_Comm_size MPI_Comm_rank MPI_Send or MPI_Bcast MPI_Recv MPI_Reduce MPI_Finalize! Flexibility: use more functions as required! 2006 UC Regents! 11!
12 To be or not to be MPI user! Use if:!! Your data do not fit data parallel model!! Need portable parallel program!! Writing parallel library! Donʼt use if:!! Donʼt need any parallelism!! Can use libraries!! Can use fortran! 2006 UC Regents! 12!
13 Writing MPI programs! provide basic MPI definitions and types! #include mpi.h! start MPI! MPI_Init( &argc, &argv );! provide local non-mpi routines! exit MPI! MPI_Finalize();! see /opt/mpich/gnu/examples! /opt/mpich/gnu/share/examples! 2006 UC Regents! 13!
14 Compiling MPI programs! From a command line:! mpicc -o prog prog.c! Use profiling options (specific to mpich)! -mpilog Generate log files of MPI calls! -mpitrace Trace execution of MPI calls! -mpianim Real-time animation of MPI (not available on all systems)! --help Find list of available options! Use makefile!! get Makefile.in template and create Makefile! mpireconfig Makefile! compile! make progname! 2006 UC Regents! 14!
15 Running MPI program! Depends on your implementation of MPI! For mpich:! mpirun -np2 foo!!# run MPI program! For lam:! lamboot -v lamhosts!!# starts LAM! mpirun -v -np 2 foo!!# run MPI program! lamclean -v!!!# rm all user processes! mpirun!!!# run another program! lamclean! lamhalt!!!# stop LAM! 2006 UC Regents! 15!
16 Common MPI flavors on Rocks! 2006 UC Regents! 16!
17 MPI flavors path! /opt + MPI flavor + interconnect + compiler + bin/ + executable! MPICH + Ethernet + GNU!!!!/opt/mpich/ethernet/gnu/bin/! MPICH + Myrinet + GNU!!!/opt/mpich/myrinet/gnu/bin/! MPICH + Ethernet + INTEL!!!/opt/mpich/ethernet/intel/bin/! MPICH + Myrinet + INTEL!!!/opt/mpich/myrinet/intel/bin/! LAM + Ethernet + GNU!!!/opt/lam/ethernet/gnu/bin/! LAM + Myrinet + GNU!!!/opt/lam/myrinet/gnu/bin/! LAM + Ethernet + INTEL!!!/opt/lam/ethernet/intel/bin/! LAM + Myrinet + INTEL!!!/opt/lam/myrinet/intel/bin/!!!C:!mpicc!!C++:!mpiCC!!!F77:!mpif77!!F90:!mpif90! 2006 UC Regents! 17!
18 What provides MPI! 2006 UC Regents! 18!
19 Example 1: LAM hello! Execute all commands as a regular user! 1. Start ssh agent for key management! $ ssh-agent $SHELL! 2. Add your keys! $ ssh-add! (at prompt give your ssh passphrase)! 3. Make sure you have right mpicc:! $ which mpicc! (output must be /opt/lam/gnu/bin/mpicc)! 4. Create program source hello.c (see next page)! 2006 UC Regents! 19!
20 hello.c! #include "mpi.h"! #include <stdio.h>! int main(int argc,char *argv[])! {!!int myrank;!!mpi_init(&argc, &argv);!!mpi_comm_rank(mpi_comm_world, &myrank);!!fprintf(stdout, "Hello World, I am process %d\n", myrank);!!mpi_finalize();!!return 0;! }! 2006 UC Regents! 20!
21 Example 1 (contʼd)! 5. compile! $ mpicc -o hello hello.c! 6. create machines file with IPʼs of two nodes. Use your numbers here!! ! ! 7. start LAM! $ lamboot -v machines! 8. run your program! $ mpirun -np 2 -v hello! 9. clean after the run! $ lamclean -v! 10. stop LAM! $ lamhalt! 2006 UC Regents! 21!
22 Example1 output! $ ssh-agent $SHELL! $ ssh-add! Enter passphrase for /home/nadya/.ssh/id_rsa:! Identity added: /home/nadya/.ssh/id_rsa (/home/nadya/.ssh/id_rsa)! $ which mpicc! /opt/lam/gnu/bin/mpicc! $ mpicc -o hello hello.c! $ lamboot -v machines! LAM 7.1.1/MPI 2 C++/ROMIO - Indiana University! n-1<27213> ssi:boot:base:linear: booting n0 (rocks-155.sdsc.edu)! $ mpirun -np 2 -v hello! hello running on n0 (o)! 7791 hello running on n1! n-1<27213> ssi:boot:base:linear: booting n1 ( )! n-1<27213> ssi:boot:base:linear: finished! Hello World, I am process 0! Hello World, I am process 1! $ lamclean -v! killing processes, done! closing files, done! sweeping traces, done! cleaning up registered objects, done! sweeping messages, done! $ lamhalt! LAM 7.1.1/MPI 2 C++/ROMIO - Indiana University! 2006 UC Regents! 22!
23 Example 2: mpich cpi! 1. set your ssh keys as in example 1 (if not done already)! $ ssh-agent $SHELL! $ ssh-add! 2. copy example files to your working directory! $ cp /opt/mpich/gnu/examples/*.c.! $ cp /opt/mpich/gnu/examples/makefile.in.! 3. create Makefile! $ mpireconfig Makefile! 4. make sure you have right mpicc! $ which mpicc! If output lists path /opt/lam update the path:! $ export PATH=$/opt/mpich/gnu/bin:$PATH! 5. compile your program! $ make cpi! 6. run! $ mpirun -np 2 -machinefile machines cpi! or $ mpirun -nolocal -np 2 -machinefile machines cpi! 2006 UC Regents! 23!
24 Example 2 details! If using frontend and compute nodes in machines file use!!mpirun -np 2 -machinefile machines cpi! If using only compute nodes in machine file use!!mpirun -nolocal -np 2 -machinefile machines cpi! -nolocal - donʼt start job on frontend! -np 2 - start job on 2 nodes! -machinefile machines - nodes are specified in machinesfile! cpi - start program cpi! 2006 UC Regents! 24!
25 More examples! See CPU benchmark lab! how to run linpack! Additional examples in! /opt/mpich/gnu/examples! /opt/mpich/gnu/share/examples! 2006 UC Regents! 25!
26 Cleanup when an MPI Program Crashes! MPICH in Rocks uses shared memory segments to pass messages between processes on the same node! When an MPICH program crashes, it doesnʼt properly cleanup these shared memory segments! After a program crash, run:! $ cluster-fork sh /opt/mpich/gnu/sbin/cleanipcs! NOTE: this removes all shared memory segments for your user id! If you have other live MPI programs running, this will remove their shared memory segments too and cause that program to fail! 2006 UC Regents! 26!
27 Steps to combine SGE and MPI! 1. create SGE submit script! 2. run qsub command!!$ qsub runprog.sh!!$ qsub -pe mpich 32 runprog.sh! 3. check job status!!$ qstat -j! 2006 UC Regents! 27!
28 SGE submit script! Script contents! #!/bin/tcsh! #$ -S /bin/tcsh! setenv MPI=/path/to/MPI/binaries!! $MPI/mpirun -machinefile machines -np $NSLOTS appname! make it executable! $ chmod +x runprog.sh! 2006 UC Regents! 28!
29 Submit file options! # meet given resource request!!#$ -l h_rt=600! # specify interpreting shell for the job!!#$ -S /bin/sh! # use path for stadard output of job!!#$ -o path! # execute from current dir See man qsub for more options!!#$ -cwd! # run on 32 processes in mpich PE!!#$ -pe mpich 32! # Export all environmental variables!!#$ -V! # Export these environmental variables!!#$ -v MPI_ROOT,FOOBAR=BAR! 2006 UC Regents! 29!
30 Online resources! MPI standard:!!www-unix.mcs.anl.gov/mpi! Local Area Multicomputer MPI (LAM MPI):! MPICH: Aggregate Function MPI (AFMPI):! garage.ecn.purdue.edu/~papers Lam tutorial! UC Regents! 30!
31 Glossary! MPI - message passing interface! PVM - parallel virtual machine! LAM - local area multicomputer! P4-3rd generation parallel programming library, includes! message-passing and shared-memory components! Chameleon - high-performance portability package for!!! message passing on parallel supercomputers! Zipcode - portable system for writing of scalable libraries! ADI - abstract device architecture! 2006 UC Regents! 31!
32 Glossary (contʼd)! SIMD - Single Instruction Multiple Data! SPMD - Single Program Multiple Data! MIMD - Multiple Instruction Multiple Data! MPMD - Multiple Program Multiple Data! 2006 UC Regents! 32!
Lightning Introduction to MPI Programming
Lightning Introduction to MPI Programming May, 2015 What is MPI? Message Passing Interface A standard, not a product First published 1994, MPI-2 published 1997 De facto standard for distributed-memory
HPCC - Hrothgar Getting Started User Guide MPI Programming
HPCC - Hrothgar Getting Started User Guide MPI Programming High Performance Computing Center Texas Tech University HPCC - Hrothgar 2 Table of Contents 1. Introduction... 3 2. Setting up the environment...
Streamline Computing Linux Cluster User Training. ( Nottingham University)
1 Streamline Computing Linux Cluster User Training ( Nottingham University) 3 User Training Agenda System Overview System Access Description of Cluster Environment Code Development Job Schedulers Running
High performance computing systems. Lab 1
High performance computing systems Lab 1 Dept. of Computer Architecture Faculty of ETI Gdansk University of Technology Paweł Czarnul For this exercise, study basic MPI functions such as: 1. for MPI management:
LOAD BALANCING DISTRIBUTED OPERATING SYSTEMS, SCALABILITY, SS 2015. Hermann Härtig
LOAD BALANCING DISTRIBUTED OPERATING SYSTEMS, SCALABILITY, SS 2015 Hermann Härtig ISSUES starting points independent Unix processes and block synchronous execution who does it load migration mechanism
Grid 101. Grid 101. Josh Hegie. grid@unr.edu http://hpc.unr.edu
Grid 101 Josh Hegie grid@unr.edu http://hpc.unr.edu Accessing the Grid Outline 1 Accessing the Grid 2 Working on the Grid 3 Submitting Jobs with SGE 4 Compiling 5 MPI 6 Questions? Accessing the Grid Logging
1.0. User Manual For HPC Cluster at GIKI. Volume. Ghulam Ishaq Khan Institute of Engineering Sciences & Technology
Volume 1.0 FACULTY OF CUMPUTER SCIENCE & ENGINEERING Ghulam Ishaq Khan Institute of Engineering Sciences & Technology User Manual For HPC Cluster at GIKI Designed and prepared by Faculty of Computer Science
SGE Roll: Users Guide. Version @VERSION@ Edition
SGE Roll: Users Guide Version @VERSION@ Edition SGE Roll: Users Guide : Version @VERSION@ Edition Published Aug 2006 Copyright 2006 UC Regents, Scalable Systems Table of Contents Preface...i 1. Requirements...1
To connect to the cluster, simply use a SSH or SFTP client to connect to:
RIT Computer Engineering Cluster The RIT Computer Engineering cluster contains 12 computers for parallel programming using MPI. One computer, cluster-head.ce.rit.edu, serves as the master controller or
GRID Computing: CAS Style
CS4CC3 Advanced Operating Systems Architectures Laboratory 7 GRID Computing: CAS Style campus trunk C.I.S. router "birkhoff" server The CAS Grid Computer 100BT ethernet node 1 "gigabyte" Ethernet switch
MOSIX: High performance Linux farm
MOSIX: High performance Linux farm Paolo Mastroserio [mastroserio@na.infn.it] Francesco Maria Taurino [taurino@na.infn.it] Gennaro Tortone [tortone@na.infn.it] Napoli Index overview on Linux farm farm
Lecture 6: Introduction to MPI programming. Lecture 6: Introduction to MPI programming p. 1
Lecture 6: Introduction to MPI programming Lecture 6: Introduction to MPI programming p. 1 MPI (message passing interface) MPI is a library standard for programming distributed memory MPI implementation(s)
Parallelization: Binary Tree Traversal
By Aaron Weeden and Patrick Royal Shodor Education Foundation, Inc. August 2012 Introduction: According to Moore s law, the number of transistors on a computer chip doubles roughly every two years. First
MPI Application Development Using the Analysis Tool MARMOT
MPI Application Development Using the Analysis Tool MARMOT HLRS High Performance Computing Center Stuttgart Allmandring 30 D-70550 Stuttgart http://www.hlrs.de 24.02.2005 1 Höchstleistungsrechenzentrum
RA MPI Compilers Debuggers Profiling. March 25, 2009
RA MPI Compilers Debuggers Profiling March 25, 2009 Examples and Slides To download examples on RA 1. mkdir class 2. cd class 3. wget http://geco.mines.edu/workshop/class2/examples/examples.tgz 4. tar
Session 2: MUST. Correctness Checking
Center for Information Services and High Performance Computing (ZIH) Session 2: MUST Correctness Checking Dr. Matthias S. Müller (RWTH Aachen University) Tobias Hilbrich (Technische Universität Dresden)
Introduction to Sun Grid Engine (SGE)
Introduction to Sun Grid Engine (SGE) What is SGE? Sun Grid Engine (SGE) is an open source community effort to facilitate the adoption of distributed computing solutions. Sponsored by Sun Microsystems
Manual for using Super Computing Resources
Manual for using Super Computing Resources Super Computing Research and Education Centre at Research Centre for Modeling and Simulation National University of Science and Technology H-12 Campus, Islamabad
MPICH FOR SCI-CONNECTED CLUSTERS
Autumn Meeting 99 of AK Scientific Computing MPICH FOR SCI-CONNECTED CLUSTERS Joachim Worringen AGENDA Introduction, Related Work & Motivation Implementation Performance Work in Progress Summary MESSAGE-PASSING
Introduction to Cloud Computing
Introduction to Cloud Computing Distributed Systems 15-319, spring 2010 11 th Lecture, Feb 16 th Majd F. Sakr Lecture Motivation Understand Distributed Systems Concepts Understand the concepts / ideas
Introduction to grid technologies, parallel and cloud computing. Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber
Introduction to grid technologies, parallel and cloud computing Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber OUTLINES Grid Computing Parallel programming technologies (MPI- Open MP-Cuda )
High Performance Computing Facility Specifications, Policies and Usage. Supercomputer Project. Bibliotheca Alexandrina
High Performance Computing Facility Specifications, Policies and Usage Supercomputer Project Bibliotheca Alexandrina Bibliotheca Alexandrina 1/16 Topics Specifications Overview Site Policies Intel Compilers
BLM 413E - Parallel Programming Lecture 3
BLM 413E - Parallel Programming Lecture 3 FSMVU Bilgisayar Mühendisliği Öğr. Gör. Musa AYDIN 14.10.2015 2015-2016 M.A. 1 Parallel Programming Models Parallel Programming Models Overview There are several
HP-MPI User s Guide. 11th Edition. Manufacturing Part Number : B6060-96024 September 2007
HP-MPI User s Guide 11th Edition Manufacturing Part Number : B6060-96024 September 2007 Copyright 1979-2007 Hewlett-Packard Development Company, L.P. Table 1 Revision history Edition MPN Description Eleventh
Notes on the SNOW/Rmpi R packages with OpenMPI and Sun Grid Engine
Notes on the SNOW/Rmpi R packages with OpenMPI and Sun Grid Engine Last updated: 6/2/2008 4:43PM EDT We informally discuss the basic set up of the R Rmpi and SNOW packages with OpenMPI and the Sun Grid
Grid Engine. Application Integration
Grid Engine Application Integration Getting Stuff Done. Batch Interactive - Terminal Interactive - X11/GUI Licensed Applications Parallel Jobs DRMAA Batch Jobs Most common What is run: Shell Scripts Binaries
INF-110. GPFS Installation
INF-110 GPFS Installation Overview Plan the installation Before installing any software, it is important to plan the GPFS installation by choosing the hardware, deciding which kind of disk connectivity
Grid Engine Users Guide. 2011.11p1 Edition
Grid Engine Users Guide 2011.11p1 Edition Grid Engine Users Guide : 2011.11p1 Edition Published Nov 01 2012 Copyright 2012 University of California and Scalable Systems This document is subject to the
Grid Engine Basics. Table of Contents. Grid Engine Basics Version 1. (Formerly: Sun Grid Engine)
Grid Engine Basics (Formerly: Sun Grid Engine) Table of Contents Table of Contents Document Text Style Associations Prerequisites Terminology What is the Grid Engine (SGE)? Loading the SGE Module on Turing
PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN
1 PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN Introduction What is cluster computing? Classification of Cluster Computing Technologies: Beowulf cluster Construction
An introduction to Fyrkat
Cluster Computing May 25, 2011 How to get an account https://fyrkat.grid.aau.dk/useraccount How to get help https://fyrkat.grid.aau.dk/wiki What is a Cluster Anyway It is NOT something that does any of
How to Run Parallel Jobs Efficiently
How to Run Parallel Jobs Efficiently Shao-Ching Huang High Performance Computing Group UCLA Institute for Digital Research and Education May 9, 2013 1 The big picture: running parallel jobs on Hoffman2
Running applications on the Cray XC30 4/12/2015
Running applications on the Cray XC30 4/12/2015 1 Running on compute nodes By default, users do not log in and run applications on the compute nodes directly. Instead they launch jobs on compute nodes
Lecture 2 Parallel Programming Platforms
Lecture 2 Parallel Programming Platforms Flynn s Taxonomy In 1966, Michael Flynn classified systems according to numbers of instruction streams and the number of data stream. Data stream Single Multiple
Symmetric Multiprocessing
Multicore Computing A multi-core processor is a processing system composed of two or more independent cores. One can describe it as an integrated circuit to which two or more individual processors (called
OpenMP & MPI CISC 879. Tristan Vanderbruggen & John Cavazos Dept of Computer & Information Sciences University of Delaware
OpenMP & MPI CISC 879 Tristan Vanderbruggen & John Cavazos Dept of Computer & Information Sciences University of Delaware 1 Lecture Overview Introduction OpenMP MPI Model Language extension: directives-based
MPI / ClusterTools Update and Plans
HPC Technical Training Seminar July 7, 2008 October 26, 2007 2 nd HLRS Parallel Tools Workshop Sun HPC ClusterTools 7+: A Binary Distribution of Open MPI MPI / ClusterTools Update and Plans Len Wisniewski
High Performance Computing
High Performance Computing at Stellenbosch University Gerhard Venter Outline 1 Background 2 Clusters 3 SU History 4 SU Cluster 5 Using the Cluster 6 Examples What is High Performance Computing? Wikipedia
High Performance Computing
High Performance Computing Trey Breckenridge Computing Systems Manager Engineering Research Center Mississippi State University What is High Performance Computing? HPC is ill defined and context dependent.
Compute Cluster Server Lab 3: Debugging the parallel MPI programs in Microsoft Visual Studio 2005
Compute Cluster Server Lab 3: Debugging the parallel MPI programs in Microsoft Visual Studio 2005 Compute Cluster Server Lab 3: Debugging the parallel MPI programs in Microsoft Visual Studio 2005... 1
Scalability and Classifications
Scalability and Classifications 1 Types of Parallel Computers MIMD and SIMD classifications shared and distributed memory multicomputers distributed shared memory computers 2 Network Topologies static
Improved LS-DYNA Performance on Sun Servers
8 th International LS-DYNA Users Conference Computing / Code Tech (2) Improved LS-DYNA Performance on Sun Servers Youn-Seo Roh, Ph.D. And Henry H. Fong Sun Microsystems, Inc. Abstract Current Sun platforms
Client/Server Computing Distributed Processing, Client/Server, and Clusters
Client/Server Computing Distributed Processing, Client/Server, and Clusters Chapter 13 Client machines are generally single-user PCs or workstations that provide a highly userfriendly interface to the
Installing and running COMSOL on a Linux cluster
Installing and running COMSOL on a Linux cluster Introduction This quick guide explains how to install and operate COMSOL Multiphysics 5.0 on a Linux cluster. It is a complement to the COMSOL Installation
Middleware and Distributed Systems. Introduction. Dr. Martin v. Löwis
Middleware and Distributed Systems Introduction Dr. Martin v. Löwis 14 3. Software Engineering What is Middleware? Bauer et al. Software Engineering, Report on a conference sponsored by the NATO SCIENCE
Introduction to Linux and Cluster Basics for the CCR General Computing Cluster
Introduction to Linux and Cluster Basics for the CCR General Computing Cluster Cynthia Cornelius Center for Computational Research University at Buffalo, SUNY 701 Ellicott St Buffalo, NY 14203 Phone: 716-881-8959
The Asterope compute cluster
The Asterope compute cluster ÅA has a small cluster named asterope.abo.fi with 8 compute nodes Each node has 2 Intel Xeon X5650 processors (6-core) with a total of 24 GB RAM 2 NVIDIA Tesla M2050 GPGPU
Parallel Computing. Parallel shared memory computing with OpenMP
Parallel Computing Parallel shared memory computing with OpenMP Thorsten Grahs, 14.07.2014 Table of contents Introduction Directives Scope of data Synchronization OpenMP vs. MPI OpenMP & MPI 14.07.2014
Analysis and Implementation of Cluster Computing Using Linux Operating System
IOSR Journal of Computer Engineering (IOSRJCE) ISSN: 2278-0661 Volume 2, Issue 3 (July-Aug. 2012), PP 06-11 Analysis and Implementation of Cluster Computing Using Linux Operating System Zinnia Sultana
Agenda. Using HPC Wales 2
Using HPC Wales Agenda Infrastructure : An Overview of our Infrastructure Logging in : Command Line Interface and File Transfer Linux Basics : Commands and Text Editors Using Modules : Managing Software
Introduction to Cloud Computing
Introduction to Cloud Computing Parallel Processing I 15 319, spring 2010 7 th Lecture, Feb 2 nd Majd F. Sakr Lecture Motivation Concurrency and why? Different flavors of parallel computing Get the basic
16 node Linux cluster at SCFBio
Clustering Tutorial What is Clustering? Clustering is the use of multiple computers, typically PCs or UNIX workstations, multiple storage devices, and redundant interconnections, to form what appears to
An Introduction to High Performance Computing in the Department
An Introduction to High Performance Computing in the Department Ashley Ford & Chris Jewell Department of Statistics University of Warwick October 30, 2012 1 Some Background 2 How is Buster used? 3 Software
Cluster@WU User s Manual
Cluster@WU User s Manual Stefan Theußl Martin Pacala September 29, 2014 1 Introduction and scope At the WU Wirtschaftsuniversität Wien the Research Institute for Computational Methods (Forschungsinstitut
Paul s Norwegian Vacation (or Experiences with Cluster Computing ) Paul Sack 20 September, 2002. sack@stud.ntnu.no www.stud.ntnu.
Paul s Norwegian Vacation (or Experiences with Cluster Computing ) Paul Sack 20 September, 2002 sack@stud.ntnu.no www.stud.ntnu.no/ sack/ Outline Background information Work on clusters Profiling tools
Performance Tool Support for MPI-2 on Linux 1
Performance Tool Support for MPI-2 on Linux 1 Kathryn Mohror and Karen L. Karavanic Portland State University {kathryn, karavan}@cs.pdx.edu Abstract Programmers of message-passing codes for clusters of
LS-DYNA Scalability on Cray Supercomputers. Tin-Ting Zhu, Cray Inc. Jason Wang, Livermore Software Technology Corp.
LS-DYNA Scalability on Cray Supercomputers Tin-Ting Zhu, Cray Inc. Jason Wang, Livermore Software Technology Corp. WP-LS-DYNA-12213 www.cray.com Table of Contents Abstract... 3 Introduction... 3 Scalability
Introduction. Reading. Today MPI & OpenMP papers Tuesday Commutativity Analysis & HPF. CMSC 818Z - S99 (lect 5)
Introduction Reading Today MPI & OpenMP papers Tuesday Commutativity Analysis & HPF 1 Programming Assignment Notes Assume that memory is limited don t replicate the board on all nodes Need to provide load
WinBioinfTools: Bioinformatics Tools for Windows Cluster. Done By: Hisham Adel Mohamed
WinBioinfTools: Bioinformatics Tools for Windows Cluster Done By: Hisham Adel Mohamed Objective Implement and Modify Bioinformatics Tools To run under Windows Cluster Project : Research Project between
The SUN ONE Grid Engine BATCH SYSTEM
The SUN ONE Grid Engine BATCH SYSTEM Juan Luis Chaves Sanabria Centro Nacional de Cálculo Científico (CeCalCULA) Latin American School in HPC on Linux Cluster October 27 November 07 2003 What is SGE? Is
Principles and characteristics of distributed systems and environments
Principles and characteristics of distributed systems and environments Definition of a distributed system Distributed system is a collection of independent computers that appears to its users as a single
NEC HPC-Linux-Cluster
NEC HPC-Linux-Cluster Hardware configuration: 4 Front-end servers: each with SandyBridge-EP processors: 16 cores per node 128 GB memory 134 compute nodes: 112 nodes with SandyBridge-EP processors (16 cores
Linux tools for debugging and profiling MPI codes
Competence in High Performance Computing Linux tools for debugging and profiling MPI codes Werner Krotz-Vogel, Pallas GmbH MRCCS September 02000 Pallas GmbH Hermülheimer Straße 10 D-50321
Application Performance Tools on Discover
Application Performance Tools on Discover Tyler Simon 21 May 2009 Overview 1. ftnchek - static Fortran code analysis 2. Cachegrind - source annotation for cache use 3. Ompp - OpenMP profiling 4. IPM MPI
The CNMS Computer Cluster
The CNMS Computer Cluster This page describes the CNMS Computational Cluster, how to access it, and how to use it. Introduction (2014) The latest block of the CNMS Cluster (2010) Previous blocks of the
How To Visualize Performance Data In A Computer Program
Performance Visualization Tools 1 Performance Visualization Tools Lecture Outline : Following Topics will be discussed Characteristics of Performance Visualization technique Commercial and Public Domain
The GRID according to Microsoft
JM4Grid 2008 The GRID according to Microsoft Andrea Passadore passa@dist.unige.it l.i.d.o.- DIST University of Genoa Agenda Windows Compute Cluster Server 2003 Overview Applications Windows HPC Server
- An Essential Building Block for Stable and Reliable Compute Clusters
Ferdinand Geier ParTec Cluster Competence Center GmbH, V. 1.4, March 2005 Cluster Middleware - An Essential Building Block for Stable and Reliable Compute Clusters Contents: Compute Clusters a Real Alternative
Parallel Debugging with DDT
Parallel Debugging with DDT Nate Woody 3/10/2009 www.cac.cornell.edu 1 Debugging Debugging is a methodical process of finding and reducing the number of bugs, or defects, in a computer program or a piece
Applications of Passive Message Logging and TCP Stream Reconstruction to Provide Application-Level Fault Tolerance. Sunny Gleason COM S 717
Applications of Passive Message Logging and TCP Stream Reconstruction to Provide Application-Level Fault Tolerance Sunny Gleason COM S 717 December 17, 2001 0.1 Introduction The proliferation of large-scale
SLURM Workload Manager
SLURM Workload Manager What is SLURM? SLURM (Simple Linux Utility for Resource Management) is the native scheduler software that runs on ASTI's HPC cluster. Free and open-source job scheduler for the Linux
Linux Cluster Computing An Administrator s Perspective
Linux Cluster Computing An Administrator s Perspective Robert Whitinger Traques LLC and High Performance Computing Center East Tennessee State University : http://lxer.com/pub/self2015_clusters.pdf 2015-Jun-14
Virtual Machines. www.viplavkambli.com
1 Virtual Machines A virtual machine (VM) is a "completely isolated guest operating system installation within a normal host operating system". Modern virtual machines are implemented with either software
Debugging with TotalView
Tim Cramer 17.03.2015 IT Center der RWTH Aachen University Why to use a Debugger? If your program goes haywire, you may... ( wand (... buy a magic... read the source code again and again and...... enrich
Batch Scheduling and Resource Management
Batch Scheduling and Resource Management Luke Tierney Department of Statistics & Actuarial Science University of Iowa October 18, 2007 Luke Tierney (U. of Iowa) Batch Scheduling and Resource Management
Hodor and Bran - Job Scheduling and PBS Scripts
Hodor and Bran - Job Scheduling and PBS Scripts UND Computational Research Center Now that you have your program compiled and your input file ready for processing, it s time to run your job on the cluster.
Many-task applications in use today with a look toward the future
Many-task applications in use today with a look toward the future Alan Gara IBM Research Lots of help form Mark Megerian, IBM 1 Outline Review of Many-Task motivations on supercomputers and observations
THE EXPAND PARALLEL FILE SYSTEM A FILE SYSTEM FOR CLUSTER AND GRID COMPUTING. José Daniel García Sánchez ARCOS Group University Carlos III of Madrid
THE EXPAND PARALLEL FILE SYSTEM A FILE SYSTEM FOR CLUSTER AND GRID COMPUTING José Daniel García Sánchez ARCOS Group University Carlos III of Madrid Contents 2 The ARCOS Group. Expand motivation. Expand
Ra - Batch Scripts. Timothy H. Kaiser, Ph.D. tkaiser@mines.edu
Ra - Batch Scripts Timothy H. Kaiser, Ph.D. tkaiser@mines.edu Jobs on Ra are Run via a Batch System Ra is a shared resource Purpose: Give fair access to all users Have control over where jobs are run Set
MPI Runtime Error Detection with MUST For the 13th VI-HPS Tuning Workshop
MPI Runtime Error Detection with MUST For the 13th VI-HPS Tuning Workshop Joachim Protze and Felix Münchhalfen IT Center RWTH Aachen University February 2014 Content MPI Usage Errors Error Classes Avoiding
CPSC 226 Lab Nine Fall 2015
CPSC 226 Lab Nine Fall 2015 Directions. Our overall lab goal is to learn how to use BBB/Debian as a typical Linux/ARM embedded environment, program in a traditional Linux C programming environment, and
CPS221 Lecture: Operating System Structure; Virtual Machines
Objectives CPS221 Lecture: Operating System Structure; Virtual Machines 1. To discuss various ways of structuring the operating system proper 2. To discuss virtual machines Materials: 1. Projectable of
Intro to Intel Galileo - IoT Apps GERARDO CARMONA
Intro to Intel Galileo - IoT Apps GERARDO CARMONA IRVING LLAMAS Welcome! Campus Party Guadalajara 2015 Introduction In this course we will focus on how to get started with the Intel Galileo Gen 2 development
Batch Scripts for RA & Mio
Batch Scripts for RA & Mio Timothy H. Kaiser, Ph.D. tkaiser@mines.edu 1 Jobs are Run via a Batch System Ra and Mio are shared resources Purpose: Give fair access to all users Have control over where jobs
Using WestGrid. Patrick Mann, Manager, Technical Operations Jan.15, 2014
Using WestGrid Patrick Mann, Manager, Technical Operations Jan.15, 2014 Winter 2014 Seminar Series Date Speaker Topic 5 February Gino DiLabio Molecular Modelling Using HPC and Gaussian 26 February Jonathan
The Double-layer Master-Slave Model : A Hybrid Approach to Parallel Programming for Multicore Clusters
The Double-layer Master-Slave Model : A Hybrid Approach to Parallel Programming for Multicore Clusters User s Manual for the HPCVL DMSM Library Gang Liu and Hartmut L. Schmider High Performance Computing
Allinea Performance Reports User Guide. Version 6.0.6
Allinea Performance Reports User Guide Version 6.0.6 Contents Contents 1 1 Introduction 4 1.1 Online Resources...................................... 4 2 Installation 5 2.1 Linux/Unix Installation...................................
McMPI. Managed-code MPI library in Pure C# Dr D Holmes, EPCC dholmes@epcc.ed.ac.uk
McMPI Managed-code MPI library in Pure C# Dr D Holmes, EPCC dholmes@epcc.ed.ac.uk Outline Yet another MPI library? Managed-code, C#, Windows McMPI, design and implementation details Object-orientation,
Introduction to the SGE/OGS batch-queuing system
Grid Computing Competence Center Introduction to the SGE/OGS batch-queuing system Riccardo Murri Grid Computing Competence Center, Organisch-Chemisches Institut, University of Zurich Oct. 6, 2011 The basic
Introduction to Running Hadoop on the High Performance Clusters at the Center for Computational Research
Introduction to Running Hadoop on the High Performance Clusters at the Center for Computational Research Cynthia Cornelius Center for Computational Research University at Buffalo, SUNY 701 Ellicott St
24/08/2004. Introductory User Guide
24/08/2004 Introductory User Guide CSAR Introductory User Guide Introduction This material is designed to provide new users with all the information they need to access and use the SGI systems provided
Miami University RedHawk Cluster Working with batch jobs on the Cluster
Miami University RedHawk Cluster Working with batch jobs on the Cluster The RedHawk cluster is a general purpose research computing resource available to support the research community at Miami University.
Automated Testing of Installed Software
Automated Testing of Installed Software or so far, How to validate MPI stacks of an HPC cluster? Xavier Besseron HPC and Computational Science @ FOSDEM 2014 February 1, 2014 Automated Testing of Installed
Chapter 3 Operating-System Structures
Contents 1. Introduction 2. Computer-System Structures 3. Operating-System Structures 4. Processes 5. Threads 6. CPU Scheduling 7. Process Synchronization 8. Deadlocks 9. Memory Management 10. Virtual
ELEC 377. Operating Systems. Week 1 Class 3
Operating Systems Week 1 Class 3 Last Class! Computer System Structure, Controllers! Interrupts & Traps! I/O structure and device queues.! Storage Structure & Caching! Hardware Protection! Dual Mode Operation
Petascale Software Challenges. Piyush Chaudhary piyushc@us.ibm.com High Performance Computing
Petascale Software Challenges Piyush Chaudhary piyushc@us.ibm.com High Performance Computing Fundamental Observations Applications are struggling to realize growth in sustained performance at scale Reasons
Overview. Lecture 1: an introduction to CUDA. Hardware view. Hardware view. hardware view software view CUDA programming
Overview Lecture 1: an introduction to CUDA Mike Giles mike.giles@maths.ox.ac.uk hardware view software view Oxford University Mathematical Institute Oxford e-research Centre Lecture 1 p. 1 Lecture 1 p.
Hack the Gibson. John Fitzpatrick Luke Jennings. Exploiting Supercomputers. 44Con Edition September 2013. Public EXTERNAL
Hack the Gibson Exploiting Supercomputers 44Con Edition September 2013 John Fitzpatrick Luke Jennings Labs.mwrinfosecurity.com MWR Labs Labs.mwrinfosecurity.com MWR Labs 1 Outline Introduction Important
High-Performance Reservoir Risk Assessment (Jacta Cluster)
High-Performance Reservoir Risk Assessment (Jacta Cluster) SKUA-GOCAD 2013.1 Paradigm 2011.3 With Epos 4.1 Data Management Configuration Guide 2008 2013 Paradigm Ltd. or its affiliates and subsidiaries.
supercomputing. simplified.
supercomputing. simplified. INTRODUCING WINDOWS HPC SERVER 2008 R2 SUITE Windows HPC Server 2008 R2, Microsoft s third-generation HPC solution, provides a comprehensive and costeffective solution for harnessing