Introduction to MSI* for PubH 8403

Similar documents
Introduction to Linux and Cluster Basics for the CCR General Computing Cluster

MFCF Grad Session 2015

Instructions for Accessing the Advanced Computing Facility Supercomputing Cluster at the University of Kansas

HPC at IU Overview. Abhinav Thota Research Technologies Indiana University

How to Use NoMachine 4.4

Introduction to Running Hadoop on the High Performance Clusters at the Center for Computational Research

Overview. Remote access and file transfer. SSH clients by platform. Logging in remotely

File Transfer Examples. Running commands on other computers and transferring files between computers

HPC system startup manual (version 1.30)

How To Install Storegrid Server On Linux On A Microsoft Ubuntu 7.5 (Amd64) Or Ubuntu (Amd86) (Amd77) (Orchestra) (For Ubuntu) (Permanent) (Powerpoint

High-Performance Computing

4cast Server Specification and Installation

An Introduction to High Performance Computing in the Department

Using WestGrid. Patrick Mann, Manager, Technical Operations Jan.15, 2014

13.1 Backup virtual machines running on VMware ESXi / ESX Server

Parallel Processing using the LOTUS cluster

Week Overview. Running Live Linux Sending from command line scp and sftp utilities

MATLAB on EC2 Instructions Guide

Introduction to Supercomputing with Janus

CONNECTING TO DEPARTMENT OF COMPUTER SCIENCE SERVERS BOTH FROM ON AND OFF CAMPUS USING TUNNELING, PuTTY, AND VNC Client Utilities

1. Product Information

Online Backup Client User Manual Linux

Module Title: Advanced Systems Administration 2

C CMRR Computer Resources Overview

Configuring Renoir to Drive Simulation on Remote Machines

Data management on HPC platforms

PROGRAMMING FOR BIOLOGISTS. BIOL 6297 Monday, Wednesday 10 am -12 pm

RecoveryVault Express Client User Manual

Linux Overview. Local facilities. Linux commands. The vi (gvim) editor

Parallels Plesk Panel 11 for your Linux server

Online Backup Linux Client User Manual

OMU350 Operations Manager 9.x on UNIX/Linux Advanced Administration

Getting Started with HPC

Online Backup Client User Manual

Bootstrap guide for the File Station

Remote & Collaborative Visualization. Texas Advanced Compu1ng Center

Installing a Symantec Backup Exec Agent on a SnapScale Cluster X2 Node or SnapServer DX1 or DX2. Summary

Connecting to the School of Computing Servers and Transferring Files

Tutorial: Using WestGrid. Drew Leske Compute Canada/WestGrid Site Lead University of Victoria

Accessing VirtualBox Guests from Host using SSH, WinSCP and Tunnelling

Remote Access to Unix Machines

SparkLab May 2015 An Introduction to

Navigating the Rescue Mode for Linux

Other trademarks and Registered trademarks include: LONE-TAR. AIR-BAG. RESCUE-RANGER TAPE-TELL. CRONY. BUTTSAVER. SHELL-LOCK

Project management integrated into Outlook

Out n About! for Outlook Electronic In/Out Status Board. Administrators Guide. Version 3.x

Simple. Control Panel. for your Linux Server. Getting Started Guide. Simple Control Panel // Linux Server

Getting Started Guide. Getting Started With Your Dedicated Server. Setting up and hosting a domain on your Linux Dedicated Server using Plesk 8.0.

How To Run Linux On Windows 7 (For A Non-Privileged User) On A Windows 7 Computer (For Non-Patty) On Your Computer (Windows) On An Unix Computer (Unix) On Windows) On The Same

Cisco Networking Academy Program Curriculum Scope & Sequence. Fundamentals of UNIX version 2.0 (July, 2002)

Author A.Kishore/Sachin VNC Background

1.0. User Manual For HPC Cluster at GIKI. Volume. Ghulam Ishaq Khan Institute of Engineering Sciences & Technology

Visualization Cluster Getting Started

Acronis Backup & Recovery 10 Server for Linux. Installation Guide

Parallel Computing with Mathematica UVACSE Short Course

BACKUP YOUR SENSITIVE DATA WITH BACKUP- MANAGER

What s New in Centrify Server Suite 2013 Update 2

Remote Unix Lab Environment (RULE)

Data Movement and Storage. Drew Dolgert and previous contributors

Miami University RedHawk Cluster Connecting to the Cluster Using Windows

Accessing RCS IBM Console in Windows Using Linux Virtual Machine

Introweb Remote Backup Client for Mac OS X User Manual. Version 3.20

Assignment # 1 (Cloud Computing Security)

The CNMS Computer Cluster

SURFsara HPC Cloud Workshop

Tutorial Guide to the IS Unix Service

Getting Started With Your Virtual Dedicated Server. Getting Started Guide

Introduction to Running Computations on the High Performance Clusters at the Center for Computational Research

Introduction to HPC Workshop. Center for e-research

Acronis Backup & Recovery 10 Server for Linux. Installation Guide

IT at D-PHYS - Tutorial

Office of Information Technologies (OIT) Network File Shares

SURFsara HPC Cloud Workshop

Freshservice Discovery Probe User Guide

Installing the SSH Client v3.2.2 For Microsoft Windows

Deploying and managing a Visualization Onera

IDS and Penetration Testing Lab II

Acronis Backup & Recovery 10 Server for Linux. Installation Guide

CASHNet Secure File Transfer Instructions

Acronis Backup & Recovery 10 Server for Linux. Quick Start Guide

Remote Desktop Administration

WinSCP for Windows: Using SFTP to upload files to a server

Linux Cluster Computing An Administrator s Perspective

PARALLELS SERVER BARE METAL 5.0 README

SLURM Workload Manager

Online Backup Client User Manual Mac OS

Online Backup Client User Manual Mac OS

Service Product: IBM Cloud Automated Modular Management (AMM) for SAP HANA One

Transcription:

Introduction to MSI* for PubH 8403 Sep 30, 2015 Nancy Rowe *The Minnesota Supercomputing Institute for Advanced Computational Research

Overview MSI at a Glance MSI Resources Access System Access - Physical Additional Assistance

MSI at a Glance Facilitate research, help attract funding, contribute to education Access through eligible PI Serves more than 500 PI groups; 3000+ users About 40 fulltime staff; student workers A unit of the Office of the VP for Research Access to HPC, labs, storage and support 300+ software packages Basic resources at no charge

Questions? www.msi.umn.edu/support/faq.html

Location Main offices 5 th floor Walter Library HPC systems basement of Walter Library Computer labs Walter, Hasselmo, 717 Delaware (East Bank) Cargill (St. Paul)

Resources HPC systems Labs Software Storage Support

HPC systems Mesabi new this year; HP Linux cluster; 100 fastest in the world; about 18K cores, 67 TB memory Itasca HP Linux cluster about 9500 cores, 31TB memory Several other specialized systems

Laboratories Scientific Development and Visualization 575 and 585 Walter Library Basic Sciences Computing 1-280 Nils Hasselmo Hall Computational Genetics 138 Cargill Building Biomedical Modeling, Simulation, and Design 414 717 Delaware Building LCSE-MSI Visualization Virtual reality Large screen Remote visualization 125 Walter Library

Storage High Performance Storage 2.8 PB 25GB/s read/write 150 GB/group default; more w/ justification Second Tier Storage 1.4 PB CEPH Globally available Scratch < 30 days, not backed up Can get extensions

UNIX/Linux UNIX is the operating system of choice for engineering and scientific workstations. For our purposes UNIX/Linux are the same. Most software at MSI will run faster on UNIX Worth the effort to learn to use UNIX The variant of UNIX found at MSI and most widely in use around the world is GNU/Linux. MSI currently uses CentOS Linux. There are many other distributions (RedHat, Ubuntu, Debian)

Access building and system System access is through Professor Carlin For building email help@msi.umn.edu Access to BSCL (use appropriate lab name) Full legal name, your student ID number, U Card number, phone number Your instructor and/or class For other labs include whether you have access to AHC facilities Information can be found in the General Information page for each lab (www.msi.umn.edu/labs/ )

Remote Connection to MSI Several options for remote connection https://www.msi.umn.edu/remote-access NICE From inside UMN www.msi.umn.edu/support/faq/how-do-i-access-msi-windows-server-mywindows-machine www.msi.umn.edu/support/remote-desktop From outside UMN use VPN first www.msi.umn.edu/support/faq/why-cant-i-remote-desktop-msi-machine

Accessing machines while at MSI ssh [options] machine [options] -X set up environment to port graphics -Y for Macs machine User itasca, mesabi, etc. Encrypted login to remote machines $> man ssh See the MSI home page for a full lis:ng of lab and core machines scp scp [[user@]host1:]filename1[[user@]host2:]filename2 Examples: scp temp.ps login.msi.umn.edu:/scratch/temp.ps ssh Y rowe@itasca.msi.umn.edu www.msi.umn.edu/support/faq - File transfer section

Remote Login from outside MSI Requires VPN it.umn.edu/services/all/data-network/vpn/ Terminal login to the bastion host* login.msi.umn.edu Use ssh to connect to other machines Syntax: ssh [-X][-Y] [user@]host1 Examples: Use NICE Remote graphical connection Fastest Download client You can launch software directly on NICE ssh Y rowe@login.msi.umn.edu ssh itasca or isub *Users cannot launch software directly on login.msi.umn.edu

Getting Started MSI account. Open a terminal while sitting at the machine. A shell provides an interface for the user to interact with the operating system. BASH is the default shell at MSI. Alternatively, see the following link for information concerning remote access from your machine. www.msi.umn.edu/remote-access

isub isub is an MSI specific command to connect to MSI machines from login.msi.umn.edu or NX Expects bash shell Examples: isub isub n nodes=1:ppn=4 m 16GB w 24:00:0 Check www.msi.umn.edu/isub for more details *Users cannot launch software directly on login.msi.umn.edu or from NX

Linux software (modules) see web page www.msi.umn.edu/sw/r module load R start software R module avail R see available versions

Queueing system HPC system generally are not interactive Jobs are submitted to queues PBS https://www.msi.umn.edu/resources/jobsubmission-and-scheduling-pbs-scripts https://www.msi.umn.edu/labs/pbs Each HPC system has a Quickstart page

Caveats If you delete a file, it s GONE! There is no Recycle Bin step. The file may be able to be recovered from a backup by contacting help@msi.umn.edu. See https://www.msi.umn.edu/support/faq Access question 7 If you overwrite a file it has been changed forever. Home directories are backed up nightly. The scratch spaces are not backed up.

MSI home page www.msi.umn.edu Software www.msi.umn.edu/sw Password reset www.msi.umn.edu/password Tutorials www.msi.umn.edu/tutorial FAQ MSI web pages www.msi.umn.edu/support/faq.html

For help By email: help@msi.umn.edu Web: www.msi.umn.edu Phone: 612-626-0802 In person: Room 587 Walter Staffed 8:30AM to 6:00PM or by appointment Nancy Rowe rowe@msi.umn.edu or 612-624-2390 The University of Minnesota is an equal opportunity educator and employer. This PowerPoint is available in alternative formats upon request. Direct requests to Minnesota, 599 Walter library, 117 Pleasant St. SE, Minneapolis, Minnesota, 55455, 612-624-0528.