bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 19.
|
|
|
- Shanon Miles
- 8 years ago
- Views:
Transcription
1 bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 19. January 2011 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
2 Course Organization What is bwgrid Treff? Participants Current users of the bwgrid Clusters HD/MA Students and scientists interested in Grid Computing Members of the Universities Heidelberg and Mannheim Scope bwgrid Status and Plans Lectures and/or Workshops User contributions To meet you in person Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
3 bwgrid Treff History Course Organization Date Site Main Focus HD bwgrid Status and Interconnection HD/MA HD Batch-System and Parallel execution of serial jobs HD Parallel Programming with Java (Part I) HD Parallel Programming with Java (Part II) MA Matlab & Matlab Clones MA Statistics Software R HD Chemistry Software with Schrödinger Presentation HD Globus Toolkit Workshop Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
4 Course Organization bwgrid Treff 19. January 2011 Agenda for today: Status of the bwgrid Cluster MA/HD GLOBUS TOOLKIT WORKSHOP Installation of Globus Toolkit on your own computer Working at other bwgrid clusters Using the central bwgrid storage in Karlsruhe Discussion of topics for the next meetings Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
5 bwgrid News bwgrid Introduction Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
6 What is bwgrid? bwgrid News bwgrid Virtual Organization (VO) D-Grid Community project of the Universities in Baden-Württemberg VO bwgrid is open for all members of the participating Universities bwgrid Resources Compute clusters at 8 locations Central storage unit in Karlsruhe bwgrid Objectives Verifying the functionality and the benefit of Grid concepts for the HPC community in Baden-Württemberg Managing organisational, security, and license issues Development of new cluster and Grid applications Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
7 bwgrid News bwgrid Resources Compute cluster: Mannheim/Heidelberg: 280 nodes Direct Interconnection Frankfurt Karlsruhe: 140 nodes Stuttgart: 420 nodes Tübingen: 140 nodes Mannheim (interconnected to a single cluster) Heidelberg Ulm (Konstanz): 280 nodes Hardware in Ulm Karlsruhe Stuttgart Freiburg: 140 nodes Esslingen Esslingen: 180 nodes more recent Hardware Central storage: Freiburg Tübingen Ulm (joint cluster with Konstanz) München Karlsruhe: 128 TB (with Backup) 256 TB (without Backup) Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
8 bwgrid News bwgrid Cluster Mannheim/Heidelberg Configuration Belwue VORM Benutzer Benutzer PBS Benutzer Benutzer VORM LDAP Admin AD Cluster Mannheim InfiniBand Obsidian + ADVA passwd InfiniBand Cluster Heidelberg Lustre bwfs MA Lustre bwfs HD Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
9 bwgrid News Status of the bwgrid Cluster MA/HD Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
10 bwgrid News bwgrid Cluster Mannheim/Heidelberg Current Status bwgrid storage in Heidelberg Current temporary home directories No Backup! limited to 100 GB per user Workspaces for temporary data bwgrid storage in Mannheim Damaged old home directories Plan: Access open until 1. March 2011 Project descriptions for Many project description are missing Important: Publications!, coworkers, text, pictures, links Account still needed, if project is completed? Need more time? Please, inform us. Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
11 Globus Toolkit Workshop Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
12 Introduction Prerequisites for bwgrid Access DFN Grid certificate Membership in the VO bwgrid Grid Middleware client (Globus Toolkit) Information leaflet available at: HD: Zugangsmöglichkeiten MA: cluster Zugangsberechtigung Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
13 Introduction Access to bwgrid resources: How does it work? VOMRS 1. Registration with grid certificate 3. List with DNs (grid-mapfile) 2. Approves DN (= distinguished name) User VO 5. Access with Middleware Client Tools gsissh/gsiscp - GridFTP - Web Services 4. Preparations: Setup Middleware client Prepare certificate files Grid-Proxy for Single Sign-on 4. Preparations: Setup Middleware server Provide accounts for DNs Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
14 Introduction Middlewares at bwgrid resources Globus Toolkit Version recommended 4.0 release available at all bwgrid sites client should have the same version Planned: UNICORE 5.0/6.0, Globus Toolkit 5 In development: bwgrid Portal Web Access to bwgrid via different Middlewares Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
15 Introduction Globus Toolkit Workshop Agenda Installation of Globus Toolkit on your own computer Working at other bwgrid clusters Using the central bwgrid storage in Karlsruhe Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
16 Installation & Preparation Installation & Preparation Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
17 Installation & Preparation Installation of Globus Toolkit How to get Globus Toolkit? Login to your computer where you want to install Open Globus Toolkit web site: Menu: Globus Toolkit Download Stable Releases: Globus Toolkit Downloads Source Downloads: Full Toolkit Source Download Download page for gt4.0.8-all-source-installer.tar.bz2 Enter Survey Data Download and save file Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
18 Installation & Preparation Installation of Globus Toolkit How to build Globus Toolkit? Determine and make installation directory, e.g.: TARGET DIR="/home/user/opt/gt/4.0.8" mkdir -vp "$TARGET DIR" Unpack source and change to source directory: tar -jxvf gt4.0.8-all-source-installer.tar.bz2 cd gt4.0.8-all-source-installer Configure (Java is only needed for web services, ignore warnings):./configure --prefix "$TARGET DIR" Build and install: make gsi-openssh (sufficient for gsissh and gsiscp) make gridftp (necessary for globus-url-copy) make install Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
19 Installation & Preparation Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
20 Useful Globus Toolkit Commands Installation & Preparation Security Authentication & Authorization grid-proxy-init Generate a new proxy certificate grid-proxy-destroy Destroy the current proxy certificate grid-proxy-info Display proxy certificate information GSI-OpenSSH gsissh Secure remote login gsiscp Secure remote file copy gsisftp Secure file transfer Data Management GridFTP globus-url-copy Multi-protocol data movement Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
21 Installation & Preparation Preparations Part I Export your PKCS12 certificate from your browser. In Firefox: Edit Preferences Advanced Encryption View Certificates Your Certificates Backup... You will get a file named cert yourname.p12 for instance. Convert the private key of your certificate to the pem-format: openssl pkcs12 -in cert yourname.p12 \ -out userkey.pem -nocerts Convert the public key of your certificate to the pem-format: openssl pkcs12 -in cert yourname.p12 \ -out usercert.pem -clcerts -nokeys Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
22 Installation & Preparation Preparations Part II Copy the keys to a.globus directory in your home directory: mkdir -p $HOME/.globus mv userkey.pem usercert.pem $HOME/.globus/ Protect your certificate files: chmod -c 700 $HOME/.globus chmod -c 600 $HOME/.globus/user* Obtain and include CA certificates: mkdir -p $HOME/.globus/certificates cd $HOME/.globus/certificates wget " \ igtf/current/accredited/ \ igtf-preinstalled-bundle-classic.tar.gz" tar xvzf igtf-preinstalled-bundle-classic.tar.gz Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
23 Installation & Preparation Set Environment (for each session) Set environment variables (can be included in ḃashrc): export GLOBUS LOCATION=$TARGET DIR source $GLOBUS LOCATION/etc/globus-user-env.sh Create a grid-proxy-certificate: grid-proxy-init -debug The grid-proxy-certificate expires after 12 hours. To inquire an existing grid-proxy-certificate: grid-proxy-info Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
24 Working at other bwgrid clusters Working at other bwgrid clusters Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
25 Working at other bwgrid clusters bwgrid compute clusters Addresses ( Benutzerinformationen Zugang): Mannheim/Heidelberg: gtbw.grid.uni-mannheim.de Ulm/Konstanz: koios.rz.uni-ulm.de Stuttgart: gridway.dgrid.hlrs.de Freiburg: globus.bfg.uni-freiburg.de Tübingen: gt4.uni-tuebingen.de Karlsruhe: bwgrid-cluster.scc.kit.edu Esslingen: grid01.hs-esslingen.de Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
26 Working at other bwgrid clusters Connection to bwgrid sites To connect to a globus toolkit server: gsissh -p 2222 gt servername Option -X for X forwarding Options -v or -vv for more information in case of errors Example: Connect and gain site information gsissh -p 2222 bwgrid-cluster.scc.kit.edu Note login messages: Dokus, Support, News Conditions for using bwgrid: man bw-grid Available software modules: module avail Batch class limits: qstat -q Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
27 Working at other bwgrid clusters File Transfer to and from bwgrid sites To transfer files to a globus server: gsiscp -P 2222 local file gt servername: To fetch files from a globus server: gsiscp -P 2222 gt servername:remote file. Takes normal scp options Between globus servers option -P 2222 not necessary Example: Connect, copy files and run example job gsissh -p 2222 bwgrid-cluster.scc.kit.edu gsiscp -r gtbw.grid.uni-mannheim.de:\ /opt/bwgrid/mpi/openmpi/1.4.2-gnu-4.1/examples. cd examples module load mpi/openmpi/1.4.2-gnu-4.1 mpicc hello.c -o hello qsub bwgrid-mpi.pbs qstat Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
28 Central bwgrid Storage in Karlsruhe Central bwgrid Storage in Karlsruhe Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
29 Central bwgrid Storage in Karlsruhe bwgrid Storage Configuration 2 File Systems: Backup (/bwfs/backup), 128 TByte (with Backup) Restore request via ticket at Work (/bwfs/work), 256 TByte (without Backup) User documentation: Common address bwgrid-se.scc.kit.edu for 6 access nodes bwgrid-se[1-6].scc.kit.edu (10GE) gsissh and gridftp (faster) Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
30 Central bwgrid Storage in Karlsruhe bwgrid Storage Configuration Schema des zentralen Storage BelWü Dateisystem Kapazität Schreibdurchsatz backup 128 TB 1500 MB/s work 256 TB 3700 MB/s Lesedurchsatz 1900 MB/s 4200 MB/s Gateway Gateway Gateway Gateway Gateway Gateway InfiniBand DDR Interconnect MGS MDS OSS OSS MGS MDS OSS OSS OSS OSS OSS OSS Zentrales Storage Element für bwgrid (R. Laifer, O. Schneider, A. Trunov) Steinbuch Centre for Computing Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
31 Central bwgrid Storage in Karlsruhe bwgrid Storage Example Login: gsissh -p 2222 bwgrid-se.scc.kit.edu Home directory is in Backup file system: pwd Link to Work file system is available: ll work Copy job result to work file system of the bwgrid storage: From cluster to storage with gsiscp: gsiscp bwgrid-mpi.oxxx bwgrid-se.scc.kit.edu:work/ From cluster to storage with gridftp: globus-url-copy file:$home/examples/bwgrid-mpi.oxxx \ gsiftp://bwgrid-se.scc.kit.de:2811/~/work/ Whole directory from cluster to storage with gridftp: globus-url-copy -r -cd file:$home/examples/ \ gsiftp://bwgrid-se.scc.kit.de:2811/~/work/examples/ Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
32 Further Meetings Further Meetings Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
33 Further Meetings bwgrid Treff Further Meetings Date Site Main Focus HD bwgrid Status and Interconnection HD/MA HD Batch-System and Parallel execution of serial jobs HD Parallel Programming with Java (Part I) HD Parallel Programming with Java (Part II) MA Matlab & Matlab Clones MA Statistics Software R HD Chemistry Software with Schrödinger Presentation HD Globus Toolkit Workshop Feb 2011 HD??? Mar 2011 MA??? Apr 2011 MA??? Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/ / 33
bwgrid Treff HD/MA Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 30.
bwgrid Treff HD/MA Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 30. January 2013 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2012/2013 1 / 23 Course
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 24.
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 24. November 2010 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/2011 1 / 17 Course
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 5.
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 5. October 2011 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2011/12 1 / 21 Course
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 29.
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 29. September 2010 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/2011 1 / 25 Course
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 20.
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 20. October 2010 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2010/2011 1 / 27 Course
bwgrid Treff HD/MA Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 30.
bwgrid Treff HD/MA Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 30. January 2013 Richling/Kredel (URZ/RUM) bwgrid Treff WS 2012/2013 1 / 23 Course
How To Use Bwgrid
bwgrid Treff HD/MA Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 15. May 2013 Richling/Kredel (URZ/RUM) bwgrid Treff SS 2013 1 / 22 Course Organization
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 11.
bwgrid Treff MA/HD Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 11. July 2012 Richling/Kredel (URZ/RUM) bwgrid Treff SS 2012 1 / 21 Course Organization
Hands On Session. Bijoy M B. System Software Development Group CDAC, Bangalore. Thursday, October 07, 2010 GBC-2010- IMSC CHENNAI 1
Hands On Session Bijoy M B System Software Development Group CDAC, Bangalore GBC-- IMSC CHENNAI 1 Presentation Overview What is Globus Toolkit? Components of Globus Toolkit Functions of Globus Components
Linux für bwgrid. Sabine Richling, Heinz Kredel. Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim. 27.
Linux für bwgrid Sabine Richling, Heinz Kredel Universitätsrechenzentrum Heidelberg Rechenzentrum Universität Mannheim 27. June 2011 Richling/Kredel (URZ/RUM) Linux für bwgrid FS 2011 1 / 33 Introduction
Lessons learned from parallel file system operation
Lessons learned from parallel file system operation Roland Laifer STEINBUCH CENTRE FOR COMPUTING - SCC KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association
XSEDE Service Provider Software and Services Baseline. September 24, 2015 Version 1.2
XSEDE Service Provider Software and Services Baseline September 24, 2015 Version 1.2 i TABLE OF CONTENTS XSEDE Production Baseline: Service Provider Software and Services... i A. Document History... A-
A Brief Guide to Certificate Management
A Brief Guide to Certificate Management M.L. Luvisetto November 18, 2008 1 Introduction: Concepts, Passphrase Certificates are the way users authenticate themselves in network activities that perform identity
Using Globus Toolkit
Using Globus Toolkit G. Poghosyan & D. Nilsen GridKa School 11-15 September 2006 Basic Grid Services in GT Security Services GSI (Grid Security Infrastructure) Data Services GridFTP RFT (Reliable File
Introduction to Programming and Computing for Scientists
Oxana Smirnova (Lund University) Programming for Scientists Tutorial 7b 1 / 48 Introduction to Programming and Computing for Scientists Oxana Smirnova Lund University Tutorial 7b: Grid certificates and
NorduGrid ARC Tutorial
NorduGrid ARC Tutorial / Arto Teräs and Olli Tourunen 2006-03-23 Slide 1(34) NorduGrid ARC Tutorial Arto Teräs and Olli Tourunen CSC, Espoo, Finland March 23
Grid and Cloud Computing at LRZ Dr. Helmut Heller, Group Leader Distributed Resources Group
Grid and Cloud Computing at LRZ Dr. Helmut Heller, Group Leader Distributed Resources Group Overview Grid: http://www.grid.lrz.de What is Grid computing? Advantages of Grid computing (why you should use
Ciphermail Gateway Separate Front-end and Back-end Configuration Guide
CIPHERMAIL EMAIL ENCRYPTION Ciphermail Gateway Separate Front-end and Back-end Configuration Guide June 19, 2014, Rev: 8975 Copyright 2010-2014, ciphermail.com. CONTENTS CONTENTS Contents 1 Introduction
Australian Synchrotron, Storage Gateway
Australian Synchrotron, Storage Gateway User Help Manual Version 1.2 Storage Gateway User Help Manual 2 REVISION HISTORY Date Version Description Author 2 May 2008 1.0 Document creation Chris Myers 13
F-Secure Messaging Security Gateway. Deployment Guide
F-Secure Messaging Security Gateway Deployment Guide TOC F-Secure Messaging Security Gateway Contents Chapter 1: Deploying F-Secure Messaging Security Gateway...3 1.1 The typical product deployment model...4
EUROPEAN MIDDLEWARE INITIATIVE
EUROPEAN MIDDLEWARE INITIATIVE GRIDSITE ADMINISTRATOR GUIDE Document version: 2.0.0-1 EMI Component Version: 1.x, 2.x 1/9 GridSite Administrator Guide This work is co-funded by the European Commission
TECHNICAL NOTE Stormshield Network Firewall AUTOMATIC BACKUPS. Document version: 1.0 Reference: snentno_autobackup
Stormshield Network Firewall Document version: 1.0 Reference: snentno_autobackup CONTENTS INTRODUCTION 3 OPERATION 3 Storing in the Mystormshield.eu client area 3 Storing on a customized server 3 FIREWALL
LoadMaster SSL Certificate Quickstart Guide
LoadMaster SSL Certificate Quickstart Guide for the LM-1500, LM-2460, LM-2860, LM-3620, SM-1020 This guide serves as a complement to the LoadMaster documentation, and is not a replacement for the full
Introduction to ANSYS Academic Research
Introduction to ANSYS Academic Research bwgrid meeting University of Heidelberg 05.10.2011 Steinbuch Centre for Computing (SCC) Dr. Scientific Computing Services (SCS) Zirkel 2, Bldg. 20.21 76131 Karlsruhe,
The ENEA gateway approach providing EGEE/gLite access to unsupported platforms and operating systems
EU-IndiaGrid Workshop Taipei, November 2nd 2007 The ENEA gateway approach providing EGEE/gLite access to unsupported platforms and operating systems G. Bracco, S.Migliori, A. Quintiliani, A. Santoro, C.
HPC system startup manual (version 1.30)
HPC system startup manual (version 1.30) Document change log Issue Date Change 1 12/1/2012 New document 2 10/22/2013 Added the information of supported OS 3 10/22/2013 Changed the example 1 for data download
Towards a Comprehensive Accounting Solution in the Multi-Middleware Environment of the D-Grid Initiative
Towards a Comprehensive Accounting Solution in the Multi-Middleware Environment of the D-Grid Initiative Jan Wiebelitz Wolfgang Müller, Michael Brenner, Gabriele von Voigt Cracow Grid Workshop 2008, Cracow,
École des Ponts Paristech DSI. Installing OpenVPN
École des Ponts Paristech DSI Installing OpenVPN Introduction... 3 Windows... 3 Preamble... 3 Installation of OpenVPN... 3 Use... 11 Linux... 13 Install... 13 Use... 14 Mac OS X... 14 Install... 14 Use...
HPC at IU Overview. Abhinav Thota Research Technologies Indiana University
HPC at IU Overview Abhinav Thota Research Technologies Indiana University What is HPC/cyberinfrastructure? Why should you care? Data sizes are growing Need to get to the solution faster Compute power is
Data Management. Network transfers
Data Management Network transfers Network data transfers Not everyone needs to transfer large amounts of data on and off a HPC service Sometimes data is created and consumed on the same service. If you
Authentication Methods
Authentication Methods Overview In addition to the OU Campus-managed authentication system, OU Campus supports LDAP, CAS, and Shibboleth authentication methods. LDAP users can be configured through the
BlackBerry Enterprise Service 10. Version: 10.2. Configuration Guide
BlackBerry Enterprise Service 10 Version: 10.2 Configuration Guide Published: 2015-02-27 SWD-20150227164548686 Contents 1 Introduction...7 About this guide...8 What is BlackBerry Enterprise Service 10?...9
VMware Identity Manager Connector Installation and Configuration
VMware Identity Manager Connector Installation and Configuration VMware Identity Manager This document supports the version of each product listed and supports all subsequent versions until the document
Certificate technology on Pulse Secure Access
Certificate technology on Pulse Secure Access How-to Guide Published Date July 2015 Contents Introduction: 3 Creating a Certificate signing request (CSR): 3 Import Intermediate CAs: 5 Using Trusted Client
Grid Computing With FreeBSD
Grid Computing With FreeBSD USENIX ATC '04: UseBSD SIG Boston, MA, June 29 th 2004 Brooks Davis, Craig Lee The Aerospace Corporation El Segundo, CA {brooks,lee}aero.org http://people.freebsd.org/~brooks/papers/usebsd2004/
Technical Guide to ULGrid
Technical Guide to ULGrid Ian C. Smith Computing Services Department September 4, 2007 1 Introduction This document follows on from the User s Guide to Running Jobs on ULGrid using Condor-G [1] and gives
File transfer in UNICORE State of the art
Mitglied der Helmholtz-Gemeinschaft File transfer in UNICORE State of the art Bernd Schuller, Björn Hagemeier, Michael Rambadt Federated Systems and Data division Jülich Supercomputer Centre Forschungszentrum
Getting Started with HPC
Getting Started with HPC An Introduction to the Minerva High Performance Computing Resource 17 Sep 2013 Outline of Topics Introduction HPC Accounts Logging onto the HPC Clusters Common Linux Commands Storage
Recommendations for Static Firewall Configuration in D-Grid
D-Grid Integrationsprojekt (DGI-2) Fachgebiet 3-3 Firewalls Recommendations for Static Firewall Configuration in D-Grid Version 1.5, 21. Mai 2008 D-Grid Integrationsprojekt (DGI-2) Autoren: Gian Luca Volpato
Workshop Agenda Feb 25th 2015
Workshop Agenda Feb 25th 2015 Time Presenter Title 09:30 T. König Talk bwhpc Concept & bwhpc-c5 - Federated User Support Activities 09:45 R. Walter Talk bwhpc architecture (bwunicluster, bwforcluster JUSTUS,
File Transfer Best Practices
File Transfer Best Practices David Turner User Services Group NERSC User Group Meeting October 2, 2008 Overview Available tools ftp, scp, bbcp, GridFTP, hsi/htar Examples and Performance LAN WAN Reliability
Data Movement and Storage. Drew Dolgert and previous contributors
Data Movement and Storage Drew Dolgert and previous contributors Data Intensive Computing Location Viewing Manipulation Storage Movement Sharing Interpretation $HOME $WORK $SCRATCH 72 is a Lot, Right?
HOWTO. Configure Nginx for SSL with DoD CAC Authentication on CentOS 6.3. Joshua Penton Geocent, LLC joshua.penton@geocent.com.
HOWTO Configure Nginx for SSL with DoD CAC Authentication on CentOS 6.3 Joshua Penton Geocent, LLC joshua.penton@geocent.com March 2013 Table of Contents Overview... 1 Prerequisites... 2 Install OpenSSL...
Introduction to SDSC systems and data analytics software packages "
Introduction to SDSC systems and data analytics software packages " Mahidhar Tatineni (mahidhar@sdsc.edu) SDSC Summer Institute August 05, 2013 Getting Started" System Access Logging in Linux/Mac Use available
HP Device Manager 4.7
Technical white paper HP Device Manager 4.7 FTPS Certificates Configuration Table of contents Overview... 2 Server certificate... 2 Configuring a server certificate on an IIS FTPS server... 2 Creating
Designing IT Platform Collaborative Applications with Microsoft SharePoint 2003 Workshop
Designing IT Platform Collaborative Applications with Microsoft SharePoint 2003 Workshop Course 8036: Two days; Instructor-led Microsoft Certified Professional Exams No Microsoft Certified Professional
Browser-based Support Console
TECHNICAL PAPER Browser-based Support Console Mass deployment of certificate Netop develops and sells software solutions that enable swift, secure and seamless transfer of video, screens, sounds and data
CERTIFICATE-BASED SINGLE SIGN-ON FOR EMC MY DOCUMENTUM FOR MICROSOFT OUTLOOK USING CA SITEMINDER
White Paper CERTIFICATE-BASED SINGLE SIGN-ON FOR EMC MY DOCUMENTUM FOR MICROSOFT OUTLOOK USING CA SITEMINDER Abstract This white paper explains the process of integrating CA SiteMinder with My Documentum
Work Environment. David Tur HPC Expert. HPC Users Training September, 18th 2015
Work Environment David Tur HPC Expert HPC Users Training September, 18th 2015 1. Atlas Cluster: Accessing and using resources 2. Software Overview 3. Job Scheduler 1. Accessing Resources DIPC technicians
globus online Globus Online for Research Data Management Rachana Ananthakrishnan Great Plains Network Annual Meeting 2013
globus online Globus Online for Research Data Management Rachana Ananthakrishnan Great Plains Network Annual Meeting 2013 We started with technology proven in many large-scale grids GridFTP GRAM MyProxy
Certificate technology on Junos Pulse Secure Access
Certificate technology on Junos Pulse Secure Access How-to Introduction:... 1 Creating a Certificate signing request (CSR):... 1 Import Intermediate CAs: 3 Using Trusted Client CA on Juno Pulse Secure
Introduction to Linux and Cluster Basics for the CCR General Computing Cluster
Introduction to Linux and Cluster Basics for the CCR General Computing Cluster Cynthia Cornelius Center for Computational Research University at Buffalo, SUNY 701 Ellicott St Buffalo, NY 14203 Phone: 716-881-8959
Workspot Configuration Guide for the Cisco Adaptive Security Appliance
Workspot Configuration Guide for the Cisco Adaptive Security Appliance Workspot, Inc. 1/27/2015 Cisco ASA and Workspot Overview The Cisco Adaptive Security Appliance (ASA) provides organizations with secure,
http://cnmonitor.sourceforge.net CN=Monitor Installation and Configuration v2.0
1 Installation and Configuration v2.0 2 Installation...3 Prerequisites...3 RPM Installation...3 Manual *nix Installation...4 Setup monitoring...5 Upgrade...6 Backup configuration files...6 Disable Monitoring
Quick Introduction to HPSS at NERSC
Quick Introduction to HPSS at NERSC Nick Balthaser NERSC Storage Systems Group nabalthaser@lbl.gov Joint Genome Institute, Walnut Creek, CA Feb 10, 2011 Agenda NERSC Archive Technologies Overview Use Cases
An Information System
An Information System Module 1: Tutorials and Exercises Basics Software Setup Login in your machine cd $HOME/MyOpenLDAP chmod u+x setup.sh./setup.sh ./setup.sh (BDB setup) Prepare the Berkeley Database
Implementing and Managing Microsoft Server Virtualization
Course 10215A: Implementing and Managing Microsoft Server Virtualization Course Details Course Outline Module 1: Evaluating and Planning for Virtualization Describe virtualization as it relates to server,
Entrust IdentityGuard Comprehensive
Entrust IdentityGuard Comprehensive Entrust IdentityGuard Comprehensive is a five-day, hands-on overview of Entrust Course participants will gain experience planning, installing and configuring Entrust
Sustainability in Grid-Computing Christian Baun. Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH)
Sustainability in Grid-Computing Christian Baun Die Kooperation von Sustainability in Grid-Computing Important topics in Grid-Computing during GridKa-School 2007: Grid applications Grid middleware systems
Contents Set up Cassandra Cluster using Datastax Community Edition on Amazon EC2 Installing OpsCenter on Amazon AMI References Contact
Contents Set up Cassandra Cluster using Datastax Community Edition on Amazon EC2... 2 Launce Amazon micro-instances... 2 Install JDK 7... 7 Install Cassandra... 8 Configure cassandra.yaml file... 8 Start
Configuration Guide BES12. Version 12.2
Configuration Guide BES12 Version 12.2 Published: 2015-07-07 SWD-20150630131852557 Contents About this guide... 8 Getting started... 9 Administrator permissions you need to configure BES12... 9 Obtaining
NEC HPC-Linux-Cluster
NEC HPC-Linux-Cluster Hardware configuration: 4 Front-end servers: each with SandyBridge-EP processors: 16 cores per node 128 GB memory 134 compute nodes: 112 nodes with SandyBridge-EP processors (16 cores
Enabling SSL and Client Certificates on the SAP J2EE Engine
Enabling SSL and Client Certificates on the SAP J2EE Engine Angel Dichev RIG, SAP Labs SAP AG 1 Learning Objectives As a result of this session, you will be able to: Understand the different SAP J2EE Engine
Tutorial: Using WestGrid. Drew Leske Compute Canada/WestGrid Site Lead University of Victoria
Tutorial: Using WestGrid Drew Leske Compute Canada/WestGrid Site Lead University of Victoria Fall 2013 Seminar Series Date Speaker Topic 23 September Lindsay Sill Introduction to WestGrid 9 October Drew
Marriott Enrollment Server for Web User Guide V1.4
Marriott Enrollment Server for Web User Guide V1.4 Page 1 of 26 Table of Contents TABLE OF CONTENTS... 2 PREREQUISITES... 3 ADMINISTRATIVE ACCESS... 3 RNACS... 3 SUPPORTED BROWSERS... 3 DOWNLOADING USING
SECURE Web Gateway. HTTPS/SSL Technical FAQ. Version 1.1. Date 04/10/12
SECURE Web Gateway HTTPS/SSL Technical FAQ Version 1.1 Date 04/10/12 Introduction This Technical FAQ explains the operation of the HTTPS/SSL scanning and how it is deployed. How does the SECURE Web Gateway
Content Filtering Client Policy & Reporting Administrator s Guide
Content Filtering Client Policy & Reporting Administrator s Guide Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your system. CAUTION: A CAUTION
The Technical Realization of the National Analysis Facility
Waltraut Niepraschk Andreas Haupt Wolfgang Friebel Kai Leffhalm Götz Waschk Peter Wegner for the NAF team The Technical Realization of the National Analysis Facility Technical Seminar Zeuthen 2008-04-15
Integrating Apache Web Server with Tomcat Application Server
Integrating Apache Web Server with Tomcat Application Server The following document describes how to build an Apache/Tomcat server from all source code. The end goal of this document is to configure the
Defender 5.7 - Token Deployment System Quick Start Guide
Defender 5.7 - Token Deployment System Quick Start Guide This guide describes how to install, configure and use the Defender Token Deployment System, based on default settings and how to self register
Beyond Windows: Using the Linux Servers and the Grid
Beyond Windows: Using the Linux Servers and the Grid Topics Linux Overview How to Login & Remote Access Passwords Staying Up-To-Date Network Drives Server List The Grid Useful Commands Linux Overview Linux
WebSpy Vantage Ultimate 2.2 Web Module Administrators Guide
WebSpy Vantage Ultimate 2.2 Web Module Administrators Guide This document is intended to help you get started using WebSpy Vantage Ultimate and the Web Module. For more detailed information, please see
GT 6.0 GSI C Security: Key Concepts
GT 6.0 GSI C Security: Key Concepts GT 6.0 GSI C Security: Key Concepts Overview GSI uses public key cryptography (also known as asymmetric cryptography) as the basis for its functionality. Many of the
Service Manager 9.32: Generating SSL Profiles for an F5 HWLB
Knowledge Article Service Manager 9.32: Generating SSL Profiles for an F5 HWLB Describes how to create SSL Profiles for an F5 hardware load balancer to communicate with the Service Manager 9.32 server
1Y0-250 Implementing Citrix NetScaler 10 for App and Desktop Solutions Practice Exam
1Y0-250 Implementing Citrix NetScaler 10 for App and Desktop Solutions Practice Exam Section 1: Assessing infrastructure needs for the NetScaler implementation 1.1 Task Description: Verify the objectives
Using the Push Notifications Extension Part 1: Certificates and Setup
// tutorial Using the Push Notifications Extension Part 1: Certificates and Setup Version 1.0 This tutorial is the second part of our tutorials covering setting up and running the Push Notifications Native
Configuration Guide BES12. Version 12.3
Configuration Guide BES12 Version 12.3 Published: 2016-01-19 SWD-20160119132230232 Contents About this guide... 7 Getting started... 8 Configuring BES12 for the first time...8 Configuration tasks for managing
Release Notes. CTERA Portal 3.2.43. May 2013. CTERA Portal 3.2.43 Release Notes 1
Release Notes CTERA Portal 3.2.43 May 2013 CTERA Portal 3.2.43 Release Notes 1 1 Release Contents Copyright 2009-2013 CTERA Networks Ltd. All rights reserved. No part of this document may be reproduced
The ENEA-EGEE site: Access to non-standard platforms
V INFNGrid Workshop Padova, Italy December 18-20 2006 The ENEA-EGEE site: Access to non-standard platforms C. Sciò**, G. Bracco, P. D'Angelo, L. Giammarino*, S.Migliori, A. Quintiliani, F. Simoni, S. Podda
CMS Tier-3 cluster at NISER. Dr. Tania Moulik
CMS Tier-3 cluster at NISER Dr. Tania Moulik What and why? Grid computing is a term referring to the combination of computer resources from multiple administrative domains to reach common goal. Grids tend
Integrating EJBCA and OpenSSO
Integrating EJBCA and OpenSSO EJBCA is an Enterprise PKI Certificate Authority issuing certificates to users, servers and devices. In an organization certificate can be used for strong authentication.
CreationDirect. Clearstream file transfer connectivity solutions
CreationDirect Clearstream file transfer connectivity solutions CreationDirect - Clearstream file transfer connectivity solutions Document number: 6731 This document is the property of Clearstream Banking
HADOOP - MULTI NODE CLUSTER
HADOOP - MULTI NODE CLUSTER http://www.tutorialspoint.com/hadoop/hadoop_multi_node_cluster.htm Copyright tutorialspoint.com This chapter explains the setup of the Hadoop Multi-Node cluster on a distributed
NSi Mobile Installation Guide. Version 6.2
NSi Mobile Installation Guide Version 6.2 Revision History Version Date 1.0 October 2, 2012 2.0 September 18, 2013 2 CONTENTS TABLE OF CONTENTS PREFACE... 5 Purpose of this Document... 5 Version Compatibility...
10215A Implementing and Managing Microsoft Server Virtualization
10215A Implementing and Managing Microsoft Server Virtualization About this Course This five-day course will provide you with the knowledge and skills to deploy and manage a server virtualization environment
The Asterope compute cluster
The Asterope compute cluster ÅA has a small cluster named asterope.abo.fi with 8 compute nodes Each node has 2 Intel Xeon X5650 processors (6-core) with a total of 24 GB RAM 2 NVIDIA Tesla M2050 GPGPU
Chapter 7 Managing Users, Authentication, and Certificates
Chapter 7 Managing Users, Authentication, and Certificates This chapter contains the following sections: Adding Authentication Domains, Groups, and Users Managing Certificates Adding Authentication Domains,
SSL... 2 2.1. 3 2.2. 2.2.1. 2.2.2. SSL VPN
1. Introduction... 2 2. Remote Access via SSL... 2 2.1. Configuration of the Astaro Security Gateway... 3 2.2. Configuration of the Remote Client...10 2.2.1. Astaro User Portal: Getting Software and Certificates...10
CA and SSL Certificates
1 For this exercise you must again be root. Login and obtain root privileges: sudo su 2 Create a working directory only accessible to root: mkdir ~/ca cd ~/ca chmod og rwx. 3 Install openssl if necessary
Data Management Best Practices
December 4, 2013 Data Management Best Practices Ryan Mokos Outline Overview of Nearline system (HPSS) Hardware File system structure Data transfer on Blue Waters Globus Online (GO) interface Web GUI Command-Line
Only LDAP-synchronized users can access SAML SSO-enabled web applications. Local end users and applications users cannot access them.
This chapter provides information about the Security Assertion Markup Language (SAML) Single Sign-On feature, which allows administrative users to access certain Cisco Unified Communications Manager and
New High-performance computing cluster: PAULI. Sascha Frick Institute for Physical Chemistry
New High-performance computing cluster: PAULI Sascha Frick Institute for Physical Chemistry 02/05/2012 Sascha Frick (PHC) HPC cluster pauli 02/05/2012 1 / 24 Outline 1 About this seminar 2 New Hardware
JUROPA Linux Cluster An Overview. 19 May 2014 Ulrich Detert
Mitglied der Helmholtz-Gemeinschaft JUROPA Linux Cluster An Overview 19 May 2014 Ulrich Detert JuRoPA JuRoPA Jülich Research on Petaflop Architectures Bull, Sun, ParTec, Intel, Mellanox, Novell, FZJ JUROPA
UVOS WEB REGISTRATION EXTENSION MANUAL
UVOS Web Registration Extension Manual UVOS WEB REGISTRATION EXTENSION MANUAL UNICORE Team Document Version: 1.5.1 Component Version: 1.5.0-p6 Date: 13 04 2012 This work is co-funded by the EC EMI project
locuz.com HPC App Portal V2.0 DATASHEET
locuz.com HPC App Portal V2.0 DATASHEET Ganana HPC App Portal makes it easier for users to run HPC applications without programming and for administrators to better manage their clusters. The web-based
CUSTOMER Installing SAP Afaria
SAP Afaria Document Version: 7 SP05-2014-09-02 CUSTOMER Table of Contents 1....3 1.1 Launching the Afaria Setup Program....3 1.2 Installing the Afaria Server....4 1.2.1 Configuring Afaria to use LDAP....6
SSL Configuration Best Practices for SAS Visual Analytics 7.1 Web Applications and SAS LASR Authorization Service
Paper SAS1541-2015 SSL Configuration Best Practices for SAS Visual Analytics 7.1 Web Applications and SAS LASR Authorization Service Heesun Park and Jerome Hughes, SAS Institute Inc., Cary, NC ABSTRACT
TIBCO Spotfire Platform IT Brief
Platform IT Brief This IT brief outlines features of the system: Communication security, load balancing and failover, authentication options, and recommended practices for licenses and access. It primarily
Introduction to Running Hadoop on the High Performance Clusters at the Center for Computational Research
Introduction to Running Hadoop on the High Performance Clusters at the Center for Computational Research Cynthia Cornelius Center for Computational Research University at Buffalo, SUNY 701 Ellicott St
Running Knn Spark on EC2 Documentation
Pseudo code Running Knn Spark on EC2 Documentation Preparing to use Amazon AWS First, open a Spark launcher instance. Open a m3.medium account with all default settings. Step 1: Login to the AWS console.