Broadening Moab/TORQUE for Expanding User Needs
|
|
|
- Brianna Anthony
- 8 years ago
- Views:
Transcription
1 Broadening Moab/TORQUE for Expanding User Needs Gary D. Brown HPC Product Manager CUG Adaptive Computing Enterprises, Inc.
2 Agenda DataWarp Intel MIC KNL Viewpoint Web Portal User Portal Administrator Portal Remote Visualization Nitro HTC Adaptive Computing Enterprises, Inc.
3 Agenda DataWarp (fast I/O) Intel MIC KNL Viewpoint Web Portal User Portal Administrator Portal Remote Visualization Nitro HTC Adaptive Computing Enterprises, Inc.
4 Use Cases Stage job data with fast SSD-based storage Input data before job starts Output data after job ends Fast persistent storage for job workflows Fast job checkpoint/restore Adaptive Computing Enterprises, Inc.
5 Cray DataWarp SSD-based storage system independent of parallel file system (PFS) Hosted on DataWarp (DW) service nodes Contain actual SSDs Nodes connect to Aries high-speed network DataWarp Service (DWS) Organizes DW storage for jobs and persistent storage Manages SSD storage across DW service nodes Adaptive Computing Enterprises, Inc.
6 Cray DataWarp Physical Architecture DW storage 2-hop roundtrip Aries HSN Electronic access times PFS storage 4-hop roundtrip 2-hop Aries HSN 2-hop InfiniBand Electro-mechanical access times DWS not shown Adaptive Computing Enterprises, Inc.
7 Cray DataWarp Support DataWarp Storage Types Job-based Persistent Script-based integration with Moab/TORQUE DW-enabled jobs processed by Moab job submit filter Moab automatically creates DW job workflow Adaptive Computing Enterprises, Inc.
8 DataWarp Integration Project All DW storage scheduled by Moab Job DW storage by job scheduling Persistent DW storage by reservation scheduling Out-of-the-box functionality Some site-specific information configuration required Adaptive Computing Enterprises, Inc.
9 Moab 3-Job DataWarp Model Follows Moab Data-staging Model Uses Moab system jobs to create/destroy DW storage and stage data in/out Automatically creates 3-job workflow DW creation/input data-staging system job User job Output data-staging/dw destruction system job Adaptive Computing Enterprises, Inc.
10 DataWarp-enabled Job Workflow User submits user job Job Submit Filter detects #DW directives Job Submit Filter creates 3-job workflow 1. DW Creation / Input Datastaging System job 2. User Job 3. Output Data-staging / DW Destruction System Job Adaptive Computing Enterprises, Inc.
11 Automatic Job/DW Workflow Generation What if user submits multiple-job workflow And some user jobs in job workflow use DataWarp storage? Job Submit Filter creates proper DW job dependencies, but not for entire user job workflow Example Data validation Compute (uses DataWarp) Visualization User Job A User Job B (DW) User Job C Adaptive Computing Enterprises, Inc.
12 Automatic Job/DW Workflow Generation User Job Dependencies Data validation Compute Visualization Job A (ok) Job B (ok) Job C User Job A User Job B (DataWarp-enabled job) User Job C Job workflow generation script must work with Job Submit Filter to create proper job dependencies (solid lines below) Adaptive Computing Enterprises, Inc.
13 Multi-Job Workflow Generation Script # Submit data validation job A jobaid=`msub -l nodes=1,walltime=10:00 mycheck.sh` # Submit DataWarp-enabled compute job B # (3 jobids returned (dwin, user, dwout); put into array) jobbids=(`msub -l nodes=16,walltime=01:30:00,\ depend=afterok:${jobaid}...\ mysim.sh`) # Submit visualization job C jobcid=`msub -l nodes=1,walltime=30:00,\ depend=afterok:${jobbids[1]}:${jobbids[2]} \ myviz.sh` Adaptive Computing Enterprises, Inc.
14 Persistent DataWarp Storage Moab schedules and tracks all DW storage capacity Moab persistent DW storage uses DW storage reservation Persistent DataWarp storage management Created by reservation start trigger Destroyed by reservation end trigger Jobs get mount point Adaptive Computing Enterprises, Inc.
15 Benefits Moab schedules and manages both job and persistent DataWarp storage Users have good user experience No race conditions cause cancelled jobs! Jobs have fast I/O Jobs execute in less time Adaptive Computing Enterprises, Inc.
16 Agenda DataWarp Intel MIC KNL (re-provisioning) Viewpoint Web Portal User Portal Administrator Portal Remote Visualization Nitro HTC Adaptive Computing Enterprises, Inc.
17 Use Case Intel introduces 2 nd -gen Xeon Phi processor KNL supports 3 different NUMA configurations with 5 modes 3 different MCDRAM configurations with 4 modes 20 possible NUMA/MCDRAM configurations Some applications execute fastest with specific NUMA/MCDRAM configuration Adaptive Computing Enterprises, Inc.
18 Intel MIC Knights Landing (KNL) 5 NUMA configurations for cores and DDR4 and MCDRAM memories No NUMA (all2all, hemisphere, quadrant) and sub-numa cluster 2 and 4 a2a, hemi, quad, snc2, snc4 4 MCDRAM mode configurations Cache, flat, 50/50 hybrid, 25/75 hybrid cache, flat, equal, split Adaptive Computing Enterprises, Inc.
19 Moab Cray KNL Support 20 pre-defined combinations Select combination as OS at job submission msub nodes=20,os=cle_snc4_flat myjobscript Moab re-provisions Cray compute nodes when necessary Uses Moab s built-in re-provisioning capability Quickly re-provisions Cray KNL compute nodes for jobs requesting specific NUMA/MCDRAM modes Adaptive Computing Enterprises, Inc.
20 Cray KNL Re-provisioning Process User submits job requiring specific KNL NUMA / MCDRAM configuration msub l nodes=20,os=cle_snc4_flat myjob Moab schedules KNL job to nodes Moab runs NodeModifyURL script to modify compute node configurations and reboot them Script executes Cray capmc to set KNL NUMA node and MCDRAM configurations and to reboot nodes Cray s capmc modifies nodes BIOS settings and reboots nodes Cray reports new NUMA node / MCDRAM configurations pbs_reporter maps NUMA node/mcdram configuration to OS name and reports OS name to pbs_server TORQUE pbs_server passes new OS name to Moab, which starts the KNL job Moab Scheduler New OS Modify Name Node Node URL Update Report Node Modify Script capmc Modify NUMA / MCDRAM Modify BIOS config and reboot TORQUE pbs_server TORQUE pbs_reporter System Query Report ALPS NUMA / MCDRAM config Adaptive Computing Enterprises, Inc.
21 Benefits Users can run applications with KNL NUMA and MCDRAM configuration for optimal job execution. Easy to request specific KNL configuration with job submission Adaptive Computing Enterprises, Inc.
22 Agenda DataWarp Intel MIC KNL Viewpoint Web Portal (non-technical users) User Portal Administrator Portal Remote Visualization Nitro HTC Adaptive Computing Enterprises, Inc.
23 Use Case Many HPC sites asked to expand user base Non-technical users What is a command line? Non-traditional users Non-research Engineers and Scientists Humanities Local or regional industries with no HPC experience Adaptive Computing Enterprises, Inc.
24 Agenda DataWarp Intel MIC KNL Viewpoint Web Portal (non-technical users) User Portal (job submission) Administrator Portal Remote Visualization Nitro HTC Adaptive Computing Enterprises, Inc.
25 Use Case Someone said I need to use xyz program I have data Someone gave me my data Someone mentored/trained me and I created my own data I taught myself and created my own data How do I use xyz with my data? Adaptive Computing Enterprises, Inc.
26 Log in as user to Viewpoint Web Portal Adaptive Computing Enterprises, Inc.
27 Click Templates on your User Dashboard Adaptive Computing Enterprises, Inc.
28 Use xyz application template Adaptive Computing Enterprises, Inc.
29 Fill in application template Adaptive Computing Enterprises, Inc.
30 Choose a time limit Adaptive Computing Enterprises, Inc.
31 Tell it where your data file is Adaptive Computing Enterprises, Inc.
32 Submit your xyz job Adaptive Computing Enterprises, Inc.
33 Click Workload to check on your xyz job Adaptive Computing Enterprises, Inc.
34 Check out your xyz job s details Adaptive Computing Enterprises, Inc.
35 Look at your job s statistics Adaptive Computing Enterprises, Inc.
36 Download your xyz job s results Adaptive Computing Enterprises, Inc.
37 Benefits Allows non-technical users to submit jobs using pre-defined application templates Application templates contain Job script for running application Web form design with pre-defined and/or custom widgets and their variables Job submission replaces variables within job script with form s widget values Adaptive Computing Enterprises, Inc.
38 Agenda DataWarp Intel MIC KNL Viewpoint Web Portal (non-technical users) User Portal Administrator Portal (application templates) Remote Visualization Nitro HTC Adaptive Computing Enterprises, Inc.
39 Use Case Administrator needs to support many nontechnical users and their applications Define application templates using editor Define and customize application template form using pre-defined widget types Define widgets variable name, default value, and other characteristics to build form Create job script Adaptive Computing Enterprises, Inc.
40 Log in as admin to Viewpoint Web Portal Adaptive Computing Enterprises, Inc.
41 Click on Templates in Admin Dashboard Adaptive Computing Enterprises, Inc.
42 Choose an application template Adaptive Computing Enterprises, Inc.
43 View application template history Adaptive Computing Enterprises, Inc.
44 Edit and design application template Adaptive Computing Enterprises, Inc.
45 Edit application template (lower part) Adaptive Computing Enterprises, Inc.
46 Choose Basic Job Settings widgets Adaptive Computing Enterprises, Inc.
47 Choose Resources widgets Adaptive Computing Enterprises, Inc.
48 Choose Node Policies Settings widgets Adaptive Computing Enterprises, Inc.
49 Design custom xyz Settings widgets Adaptive Computing Enterprises, Inc.
50 Choose custom widget from widget type list Adaptive Computing Enterprises, Inc.
51 Create/import job script with Script Builder Adaptive Computing Enterprises, Inc.
52 Add widget variables to job script Adaptive Computing Enterprises, Inc.
53 Benefits Application templates let an administrator create application templates for nontechnical users. Non-technical users have a simple way to submit jobs for specific applications Adaptive Computing Enterprises, Inc.
54 Agenda DataWarp Intel MIC KNL Viewpoint Web Portal (non-technical users) User Portal Administrator Portal Remote Visualization (graphical interfaces) Nitro HTC Adaptive Computing Enterprises, Inc.
55 Use Cases Users need to visualize their data to gain insights from it. Desktops or workstations with decent visualization hardware can be expensive. Data can be too large to move to another location. Non-technical users need a way to easily set up a remote visualization session Adaptive Computing Enterprises, Inc.
56 Choose Remote Visualization Templates Adaptive Computing Enterprises, Inc.
57 Choose Remote Desktop App Template Adaptive Computing Enterprises, Inc.
58 Choose Graphical Desktop Type Adaptive Computing Enterprises, Inc.
59 Submit Remote Desktop Job Adaptive Computing Enterprises, Inc.
60 Remote Desktop Job s Compute Node Adaptive Computing Enterprises, Inc.
61 Remote Desktop Session Screen Adaptive Computing Enterprises, Inc.
62 Remote Visualization Session Controls Adaptive Computing Enterprises, Inc.
63 Resized Remote Viz Session Desktop Adaptive Computing Enterprises, Inc.
64 Job Detail with Remote Viz Session Adaptive Computing Enterprises, Inc.
65 Canceling the Remote Desktop Session Adaptive Computing Enterprises, Inc.
66 Choose ParaView Application Template Adaptive Computing Enterprises, Inc.
67 ParaView Input Data file selection Adaptive Computing Enterprises, Inc.
68 Submitting ParaView Remote Viz Job Adaptive Computing Enterprises, Inc.
69 ParaView Remote Viz Session Adaptive Computing Enterprises, Inc.
70 Adjusting Session Image Quality Adaptive Computing Enterprises, Inc.
71 Remote Desktop / ParaView Session Adaptive Computing Enterprises, Inc.
72 Benefits Technical and non-technical users can easily create remote visualization sessions with their applications and data Adaptive Computing Enterprises, Inc.
73 Agenda DataWarp Intel MIC KNL Viewpoint Web Portal (non-technical users) User Portal Administrator Portal Remote Visualization Nitro (HTC job scheduling) Adaptive Computing Enterprises, Inc.
74 Use Cases A user can have thousands or millions of single-core to single-node jobs. Parameter sweeps Monte Carlo simulations Regression tests Other Large job queues Long scheduling cycles Adaptive Computing Enterprises, Inc.
75 Nitro HTC Scheduler Application Scheduler-agnostic HTC scheduler application TORQUE Slurm Platform LSF Cray ALPS Submitted as HPC job to scheduler Adaptive Computing Enterprises, Inc.
76 Nitro Job User converts HTC jobs to Nitro tasks Tasks defined in Nitro Task file Submit 1 Nitro job with Task file Schedule 1 parallel HPC job Execute millions of HTC tasks What about HTC for non-technical users? Adaptive Computing Enterprises, Inc.
77 Choose Nitro Application Template Adaptive Computing Enterprises, Inc.
78 Nitro Task File selection Adaptive Computing Enterprises, Inc.
79 Nitro Task file upload and job submission Adaptive Computing Enterprises, Inc.
80 Nitro job progress and statistics Adaptive Computing Enterprises, Inc.
81 Nitro job progress Adaptive Computing Enterprises, Inc.
82 Nitro Task Log file display during job Adaptive Computing Enterprises, Inc.
83 Benefits Remove thousands-to-millions of HTC jobs from HPC scheduler queue(s) Execute HTC jobs faster Non-technical users can Submit Nitro jobs Monitor Nitro job progress Examine Nitro Task results Adaptive Computing Enterprises, Inc.
84 Questions? Adaptive Computing Enterprises, Inc. CONFIDENTIAL AND PROPRIETARY
85 PMIx Support Process Management Interface for exascale Open-source Project on github Intel, Mellanox, IBM, Adaptive Computing, SchedMD Benefits Instant On very fast job start (10 minutes 2 seconds) Asynchronous, non-blocking operations Blob-based data transfers Fast broadcasts/collectives Interfaces with RMs (e.g., TORQUE) Will work with malleable/evolving jobs in future Adaptive Computing Enterprises, Inc. CONFIDENTIAL AND PROPRIETARY
86 Malleable and Evolving Jobs Next-generation application/rte support Malleable jobs (scheduler application/rte) Evolvable jobs (application/rte scheduler) Need standard API to negotiate resources Like MPI for parallel communications Gathering use cases for PMIx API definition Benefits Standard application API for scheduler/app dialog Scheduler and Malleable/Evolving Application Dialog (SMEAD) API definition Allows applications to ask for and return resources Allows scheduler to give and take resources to and from a job Adaptive Computing Enterprises, Inc. CONFIDENTIAL AND PROPRIETARY
87 Backup Slides Adaptive Computing Enterprises, Inc. CONFIDENTIAL AND PROPRIETARY
Moab and TORQUE Highlights CUG 2015
Moab and TORQUE Highlights CUG 2015 David Beer TORQUE Architect 28 Apr 2015 Gary D. Brown HPC Product Manager 1 Agenda NUMA-aware Heterogeneous Jobs Ascent Project Power Management and Energy Accounting
IBM Platform Computing : infrastructure management for HPC solutions on OpenPOWER Jing Li, Software Development Manager IBM
IBM Platform Computing : infrastructure management for HPC solutions on OpenPOWER Jing Li, Software Development Manager IBM #OpenPOWERSummit Join the conversation at #OpenPOWERSummit 1 Scale-out and Cloud
HPC Cluster Decisions and ANSYS Configuration Best Practices. Diana Collier Lead Systems Support Specialist Houston UGM May 2014
HPC Cluster Decisions and ANSYS Configuration Best Practices Diana Collier Lead Systems Support Specialist Houston UGM May 2014 1 Agenda Introduction Lead Systems Support Specialist Cluster Decisions Job
Mitglied der Helmholtz-Gemeinschaft. System monitoring with LLview and the Parallel Tools Platform
Mitglied der Helmholtz-Gemeinschaft System monitoring with LLview and the Parallel Tools Platform November 25, 2014 Carsten Karbach Content 1 LLview 2 Parallel Tools Platform (PTP) 3 Latest features 4
Scaling LS-DYNA on Rescale HPC Cloud Simulation Platform
Scaling LS-DYNA on Rescale HPC Cloud Simulation Platform Joris Poort, President & CEO, Rescale, Inc. Ilea Graedel, Manager, Rescale, Inc. 1 Cloud HPC on the Rise 1.1 Background Engineering and science
Using the Windows Cluster
Using the Windows Cluster Christian Terboven terboven@rz.rwth aachen.de Center for Computing and Communication RWTH Aachen University Windows HPC 2008 (II) September 17, RWTH Aachen Agenda o Windows Cluster
Simulation Platform Overview
Simulation Platform Overview Build, compute, and analyze simulations on demand www.rescale.com CASE STUDIES Companies in the aerospace and automotive industries use Rescale to run faster simulations Aerospace
Managing a local Galaxy Instance. Anushka Brownley / Adam Kraut BioTeam Inc.
Managing a local Galaxy Instance Anushka Brownley / Adam Kraut BioTeam Inc. Agenda Who are we Why a local installation Local infrastructure Local installation Tips and Tricks SlipStream Appliance WHO ARE
A High Performance Computing Scheduling and Resource Management Primer
LLNL-TR-652476 A High Performance Computing Scheduling and Resource Management Primer D. H. Ahn, J. E. Garlick, M. A. Grondona, D. A. Lipari, R. R. Springmeyer March 31, 2014 Disclaimer This document was
Microsoft HPC. V 1.0 José M. Cámara (checam@ubu.es)
Microsoft HPC V 1.0 José M. Cámara (checam@ubu.es) Introduction Microsoft High Performance Computing Package addresses computing power from a rather different approach. It is mainly focused on commodity
N8103-149/150/151/160 RAID Controller. N8103-156 MegaRAID CacheCade. Feature Overview
N8103-149/150/151/160 RAID Controller N8103-156 MegaRAID CacheCade Feature Overview April 2012 Rev.1.0 NEC Corporation Contents 1 Introduction... 3 2 Types of RAID Controllers... 3 3 New Features of RAID
The Seven Keys to Successfully Managing Compute Workloads at Financial Institutions
Intelligent HPC Workload Management The Seven Keys to Successfully Managing Compute Workloads at Financial Institutions p Executive Summary It is no small fact that compute workloads at financial organizations
GPU System Architecture. Alan Gray EPCC The University of Edinburgh
GPU System Architecture EPCC The University of Edinburgh Outline Why do we want/need accelerators such as GPUs? GPU-CPU comparison Architectural reasons for GPU performance advantages GPU accelerated systems
Managing GPUs by Slurm. Massimo Benini HPC Advisory Council Switzerland Conference March 31 - April 3, 2014 Lugano
Managing GPUs by Slurm Massimo Benini HPC Advisory Council Switzerland Conference March 31 - April 3, 2014 Lugano Agenda General Slurm introduction Slurm@CSCS Generic Resource Scheduling for GPUs Resource
Cluster, Grid, Cloud Concepts
Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of
Microsoft Compute Clusters in High Performance Technical Computing. Björn Tromsdorf, HPC Product Manager, Microsoft Corporation
Microsoft Compute Clusters in High Performance Technical Computing Björn Tromsdorf, HPC Product Manager, Microsoft Corporation Flexible and efficient job scheduling via Windows CCS has allowed more of
HPC on AWS. Hiroshi Kobayashi, Dev./Lab. IT System HGST Japan, Ltd. Jun 3, 2015
HPC on AWS Hiroshi Kobayashi, Dev./Lab. IT System HGST Japan, Ltd. Jun 3, 2015 1 HPC on AWS HPC = High Performance Computing AWS = Amazon Web Service 2 Agenda HGST Why choose Cloud? Performance Flexibility
DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION
DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION A DIABLO WHITE PAPER AUGUST 2014 Ricky Trigalo Director of Business Development Virtualization, Diablo Technologies
LSKA 2010 Survey Report Job Scheduler
LSKA 2010 Survey Report Job Scheduler Graduate Institute of Communication Engineering {r98942067, r98942112}@ntu.edu.tw March 31, 2010 1. Motivation Recently, the computing becomes much more complex. However,
High Performance. CAEA elearning Series. Jonathan G. Dudley, Ph.D. 06/09/2015. 2015 CAE Associates
High Performance Computing (HPC) CAEA elearning Series Jonathan G. Dudley, Ph.D. 06/09/2015 2015 CAE Associates Agenda Introduction HPC Background Why HPC SMP vs. DMP Licensing HPC Terminology Types of
Parallel Processing using the LOTUS cluster
Parallel Processing using the LOTUS cluster Alison Pamment / Cristina del Cano Novales JASMIN/CEMS Workshop February 2015 Overview Parallelising data analysis LOTUS HPC Cluster Job submission on LOTUS
Overview of HPC Resources at Vanderbilt
Overview of HPC Resources at Vanderbilt Will French Senior Application Developer and Research Computing Liaison Advanced Computing Center for Research and Education June 10, 2015 2 Computing Resources
"Charting the Course...... to Your Success!" MOC 50290 A Understanding and Administering Windows HPC Server 2008. Course Summary
Description Course Summary This course provides students with the knowledge and skills to manage and deploy Microsoft HPC Server 2008 clusters. Objectives At the end of this course, students will be Plan
Ten Reasons to Switch from Maui Cluster Scheduler to Moab HPC Suite Comparison Brief
TM Ten Reasons to Switch from Maui Cluster Scheduler to Moab HPC Suite Comparison Brief Many Maui users make the switch to Moab each year for key scalability, capability and support advantages that help
:Introducing Star-P. The Open Platform for Parallel Application Development. Yoel Jacobsen E&M Computing LTD yoel@emet.co.il
:Introducing Star-P The Open Platform for Parallel Application Development Yoel Jacobsen E&M Computing LTD yoel@emet.co.il The case for VHLLs Functional / applicative / very high-level languages allow
Hack the Gibson. John Fitzpatrick Luke Jennings. Exploiting Supercomputers. 44Con Edition September 2013. Public EXTERNAL
Hack the Gibson Exploiting Supercomputers 44Con Edition September 2013 John Fitzpatrick Luke Jennings Labs.mwrinfosecurity.com MWR Labs Labs.mwrinfosecurity.com MWR Labs 1 Outline Introduction Important
MPI / ClusterTools Update and Plans
HPC Technical Training Seminar July 7, 2008 October 26, 2007 2 nd HLRS Parallel Tools Workshop Sun HPC ClusterTools 7+: A Binary Distribution of Open MPI MPI / ClusterTools Update and Plans Len Wisniewski
ALPS Supercomputing System A Scalable Supercomputer with Flexible Services
ALPS Supercomputing System A Scalable Supercomputer with Flexible Services 1 Abstract Supercomputing is moving from the realm of abstract to mainstream with more and more applications and research being
Windows HPC Server 2008 R2 Service Pack 3 (V3 SP3)
Windows HPC Server 2008 R2 Service Pack 3 (V3 SP3) Greg Burgess, Principal Development Manager Windows Azure High Performance Computing Microsoft Corporation HPC Server Components Job Scheduler Distributed
So#ware Tools and Techniques for HPC, Clouds, and Server- Class SoCs Ron Brightwell
So#ware Tools and Techniques for HPC, Clouds, and Server- Class SoCs Ron Brightwell R&D Manager, Scalable System So#ware Department Sandia National Laboratories is a multi-program laboratory managed and
Cloud Storage. Parallels. Performance Benchmark Results. White Paper. www.parallels.com
Parallels Cloud Storage White Paper Performance Benchmark Results www.parallels.com Table of Contents Executive Summary... 3 Architecture Overview... 3 Key Features... 4 No Special Hardware Requirements...
EnterpriseLink Benefits
EnterpriseLink Benefits GGY AXIS 5001 Yonge Street Suite 1300 Toronto, ON M2N 6P6 Phone: 416-250-6777 Toll free: 1-877-GGY-AXIS Fax: 416-250-6776 Email: axis@ggy.com Web: www.ggy.com Table of Contents
System Monitoring and Reporting
This chapter contains the following sections: Dashboard, page 1 Summary, page 2 Inventory Management, page 3 Resource Pools, page 4 Clusters, page 4 Images, page 4 Host Nodes, page 6 Virtual Machines (VMs),
An introduction to Fyrkat
Cluster Computing May 25, 2011 How to get an account https://fyrkat.grid.aau.dk/useraccount How to get help https://fyrkat.grid.aau.dk/wiki What is a Cluster Anyway It is NOT something that does any of
DB2 Connect for NT and the Microsoft Windows NT Load Balancing Service
DB2 Connect for NT and the Microsoft Windows NT Load Balancing Service Achieving Scalability and High Availability Abstract DB2 Connect Enterprise Edition for Windows NT provides fast and robust connectivity
Cloud Computing through Virtualization and HPC technologies
Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC
Mitglied der Helmholtz-Gemeinschaft UNICORE. Uniform Access to JSC Resources. Michael Rambadt, unicore-info@fz-juelich.de. 20.
Mitglied der Helmholtz-Gemeinschaft UNICORE Uniform Access to JSC Resources 20. Mai 2014 Michael Rambadt, unicore-info@fz-juelich.de Outline Introduction Features UNICORE Portal UNICORE Rich Client UNICORE
Building a BI Solution in the Cloud
Building a BI Solution in the Cloud Stacia Varga, Principal Consultant Email: stacia@datainspirations.com Twitter: @_StaciaV_ 2 SQLSaturday #467 Sponsors Stacia (Misner) Varga Over 30 years of IT experience,
Recommended hardware system configurations for ANSYS users
Recommended hardware system configurations for ANSYS users The purpose of this document is to recommend system configurations that will deliver high performance for ANSYS users across the entire range
How System Settings Impact PCIe SSD Performance
How System Settings Impact PCIe SSD Performance Suzanne Ferreira R&D Engineer Micron Technology, Inc. July, 2012 As solid state drives (SSDs) continue to gain ground in the enterprise server and storage
HP Proliant BL460c G7
HP Proliant BL460c G7 The HP Proliant BL460c G7, is a high performance, fully fault tolerant, nonstop server. It s well suited for all mid-level operations, including environments with local storage, SAN
Administration Guide. . All right reserved. For more information about Specops Deploy and other Specops products, visit www.specopssoft.
. All right reserved. For more information about Specops Deploy and other Specops products, visit www.specopssoft.com Copyright and Trademarks Specops Deploy is a trademark owned by Specops Software. All
The Mantid Project. The challenges of delivering flexible HPC for novice end users. Nicholas Draper SOS18
The Mantid Project The challenges of delivering flexible HPC for novice end users Nicholas Draper SOS18 What Is Mantid A framework that supports high-performance computing and visualisation of scientific
owncloud Enterprise Edition on IBM Infrastructure
owncloud Enterprise Edition on IBM Infrastructure A Performance and Sizing Study for Large User Number Scenarios Dr. Oliver Oberst IBM Frank Karlitschek owncloud Page 1 of 10 Introduction One aspect of
Welcome The webinar will begin shortly
Welcome The webinar will begin shortly Angela Chumley Angela.Chumley@crownpeak.com 08.18.15 Engagement Tip Mute Button Listen Actively Ask Questions 2 AGENDA Getting Started Web Content Management (WCMS)
Numerix CrossAsset XL and Windows HPC Server 2008 R2
Numerix CrossAsset XL and Windows HPC Server 2008 R2 Faster Performance for Valuation and Risk Management in Complex Derivative Portfolios Microsoft Corporation Published: February 2011 Abstract Numerix,
Technical Computing Suite Job Management Software
Technical Computing Suite Job Management Software Toshiaki Mikamo Fujitsu Limited Supercomputer PRIMEHPC FX10 PRIMERGY x86 cluster Outline System Configuration and Software Stack Features The major functions
Assignment # 1 (Cloud Computing Security)
Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual
User Manual: Using Hadoop with WS-PGRADE. workflow.
User Manual: Using Hadoop with WS-PGRADE workflows December 9, 2014 1 About This manual explains the configuration of a set of workflows that can be used to submit a Hadoop job through a WS-PGRADE portal.
PRIMERGY server-based High Performance Computing solutions
PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating
Neptune. A Domain Specific Language for Deploying HPC Software on Cloud Platforms. Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams
Neptune A Domain Specific Language for Deploying HPC Software on Cloud Platforms Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams ScienceCloud 2011 @ San Jose, CA June 8, 2011 Cloud Computing Three
Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases
NASA Ames NASA Advanced Supercomputing (NAS) Division California, May 24th, 2012 Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases Ignacio M. Llorente Project Director OpenNebula Project.
Universal Management Service 2015
Universal Management Service 2015 UMS 2015 Help All rights reserved. No parts of this work may be reproduced in any form or by any means - graphic, electronic, or mechanical, including photocopying, recording,
Parallel Computing with MATLAB
Parallel Computing with MATLAB Scott Benway Senior Account Manager Jiro Doke, Ph.D. Senior Application Engineer 2013 The MathWorks, Inc. 1 Acceleration Strategies Applied in MATLAB Approach Options Best
NETWRIX EVENT LOG MANAGER
NETWRIX EVENT LOG MANAGER QUICK-START GUIDE FOR THE ENTERPRISE EDITION Product Version: 4.0 July/2012. Legal Notice The information in this publication is furnished for information use only, and does not
Achieving Performance Isolation with Lightweight Co-Kernels
Achieving Performance Isolation with Lightweight Co-Kernels Jiannan Ouyang, Brian Kocoloski, John Lange The Prognostic Lab @ University of Pittsburgh Kevin Pedretti Sandia National Laboratories HPDC 2015
locuz.com HPC App Portal V2.0 DATASHEET
locuz.com HPC App Portal V2.0 DATASHEET Ganana HPC App Portal makes it easier for users to run HPC applications without programming and for administrators to better manage their clusters. The web-based
Adobe Summit 2015 Lab 718: Managing Mobile Apps: A PhoneGap Enterprise Introduction for Marketers
Adobe Summit 2015 Lab 718: Managing Mobile Apps: A PhoneGap Enterprise Introduction for Marketers 1 INTRODUCTION GOAL OBJECTIVES MODULE 1 AEM & PHONEGAP ENTERPRISE INTRODUCTION LESSON 1- AEM BASICS OVERVIEW
Introduction to Running Computations on the High Performance Clusters at the Center for Computational Research
! Introduction to Running Computations on the High Performance Clusters at the Center for Computational Research! Cynthia Cornelius! Center for Computational Research University at Buffalo, SUNY! cdc at
Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage
White Paper Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage A Benchmark Report August 211 Background Objectivity/DB uses a powerful distributed processing architecture to manage
Tuning Tableau Server for High Performance
Tuning Tableau Server for High Performance I wanna go fast PRESENT ED BY Francois Ajenstat Alan Doerhoefer Daniel Meyer Agenda What are the things that can impact performance? Tips and tricks to improve
Configuring and Launching ANSYS FLUENT 16.0 - Distributed using IBM Platform MPI or Intel MPI
Configuring and Launching ANSYS FLUENT 16.0 - Distributed using IBM Platform MPI or Intel MPI Table of Contents BEFORE YOU PROCEED... 1 Launching FLUENT Using Shared Memory... 2 Configuring FLUENT to run
Parallel Computing using MATLAB Distributed Compute Server ZORRO HPC
Parallel Computing using MATLAB Distributed Compute Server ZORRO HPC Goals of the session Overview of parallel MATLAB Why parallel MATLAB? Multiprocessing in MATLAB Parallel MATLAB using the Parallel Computing
Automating Big Data Benchmarking for Different Architectures with ALOJA
www.bsc.es Jan 2016 Automating Big Data Benchmarking for Different Architectures with ALOJA Nicolas Poggi, Postdoc Researcher Agenda 1. Intro on Hadoop performance 1. Current scenario and problematic 2.
Configuring HP Elite, EliteBook, and Z220 systems for Intel Smart Response Technology
Technical white paper Configuring HP Elite, EliteBook, and Z220 systems for Intel Smart Response Technology Table of contents Overview 2 System requirements 3 How to enable Intel Smart Response Technology
Recent Advances in HPC for Structural Mechanics Simulations
Recent Advances in HPC for Structural Mechanics Simulations 1 Trends in Engineering Driving Demand for HPC Increase product performance and integrity in less time Consider more design variants Find the
præsentation oktober 2011
Johnny Olesen System X presale præsentation oktober 2011 2010 IBM Corporation 2 Hvem er jeg Dagens agenda Server overview System Director 3 4 Portfolio-wide Innovation with IBM System x and BladeCenter
WINDOWS AZURE AND WINDOWS HPC SERVER
David Chappell March 2012 WINDOWS AZURE AND WINDOWS HPC SERVER HIGH-PERFORMANCE COMPUTING IN THE CLOUD Sponsored by Microsoft Corporation Copyright 2012 Chappell & Associates Contents High-Performance
Supercomputing on Windows. Microsoft (Thailand) Limited
Supercomputing on Windows Microsoft (Thailand) Limited W hat D efines S upercom puting A lso called High Performance Computing (HPC) Technical Computing Cutting edge problems in science, engineering and
SENSE/NET 6.0. Open Source ECMS for the.net platform. www.sensenet.com 1
SENSE/NET 6.0 Open Source ECMS for the.net platform www.sensenet.com 1 ABOUT THE PRODUCT: SENSE/NET 6.0 About the product 2 KEY FEATURES Workspaces-based collaboration Document management Office integration
SLURM Workload Manager
SLURM Workload Manager What is SLURM? SLURM (Simple Linux Utility for Resource Management) is the native scheduler software that runs on ASTI's HPC cluster. Free and open-source job scheduler for the Linux
HIPAA Compliance Use Case
Overview HIPAA Compliance helps ensure that all medical records, medical billing, and patient accounts meet certain consistent standards with regard to documentation, handling, and privacy. Current Situation
NETWRIX PASSWORD MANAGER
NETWRIX PASSWORD MANAGER ADMINISTRATOR S GUIDE Product Version: 6.1 February/2012 Legal Notice The information in this publication is furnished for information use only, and does not constitute a commitment
Build Transactions Into Your Apps and Mobilize Your Enterprise with MicroStrategy 10
Build Transactions Into Your Apps and Mobilize Your Enterprise with MicroStrategy 10 Agenda Introduction What is a workflow app? Transaction Services Component Objects Transaction Input Controls Transaction
Solution White Paper Connect Hadoop to the Enterprise
Solution White Paper Connect Hadoop to the Enterprise Streamline workflow automation with BMC Control-M Application Integrator Table of Contents 1 EXECUTIVE SUMMARY 2 INTRODUCTION THE UNDERLYING CONCEPT
PARALLELS SERVER 4 BARE METAL README
PARALLELS SERVER 4 BARE METAL README This document provides the first-priority information on Parallels Server 4 Bare Metal and supplements the included documentation. TABLE OF CONTENTS 1 About Parallels
Foglight. Managing Hyper-V Systems User and Reference Guide
Foglight Managing Hyper-V Systems User and Reference Guide 2014 Quest Software, Inc. ALL RIGHTS RESERVED. This guide contains proprietary information protected by copyright. The software described in this
Cisco UCS CPA Workflows
This chapter contains the following sections: Workflows for Big Data, page 1 About Service Requests for Big Data, page 2 Workflows for Big Data Cisco UCS Director Express for Big Data defines a set of
Cloud Attached Storage 3.1 EA
Release Notes Cloud Attached Storage 3.1 EA March 2012 Cloud Attached Storage 3.1 EA Release Notes 1 1 Release Contents Copyright 2009-2012 CTERA Networks Ltd. All rights reserved. No part of this document
5-Bay Raid Sub-System Smart Removable 3.5" SATA Multiple Bay Data Storage Device User's Manual
5-Bay Raid Sub-System Smart Removable 3.5" SATA Multiple Bay Data Storage Device User's Manual www.vipower.com Table of Contents 1. How the SteelVine (VPMP-75511R/VPMA-75511R) Operates... 1 1-1 SteelVine
IBM Tivoli Composite Application Manager for Microsoft Applications: Microsoft Hyper-V Server Agent Version 6.3.1 Fix Pack 2.
IBM Tivoli Composite Application Manager for Microsoft Applications: Microsoft Hyper-V Server Agent Version 6.3.1 Fix Pack 2 Reference IBM Tivoli Composite Application Manager for Microsoft Applications:
KASEYA CLOUD SOLUTION CATALOG 2016 Q1. UPDATED & EFFECTIVE AS OF: February 1, 2016. Kaseya Catalog - 1 - Kaseya Copyright 2016. All rights reserved.
KASEYA CLOUD SOLUTION CATALOG 2016 Q1 UPDATED & EFFECTIVE AS OF: February 1, 2016 Kaseya Catalog - 1 - Overview of the Kaseya Cloud Subscription Solutions The Kaseya Cloud solutions are designed to meet
SRNWP Workshop. HP Solutions and Activities in Climate & Weather Research. Michael Riedmann European Performance Center
SRNWP Workshop HP Solutions and Activities in Climate & Weather Research Michael Riedmann European Performance Center Agenda A bit of marketing: HP Solutions for HPC A few words about recent Met deals
Job Scheduling with Moab Cluster Suite
Job Scheduling with Moab Cluster Suite IBM High Performance Computing February 2010 Y. Joanna Wong, Ph.D. yjw@us.ibm.com 2/22/2010 Workload Manager Torque Source: Adaptive Computing 2 Some terminology..
Deploying Windows Streaming Media Servers NLB Cluster and metasan
Deploying Windows Streaming Media Servers NLB Cluster and metasan Introduction...................................................... 2 Objectives.......................................................
Integration of Virtualized Workernodes in Batch Queueing Systems The ViBatch Concept
Integration of Virtualized Workernodes in Batch Queueing Systems, Dr. Armin Scheurer, Oliver Oberst, Prof. Günter Quast INSTITUT FÜR EXPERIMENTELLE KERNPHYSIK FAKULTÄT FÜR PHYSIK KIT University of the
FileMaker Server 15. Getting Started Guide
FileMaker Server 15 Getting Started Guide 2007 2016 FileMaker, Inc. All Rights Reserved. FileMaker, Inc. 5201 Patrick Henry Drive Santa Clara, California 95054 FileMaker and FileMaker Go are trademarks
Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes. Anthony Kenisky, VP of North America Sales
Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes Anthony Kenisky, VP of North America Sales About Appro Over 20 Years of Experience 1991 2000 OEM Server Manufacturer 2001-2007
The insidehpc Guide to Cloud Computing BROUGHT TO YOU BY
The insidehpc Guide to Cloud Computing BROUGHT TO YOU BY Introduction IT organizations are facing increasing pressure to deliver critical services to their users while their budgets are either reduced
Using WestGrid. Patrick Mann, Manager, Technical Operations Jan.15, 2014
Using WestGrid Patrick Mann, Manager, Technical Operations Jan.15, 2014 Winter 2014 Seminar Series Date Speaker Topic 5 February Gino DiLabio Molecular Modelling Using HPC and Gaussian 26 February Jonathan
vrealize Operations Manager Customization and Administration Guide
vrealize Operations Manager Customization and Administration Guide vrealize Operations Manager 6.0.1 This document supports the version of each product listed and supports all subsequent versions until
COMMANDS 1 Overview... 1 Default Commands... 2 Creating a Script from a Command... 10 Document Revision History... 10
LabTech Commands COMMANDS 1 Overview... 1 Default Commands... 2 Creating a Script from a Command... 10 Document Revision History... 10 Overview Commands in the LabTech Control Center send specific instructions
REDEFINE SIMPLICITY TOP REASONS: EMC VSPEX BLUE FOR VIRTUALIZED ENVIRONMENTS
REDEFINE SIMPLICITY AGILE. SCALABLE. TRUSTED. TOP REASONS: EMC VSPEX BLUE FOR VIRTUALIZED ENVIRONMENTS Redefine Simplicity: Agile, Scalable and Trusted. Mid-market and Enterprise customers as well as Managed
Cost-Effective Business Intelligence with Red Hat and Open Source
Cost-Effective Business Intelligence with Red Hat and Open Source Sherman Wood Director, Business Intelligence, Jaspersoft September 3, 2009 1 Agenda Introductions Quick survey What is BI?: reporting,
A Study on the Scalability of Hybrid LS-DYNA on Multicore Architectures
11 th International LS-DYNA Users Conference Computing Technology A Study on the Scalability of Hybrid LS-DYNA on Multicore Architectures Yih-Yih Lin Hewlett-Packard Company Abstract In this paper, the
Accelerating From Cluster to Cloud: Overview of RDMA on Windows HPC. Wenhao Wu Program Manager Windows HPC team
Accelerating From Cluster to Cloud: Overview of RDMA on Windows HPC Wenhao Wu Program Manager Windows HPC team Agenda Microsoft s Commitments to HPC RDMA for HPC Server RDMA for Storage in Windows 8 Microsoft
HPC Wales Skills Academy Course Catalogue 2015
HPC Wales Skills Academy Course Catalogue 2015 Overview The HPC Wales Skills Academy provides a variety of courses and workshops aimed at building skills in High Performance Computing (HPC). Our courses
Virtualization @ Google
Virtualization @ Google Alexander Schreiber Google Switzerland Libre Software Meeting 2012 Geneva, Switzerland, 2012-06-10 Introduction Talk overview Corporate infrastructure Overview Use cases Technology
UMass High Performance Computing Center
.. UMass High Performance Computing Center University of Massachusetts Medical School October, 2014 2 / 32. Challenges of Genomic Data It is getting easier and cheaper to produce bigger genomic data every
Instant Chime for IBM Sametime High Availability Server Guide
Instant Chime for IBM Sametime High Availability Server Guide Fall 2014 Page 1 Copyright and Disclaimer This document, as well as the software described in it, is furnished under license of the Instant