GPFS und HPSS am HLRS

Size: px
Start display at page:

Download "GPFS und HPSS am HLRS"

Transcription

1 GPFS und HPSS am HLRS Peter W. Haas Archivierung im Bereich Höchstleistungsrechner Swisstopo, Bern 3. Juli High Performance Computing Center Stuttgart

2 Table of Contents 1. What are GPFS and HPSS Conceptual Architecture of GPFS and HPSS Operation of distributed Infrastructures 2. What is GPFS/HPSS Co-Location of LAN and SAN Services GPFS/HPSS Configuration at HLRS 3. Information Life Cycle Management (ILM) ILM Rule-driven Automigration and Stageback Operational Concepts for Backup and Restore 4. Using HPSS with other Disk File Systems The Terascale Workbench at HLRS Potential Interfaces towards other File Systems 2 High Performance Computing Center Stuttgart

3 What are GPFS and HPSS 3 High Performance Computing Center Stuttgart

4 What are GPFS and HPSS Both GPFS and HPSS are... Cluster file systems supporting large numbers of storage devices Parallel Storage software designed for file sharing Used in heterogenous distributed HPC environments GPFS is the General Parallel File System File system optimized for high performance dynamic storage Metadata architecture optimized for very low latency Supports multiple types and uses of disks organized into pools A commercial product developed and supported by IBM HPSS is the High Performance Storage System Storage software optimized for long term file retention and rapid staging Metadata architecture optimized for robust operation and rapid recovery Supports disk and tape (or tape only) organized into storage classes A collaborative product developed by five DOE laboratories and IBM that is sold with a Service Subscription by IBM 4 High Performance Computing Center Stuttgart

5 Conceptual Architectures of GPFS & HPSS HPSS HPSS Core Core Server Server GPFS GPFS NSD NSD Nodes Nodes Client Cluster HPSS HPSS Movers Movers GPFS Disk Arrays GPFS Cluster HPSS Disk Arrays HPSS Tape Libraries HPSS Cluster 5 High Performance Computing Center Stuttgart

6 General Parallel File System (GPFS) Cluster: nodes, fast reliable communication, common admin domain. Shared disk: all data and metadata on disk accessible from any node. Parallel: data and metadata flow to/from all nodes from/to all disks in parallel; files striped across all disks. In the classic LAN configuration, some GPFS nodes are configured as network storage devices (NSDs) that function as data servers, moving data over an IP LAN GPFS NSD Server SAN (FC, Infiniband, etc.) IP Data LAN (10 GigE, etc.) Node Interconnect Fabric GPFS NSD Server Compute Node GPFS GPFS NSD Server Compute Node GPFS Compute Node GPFS GPFS NSD Server Compute Node GPFS GPFS Disk Compute Node GPFS GPFS Disk Compute Node GPFS GPFS Disk Compute Node GPFS GPFS Disk Compute Node GPFS 6 High Performance Computing Center Stuttgart

7 HPSS Network-centric parallel HSM (1) 7 High Performance Computing Center Stuttgart

8 HPSS Network-centric parallel HSM (2) HPSS is a cluster hierarchical storage system 5 levels of disk and tape Multiple configurable classes of service DB2 metadata engine assures reliability and quick recovery Cluster architecture and metadata architecture support horizontal scaling to: 100s of petabytes 100s of millions of files Gbyte/s data rates All in a single system Supports technology insertion Add new components, no need to replace Mix and match vendors and models AIX, Linux, IRIX, Solaris HPSS Cluster Architecture Client Cluster Disk Arrays LAN SAN Core Server DB2 Metadata Backup Core Server Mover Cluster Robotic Tape Libraries 8 High Performance Computing Center Stuttgart

9 What is GPFS/HPSS GPFS/HPSS is a collaborative project to develop synergy between IBM s General Parallel File System and the HPSS Collaboration s High Performance Storage System Goals Extend GPFS pool concept to tape and other long term storage Use the GPFS rule-based ILM to centralize ILM administration Provide backup for GPFS that makes effective use of ongoing file migration to tape under ILM control Participants HPSS Collaboration member NERSC/Lawrence Berkeley Lab IBM Research, Almaden Lab IBM GPFS Product Development in Poughkeepsie NY IBM HPSS Development and Support in Houston TX Status Ongoing work demonstrated at 8 th HLRS Workshop on SGPFS 2009 Expect test release general availability by July High Performance Computing Center Stuttgart

10 GPFS/HPSS LAN Configuration IP Control and Data LAN (10 GigE, etc.) GPFS NSD Server GPFS NSD Server GPFS NSD Server GPFS NSD Server GPFS Disk GPFS Disk GPFS Disk GPFS Disk Node Interconnect Fabric Compute Node Compute Node Compute Node Compute Node GPFS HPSS I/F GPFS HPSS I/F GPFS HPSS I/F GPFS HPSS I/F HPSS Core Server HPSS Mover HPSS Mover HPSS Mover Tape Library Tape Library HPSS Disk (optional) HPSS Disk (optional) SAN, GPFS zone SAN, HPSS zone HPSS and GPFS may be used together for total storage ILM GPFS NSD Servers and HPSS Movers may be installed on the same physical nodes HPSS can be can be configured with disks or for direct access to tape 10 High Performance Computing Center Stuttgart

11 GFPS/HPSS LAN/SAN Configuration Swisstopo - Geodaten, 3. Juli 2009 Peter W. Haas 11 High Performance Computing Center Stuttgart

12 Information Life Cycle Management (ILM) 12 High Performance Computing Center Stuttgart

13 ILM Management Actions Swisstopo - Geodaten, 3. Juli 2009 Peter W. Haas 13 High Performance Computing Center Stuttgart

14 HPSS Configuration at HLRS 14 High Performance Computing Center Stuttgart

15 HLRS Distributed Computer Configuration Global File System NEC SX-6 (48) NEC SX-8 (576) VR Cave Ulm DALCO Viz-Cluster Opteron (64) Stuttgart IBM HSM 3 PB NEC Asama (64) IBM Cell SUN Fire 2900 (48x2) IBM x3755 (144x2) Cray XT5+XD1 (480) NEC Nehalem (1400 x 4) IBM (2800x4) 15 High Performance Computing Center Stuttgart

16 Teraflop Workbench Configuration IA64 SMP Cluster Vector SMP Cluster PC Cluster SAN Integrated workbench for preprocessing, simulation, postprocessing and vizualisation Choose the best platform for each task Global Parallel File Systems: IBM GPFS, Lustre, HPSS Avoid file copies in distributed processing environments HP-CAST Peter W. Haas 16 High Performance Computing Center Stuttgart

17 Demonstration in the HLRS-Cave Optimization of geometry in a radial water turbine using Virtual Reality and online flow simulation HP-CAST Peter W. Haas 17 High Performance Computing Center Stuttgart

18 HP-CAST Peter W. Haas 18 High Performance Computing Center Stuttgart

19 Thank you very much for your attention! Special thanks are due to: Julie Schaefer, IBM Houston Pat Schaefer, IBM Houston Benny Wilbanks, IBM Houston Dr. Roger Haskin, Almaden Research Center Bob Coyne, Exec HPSS Collaboration Harry Hulen, HPSS Collaboration Dr. Richard Watson, Lawrence Livermore Laboratory 19 High Performance Computing Center Stuttgart

High Performance Storage System Interfaces. Harry Hulen 281-488-2473 hulen@us.ibm.com

High Performance Storage System Interfaces. Harry Hulen 281-488-2473 hulen@us.ibm.com High Performance Storage System Interfaces Harry Hulen 281-488-2473 hulen@us.ibm.com Outline Introduction to Interfaces The Collaboration How a SAN File System Works 3. MDC sends lock and ticket back to

More information

High Performance Storage System. Overview

High Performance Storage System. Overview Overview * Please review disclosure statement on last slide Please see disclaimer on last slide Copyright IBM 2009 Slide Number 1 Hierarchical storage software developed in collaboration with five US Department

More information

Kriterien für ein PetaFlop System

Kriterien für ein PetaFlop System Kriterien für ein PetaFlop System Rainer Keller, HLRS :: :: :: Context: Organizational HLRS is one of the three national supercomputing centers in Germany. The national supercomputing centers are working

More information

Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007

Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007 Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms Cray User Group Meeting June 2007 Cray s Storage Strategy Background Broad range of HPC requirements

More information

Cluster Implementation and Management; Scheduling

Cluster Implementation and Management; Scheduling Cluster Implementation and Management; Scheduling CPS343 Parallel and High Performance Computing Spring 2013 CPS343 (Parallel and HPC) Cluster Implementation and Management; Scheduling Spring 2013 1 /

More information

Large File System Backup NERSC Global File System Experience

Large File System Backup NERSC Global File System Experience Large File System Backup NERSC Global File System Experience M. Andrews, J. Hick, W. Kramer, A. Mokhtarani National Energy Research Scientific Computing Center at Lawrence Berkeley National Laboratory

More information

IBM System x GPFS Storage Server

IBM System x GPFS Storage Server IBM System x GPFS Storage Server Schöne Aussicht en für HPC Speicher ZKI-Arbeitskreis Paderborn, 15.03.2013 Karsten Kutzer Client Technical Architect Technical Computing IBM Systems & Technology Group

More information

August 2009. Transforming your Information Infrastructure with IBM s Storage Cloud Solution

August 2009. Transforming your Information Infrastructure with IBM s Storage Cloud Solution August 2009 Transforming your Information Infrastructure with IBM s Storage Cloud Solution Page 2 Table of Contents Executive summary... 3 Introduction... 4 A Story or three for inspiration... 6 Oops,

More information

Storage Challenges for Petascale Systems

Storage Challenges for Petascale Systems Storage Challenges for Petascale Systems Dilip D. Kandlur Director, Storage Systems Research IBM Research Division 2004 IBM Corporation Outline Storage Technology Trends Implications for high performance

More information

Big data management with IBM General Parallel File System

Big data management with IBM General Parallel File System Big data management with IBM General Parallel File System Optimize storage management and boost your return on investment Highlights Handles the explosive growth of structured and unstructured data Offers

More information

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC HPC Architecture End to End Alexandre Chauvin Agenda HPC Software Stack Visualization National Scientific Center 2 Agenda HPC Software Stack Alexandre Chauvin Typical HPC Software Stack Externes LAN Typical

More information

IBM Global Technology Services November 2009. Successfully implementing a private storage cloud to help reduce total cost of ownership

IBM Global Technology Services November 2009. Successfully implementing a private storage cloud to help reduce total cost of ownership IBM Global Technology Services November 2009 Successfully implementing a private storage cloud to help reduce total cost of ownership Page 2 Contents 2 Executive summary 3 What is a storage cloud? 3 A

More information

Archival Storage At LANL Past, Present and Future

Archival Storage At LANL Past, Present and Future Archival Storage At LANL Past, Present and Future Danny Cook Los Alamos National Laboratory dpc@lanl.gov Salishan Conference on High Performance Computing April 24-27 2006 LA-UR-06-0977 Main points of

More information

Tivoli Flashcopy Manager Update and Demonstration

Tivoli Flashcopy Manager Update and Demonstration Tivoli Flashcopy Manager Update and Demonstration Dave Canan IBM March 2 nd, 2011 Session:9092 Topics Tivoli Flashcopy Manager Functionality Flashcopy Manager Backup and Restore Configuration Details Flashcopy

More information

New Storage System Solutions

New Storage System Solutions New Storage System Solutions Craig Prescott Research Computing May 2, 2013 Outline } Existing storage systems } Requirements and Solutions } Lustre } /scratch/lfs } Questions? Existing Storage Systems

More information

Petascale Software Challenges. Piyush Chaudhary piyushc@us.ibm.com High Performance Computing

Petascale Software Challenges. Piyush Chaudhary piyushc@us.ibm.com High Performance Computing Petascale Software Challenges Piyush Chaudhary piyushc@us.ibm.com High Performance Computing Fundamental Observations Applications are struggling to realize growth in sustained performance at scale Reasons

More information

The safer, easier way to help you pass any IT exams. Exam : 000-115. Storage Sales V2. Title : Version : Demo 1 / 5

The safer, easier way to help you pass any IT exams. Exam : 000-115. Storage Sales V2. Title : Version : Demo 1 / 5 Exam : 000-115 Title : Storage Sales V2 Version : Demo 1 / 5 1.The IBM TS7680 ProtecTIER Deduplication Gateway for System z solution is designed to provide all of the following EXCEPT: A. ESCON attach

More information

Flexible Scalable Hardware independent. Solutions for Long Term Archiving

Flexible Scalable Hardware independent. Solutions for Long Term Archiving Flexible Scalable Hardware independent Solutions for Long Term Archiving More than 20 years of experience in archival storage 2 OA HPA 2010 1992 2000 2004 2007 Mainframe Tape Libraries Open System Tape

More information

Sun Constellation System: The Open Petascale Computing Architecture

Sun Constellation System: The Open Petascale Computing Architecture CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John Fragalla Senior HPC Technical Specialist Global Systems Practice Sun Microsystems, Inc. 25 Years of Technical

More information

2. Highlights and Updates: ITSM for Databases

2. Highlights and Updates: ITSM for Databases IBM Tivoli Storage Manager Data Protection for Oracle Neil Rasmussen Software Development for Tivoli Data Protection Tivoli Software, IBM SWG rasmussn@us.ibm.com Agenda 1. Overview: Tivoli Storage Manager

More information

Lessons learned from parallel file system operation

Lessons learned from parallel file system operation Lessons learned from parallel file system operation Roland Laifer STEINBUCH CENTRE FOR COMPUTING - SCC KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association

More information

List of Figures and Tables

List of Figures and Tables List of Figures and Tables FIGURES 1.1 Server-Centric IT architecture 2 1.2 Inflexible allocation of free storage capacity 3 1.3 Storage-Centric IT architecture 4 1.4 Server upgrade: preparation of a new

More information

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures 1 Refreshing Your Data Protection Environment with Next-Generation Architectures Dale Rhine, Principal Sales Consultant Kelly Boeckman, Product Marketing Analyst Program Agenda Storage

More information

(Scale Out NAS System)

(Scale Out NAS System) For Unlimited Capacity & Performance Clustered NAS System (Scale Out NAS System) Copyright 2010 by Netclips, Ltd. All rights reserved -0- 1 2 3 4 5 NAS Storage Trend Scale-Out NAS Solution Scaleway Advantages

More information

Quantum BACKUP. RECOVERY. ARCHIVE. IT S WHAT WE DO.

Quantum BACKUP. RECOVERY. ARCHIVE. IT S WHAT WE DO. Quantum BACKUP. RECOVERY. ARCHIVE. IT S WHAT WE DO. TM Next Generation Archival--StorNext 9 2010 Quantum Corporation. Company Confidential. Forward-looking information is based upon multiple assumptions

More information

IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV

IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV 11 Manager May 04, 2010 Joe Rotiroti Client Systems IBM, Federal 484 433 9756 cell 845 491 5227 fax rotiroti@us.ibm.com How is GPFS different?

More information

GNR TSM documentation Page 1of 10. TSM Documentation. Finn Henningsen - Sagitta Performance Systems Version 1.0 23 th April 2002

GNR TSM documentation Page 1of 10. TSM Documentation. Finn Henningsen - Sagitta Performance Systems Version 1.0 23 th April 2002 GNR TSM documentation Page 1of 10 Global.Name Registry TSM Documentation Finn Henningsen - Sagitta Performance Systems Version 1.0 23 th April 2002 GNR TSM documentation Page 2of 10 Review History Version

More information

Oracle Storage Options

Oracle Storage Options 1/27 Oracle Storage Options RAW, ASM, CFS, for Real Application Cluster Unterföhring, 11.2005 M. Kühn 1 2/27 Be spoilt for choice? RAC Review Introduction Storage Options RAW In short ASM Automatic Storage

More information

Sun Storage Perspective & Lustre Architecture. Dr. Peter Braam VP Sun Microsystems

Sun Storage Perspective & Lustre Architecture. Dr. Peter Braam VP Sun Microsystems Sun Storage Perspective & Lustre Architecture Dr. Peter Braam VP Sun Microsystems Agenda Future of Storage Sun s vision Lustre - vendor neutral architecture roadmap Sun s view on storage introduction The

More information

EMC BACKUP MEETS BIG DATA

EMC BACKUP MEETS BIG DATA EMC BACKUP MEETS BIG DATA Strategies To Protect Greenplum, Isilon And Teradata Systems 1 Agenda Big Data: Overview, Backup and Recovery EMC Big Data Backup Strategy EMC Backup and Recovery Solutions for

More information

Quantum StorNext. Product Brief: Distributed LAN Client

Quantum StorNext. Product Brief: Distributed LAN Client Quantum StorNext Product Brief: Distributed LAN Client NOTICE This product brief may contain proprietary information protected by copyright. Information in this product brief is subject to change without

More information

HP OpenView Storage Data Protector

HP OpenView Storage Data Protector For the streaming audio link, click the blue icon in the lower right corner HP OpenView Storage Data Protector 2005 Hewlett-Packard Development Company, L.P. The information contained herein is subject

More information

How To Write A High Performance Nfs For A Linux Server Cluster (For A Microsoft) (For An Ipa) (I.O) ( For A Microsnet) (Powerpoint) (Permanent) (Unmanip

How To Write A High Performance Nfs For A Linux Server Cluster (For A Microsoft) (For An Ipa) (I.O) ( For A Microsnet) (Powerpoint) (Permanent) (Unmanip High Performance NFS Roger Haskin Senior Manager, File Systems IBM Almaden Research Center 2006 IBM Corporation NFS4 and Parallel NFS Work at IBM Research IBM Almaden Research has a long history of work

More information

Magellan A Test Bed to Explore Cloud Computing for Science Shane Canon and Lavanya Ramakrishnan Cray XE6 Training February 8, 2011

Magellan A Test Bed to Explore Cloud Computing for Science Shane Canon and Lavanya Ramakrishnan Cray XE6 Training February 8, 2011 Magellan A Test Bed to Explore Cloud Computing for Science Shane Canon and Lavanya Ramakrishnan Cray XE6 Training February 8, 2011 Magellan Exploring Cloud Computing Co-located at two DOE-SC Facilities

More information

Managing a Fibre Channel Storage Area Network

Managing a Fibre Channel Storage Area Network Managing a Fibre Channel Storage Area Network Storage Network Management Working Group for Fibre Channel (SNMWG-FC) November 20, 1998 Editor: Steven Wilson Abstract This white paper describes the typical

More information

How To Build A Supermicro Computer With A 32 Core Power Core (Powerpc) And A 32-Core (Powerpc) (Powerpowerpter) (I386) (Amd) (Microcore) (Supermicro) (

How To Build A Supermicro Computer With A 32 Core Power Core (Powerpc) And A 32-Core (Powerpc) (Powerpowerpter) (I386) (Amd) (Microcore) (Supermicro) ( TECHNICAL GUIDELINES FOR APPLICANTS TO PRACE 7 th CALL (Tier-0) Contributing sites and the corresponding computer systems for this call are: GCS@Jülich, Germany IBM Blue Gene/Q GENCI@CEA, France Bull Bullx

More information

2. COMPUTER SYSTEM. 2.1 Introduction

2. COMPUTER SYSTEM. 2.1 Introduction 2. COMPUTER SYSTEM 2.1 Introduction The computer system at the Japan Meteorological Agency (JMA) has been repeatedly upgraded since IBM 704 was firstly installed in 1959. The current system has been completed

More information

LDM-129: Data Management Infrastructure Design

LDM-129: Data Management Infrastructure Design LDM-129: Data Management Infrastructure Design Release 3.0 Mike Freemon, Jeff Kantor October 11, 2013 Contents 1 2 Infrastructure Components 5 2 3 Facilities 9 2.1 3.1 National Petascale Computing Facility,

More information

Large Scale Storage. Orlando Richards, Information Services orlando.richards@ed.ac.uk. LCFG Users Day, University of Edinburgh 18 th January 2013

Large Scale Storage. Orlando Richards, Information Services orlando.richards@ed.ac.uk. LCFG Users Day, University of Edinburgh 18 th January 2013 Large Scale Storage Orlando Richards, Information Services orlando.richards@ed.ac.uk LCFG Users Day, University of Edinburgh 18 th January 2013 Overview My history of storage services What is (and is not)

More information

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance 11 th International LS-DYNA Users Conference Session # LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance Gilad Shainer 1, Tong Liu 2, Jeff Layton 3, Onur Celebioglu

More information

POWER ALL GLOBAL FILE SYSTEM (PGFS)

POWER ALL GLOBAL FILE SYSTEM (PGFS) POWER ALL GLOBAL FILE SYSTEM (PGFS) Defining next generation of global storage grid Power All Networks Ltd. Technical Whitepaper April 2008, version 1.01 Table of Content 1. Introduction.. 3 2. Paradigm

More information

SAN Conceptual and Design Basics

SAN Conceptual and Design Basics TECHNICAL NOTE VMware Infrastructure 3 SAN Conceptual and Design Basics VMware ESX Server can be used in conjunction with a SAN (storage area network), a specialized high speed network that connects computer

More information

Independent Software Vendor (ISV) Compatibility matrixes for NEC Tape Automation

Independent Software Vendor (ISV) Compatibility matrixes for NEC Tape Automation Independent Software Vendor (ISV) Compatibility matrixes for NEC Tape Automation Product Reference Compact Tape Autoloader (LL009F) IBM, SAS I/F IBM, SAS I/F IBM, SAS I/F Tape Library (T30A/T60A) IBM,

More information

How To Virtualize A Storage Area Network (San) With Virtualization

How To Virtualize A Storage Area Network (San) With Virtualization A New Method of SAN Storage Virtualization Table of Contents 1 - ABSTRACT 2 - THE NEED FOR STORAGE VIRTUALIZATION 3 - EXISTING STORAGE VIRTUALIZATION METHODS 4 - A NEW METHOD OF VIRTUALIZATION: Storage

More information

Big + Fast + Safe + Simple = Lowest Technical Risk

Big + Fast + Safe + Simple = Lowest Technical Risk Big + Fast + Safe + Simple = Lowest Technical Risk The Synergy of Greenplum and Isilon Architecture in HP Environments Steffen Thuemmel (Isilon) Andreas Scherbaum (Greenplum) 1 Our problem 2 What is Big

More information

Independent Software Vendor (ISV) Compatibility matrixes for NEC Tape Automation

Independent Software Vendor (ISV) Compatibility matrixes for NEC Tape Automation Independent Software Vendor (ISV) Compatibility matrixes for NEC Tape Automation Product Reference Compact Tape Autoloader (LL009F) IBM, SAS I/F IBM, SAS I/F IBM, SAS I/F Tape Library (T30A/T60A) IBM,

More information

Disk-to-Disk Backup & Restore Application Note

Disk-to-Disk Backup & Restore Application Note Disk-to-Disk Backup & Restore Application Note All trademark names are the property of their respective companies. This publication contains opinions of StoneFly, Inc., which are subject to change from

More information

IBM Smart Business Storage Cloud

IBM Smart Business Storage Cloud GTS Systems Services IBM Smart Business Storage Cloud Reduce costs and improve performance with a scalable storage virtualization solution SoNAS Gerardo Kató Cloud Computing Solutions 2010 IBM Corporation

More information

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads 89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com @EdisonGroupInc 212.367.7400 IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads A Competitive Test and Evaluation Report

More information

PADS GPFS Filesystem: Crash Root Cause Analysis. Computation Institute

PADS GPFS Filesystem: Crash Root Cause Analysis. Computation Institute PADS GPFS Filesystem: Crash Root Cause Analysis Computation Institute Argonne National Laboratory Table of Contents Purpose 1 Terminology 2 Infrastructure 4 Timeline of Events 5 Background 5 Corruption

More information

Backup of NAS devices with Avamar

Backup of NAS devices with Avamar Backup of NAS devices with Avamar Extremely fast / no load Video describing NAS backup using Avamar based on this ppt: https://youtu.be/swg1ejldgmw The most fresh version of this document, you will find

More information

<Insert Picture Here> Infrastructure as a Service (IaaS) Cloud Computing for Enterprises

<Insert Picture Here> Infrastructure as a Service (IaaS) Cloud Computing for Enterprises Infrastructure as a Service (IaaS) Cloud Computing for Enterprises Speaker Title The following is intended to outline our general product direction. It is intended for information

More information

System Software for High Performance Computing. Joe Izraelevitz

System Software for High Performance Computing. Joe Izraelevitz System Software for High Performance Computing Joe Izraelevitz Agenda Overview of Supercomputers Blue Gene/Q System LoadLeveler Job Scheduler General Parallel File System HPC at UR What is a Supercomputer?

More information

How To Backup At Qmul

How To Backup At Qmul TSM Backup and Restore Strategy and Overview (Draft) Prepared by: Trevor Leigh Version: 1.1 Page 1 of 13 Document Owner: Name/Position Steve Wicks, Servers & Storage Manager Revision History Version Description

More information

2. TEMPLATE TITLE SLIDE WITH PHOTO

2. TEMPLATE TITLE SLIDE WITH PHOTO NEW! Easily Swap Out the Image StorageTek 5800 system ( Honeycomb ) 2. TEMPLATE TITLE SLIDE WITH PHOTO Breakthrough Solution for Digital Repositories Scott Presenter s Parker Name Solutions Architect Presenter

More information

General Parallel File System (GPFS) Native RAID For 100,000-Disk Petascale Systems

General Parallel File System (GPFS) Native RAID For 100,000-Disk Petascale Systems General Parallel File System (GPFS) Native RAID For 100,000-Disk Petascale Systems Veera Deenadhayalan IBM Almaden Research Center 2011 IBM Corporation Hard Disk Rates Are Lagging There have been recent

More information

EMC DATA DOMAIN OVERVIEW. Copyright 2011 EMC Corporation. All rights reserved.

EMC DATA DOMAIN OVERVIEW. Copyright 2011 EMC Corporation. All rights reserved. EMC DATA DOMAIN OVERVIEW 1 2 With Data Domain Deduplication Storage Systems, You Can WAN Retain longer Keep backups onsite longer with less disk for fast, reliable restores, and eliminate the use of tape

More information

Case Studies Using EMC Legato NetWorker for OpenVMS Backups

Case Studies Using EMC Legato NetWorker for OpenVMS Backups OpenVMS Technical Journal V6 Case Studies Using EMC Legato NetWorker for OpenVMS Backups Case Studies Using EMC Legato NetWorker for OpenVMS Backups... 2 Overview... 2 Introduction... 2 Case Study 1: Backup

More information

Mass Storage System for Disk and Tape resources at the Tier1.

Mass Storage System for Disk and Tape resources at the Tier1. Mass Storage System for Disk and Tape resources at the Tier1. Ricci Pier Paolo et al., on behalf of INFN TIER1 Storage pierpaolo.ricci@cnaf.infn.it ACAT 2008 November 3-7, 2008 Erice Summary Tier1 Disk

More information

PASS4TEST 専 門 IT 認 証 試 験 問 題 集 提 供 者

PASS4TEST 専 門 IT 認 証 試 験 問 題 集 提 供 者 PASS4TEST 専 門 IT 認 証 試 験 問 題 集 提 供 者 http://www.pass4test.jp 1 年 で 無 料 進 級 することに 提 供 する Exam : E20-591 Title : Backup and Recovery Solutions Exam for Technology Architects Vendor : EMC Version : DEMO 1

More information

The IBM Archive Cloud Project: Compliant Archiving into the Cloud

The IBM Archive Cloud Project: Compliant Archiving into the Cloud Christian Bolik, IBM Research & Development, November 2010 The IBM Archive Cloud Project: Compliant Archiving into the Cloud (...or in German: Revisionssichere Ablage in der Cloud) Disclaimer Copyright

More information

Exam : IBM 000-061. : IBM NEDC Technical Leader. Version : R6.1

Exam : IBM 000-061. : IBM NEDC Technical Leader. Version : R6.1 Exam : IBM 000-061 Title : IBM NEDC Technical Leader Version : R6.1 Prepking - King of Computer Certification Important Information, Please Read Carefully Other Prepking products A) Offline Testing engine

More information

Panasas High Performance Storage Powers the First Petaflop Supercomputer at Los Alamos National Laboratory

Panasas High Performance Storage Powers the First Petaflop Supercomputer at Los Alamos National Laboratory Customer Success Story Los Alamos National Laboratory Panasas High Performance Storage Powers the First Petaflop Supercomputer at Los Alamos National Laboratory June 2010 Highlights First Petaflop Supercomputer

More information

IBM ELASTIC STORAGE SEAN LEE

IBM ELASTIC STORAGE SEAN LEE IBM ELASTIC STORAGE SEAN LEE Solution Architect Platform Computing Division IBM Greater China Group Agenda Challenges in Data Management What is IBM Elastic Storage Key Features Elastic Storage Server

More information

GPFS Storage Server. Concepts and Setup in Lemanicus BG/Q system" Christian Clémençon (EPFL-DIT)" " 4 April 2013"

GPFS Storage Server. Concepts and Setup in Lemanicus BG/Q system Christian Clémençon (EPFL-DIT)  4 April 2013 GPFS Storage Server Concepts and Setup in Lemanicus BG/Q system" Christian Clémençon (EPFL-DIT)" " Agenda" GPFS Overview" Classical versus GSS I/O Solution" GPFS Storage Server (GSS)" GPFS Native RAID

More information

KIT Site Report. Andreas Petzold. www.kit.edu STEINBUCH CENTRE FOR COMPUTING - SCC

KIT Site Report. Andreas Petzold. www.kit.edu STEINBUCH CENTRE FOR COMPUTING - SCC KIT Site Report Andreas Petzold STEINBUCH CENTRE FOR COMPUTING - SCC KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association www.kit.edu GridKa Tier 1 - Batch

More information

University of Birmingham & CLIMB GPFS User Experience. Simon Thompson Research Support, IT Services University of Birmingham

University of Birmingham & CLIMB GPFS User Experience. Simon Thompson Research Support, IT Services University of Birmingham University of Birmingham & CLIMB GPFS User Experience Simon Thompson Research Support, IT Services University of Birmingham University of Birmingham Research intensive University ~19000 Undergraduate Students

More information

Sun in HPC. Update for IDC HPC User Forum Tucson, AZ, Sept 2008

Sun in HPC. Update for IDC HPC User Forum Tucson, AZ, Sept 2008 Sun in HPC Update for IDC HPC User Forum Tucson, AZ, Sept 2008 Bjorn Andersson Director, HPC Marketing Makia Minich Lead Architect, Sun HPC Software, Linux Edition Sun Microsystems Core Focus Areas for

More information

Scalable NAS for Oracle: Gateway to the (NFS) future

Scalable NAS for Oracle: Gateway to the (NFS) future Scalable NAS for Oracle: Gateway to the (NFS) future Dr. Draško Tomić ESS technical consultant, HP EEM 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change

More information

Storage Virtualization from clusters to grid

Storage Virtualization from clusters to grid Seanodes presents Storage Virtualization from clusters to grid Rennes 4th october 2007 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with

More information

Keys to optimizing your backup environment: Legato NetWorker

Keys to optimizing your backup environment: Legato NetWorker Keys to optimizing your backup environment: Legato NetWorker Natalie Mead Storage Consultant GlassHouse Technologies nmead@glasshouse.com Introduction Audience Profile Storage Management Interdependence

More information

irods at CC-IN2P3: managing petabytes of data

irods at CC-IN2P3: managing petabytes of data Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules irods at CC-IN2P3: managing petabytes of data Jean-Yves Nief Pascal Calvat Yonny Cardenas Quentin Le Boulc h

More information

THE SUN STORAGE AND ARCHIVE SOLUTION FOR HPC

THE SUN STORAGE AND ARCHIVE SOLUTION FOR HPC THE SUN STORAGE AND ARCHIVE SOLUTION FOR HPC The Right Data, in the Right Place, at the Right Time José Martins Storage Practice Sun Microsystems 1 Agenda Sun s strategy and commitment to the HPC or technical

More information

Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration

Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration Solutions Integrated Storage Appliances Management Optimized Storage & Migration Archive Data Retention & Compliance Services Global Installation & Support SECURING THE FUTURE OF YOUR DATA w w w.q sta

More information

Microsoft Compute Clusters in High Performance Technical Computing. Björn Tromsdorf, HPC Product Manager, Microsoft Corporation

Microsoft Compute Clusters in High Performance Technical Computing. Björn Tromsdorf, HPC Product Manager, Microsoft Corporation Microsoft Compute Clusters in High Performance Technical Computing Björn Tromsdorf, HPC Product Manager, Microsoft Corporation Flexible and efficient job scheduling via Windows CCS has allowed more of

More information

Data storage considerations for HTS platforms. George Magklaras -- node manager http://www.no.embnet.org http://www.biotek.uio.no admin@embnet.uio.

Data storage considerations for HTS platforms. George Magklaras -- node manager http://www.no.embnet.org http://www.biotek.uio.no admin@embnet.uio. Data storage considerations for HTS platforms George Magklaras -- node manager http://www.no.embnet.org http://www.biotek.uio.no admin@embnet.uio.no Overview: The need for data storage Volume dimensioning

More information

Backup and Recovery Solutions for Exadata. Ľubomír Vaňo Principal Sales Consultant

Backup and Recovery Solutions for Exadata. Ľubomír Vaňo Principal Sales Consultant Backup and Recovery Solutions for Exadata Ľubomír Vaňo Principal Sales Consultant Fundamental Backup and Recovery Data doesn t exist in most organizations until the rule of 3 is complete: Different Media

More information

Eliminate SQL Server Downtime Even for maintenance

Eliminate SQL Server Downtime Even for maintenance Eliminate SQL Server Downtime Even for maintenance Eliminate Outages Enable Continuous Availability of Data (zero downtime) Enable Geographic Disaster Recovery - NO crash recovery 2009 xkoto, Inc. All

More information

recovery at a fraction of the cost of Oracle RAC

recovery at a fraction of the cost of Oracle RAC Concurrent data access and fast failover for unstructured data and Oracle databases recovery at a fraction of the cost of Oracle RAC Improve application performance and scalability - Get parallel processing

More information

Exadata and Database Machine Administration Seminar

Exadata and Database Machine Administration Seminar Oracle University Contact Us: 1.800.529.0165 Exadata and Database Machine Administration Seminar Duration: 2 Days What you will learn The first section of this course introduces you to Exadata Storage

More information

Using Symantec NetBackup with Symantec Security Information Manager 4.5

Using Symantec NetBackup with Symantec Security Information Manager 4.5 Using Symantec NetBackup with Symantec Security Information Manager 4.5 Using Symantec NetBackup with Symantec Security Information Manager Legal Notice Copyright 2007 Symantec Corporation. All rights

More information

TSM (Tivoli Storage Manager) Backup and Recovery. Richard Whybrow Hertz Australia System Network Administrator

TSM (Tivoli Storage Manager) Backup and Recovery. Richard Whybrow Hertz Australia System Network Administrator TSM (Tivoli Storage Manager) Backup and Recovery Richard Whybrow Hertz Australia System Network Administrator 2 Preparation meets success 3 Hertz Service Delivery Hertz has over 220 car hire locations

More information

Astrium GEO UK Multi-Mission PDGS Facilities and Services

Astrium GEO UK Multi-Mission PDGS Facilities and Services Astrium GEO UK Multi-Mission PDGS Facilities and Services Introduction UK-MM-PAC ERS-1/2 UK-MM-PAC ENVISAT Data Hosting Activities Future Activities Infoterra Archives LTDP Preparation Collaborative Activities

More information

XtreemStore A SCALABLE STORAGE MANAGEMENT SOFTWARE WITHOUT LIMITS YOUR DATA. YOUR CONTROL

XtreemStore A SCALABLE STORAGE MANAGEMENT SOFTWARE WITHOUT LIMITS YOUR DATA. YOUR CONTROL XtreemStore A SCALABLE STORAGE MANAGEMENT SOFTWARE WITHOUT LIMITS YOUR DATA. YOUR CONTROL Archive Manager - the Basis for XtreemStore DMS Email / Files ScienDfic Others PACS VIDEO PrePress CAD/CAM NFS

More information

Backup and Recovery Solutions for Exadata. Cor Beumer Storage Sales Specialist Oracle Nederland

Backup and Recovery Solutions for Exadata. Cor Beumer Storage Sales Specialist Oracle Nederland Backup and Recovery Solutions for Exadata Cor Beumer Storage Sales Specialist Oracle Nederland Recovery Point and Recovery Time Wks Days Hrs Mins Secs Secs Mins Hrs Days Wks Data Loss (Recovery Point Objective)

More information

IBM Global Technology Services September 2007. NAS systems scale out to meet growing storage demand.

IBM Global Technology Services September 2007. NAS systems scale out to meet growing storage demand. IBM Global Technology Services September 2007 NAS systems scale out to meet Page 2 Contents 2 Introduction 2 Understanding the traditional NAS role 3 Gaining NAS benefits 4 NAS shortcomings in enterprise

More information

HPSS Best Practices. Erich Thanhardt Bill Anderson Marc Genty B

HPSS Best Practices. Erich Thanhardt Bill Anderson Marc Genty B HPSS Best Practices Erich Thanhardt Bill Anderson Marc Genty B Overview Idea is to Look Under the Hood of HPSS to help you better understand Best Practices Expose you to concepts, architecture, and tape

More information

Bareos in Radio Astronomy Scaling up using Virtual Full Backups

Bareos in Radio Astronomy Scaling up using Virtual Full Backups Bareos in Radio Astronomy Scaling up using Virtual Full Backups Jan Behrend Max Planck Institute for Radio Astronomy Open Source Backup Conference September 23 rd 2014 Overview About the Institute Backup

More information

HP OpenView Storage Data Protector

HP OpenView Storage Data Protector HP OpenView Storage Data Protector Backup & Restore in HP ServiceGuard cluster for Linux Systems Version 1.0 Backup & Restore in HP ServiceGuard cluster for Linux Systems 1 1. Introduction... 3 2. HP ServiceGuard

More information

Building Storage Service in a Private Cloud

Building Storage Service in a Private Cloud Building Storage Service in a Private Cloud Sateesh Potturu & Deepak Vasudevan Wipro Technologies Abstract Storage in a private cloud is the storage that sits within a particular enterprise security domain

More information

Virtualization Technologies and Blackboard: The Future of Blackboard Software on Multi-Core Technologies

Virtualization Technologies and Blackboard: The Future of Blackboard Software on Multi-Core Technologies Virtualization Technologies and Blackboard: The Future of Blackboard Software on Multi-Core Technologies Kurt Klemperer, Principal System Performance Engineer kklemperer@blackboard.com Agenda Session Length:

More information

High Performance Computing (HPC)

High Performance Computing (HPC) High Performance Computing (HPC) High Performance Computing (HPC) White Paper Attn: Name, Title Phone: xxx.xxx.xxxx Fax: xxx.xxx.xxxx 1.0 OVERVIEW When heterogeneous enterprise environments are involved,

More information

TSMCluster. High Availability for TSM Server on UNIX. April 2013. Version 5.2 Subtle distinction

TSMCluster. High Availability for TSM Server on UNIX. April 2013. Version 5.2 Subtle distinction TSMCluster Version 5.2 Subtle distinction High Availability for TSM Server on UNIX April 2013 A cluster for TSM? 1. No, it's just backup. TSM today is a 24x7 application. Continous database log archiving.

More information

Oracle Maximum Availability Architecture with Exadata Database Machine. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska

Oracle Maximum Availability Architecture with Exadata Database Machine. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska Oracle Maximum Availability Architecture with Exadata Database Machine Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska MAA is Oracle s Availability Blueprint Oracle s MAA is a best practices

More information

ITCertMaster. http://www.itcertmaster.com. Safe, simple and fast. 100% Pass guarantee! IT Certification Guaranteed, The Easy Way!

ITCertMaster. http://www.itcertmaster.com. Safe, simple and fast. 100% Pass guarantee! IT Certification Guaranteed, The Easy Way! ITCertMaster Safe, simple and fast. 100% Pass guarantee! http://www.itcertmaster.com IT Certification Guaranteed, The Easy Way! Exam : E20-895 Title : Backup Recovery - Avamar Expert Exam for Implementation

More information

High Availability Databases based on Oracle 10g RAC on Linux

High Availability Databases based on Oracle 10g RAC on Linux High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN, June 2006 Luca Canali, CERN IT Outline Goals Architecture of an HA DB Service Deployment at the CERN Physics Database

More information

ETERNUS CS High End Unified Data Protection

ETERNUS CS High End Unified Data Protection ETERNUS CS High End Unified Data Protection Optimized Backup and Archiving with ETERNUS CS High End 0 Data Protection Issues addressed by ETERNUS CS HE 60% of data growth p.a. Rising back-up windows Too

More information

Parallele Dateisysteme für Linux und Solaris. Roland Rambau Principal Engineer GSE Sun Microsystems GmbH

Parallele Dateisysteme für Linux und Solaris. Roland Rambau Principal Engineer GSE Sun Microsystems GmbH Parallele Dateisysteme für Linux und Solaris Roland Rambau Principal Engineer GSE Sun Microsystems GmbH 1 Agenda kurze Einführung QFS Lustre pnfs ( Sorry... ) Roland.Rambau@Sun.Com Sun Proprietary/Confidential

More information

EMC Disk Library with EMC Data Domain Deployment Scenario

EMC Disk Library with EMC Data Domain Deployment Scenario EMC Disk Library with EMC Data Domain Deployment Scenario Best Practices Planning Abstract This white paper is an overview of the EMC Disk Library with EMC Data Domain deduplication storage system deployment

More information

GPFS Cloud ILM. IBM Research - Zurich. Storage Research Technology Outlook

GPFS Cloud ILM. IBM Research - Zurich. Storage Research Technology Outlook IBM Research - Zurich GPFS Cloud ILM Storage Research Technology Outlook Dr. Thomas Weigold (twe@zurich.ibm.com) Manager Cloud Storage & Security IBM Research Zurich Why Cloud Storage? Economics! Lower

More information