Scientific Computing Data Management Visions
|
|
- Magdalene Wade
- 8 years ago
- Views:
Transcription
1 Scientific Computing Data Management Visions ELI-Tango Workshop Szeged, February 2015 Péter Szász Group Leader Scientific Computing Group ELI-ALPS
2 Scientific Computing Group Responsibilities
3 Data storage and processing Challenges Very high data rates from detectors Online near-real time data analysis and reduction Online data visualization aggregation of detectors Dynamically changing needs and diversity (by experiments) Data rates/volumes Computing capacity Data analysis software Growing data volumes expected -> continuously growing IT infrastucture Design goals Flexible, scalable solutions (no hard upper limit) Scaling-out -> cost efficiency Avoid vendor lock-in Follow widely accepted standards/solutions Prefer well supported evolving solutions Possibility for customization Control Total-Cost-of-Ownership Open source state-of-the-art private cloud solution on a reliable, high capacity, high performance scale-out software-defined storage platform.
4 OpenStack Drive Shelf M6720 Data flow vision DAQ RAM GPU Nodes VM VM Job Scheduler VM Ceph Torque RAM CPU Cluster Online Data processing Online Data processing Online Data processing Online (scratch) Storage Offline Storage
5 Ceph for storage platform Open source software-defined storage platform Owned by Red Hat Distributed object store, block device, file system Client is in Linux kernel since v No single point of failure Scalability (scaling-out!) until exabyte level Fault-tolerancy Erasure coding (no need for RAID) Cache tiering Improved support for SSDs (in newer versions)
6 Ceph as storage platform As Object Storage RESTFul API partial or complete reads and writes snapshots atomic transactions As Block Device (RBD) thinly provisioned resizable images image import/export automatic stripe and replication across the cluster integrates with OpenStack -> unlimited storage can be mounted As File System (CephFS) POSIX-compliant network file system strong data safety for mission-critical applications virtually unlimited storage separates metadata from data automatically balances to deliver maximum performance
7 OpenStack for private cloud Open source cloud infrastructure as a service (IaaS) platform Co-founded by Rackspace and NASA in 2010, since then dozens of big players became its supporter (IBM, HP, Intel, Red Hat, Cisco, NetApp etc.) Supports different hypervisors (Xen, VMware, KVM) Supports several virtualization technologies (such as container, bare metal, high-performance computing) No vendor lock-in, cost efficiency Scale-out architecture Robust role-based access controls Significant references world-wide (e.g. CERN)
8 Clusters Overview DAQ HPC Cluster Storage Cluster Ethernet switch 10/40GbE for data at front-end Ethernet switch 1GbE for monitoring CPU Cluster Head Node CPU: Dual Intel Xeon E v2 RAM: 128 GB SSD: 2x128GB HDD: 2x1TB Ethernet switch 10/40 GbE for front-end Ethernet switch 1GbE for management Monitor Node 1 Monitor Node 2 Monitor Node 3 CPU: Dual Intel Xeon E V2 RAM: 64 GB HDD: 4x 300GB (SAS3) CPU Comp. Node 1 CPU Comp. Node 2 CPU Comp. Node n GPU Cluster Head Node GPU Comp. Node 1 GPU Comp. Node 2 GPU Comp. Node m CPU: Dual Intel Xeon E v2 RAM: 512 GB SSD: 2x128GB CPU: Dual Intel Xeon E v2 GPU: 6x NVIDIA Tesla K40 RAM: 128 GB SSD: 4x256GB OSD Node 1 OSD Node 2 OSD Node 3 OSD Node 4 OSD Node k CPU: Intel Xeon E V2 RAM: 128GB SSD: 800GB PCI-E 3.0 x4 HDD: 6TB SATA3 x30-60 Infiniband FDR (56Gbs) for back-end connection of CPU/GPU nodes 40GbE or InfiniBand FDR for back-end network
9 HPC Cluster Plans DAQ Front-end network 40 GbE hp sur est ore VA Cluster back-end network Infiniband (FDR) Storage cluster Head node Head node CPU Computing GPU Computing Cluster monitor/ management 1GbE
10 Storage Cluster Vision CPU/GPU Cluster Front-end network 10 or 40 GbE 10-16x HDD (per SSD) SATAIII (800MB/s) Location I/O Cluster back-end network 40GbE or InfiniBand FDR Object/Block I/O Sequential writing: 150MB/s (per HDD) CRUSH Monitor Nodes OSD Nodes 4x SSD PCIe 2GB/s Cluster management 1GbE (IPMI)
11 Next steps 1. Setup and test Ceph/OpenStack on commodity hardware (workstations with GPU cards) 2. Procure a small-grade HPC and Storage cluster 4 CPU Computing Node (+1 Head Node) 2 GPU Computing Node (+1 GPU Head Node) 4 Storage OSD Node 2 Storage Monitor Node 3. Benchmark solutions on small-grade 4. Define and procure production-ready clusters
12 THANK YOU FOR YOUR ATTENTION!
StorPool Distributed Storage Software Technical Overview
StorPool Distributed Storage Software Technical Overview StorPool 2015 Page 1 of 8 StorPool Overview StorPool is distributed storage software. It pools the attached storage (hard disks or SSDs) of standard
More informationVM Image Hosting Using the Fujitsu* Eternus CD10000 System with Ceph* Storage Software
Intel Solutions Reference Architecture VM Image Hosting Using the Fujitsu* Eternus CD10000 System with Ceph* Storage Software Intel Xeon Processor E5-2600 v3 Product Family SRA Section: Audience and Purpose
More informationLow-cost storage @PSNC
Low-cost storage @PSNC Update for TF-Storage TF-Storage meeting @Uppsala, September 22nd, 2014 Agenda Motivations data center perspective Application / use-case Hardware components: bought some, will buy
More informationProduct Spotlight. A Look at the Future of Storage. Featuring SUSE Enterprise Storage. Where IT perceptions are reality
Where IT perceptions are reality Product Spotlight A Look at the Future of Storage Featuring SUSE Enterprise Storage Document # SPOTLIGHT2013001 v5, January 2015 Copyright 2015 IT Brand Pulse. All rights
More informationInstalling Hadoop over Ceph, Using High Performance Networking
WHITE PAPER March 2014 Installing Hadoop over Ceph, Using High Performance Networking Contents Background...2 Hadoop...2 Hadoop Distributed File System (HDFS)...2 Ceph...2 Ceph File System (CephFS)...3
More informationBuilding low cost disk storage with Ceph and OpenStack Swift
Background photo from: http://edelomahony.com/2011/07/25/loving-money-doesnt-bring-you-more/ Building low cost disk storage with Ceph and OpenStack Swift Paweł Woszuk, Maciej Brzeźniak TERENA TF-Storage
More informationBuilding All-Flash Software Defined Storages for Datacenters. Ji Hyuck Yun (dr.jhyun@sk.com) Storage Tech. Lab SK Telecom
Building All-Flash Software Defined Storages for Datacenters Ji Hyuck Yun (dr.jhyun@sk.com) Storage Tech. Lab SK Telecom Introduction R&D Motivation Synergy between SK Telecom and SK Hynix Service & Solution
More informationCORRIGENDUM TO TENDER FOR HIGH PERFORMANCE SERVER
CORRIGENDUM TO TENDER FOR HIGH PERFORMANCE SERVER Tender Notice No. 3/2014-15 dated 29.12.2014 (IIT/CE/ENQ/COM/HPC/2014-15/569) Tender Submission Deadline Last date for submission of sealed bids is extended
More informationwww.thinkparq.com www.beegfs.com
www.thinkparq.com www.beegfs.com KEY ASPECTS Maximum Flexibility Maximum Scalability BeeGFS supports a wide range of Linux distributions such as RHEL/Fedora, SLES/OpenSuse or Debian/Ubuntu as well as a
More informationDeploying Ceph with High Performance Networks, Architectures and benchmarks for Block Storage Solutions
WHITE PAPER May 2014 Deploying Ceph with High Performance Networks, Architectures and benchmarks for Block Storage Solutions Contents Executive Summary...2 Background...2 Network Configuration...3 Test
More informationCan High-Performance Interconnects Benefit Memcached and Hadoop?
Can High-Performance Interconnects Benefit Memcached and Hadoop? D. K. Panda and Sayantan Sur Network-Based Computing Laboratory Department of Computer Science and Engineering The Ohio State University,
More informationSolid State Storage in the Evolution of the Data Center
Solid State Storage in the Evolution of the Data Center Trends and Opportunities Bruce Moxon CTO, Systems and Solutions stec Presented at the Lazard Capital Markets Solid State Storage Day New York, June
More informationDreamObjects. Cloud Object Storage Powered by Ceph. Monday, November 5, 12
DreamObjects Cloud Object Storage Powered by Ceph This slide is all about me, me, me. Ross Turk Community Manager, Ceph VP Community, Inktank ross@inktank.com @rossturk inktank.com ceph.com 2 DreamHost
More informationCloud Storage. Parallels. Performance Benchmark Results. White Paper. www.parallels.com
Parallels Cloud Storage White Paper Performance Benchmark Results www.parallels.com Table of Contents Executive Summary... 3 Architecture Overview... 3 Key Features... 4 No Special Hardware Requirements...
More informationBoas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation
Boas Betzler Cloud IBM Distinguished Computing Engineer for a Smarter Planet Globally Distributed IaaS Platform Examples AWS and SoftLayer November 9, 2015 20014 IBM Corporation Building Data Centers The
More informationIronPOD Piston OpenStack Cloud System Commodity Cloud IaaS Platforms for Enterprises & Service
IronPOD Piston OpenStack Cloud System Commodity Cloud IaaS Platforms for Enterprises & Service Deploying Piston OpenStack Cloud POC on IronPOD Hardware Platforms Piston and Iron Networks have partnered
More informationIT of SPIM Data Storage and Compression. EMBO Course - August 27th! Jeff Oegema, Peter Steinbach, Oscar Gonzalez
IT of SPIM Data Storage and Compression EMBO Course - August 27th Jeff Oegema, Peter Steinbach, Oscar Gonzalez 1 Talk Outline Introduction and the IT Team SPIM Data Flow Capture, Compression, and the Data
More informationMobile Cloud Computing T-110.5121 Open Source IaaS
Mobile Cloud Computing T-110.5121 Open Source IaaS Tommi Mäkelä, Otaniemi Evolution Mainframe Centralized computation and storage, thin clients Dedicated hardware, software, experienced staff High capital
More informationCUDA in the Cloud Enabling HPC Workloads in OpenStack With special thanks to Andrew Younge (Indiana Univ.) and Massimo Bernaschi (IAC-CNR)
CUDA in the Cloud Enabling HPC Workloads in OpenStack John Paul Walters Computer Scien5st, USC Informa5on Sciences Ins5tute jwalters@isi.edu With special thanks to Andrew Younge (Indiana Univ.) and Massimo
More informationHyperscale Use Cases for Scaling Out with Flash. David Olszewski
Hyperscale Use Cases for Scaling Out with Flash David Olszewski Business challenges Performanc e Requireme nts Storage Budget Balance the IT requirements How can you get the best of both worlds? SLA Optimized
More informationHedvig Distributed Storage Platform with Cisco UCS
REFERENCE ARCHITECTURE 1 Hedvig Distributed Storage Platform with Cisco UCS Solution Overview and Reference Architecture Elastic Scale to petabytes of data Start with as few as two nodes and scale to thousands.
More informationBusiness-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000
Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000 Clear the way for new business opportunities. Unlock the power of data. Overcoming storage limitations Unpredictable data growth
More informationAccelerating I/O- Intensive Applications in IT Infrastructure with Innodisk FlexiArray Flash Appliance. Alex Ho, Product Manager Innodisk Corporation
Accelerating I/O- Intensive Applications in IT Infrastructure with Innodisk FlexiArray Flash Appliance Alex Ho, Product Manager Innodisk Corporation Outline Innodisk Introduction Industry Trend & Challenge
More informationPurchase of High Performance Computing (HPC) Central Compute Resources by Northwestern Researchers
Information Technology Purchase of High Performance Computing (HPC) Central Compute Resources by Northwestern Researchers Effective for FY2016 Purpose This document summarizes High Performance Computing
More informationScaling from Datacenter to Client
Scaling from Datacenter to Client KeunSoo Jo Sr. Manager Memory Product Planning Samsung Semiconductor Audio-Visual Sponsor Outline SSD Market Overview & Trends - Enterprise What brought us to NVMe Technology
More informationInfiniBand Update Addressing new I/O challenges in HPC, Cloud, and Web 2.0 infrastructures. Brian Sparks IBTA Marketing Working Group Co-Chair
InfiniBand Update Addressing new I/O challenges in HPC, Cloud, and Web 2.0 infrastructures Brian Sparks IBTA Marketing Working Group Co-Chair Page 1 IBTA & OFA Update IBTA today has over 50 members; OFA
More informationThe path to the cloud training
The path to the cloud training Guy Carmin Roei Goldenberg RHCE, RHCI, RHCVA, RHCSA Solution Architect IGC, Red Hat RHCE Linux Consultant and Cloud expert, Matrix May 2015 I.T. Challenges in Enterprise
More informationHigh Performance. CAEA elearning Series. Jonathan G. Dudley, Ph.D. 06/09/2015. 2015 CAE Associates
High Performance Computing (HPC) CAEA elearning Series Jonathan G. Dudley, Ph.D. 06/09/2015 2015 CAE Associates Agenda Introduction HPC Background Why HPC SMP vs. DMP Licensing HPC Terminology Types of
More informationIBM System x SAP HANA
Place photo here IBM System x SAP HANA, IBM System X IBM SAP: 42 2012 Largest HANA implementation worldwide with 100 Terrabyte powered by IBM 2011 IBM Unveils Next Generation Smart Cloud Platform for Business
More informationHow To Build A Cloud Server For A Large Company
MASSIVELY SCALED INFRASTRUCTURE FOR VERIZON CLOUD COMPUTE AND STORAGE Challenge Create the world s highest performance enterprise class public cloud Provide granular, customized configurations defined
More informationConvergence-A new keyword for IT infrastructure transformation
Convergence-A new keyword for IT infrastructure transformation www.huawei.com Derek Liu, Sr. Marketing Director Singapore, Nov. 2013 HUAWEI TECHNOLOGIES CO., LTD. Evolution of IT Infrastructure/Stack IBM/DEC/
More information21 st Century Storage What s New and What s Changing
21 st Century Storage What s New and What s Changing Randy Kerns Senior Strategist Evaluator Group Overview New technologies in storage - Continued evolution - Each has great economic value - Differing
More informationA Holistic Model of the Energy-Efficiency of Hypervisors
A Holistic Model of the -Efficiency of Hypervisors in an HPC Environment Mateusz Guzek,Sebastien Varrette, Valentin Plugaru, Johnatan E. Pecero and Pascal Bouvry SnT & CSC, University of Luxembourg, Luxembourg
More informationSUSE Cloud 2.0. Pete Chadwick. Douglas Jarvis. Senior Product Manager pchadwick@suse.com. Product Marketing Manager djarvis@suse.
SUSE Cloud 2.0 Pete Chadwick Douglas Jarvis Senior Product Manager pchadwick@suse.com Product Marketing Manager djarvis@suse.com SUSE Cloud SUSE Cloud is an open source software solution based on OpenStack
More informationProduct Overview. Marc Skinner Principal Solutions Architect Red Hat RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM
Product Overview Marc Skinner Principal Solutions Architect Red Hat Seismic Shift in Enterprise IT Driven by IT Consumerization EMERGING EXISTING Applications with predictable usage models Open source
More informationIntel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance
Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance Hybrid Storage Performance Gains for IOPS and Bandwidth Utilizing Colfax Servers and Enmotus FuzeDrive Software NVMe Hybrid
More informationF600Q 8Gb FC Storage Performance Report Date: 2012/10/30
F600Q 8Gb FC Storage Performance Report Date: 2012/10/30 Table of Content IO Feature Highlights Test Configurations Maximum IOPS & Best Throughput Maximum Sequential IOPS Test Configurations Random IO
More informationUCS Storage Options. July 2015. Bertalan Dergez Consulting Systems Engineer
UCS Storage Options July 2015 Bertalan Dergez Consulting Systems Engineer Agenda UCS Direct Attached Storage Options Cisco Converged Infrastructure Solutions Software Defined Storage / Hyperconvergence
More informationBest Practices for Increasing Ceph Performance with SSD
Best Practices for Increasing Ceph Performance with SSD Jian Zhang Jian.zhang@intel.com Jiangang Duan Jiangang.duan@intel.com Agenda Introduction Filestore performance on All Flash Array KeyValueStore
More informationNutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure
Nutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure with VMware vsphere 5 and View 5 Table of Contents 1. Executive Summary...1 2. Introduction to Project Colossus...2 2.1.
More informationDIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION
DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION A DIABLO WHITE PAPER AUGUST 2014 Ricky Trigalo Director of Business Development Virtualization, Diablo Technologies
More informationWhat is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1
What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1 SouthGrid in numbers CPU [cores] RAM [TB] Disk [TB] Manpower [FTE] Power [kw] 5100 10.2 3000 7 1.5 x
More informationNexentaStor Enterprise Backend for CLOUD. Marek Lubinski Marek Lubinski Sr VMware/Storage Engineer, LeaseWeb B.V.
NexentaStor Enterprise Backend for CLOUD Marek Lubinski Marek Lubinski Sr VMware/Storage Engineer, LeaseWeb B.V. AGENDA LeaseWeb overview Express Cloud platform Initial storage build Why NexentaStor NexentaStor
More informationSUSE Enterprise Storage Highly Scalable Software Defined Storage. Gábor Nyers Sales Engineer @SUSE gnyers@suse.com
SUSE Enterprise Storage Highly Scalable Software Defined Storage Gábor Nyers Sales Engineer @SUSE gnyers@suse.com Setting the Stage Enterprise Data Capacity Utilization 1-3% 15-20% 20-25% Tier 0 Ultra
More informationOutline. Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models
1 2 Outline Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 3 Introduction What is Virtualization Station? Allows users to create and operate
More informationHigh Performance Computing in CST STUDIO SUITE
High Performance Computing in CST STUDIO SUITE Felix Wolfheimer GPU Computing Performance Speedup 18 16 14 12 10 8 6 4 2 0 Promo offer for EUC participants: 25% discount for K40 cards Speedup of Solver
More informationMaxDeploy Hyper- Converged Reference Architecture Solution Brief
MaxDeploy Hyper- Converged Reference Architecture Solution Brief MaxDeploy Reference Architecture solutions are configured and tested for support with Maxta software- defined storage and with industry
More informationMarvell DragonFly. TPC-C OLTP Database Benchmark: 20x Higher-performance using Marvell DragonFly NVCACHE with SanDisk X110 SSD 256GB
PARTNER PERFORMANCE BENCHMARK PAPER / SANDISK Marvell DragonFly With SanDisk X110 SSD 256GB TPC-C Benchmark Test Results TPC-C OLTP Database Benchmark: 20x Higher-performance using Marvell DragonFly NVCACHE
More informationScaling from Workstation to Cluster for Compute-Intensive Applications
Cluster Transition Guide: Scaling from Workstation to Cluster for Compute-Intensive Applications IN THIS GUIDE: The Why: Proven Performance Gains On Cluster Vs. Workstation The What: Recommended Reference
More informationThe path to the cloud training
The path to the cloud training Guy Carmin RHCE, RHCI, RHCVA, RHCSA Solution Architect IGC, Red Hat May 2015 Roei Goldenberg RHCE Linux Consultant and Cloud expert, Matrix I.T. Challenges in Enterprise
More informationEntry level solutions: - FAS 22x0 series - Ontap Edge. Christophe Danjou Technical Partner Manager
Entry level solutions: - FAS 22x0 series - Ontap Edge Christophe Danjou Technical Partner Manager FAS2200 Series More powerful, affordable, and flexible systems for midsized organizations and distributed
More informationIntroduction to Gluster. Versions 3.0.x
Introduction to Gluster Versions 3.0.x Table of Contents Table of Contents... 2 Overview... 3 Gluster File System... 3 Gluster Storage Platform... 3 No metadata with the Elastic Hash Algorithm... 4 A Gluster
More informationEnabling Technologies for Distributed and Cloud Computing
Enabling Technologies for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Multi-core CPUs and Multithreading
More informationFujitsu PRIMERGY Servers Portfolio
Fujitsu Servers Portfolio Complete server solutions that drive your success shaping tomorrow with you Higher IT efficiency and reduced total cost of ownership Fujitsu Micro and Tower Servers MX130 S2 TX100
More informationEnabling Technologies for Distributed Computing
Enabling Technologies for Distributed Computing Dr. Sanjay P. Ahuja, Ph.D. Fidelity National Financial Distinguished Professor of CIS School of Computing, UNF Multi-core CPUs and Multithreading Technologies
More informationThe virtualization of SAP environments to accommodate standardization and easier management is gaining momentum in data centers.
White Paper Virtualized SAP: Optimize Performance with Cisco Data Center Virtual Machine Fabric Extender and Red Hat Enterprise Linux and Kernel-Based Virtual Machine What You Will Learn The virtualization
More informationPreparation Guide. How to prepare your environment for an OnApp Cloud v3.0 (beta) deployment.
Preparation Guide v3.0 BETA How to prepare your environment for an OnApp Cloud v3.0 (beta) deployment. Document version 1.0 Document release date 25 th September 2012 document revisions 1 Contents 1. Overview...
More informationTesting of several distributed file-system (HadoopFS, CEPH and GlusterFS) for supporting the HEP experiments analisys. Giacinto DONVITO INFN-Bari
Testing of several distributed file-system (HadoopFS, CEPH and GlusterFS) for supporting the HEP experiments analisys. Giacinto DONVITO INFN-Bari 1 Agenda Introduction on the objective of the test activities
More informationMaxta Storage Platform Enterprise Storage Re-defined
Maxta Storage Platform Enterprise Storage Re-defined WHITE PAPER Software-Defined Data Center The Software-Defined Data Center (SDDC) is a unified data center platform that delivers converged computing,
More informationMoving Virtual Storage to the Cloud. Guidelines for Hosters Who Want to Enhance Their Cloud Offerings with Cloud Storage
Moving Virtual Storage to the Cloud Guidelines for Hosters Who Want to Enhance Their Cloud Offerings with Cloud Storage Table of Contents Overview... 1 Understanding the Storage Problem... 1 What Makes
More informationIntroducing NetApp FAS2500 series. Marek Stopka Senior System Engineer ALEF Distribution CZ s.r.o.
Introducing NetApp FAS2500 series Marek Stopka Senior System Engineer ALEF Distribution CZ s.r.o. Complex data storage portfolio Corporate Data Centers Cloud Data Centers Flash Arrays for extreme performance
More informationSALSA Flash-Optimized Software-Defined Storage
Flash-Optimized Software-Defined Storage Nikolas Ioannou, Ioannis Koltsidas, Roman Pletka, Sasa Tomic,Thomas Weigold IBM Research Zurich 1 New Market Category of Big Data Flash Multiple workloads don t
More informationN o v e l l A d d s t o H i g h A v a i l a b i l i t y E x t e n s i o n s f o r S U S E L i n u x E n t e r p r i s e S e r v e r 1 1
I N S I G H T N o v e l l A d d s t o H i g h A v a i l a b i l i t y E x t e n s i o n s f o r S U S E L i n u x E n t e r p r i s e S e r v e r 1 1 Jean S. Bozman I D C O P I N I O N Global Headquarters:
More informationOpenStack IaaS. Rhys Oxenham OSEC.pl BarCamp, Warsaw, Poland November 2013
OpenStack IaaS 1 Rhys Oxenham OSEC.pl BarCamp, Warsaw, Poland November 2013 Disclaimer The information provided within this presentation is for educational purposes only and was prepared for a community
More informationConverged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers
Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers White Paper rev. 2015-11-27 2015 FlashGrid Inc. 1 www.flashgrid.io Abstract Oracle Real Application Clusters (RAC)
More informationSoftware-defined Storage at the Speed of Flash
TECHNICAL BRIEF: SOFTWARE-DEFINED STORAGE AT THE SPEED OF... FLASH..................................... Intel SSD Data Center P3700 Series and Symantec Storage Foundation with Flexible Storage Sharing
More informationCloud on TEIN Part I: OpenStack Cloud Deployment. Vasinee Siripoonya Electronic Government Agency of Thailand Kasidit Chanchio Thammasat University
Cloud on TEIN Part I: OpenStack Cloud Deployment Vasinee Siripoonya Electronic Government Agency of Thailand Kasidit Chanchio Thammasat University Outline Objectives Part I: OpenStack Overview How OpenStack
More informationHadoop on OpenStack Cloud. Dmitry Mescheryakov Software Engineer, @MirantisIT
Hadoop on OpenStack Cloud Dmitry Mescheryakov Software Engineer, @MirantisIT Agenda OpenStack Sahara Demo Hadoop Performance on Cloud Conclusion OpenStack Open source cloud computing platform 17,209 commits
More informationSpringpath Data Platform with Cisco UCS Servers
Springpath Data Platform with Cisco UCS Servers Reference Architecture March 2015 SPRINGPATH DATA PLATFORM WITH CISCO UCS SERVERS Reference Architecture 1.0 Introduction to Springpath Data Platform 1 2.0
More informationStorage Virtualization in Cloud
Storage Virtualization in Cloud Cloud Strategy Partners, LLC Sponsored by: IEEE Educational Activities and IEEE Cloud Computing Course Presenter s Biography This IEEE Cloud Computing tutorial has been
More informationPOSIX and Object Distributed Storage Systems
1 POSIX and Object Distributed Storage Systems Performance Comparison Studies With Real-Life Scenarios in an Experimental Data Taking Context Leveraging OpenStack Swift & Ceph by Michael Poat, Dr. Jerome
More informationNOTICE ADDENDUM NO. TWO (2) JULY 8, 2011 CITY OF RIVIERA BEACH BID NO 308-11 SERVER VIRTULIZATION/SAN PROJECT
NOTICE ADDENDUM NO. TWO (2) JULY 8, 2011 CITY OF RIVIERA BEACH BID NO 308-11 SERVER VIRTULIZATION/SAN PROJECT TO ALL PROPOSERS ON THE ABOVE PROJECT: PLEASE NOTE CONTENTS HEREIN AND AFFIX (PASTE OR STAPLE)
More informationAccelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software
WHITEPAPER Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software SanDisk ZetaScale software unlocks the full benefits of flash for In-Memory Compute and NoSQL applications
More informationState of the Art Cloud Infrastructure
State of the Art Cloud Infrastructure Motti Beck, Director Enterprise Market Development WHD Global I April 2014 Next Generation Data Centers Require Fast, Smart Interconnect Software Defined Networks
More informationPES. Batch virtualization and Cloud computing. Part 1: Batch virtualization. Batch virtualization and Cloud computing
Batch virtualization and Cloud computing Batch virtualization and Cloud computing Part 1: Batch virtualization Tony Cass, Sebastien Goasguen, Belmiro Moreira, Ewan Roche, Ulrich Schwickerath, Romain Wartel
More informationIntro to Virtualization
Cloud@Ceid Seminars Intro to Virtualization Christos Alexakos Computer Engineer, MSc, PhD C. Sysadmin at Pattern Recognition Lab 1 st Seminar 19/3/2014 Contents What is virtualization How it works Hypervisor
More informationRED HAT STORAGE PORTFOLIO OVERVIEW
RED HAT STORAGE PORTFOLIO OVERVIEW Andrew Hatfield Practice Lead Cloud Storage and Big Data MILCIS November 2015 THE RED HAT STORAGE MISSION To offer a unified, open software-defined storage portfolio
More informationAccelerate POC to Production: OpenStack with FlexPod
Accelerate POC to Production: OpenStack with FlexPod Dave Cain Reference Architect, NetApp @thedavecain Muhammad Afzal Engineering Architect, Cisco @mafzal786 1 October 28 th, 2015 OpenStack Evolving Appliances
More informationNew Storage System Solutions
New Storage System Solutions Craig Prescott Research Computing May 2, 2013 Outline } Existing storage systems } Requirements and Solutions } Lustre } /scratch/lfs } Questions? Existing Storage Systems
More informationVxRACK : L HYPER-CONVERGENCE AVEC L EXPERIENCE VCE JEUDI 19 NOVEMBRE 2015. Jean-Baptiste ROBERJOT - VCE - Software Defined Specialist
VxRACK : L HYPER-CONVERGENCE AVEC L EXPERIENCE VCE JEUDI 19 NOVEMBRE 2015 Jean-Baptiste ROBERJOT - VCE - Software Defined Specialist Who is VCE Today? #1 Market Share & Gartner MQ position 96% Customer
More information(Scale Out NAS System)
For Unlimited Capacity & Performance Clustered NAS System (Scale Out NAS System) Copyright 2010 by Netclips, Ltd. All rights reserved -0- 1 2 3 4 5 NAS Storage Trend Scale-Out NAS Solution Scaleway Advantages
More informationMoving Virtual Storage to the Cloud
Moving Virtual Storage to the Cloud White Paper Guidelines for Hosters Who Want to Enhance Their Cloud Offerings with Cloud Storage www.parallels.com Table of Contents Overview... 3 Understanding the Storage
More informationLarge Scale Storage. Orlando Richards, Information Services orlando.richards@ed.ac.uk. LCFG Users Day, University of Edinburgh 18 th January 2013
Large Scale Storage Orlando Richards, Information Services orlando.richards@ed.ac.uk LCFG Users Day, University of Edinburgh 18 th January 2013 Overview My history of storage services What is (and is not)
More informationInvestigation of storage options for scientific computing on Grid and Cloud facilities
Investigation of storage options for scientific computing on Grid and Cloud facilities Overview Hadoop Test Bed Hadoop Evaluation Standard benchmarks Application-based benchmark Blue Arc Evaluation Standard
More informationPierre Riteau University of Chicago
Infrastructure Clouds for Science and Educa3on: Infrastructure Cloud Offerings Pierre Riteau University of Chicago 12/11/2012 NIMBUS 1 IaaS Clouds Multitude of IaaS providers available Most are following
More informationPerformance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007
Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms Cray User Group Meeting June 2007 Cray s Storage Strategy Background Broad range of HPC requirements
More informationHP Cloudline Overview
HP Cloudline Overview Infrastructure for Cloud Service Providers Dave Peterson Hewlett-Packard Company Copyright 2015 2012 Hewlett-Packard Development Company, L.P. The information contained herein is
More informationIntegrated Grid Solutions. and Greenplum
EMC Perspective Integrated Grid Solutions from SAS, EMC Isilon and Greenplum Introduction Intensifying competitive pressure and vast growth in the capabilities of analytic computing platforms are driving
More informationScala Storage Scale-Out Clustered Storage White Paper
White Paper Scala Storage Scale-Out Clustered Storage White Paper Chapter 1 Introduction... 3 Capacity - Explosive Growth of Unstructured Data... 3 Performance - Cluster Computing... 3 Chapter 2 Current
More informationDistributed Block-level Storage Management for OpenStack
Distributed Block-level Storage Management for OpenStack OpenStack APAC Conference Daniel Lee CCMA/ITRI Cloud Computing Center for Mobile Applications Industrial Technology Research Institute ( 雲 端 運 算
More informationUnified Computing System When Delivering IT as a Service. Tomi Jalonen DC CSE 2015
Unified Computing System When Delivering IT as a Service Tomi Jalonen DC CSE 2015 Key Concepts 2 Unified Computing Product Innovation Manager Comprehensive Role-Based Management and Automation for Ease
More information東 海 大 學 資 訊 工 程 研 究 所 碩 士 論 文
東 海 大 學 資 訊 工 程 研 究 所 碩 士 論 文 指 導 教 授 : 楊 朝 棟 博 士 以 異 質 儲 存 技 術 實 作 一 個 軟 體 定 義 儲 存 服 務 Implementation of a Software-Defined Storage Service with Heterogeneous Storage Technologies 研 究 生 : 連 威 翔 中 華 民
More informationLustre SMB Gateway. Integrating Lustre with Windows
Lustre SMB Gateway Integrating Lustre with Windows Hardware: Old vs New Compute 60 x Dell PowerEdge 1950-8 x 2.6Ghz cores, 16GB, 500GB Sata, 1GBe - Win7 x64 Storage 1 x Dell R510-12 x 2TB Sata, RAID5,
More informationRED HAT STORAGE SERVER TECHNICAL OVERVIEW
RED HAT STORAGE SERVER TECHNICAL OVERVIEW Ingo Börnig Solution Architect, Red Hat 24.10.2013 NEW STORAGE REQUIREMENTS FOR THE MODERN HYBRID DATACENTER DESIGNED FOR THE NEW DATA LANDSCAPE PETABYTE SCALE
More informationConnecting Flash in Cloud Storage
Connecting Flash in Cloud Storage Kevin Deierling Vice President Mellanox Technologies kevind AT mellanox.com Santa Clara, CA 1 Five Key Requirements for Connecting Flash Storage in the Cloud 1. Economical
More informationovirt and Gluster Hyperconvergence
ovirt and Gluster Hyperconvergence January 2015 Federico Simoncelli Principal Software Engineer Red Hat ovirt and GlusterFS Hyperconvergence, Jan 2015 1 Agenda ovirt Architecture and Software-defined Data
More informationBuilding a Private Cloud with Eucalyptus
Building a Private Cloud with Eucalyptus 5th IEEE International Conference on e-science Oxford December 9th 2009 Christian Baun, Marcel Kunze KIT The cooperation of Forschungszentrum Karlsruhe GmbH und
More informationVirtualization. Nelson L. S. da Fonseca IEEE ComSoc Summer Scool Trento, July 9 th, 2015
Virtualization Nelson L. S. da Fonseca IEEE ComSoc Summer Scool Trento, July 9 th, 2015 Acknowledgement Some slides in this set of slides were kindly provided by: Luiz Fernando Bittencourt, University
More informationMaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products
MaxDeploy Ready Hyper- Converged Virtualization Solution With SanDisk Fusion iomemory products MaxDeploy Ready products are configured and tested for support with Maxta software- defined storage and with
More informationDelivers high performance, reliability, and security. Is certified by the leading hardware and software vendors
Datasheet Red Hat Enterprise Linux 6 Red Hat Enterprise Linux is a high-performing operating system that has delivered outstanding value to IT environments for nearly a decade. As the world s most trusted
More information