Scaling up to Production

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Scaling up to Production"

Transcription

1 1 Scaling up to Production

2 Overview Productionize then Scale Building Production Systems Scaling Production Systems Use Case: Scaling a Production Galaxy Instance Infrastructure Advice 2

3 PRODUCTIONIZE THEN SCALE 3

4 Productionize then Scale Productionize Put into operation for end users Scale-up Ability to manage increasing workloads Characteristics of production process impacts how you scale-up 4

5 Whole Genome Sequencing WGS for humans 60x coverage ~200GB of read data ~80MB of variant data 3 hours of compute (e.g. Intel s highly optimized algorithms) Source: Gullapalli, et. al., Next generation sequencing in clinical medicine: Challenges and lessons for pathology and biomedical informatics, Journal of Pathology Informatics, Year 2012, Volume 3, Issue 1 [p. 40] 5

6 WGS in the Clinic Patients Physicians Clinics Insurance Test Lab Regulators Developers EMR Source: Gullapalli, et. al., Next generation sequencing in clinical medicine: Challenges and lessons for pathology and biomedical informatics, Journal of Pathology Informatics, Year 2012, Volume 3, Issue 1 [p. 40] 6

7 WGS at Scale Every newborn: 140 million/yr PB of read data 11.2 PB variant data 4.2 x 10 7 hours of compute PER YEAR Other Applications Cancer T/N, time series, multi-tissue Familial studies Source: Gullapalli, et. al., Next generation sequencing in clinical medicine: Challenges and lessons for pathology and biomedical informatics, Journal of Pathology Informatics, Year 2012, Volume 3, Issue 1 [p. 40] 7

8 BUILDING PRODUCTION SYSTEMS 8

9 Building Production Systems: Overview Understanding Users Managing Data Assessing Applications Additional Considerations Optimizing the Process Managing Change 9

10 Understanding Users User profiles End-users, support staff, finance, etc. Use cases Number of users Tip: create a quick matrix of user profiles and the number of users within each profile currently and in 3 years 10

11 Managing Data Data amount Data access Data characteristics Data locality Tip: write down an estimate for the low and high bound of data coming into the system and from where data generated by the system data being delivered from the system and to where 11

12 Assessing Applications Application types Application requirements Application characteristics Tip: document a few runs to get an idea of the memory use, CPU use, runtime, etc. of an application 12

13 Regulatory Compliance Revolves around organizational policies to enforce best practices ISO, Good Clinical Practice, Safe Harbor, CLIA, FDA, EMR/EHR, EMA Significant time and financial investment is required to achieve regulatory compliance 13

14 Optimizing the Process Evaluate users, data, applications and other considerations individually and as a whole What are the bottlenecks? What can be optimized? What can be automated? 14

15 Optimizing the Process Bottlenecks Optimization Automation CPU bound IO bound Memory speed Memory size Network bandwidth Network latency Instrument capture & data movement Application CPU Memory Input/Output Networking Options Program Translation QC Business rules Testing Notifications Workflows Error handling Reporting 15

16 Optimizing the Process: WGS Example Network from sequencer to storage Storage space for data Available RAM and compute Accessibility of data to compute resources Secure storage and data transfer Parallelize of mapping, variant calling Automate QC metrics 16

17 Managing Change We are in an dynamic field Tools will change, metrics will be refined, file formats will evolve, new regulations will be made Key concepts often forgotten Modularization Interoperability Usability 17

18 SCALING PRODUCTION SYSTEMS 18

19 Scaling Production Systems When to Scale How to Scale Infrastructure 19

20 When to scale BE PROACTIVE NOT REACTIVE Forecast increases in number of users number of jobs computational intensity of jobs amount of data Periodic reassessment of forecasts 20

21 How to Scale Factors to consider when scaling Number of users Number of jobs Types of jobs Amount of data 21

22 Number of Users Access control User account management Resource allocation Prioritization Individual usage monitoring/tracking 22

23 Number of Jobs Job submission management Job queues Priorities Status information Ability to appropriately use resources for jobs Load balancing 23

24 Types of Jobs Memory intensive IO intensive Compute intensive Optimized/custom applications 24

25 Amount of Data Tiered storage Handles different levels of availability Cost trade-offs Implement data management policy Data Transfer Network bandwidth and latency Data movement accelerators Data Ingestion 25

26 Infrastructure Technology Fat Nodes & Appliances Rackmounts and blades Scale-out architectures Shared memory architectures Network requirements 26

27 CASE STUDY: SCALING A PRODUCTION GALAXY INSTANCE 27

28 Scaling a Production Galaxy Instance Galaxy Overview Considerations for Local Installation Scaling Galaxy 28

29 Galaxy Overview Galaxy is an open, web-based platform for data intensive biomedical research 29

30 Considerations for Local Installation Hosting Galaxy Locally Managing the Software Supporting the Users 30

31 Hosting Galaxy Locally Host server must have sufficient storage because Galaxy need direct access to data Input data, intermediate data, results, metadata, static data resources Host server must have a sufficient network connection Host server needs sufficient compute resources Analysis tools 31

32 Hosting Galaxy Locally Personal workstation Flexibility that comes with self-management Very limited resources, requires know-how Local shared cluster Better ROI on upfront install effort investment A lot of support and management overhead Appliance Dedicated high performance server Automated software management Leverages other infrastructure to scale 32

33 Managing the Software Galaxy software versions Analysis tools versions Software dependencies Performance optimization 33

34 Supporting Users Number of Users Manage job submission Manage user accounts Setting up quotas Support Services 34

35 Scaling Galaxy Software Hardware Storage Compute Network 35

36 Software Job scheduler Grid Engine Galaxy Database PostGreSQL, MySQL Proxy server Apache Optimize configurations 36

37 Hardware: Storage Storage local to host server must be large enough to store all data handled by Galaxy Increase local capacity Network more storage Port instance to machine with more storage Backup Move data off local storage to make room 37

38 Hardware: Compute Host must have access to sufficient compute Port Galaxy to a more powerful host Build additional computational resources on the Galaxy host Leverage job scheduler to span resources Burst to the cloud or other clusters 38

39 Hardware: Network Connectivity to data sources Internal network Connection to HTP data generation instrument External network Supporting a global user base Transfer protocols Optimized tools for transferring data 39

40 INFRASTRUCTURE ADVICE 40

41 Infrastructure Advice Science is changing faster than we can refresh IT Consider future flexibility as much as current needs Avoid things that lock you into a vendor or platform Continually evaluate your default assumptions 41

42 Infrastructure Advice Physical and network data ingestion Think about edge cases and the unexpected Don t go crazy with upfront investment Compute and analysis Pay attention to areas that need optimization for your operations 42

43 Infrastructure Advice Cloud strategy Spend time to develop policies, procedures, assess risk etc. Consider laying the technical groundwork now so it is easier to make use of the cloud when needed 43

44 Infrastructure Advice Storage and data management Spend bulk of attention and budget here Understand the diversity of products and features to minimize risk and mistakes Define your storage approach to match you organization s funding and staffing model. 44

45 Final Takeaway If you think big data is here now... Know your key systems, technologies, and bottlenecks Researchers and IT must work together to build environments that enable science 45

46 Legal Disclaimer & Optimization Notice INFORMATION IN THIS DOCUMENT IS PROVIDED AS IS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. Copyright, Intel Corporation. All rights reserved. Intel, the Intel logo, Xeon, Core, VTune, and Cilk are trademarks of Intel Corporation in the U.S. and other countries. Optimization Notice Intel s compilers may or may not optimize to the same degree for non-intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice. Notice revision # Copyright 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.

47

Intel Media SDK Library Distribution and Dispatching Process

Intel Media SDK Library Distribution and Dispatching Process Intel Media SDK Library Distribution and Dispatching Process Overview Dispatching Procedure Software Libraries Platform-Specific Libraries Legal Information Overview This document describes the Intel Media

More information

Intel Platform and Big Data: Making big data work for you.

Intel Platform and Big Data: Making big data work for you. Intel Platform and Big Data: Making big data work for you. 1 From data comes insight New technologies are enabling enterprises to transform opportunity into reality by turning big data into actionable

More information

Internet, adat, biztonság, sebesség

Internet, adat, biztonság, sebesség Internet, adat, biztonság, sebesség Gacsal József Business Development Manager, Intel Hungary Ltd. 2013. április 9. HOUG Siófok Legal Information Today s presentations contain forward-looking statements.

More information

Vendor Update Intel 49 th IDC HPC User Forum. Mike Lafferty HPC Marketing Intel Americas Corp.

Vendor Update Intel 49 th IDC HPC User Forum. Mike Lafferty HPC Marketing Intel Americas Corp. Vendor Update Intel 49 th IDC HPC User Forum Mike Lafferty HPC Marketing Intel Americas Corp. Legal Information Today s presentations contain forward-looking statements. All statements made that are not

More information

Contributed Article Program and Intel DPD Search Optimization Training. John McHugh and Steve Moore January 2012

Contributed Article Program and Intel DPD Search Optimization Training. John McHugh and Steve Moore January 2012 Contributed Article Program and Intel DPD Search Optimization Training John McHugh and Steve Moore January 2012 Contributed Article Program Publish good stuff and get paid John McHugh Marcom 2 Contributed

More information

The ROI from Optimizing Software Performance with Intel Parallel Studio XE

The ROI from Optimizing Software Performance with Intel Parallel Studio XE The ROI from Optimizing Software Performance with Intel Parallel Studio XE Intel Parallel Studio XE delivers ROI solutions to development organizations. This comprehensive tool offering for the entire

More information

Intel Parallel Studio XE 2013 SP1 for Windows* Installation Guide and Release Notes

Intel Parallel Studio XE 2013 SP1 for Windows* Installation Guide and Release Notes Intel Parallel Studio XE 2013 SP1 for Windows* Installation Guide and Release Notes Document number: 323803-004US 31 January 2014 Table of Contents 1 Introduction... 1 1.1 What s New... 2 1.1.1 Changes

More information

Intel Service Assurance Administrator. Product Overview

Intel Service Assurance Administrator. Product Overview Intel Service Assurance Administrator Product Overview Running Enterprise Workloads in the Cloud Enterprise IT wants to Start a private cloud initiative to service internal enterprise customers Find an

More information

Keys to node-level performance analysis and threading in HPC applications

Keys to node-level performance analysis and threading in HPC applications Keys to node-level performance analysis and threading in HPC applications Thomas GUILLET (Intel; Exascale Computing Research) IFERC seminar, 18 March 2015 Legal Disclaimer & Optimization Notice INFORMATION

More information

High Performance Computing and Big Data: The coming wave.

High Performance Computing and Big Data: The coming wave. High Performance Computing and Big Data: The coming wave. 1 In science and engineering, in order to compete, you must compute Today, the toughest challenges, and greatest opportunities, require computation

More information

INTEL PARALLEL STUDIO XE EVALUATION GUIDE

INTEL PARALLEL STUDIO XE EVALUATION GUIDE Introduction This guide will illustrate how you use Intel Parallel Studio XE to find the hotspots (areas that are taking a lot of time) in your application and then recompiling those parts to improve overall

More information

Software & Services Group

Software & Services Group Software & Services Group Mark Zuckerberg "When I'm introspective about the last few years I think the biggest mistake that we made, as a company, is betting too much on HTML5 as opposed to native... because

More information

Three Paths to Faster Simulations Using ANSYS Mechanical 16.0 and Intel Architecture

Three Paths to Faster Simulations Using ANSYS Mechanical 16.0 and Intel Architecture White Paper Intel Xeon processor E5 v3 family Intel Xeon Phi coprocessor family Digital Design and Engineering Three Paths to Faster Simulations Using ANSYS Mechanical 16.0 and Intel Architecture Executive

More information

Hybrid parallelism for Weather Research and Forecasting Model on Intel platforms (performance evaluation)

Hybrid parallelism for Weather Research and Forecasting Model on Intel platforms (performance evaluation) Hybrid parallelism for Weather Research and Forecasting Model on Intel platforms (performance evaluation) Roman Dubtsov*, Mark Lubin, Alexander Semenov {roman.s.dubtsov,mark.lubin,alexander.l.semenov}@intel.com

More information

Intel Cyber Security Briefing: Trends, Solutions, and Opportunities. Matthew Rosenquist, Cyber Security Strategist, Intel Corp

Intel Cyber Security Briefing: Trends, Solutions, and Opportunities. Matthew Rosenquist, Cyber Security Strategist, Intel Corp Intel Cyber Security Briefing: Trends, Solutions, and Opportunities Matthew Rosenquist, Cyber Security Strategist, Intel Corp Legal Notices and Disclaimers INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION

More information

Accelerating High-Speed Networking with Intel I/O Acceleration Technology

Accelerating High-Speed Networking with Intel I/O Acceleration Technology White Paper Intel I/O Acceleration Technology Accelerating High-Speed Networking with Intel I/O Acceleration Technology The emergence of multi-gigabit Ethernet allows data centers to adapt to the increasing

More information

Intel and Qihoo 360 Internet Portal Datacenter - Big Data Storage Optimization Case Study

Intel and Qihoo 360 Internet Portal Datacenter - Big Data Storage Optimization Case Study Intel and Qihoo 360 Internet Portal Datacenter - Big Data Storage Optimization Case Study The adoption of cloud computing creates many challenges and opportunities in big data management and storage. To

More information

Accelerating Business Intelligence with Large-Scale System Memory

Accelerating Business Intelligence with Large-Scale System Memory Accelerating Business Intelligence with Large-Scale System Memory A Proof of Concept by Intel, Samsung, and SAP Executive Summary Real-time business intelligence (BI) plays a vital role in driving competitiveness

More information

IT@Intel. Memory Sizing for Server Virtualization. White Paper Intel Information Technology Computer Manufacturing Server Virtualization

IT@Intel. Memory Sizing for Server Virtualization. White Paper Intel Information Technology Computer Manufacturing Server Virtualization White Paper Intel Information Technology Computer Manufacturing Server Virtualization Memory Sizing for Server Virtualization Intel IT has standardized on 16 gigabytes (GB) of memory for dual-socket virtualization

More information

Performance Tuning for Intel Xeon Phi Coprocessors

Performance Tuning for Intel Xeon Phi Coprocessors Performance Tuning for Intel Xeon Phi Coprocessors Robert Reed Intel Technical Consulting Engineer Agenda Start tuning on host Overview of Intel VTune Amplifier XE Efficiency metrics Problem areas 5 Performance

More information

Intel Media Server Studio Essentials Edition for Windows* Server

Intel Media Server Studio Essentials Edition for Windows* Server Intel Media Server Studio 2016 Essentials Edition for Windows* Server Release Notes Overview What's New System Requirements Installation Installation Folders Known Limitations Legal Information Overview

More information

Intel Media Server Studio Essentials Edition for Windows* Server

Intel Media Server Studio Essentials Edition for Windows* Server Intel Media Server Studio 2015 R4 Essentials Edition for Windows* Server Release Notes Overview What's New System Requirements Installation Installation Folders Known Limitations Legal Information Overview

More information

Towards OpenMP Support in LLVM

Towards OpenMP Support in LLVM Towards OpenMP Support in LLVM Alexey Bataev, Andrey Bokhanko, James Cownie Intel 1 Agenda What is the OpenMP * language? Who Can Benefit from the OpenMP language? OpenMP Language Support Early / Late

More information

Improving Real-Time Performance by Utilizing Cache Allocation Technology

Improving Real-Time Performance by Utilizing Cache Allocation Technology Improving Real-Time Performance by Utilizing Cache Allocation Technology Enhancing Performance via Allocation of the Processor s Cache White Paper April 2015 Document Number: 331843-001US Legal Disclaimer

More information

Accelerating Business Intelligence with Large-Scale System Memory

Accelerating Business Intelligence with Large-Scale System Memory Accelerating Business Intelligence with Large-Scale System Memory A Proof of Concept by Intel, Samsung, and SAP Executive Summary Real-time business intelligence (BI) plays a vital role in driving competitiveness

More information

Intel Data Direct I/O Technology (Intel DDIO): A Primer >

Intel Data Direct I/O Technology (Intel DDIO): A Primer > Intel Data Direct I/O Technology (Intel DDIO): A Primer > Technical Brief February 2012 Revision 1.0 Legal Statements INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE,

More information

Big Data for Big Science. Bernard Doering Business Development, EMEA Big Data Software

Big Data for Big Science. Bernard Doering Business Development, EMEA Big Data Software Big Data for Big Science Bernard Doering Business Development, EMEA Big Data Software Internet of Things 40 Zettabytes of data will be generated WW in 2020 1 SMART CLIENTS INTELLIGENT CLOUD Richer user

More information

Developing an Intel MKL based application in Microsoft Visual Studio*- a Beginner s Guide

Developing an Intel MKL based application in Microsoft Visual Studio*- a Beginner s Guide Developing an Intel MKL based application in Microsoft Visual Studio*- a Beginner s Guide Contents 1. Creating Intel C/C++project using an Intel MKL in Microsoft Visual studio*... 4 1.1 Creating a C/C++

More information

The Foundation for Better Business Intelligence

The Foundation for Better Business Intelligence Product Brief Intel Xeon Processor E7-8800/4800/2800 v2 Product Families Data Center The Foundation for Big data is changing the way organizations make business decisions. To transform petabytes of data

More information

Cloud-based Analytics and Map Reduce

Cloud-based Analytics and Map Reduce 1 Cloud-based Analytics and Map Reduce Datasets Many technologies converging around Big Data theme Cloud Computing, NoSQL, Graph Analytics Biology is becoming increasingly data intensive Sequencing, imaging,

More information

Higher Message Rate: Minimum of 56M Non-coalesced MPI Msg/Sec at 16-core pairs running the OSU Message Bandwidth Test using QDR 80.

Higher Message Rate: Minimum of 56M Non-coalesced MPI Msg/Sec at 16-core pairs running the OSU Message Bandwidth Test using QDR 80. Introduction to QDR-80 and Dual Plane InfiniBand Fabrics being installed today by Intel utilize the True Scale Fabric. This is a Single Plane Fabric with QDR-40 HCA (Single Rail) connectivity. It provides

More information

Large-Data Software Defined Visualization on CPUs

Large-Data Software Defined Visualization on CPUs Large-Data Software Defined Visualization on CPUs Greg P. Johnson, Bruce Cherniak 2015 Rice Oil & Gas HPC Workshop Trend: Increasing Data Size Measuring / modeling increasingly complex phenomena Rendering

More information

Software Rasterizer (SWR) Timothy Rowley, Graphics Software Engineer, Parallel Visual Engineering

Software Rasterizer (SWR) Timothy Rowley, Graphics Software Engineer, Parallel Visual Engineering Software Rasterizer (SWR) Timothy Rowley, Graphics Software Engineer, Parallel Visual Engineering Software Rasterization A Software Rasterizer for OpenGL Timothy Rowley - Graphics Software Engineer, Parallel

More information

Accomplish Optimal I/O Performance on SAS 9.3 with

Accomplish Optimal I/O Performance on SAS 9.3 with Accomplish Optimal I/O Performance on SAS 9.3 with Intel Cache Acceleration Software and Intel DC S3700 Solid State Drive ABSTRACT Ying-ping (Marie) Zhang, Jeff Curry, Frank Roxas, Benjamin Donie Intel

More information

Managing a local Galaxy Instance. Anushka Brownley / Adam Kraut BioTeam Inc.

Managing a local Galaxy Instance. Anushka Brownley / Adam Kraut BioTeam Inc. Managing a local Galaxy Instance Anushka Brownley / Adam Kraut BioTeam Inc. Agenda Who are we Why a local installation Local infrastructure Local installation Tips and Tricks SlipStream Appliance WHO ARE

More information

Implementation and Performance of AES-NI in CyaSSL. Embedded SSL

Implementation and Performance of AES-NI in CyaSSL. Embedded SSL Implementation and Performance of AES-NI in CyaSSL Embedded SSL In 2010, Intel introduced the 32nm Intel microarchitecture code name Westmere. With this introduction, Intel announced support for a new

More information

Maximize Performance and Scalability of RADIOSS* Structural Analysis Software on Intel Xeon Processor E7 v2 Family-Based Platforms

Maximize Performance and Scalability of RADIOSS* Structural Analysis Software on Intel Xeon Processor E7 v2 Family-Based Platforms Maximize Performance and Scalability of RADIOSS* Structural Analysis Software on Family-Based Platforms Executive Summary Complex simulations of structural and systems performance, such as car crash simulations,

More information

Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Platforms

Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Platforms Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Platforms Ubuntu* Enterprise Cloud Executive Summary Intel Cloud Builder Guide Intel Xeon Processor Ubuntu* Enteprise Cloud Canonical*

More information

Intel Solid-State Drives Increase Productivity of Product Design and Simulation

Intel Solid-State Drives Increase Productivity of Product Design and Simulation WHITE PAPER Intel Solid-State Drives Increase Productivity of Product Design and Simulation Intel Solid-State Drives Increase Productivity of Product Design and Simulation A study of how Intel Solid-State

More information

ORACLE INFRASTRUCTURE AS A SERVICE PRIVATE CLOUD WITH CAPACITY ON DEMAND

ORACLE INFRASTRUCTURE AS A SERVICE PRIVATE CLOUD WITH CAPACITY ON DEMAND ORACLE INFRASTRUCTURE AS A SERVICE PRIVATE CLOUD WITH CAPACITY ON DEMAND FEATURES AND FACTS FEATURES Hardware and hardware support for a monthly fee Optionally acquire Exadata Storage Server Software and

More information

The Transition to PCI Express* for Client SSDs

The Transition to PCI Express* for Client SSDs The Transition to PCI Express* for Client SSDs Amber Huffman Senior Principal Engineer Intel Santa Clara, CA 1 *Other names and brands may be claimed as the property of others. Legal Notices and Disclaimers

More information

Fast, Low-Overhead Encryption for Apache Hadoop*

Fast, Low-Overhead Encryption for Apache Hadoop* Fast, Low-Overhead Encryption for Apache Hadoop* Solution Brief Intel Xeon Processors Intel Advanced Encryption Standard New Instructions (Intel AES-NI) The Intel Distribution for Apache Hadoop* software

More information

Intel Ethernet Switch Converged Enhanced Ethernet (CEE) and Datacenter Bridging (DCB) Using Intel Ethernet Switch Family Switches

Intel Ethernet Switch Converged Enhanced Ethernet (CEE) and Datacenter Bridging (DCB) Using Intel Ethernet Switch Family Switches Intel Ethernet Switch Converged Enhanced Ethernet (CEE) and Datacenter Bridging (DCB) Using Intel Ethernet Switch Family Switches February, 2009 Legal INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION

More information

New Dimensions in Configurable Computing at runtime simultaneously allows Big Data and fine Grain HPC

New Dimensions in Configurable Computing at runtime simultaneously allows Big Data and fine Grain HPC New Dimensions in Configurable Computing at runtime simultaneously allows Big Data and fine Grain HPC Alan Gara Intel Fellow Exascale Chief Architect Legal Disclaimer Today s presentations contain forward-looking

More information

Performance Benchmarking for PCIe* and NVMe* Enterprise Solid-State Drives

Performance Benchmarking for PCIe* and NVMe* Enterprise Solid-State Drives Performance Benchmarking for PCIe* and NVMe* Enterprise Solid-State Drives Order Number: 330909-003US INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR

More information

Unlocking Hidden Potential at Intel Through Big Data Analytics

Unlocking Hidden Potential at Intel Through Big Data Analytics Unlocking Hidden Potential at Intel Through Big Data Analytics Ivan Harrow Director Insights & Analytics Intel IT @ivanh Legal Notices This presentation is for informational purposes only. INTEL MAKES

More information

Dell One Identity Manager Scalability and Performance

Dell One Identity Manager Scalability and Performance Dell One Identity Manager Scalability and Performance Scale up and out to ensure simple, effective governance for users. Abstract For years, organizations have had to be able to support user communities

More information

Intel Cloud Builders Guide to Cloud Design and Deployment on Intel Platforms

Intel Cloud Builders Guide to Cloud Design and Deployment on Intel Platforms Intel Cloud Builders Guide Intel Xeon Processor-based Servers RES Virtual Desktop Extender Intel Cloud Builders Guide to Cloud Design and Deployment on Intel Platforms Client Aware Cloud with RES Virtual

More information

Cloud based Holdfast Electronic Sports Game Platform

Cloud based Holdfast Electronic Sports Game Platform Case Study Cloud based Holdfast Electronic Sports Game Platform Intel and Holdfast work together to upgrade Holdfast Electronic Sports Game Platform with cloud technology Background Shanghai Holdfast Online

More information

Installation Guide and Release Notes

Installation Guide and Release Notes Intel Parallel Studio XE 2013 for Linux* Installation Guide and Release Notes Document number: 323804-003US 25 June 2013 Table of Contents 1 Introduction... 1 1.1 What s New... 1 1.1.1 Changes since Intel

More information

Installation Guide and Release Notes

Installation Guide and Release Notes Intel Parallel Studio XE 2013 for Linux* Installation Guide and Release Notes Document number: 323804-003US 30 July 2012 Table of Contents 1 Introduction... 1 1.1 What s New... 1 1.1.1 Changes since Intel

More information

IT@Intel. Comparing Multi-Core Processors for Server Virtualization

IT@Intel. Comparing Multi-Core Processors for Server Virtualization White Paper Intel Information Technology Computer Manufacturing Server Virtualization Comparing Multi-Core Processors for Server Virtualization Intel IT tested servers based on select Intel multi-core

More information

Median Filter. Intel OpenCL SDK Sample Documentation. Copyright Intel Corporation. All Rights Reserved. Document Number: US

Median Filter. Intel OpenCL SDK Sample Documentation. Copyright Intel Corporation. All Rights Reserved. Document Number: US Intel OpenCL SDK Sample Documentation Copyright 2010 2011 Intel Corporation All Rights Reserved Document Number: 325264-003US Revision: 1.3 World Wide Web: http://www.intel.com Document Number: 325264-003US

More information

Overview of Data Fitting Component in Intel Math Kernel Library (Intel MKL) Intel Corporation

Overview of Data Fitting Component in Intel Math Kernel Library (Intel MKL) Intel Corporation Overview of Data Fitting Component in Intel Math Kernel Library (Intel MKL) Intel Corporation Agenda 1D interpolation problem statement Computation flow Application areas Data fitting in Intel MKL Data

More information

Intel Xeon Processor X5570-based Blade Servers Deliver Unmatched Performance for InterSystems Caché Database Benchmark

Intel Xeon Processor X5570-based Blade Servers Deliver Unmatched Performance for InterSystems Caché Database Benchmark White Paper Intel Xeon Processor X5570-based Blade Servers Deliver Unmatched Performance for InterSystems Caché Database Benchmark Abstract In November of 2009, Intel and HP joined InterSystems in benchmarking

More information

Solution Recipe: Improve PC Security and Reliability with Intel Virtualization Technology

Solution Recipe: Improve PC Security and Reliability with Intel Virtualization Technology Solution Recipe: Improve PC Security and Reliability with Intel Virtualization Technology 30406_VT_Brochure.indd 1 6/20/06 4:01:14 PM Preface Intel has developed a series of unique Solution Recipes designed

More information

Different NFV/SDN Solutions for Telecoms and Enterprise Cloud

Different NFV/SDN Solutions for Telecoms and Enterprise Cloud Solution Brief Artesyn Embedded Technologies* Telecom Solutions Intel Xeon Processors Different NFV/SDN Solutions for Telecoms and Enterprise Cloud Networking solutions from Artesyn Embedded Technologies*

More information

Leading Virtualization 2.0

Leading Virtualization 2.0 Leading Virtualization 2.0 How Intel is driving virtualization beyond consolidation into a solution for maximizing business agility within the enterprise White Paper Intel Virtualization Technology (Intel

More information

Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Xeon Processor-based Platforms

Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Xeon Processor-based Platforms Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Xeon Processor-based Platforms Enomaly Elastic Computing Platform, * Service Provider Edition Executive Summary Intel Cloud Builder Guide

More information

High Performance Computing for Silicon Design

High Performance Computing for Silicon Design High Performance Computing for Silicon Design Shesha Krishnapura Senior Principal Engineer April 2009 Authors & Contributors: Raju Nallapa, Doug Austin, Ananth Sankaranarayanan, Shaji Achuthan, Vipul Lal,

More information

PEPPERDATA IN MULTI-TENANT ENVIRONMENTS

PEPPERDATA IN MULTI-TENANT ENVIRONMENTS ..................................... PEPPERDATA IN MULTI-TENANT ENVIRONMENTS technical whitepaper June 2015 SUMMARY OF WHAT S WRITTEN IN THIS DOCUMENT If you are short on time and don t want to read the

More information

Programming Models for Intel Xeon processors and Intel Many Integrated Core (Intel MIC) Architecture

Programming Models for Intel Xeon processors and Intel Many Integrated Core (Intel MIC) Architecture Programming Models for Intel processors and Intel Many Integrated Core (Intel ) Architecture Scott McMillan Senior Software Engineer Software & Services Group April 11, 2012 TACC-Intel Highly Parallel

More information

ORACLE CLOUD MANAGEMENT PACK FOR MIDDLEWARE

ORACLE CLOUD MANAGEMENT PACK FOR MIDDLEWARE ORACLE CLOUD MANAGEMENT PACK FOR MIDDLEWARE CLOUD MANAGEMENT PACK FOR MIDDLEWARE KEY FEATURES Self-service provisioning of JAVA EE applications and multi-tier middleware platforms On-demand delivery of

More information

Intel Parallel Studio XE 2011 SP1 for Linux* Installation Guide and Release Notes

Intel Parallel Studio XE 2011 SP1 for Linux* Installation Guide and Release Notes Intel Parallel Studio XE 2011 SP1 for Linux* Installation Guide and Release Notes Document number: 323804-002US 3 February 2012 Table of Contents 1 Introduction... 1 1.1 What s New... 1 1.2 Product Contents...

More information

Intelligent Business Operations

Intelligent Business Operations White Paper Intel Xeon Processor E5 Family Data Center Efficiency Financial Services Intelligent Business Operations Best Practices in Cash Supply Chain Management Executive Summary The purpose of any

More information

SAP * Mobile Platform 3.0 Scaling on Intel Xeon Processor E5 v2 Family

SAP * Mobile Platform 3.0 Scaling on Intel Xeon Processor E5 v2 Family White Paper SAP* Mobile Platform 3.0 E5 Family Enterprise-class Security SAP * Mobile Platform 3.0 Scaling on Intel Xeon Processor E5 v2 Family Delivering Incredible Experiences to Mobile Users Executive

More information

Configuring RAID for Optimal Performance

Configuring RAID for Optimal Performance Configuring RAID for Optimal Performance Intel RAID Controller SRCSASJV Intel RAID Controller SRCSASRB Intel RAID Controller SRCSASBB8I Intel RAID Controller SRCSASLS4I Intel RAID Controller SRCSATAWB

More information

Intel Cloud Builder Guide: Cloud Design and Deployment on Intel Platforms

Intel Cloud Builder Guide: Cloud Design and Deployment on Intel Platforms EXECUTIVE SUMMARY Intel Cloud Builder Guide Intel Xeon Processor-based Servers Red Hat* Cloud Foundations Intel Cloud Builder Guide: Cloud Design and Deployment on Intel Platforms Red Hat* Cloud Foundations

More information

Intel Media Server Studio - Metrics Monitor (v1.1.0) Reference Manual

Intel Media Server Studio - Metrics Monitor (v1.1.0) Reference Manual Intel Media Server Studio - Metrics Monitor (v1.1.0) Reference Manual Overview Metrics Monitor is part of Intel Media Server Studio 2015 for Linux Server. Metrics Monitor is a user space shared library

More information

* * * Intel RealSense SDK Architecture

* * * Intel RealSense SDK Architecture Multiple Implementations Intel RealSense SDK Architecture Introduction The Intel RealSense SDK is architecturally different from its predecessor, the Intel Perceptual Computing SDK. If you re a developer

More information

Integrating Genetic Data into Clinical Workflow with Clinical Decision Support Apps

Integrating Genetic Data into Clinical Workflow with Clinical Decision Support Apps White Paper Healthcare Integrating Genetic Data into Clinical Workflow with Clinical Decision Support Apps Executive Summary The Transformation Lab at Intermountain Healthcare in Salt Lake City, Utah,

More information

Intel Media Server Studio Professional Edition for Windows* Server

Intel Media Server Studio Professional Edition for Windows* Server Intel Media Server Studio 2015 R3 Professional Edition for Windows* Server Release Notes Overview What's New System Requirements Installation Installation Folders Known Limitations Legal Information Overview

More information

Intel, Cisco, and Red Hat deliver a proven solution that reduces risk. Advance Your Cloud Strategy with OpenStack

Intel, Cisco, and Red Hat deliver a proven solution that reduces risk. Advance Your Cloud Strategy with OpenStack Technology Overview Simplify OpenStack * Cloud Deployment Intel, Cisco, and Red Hat deliver a proven solution that reduces risk According to a global survey of 3,643 enterprise executives responsible for

More information

Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15

Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15 Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15 Table of Contents Fully Integrated Hardware and Software

More information

Accelerate Your Ability to Create, Test, and Optimize Your Ideas

Accelerate Your Ability to Create, Test, and Optimize Your Ideas Selection Guide Accelerate Your Ability to Create, Test, and Optimize Your Ideas -based Workstations Which Workstation Best Meets Your Needs? Choosing a workstation that s up to your job demands is a smart

More information

Transforming your IT Infrastructure for Improved ROI. October 2013

Transforming your IT Infrastructure for Improved ROI. October 2013 1 Transforming your IT Infrastructure for Improved ROI October 2013 Legal Notices This presentation is for informational purposes only. INTEL MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY. Software

More information

新 一 代 軟 體 定 義 的 網 路 架 構 Software Defined Networking (SDN) and Network Function Virtualization (NFV)

新 一 代 軟 體 定 義 的 網 路 架 構 Software Defined Networking (SDN) and Network Function Virtualization (NFV) 新 一 代 軟 體 定 義 的 網 路 架 構 Software Defined Networking (SDN) and Network Function Virtualization (NFV) 李 國 輝 客 戶 方 案 事 業 群 亞 太 區 解 決 方 案 架 構 師 美 商 英 特 爾 亞 太 科 技 有 限 公 司 Email: kuo-hui.li@intel.com 1 Legal

More information

Modernizing Servers and Software

Modernizing Servers and Software SMB PLANNING GUIDE Modernizing Servers and Software Increase Performance with Intel Xeon Processor E3 v3 Family Servers and Windows Server* 2012 R2 Software Why You Should Read This Document This planning

More information

COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service

COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service Eddie Dong, Yunhong Jiang 1 Legal Disclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE,

More information

Integrated Grid Solutions. and Greenplum

Integrated Grid Solutions. and Greenplum EMC Perspective Integrated Grid Solutions from SAS, EMC Isilon and Greenplum Introduction Intensifying competitive pressure and vast growth in the capabilities of analytic computing platforms are driving

More information

Implementing Cloud Storage Metrics to Improve IT Efficiency and Capacity Management

Implementing Cloud Storage Metrics to Improve IT Efficiency and Capacity Management IT@Intel White Paper Intel IT IT Best Practices Cloud Computing and IT Efficiency July 2011 Implementing Cloud Storage Metrics to Improve IT Efficiency and Management Executive Overview Over the past year,

More information

Boosting Long Term Evolution (LTE) Application Performance with Intel System Studio

Boosting Long Term Evolution (LTE) Application Performance with Intel System Studio Case Study Intel Boosting Long Term Evolution (LTE) Application Performance with Intel System Studio Challenge: Deliver high performance code for time-critical tasks in LTE wireless communication applications.

More information

Interwoven TeamSite* 5.5 Content Management Solution Sizing Study

Interwoven TeamSite* 5.5 Content Management Solution Sizing Study Interwoven TeamSite* 5.5 Content Management Solution Sizing Study Executive Summary This Interwoven TeamSite* 5.5 Content Management Solution Sizing Study helps key decisionmakers determine which TeamSite

More information

PC Solutions That Mean Business

PC Solutions That Mean Business PC Solutions That Mean Business Desktop and notebook PCs for small business Powered by the Intel Core 2 Duo Processor The Next Big Thing in Business PCs The Features and Performance to Drive Business Success

More information

Judy Ward, Intel C++ front end engineer

Judy Ward, Intel C++ front end engineer New features in Intel C/C++ Compiler 16.0 Beta Judy Ward, Intel C++ front end engineer Judy.Ward@intel.com Agenda Compile time improvements SSE operators Honoring Parenthesis Current state of C++14 and

More information

Server Based Storage. Economical Reliable. Flash Memory Summit 2012 Santa Clara Convention Center August 21, 2012

Server Based Storage. Economical Reliable. Flash Memory Summit 2012 Santa Clara Convention Center August 21, 2012 Server Based Storage Faster Economical Reliable Steve Mattos Strategic Program Manager steve.mattos@intel.com Flash Memory Summit 2012 Santa Clara Convention Center August 21, 2012 Legal Notices and Disclaimer

More information

Intel Ethernet and Configuring Single Root I/O Virtualization (SR-IOV) on Microsoft* Windows* Server 2012 Hyper-V. Technical Brief v1.

Intel Ethernet and Configuring Single Root I/O Virtualization (SR-IOV) on Microsoft* Windows* Server 2012 Hyper-V. Technical Brief v1. Intel Ethernet and Configuring Single Root I/O Virtualization (SR-IOV) on Microsoft* Windows* Server 2012 Hyper-V Technical Brief v1.0 September 2012 2 Intel Ethernet and Configuring SR-IOV on Windows*

More information

Cloud Computing through Virtualization and HPC technologies

Cloud Computing through Virtualization and HPC technologies Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC

More information

Taking Virtualization

Taking Virtualization Taking Virtualization to the SMB Market How Lenovo is driving Virtualization solutions for the SMB market by lowering costs and simplifying deployment White Paper Lenovo Virtualization Solutions Introduction

More information

Extended Attributes and Transparent Encryption in Apache Hadoop

Extended Attributes and Transparent Encryption in Apache Hadoop Extended Attributes and Transparent Encryption in Apache Hadoop Uma Maheswara Rao G Yi Liu ( 刘 轶 ) Who we are? Uma Maheswara Rao G - umamahesh@apache.org - Software Engineer at Intel - PMC/committer, Apache

More information

Finding Performance and Power Issues on Android Systems. By Eric W Moore

Finding Performance and Power Issues on Android Systems. By Eric W Moore Finding Performance and Power Issues on Android Systems By Eric W Moore Agenda Performance & Power Tuning on Android & Features Needed/Wanted in a tool Some Performance Tools Getting a Device that Supports

More information

Microsoft Private Cloud Fast Track

Microsoft Private Cloud Fast Track Microsoft Private Cloud Fast Track Microsoft Private Cloud Fast Track is a reference architecture designed to help build private clouds by combining Microsoft software with Nutanix technology to decrease

More information

can you effectively plan for the migration and management of systems and applications on Vblock Platforms?

can you effectively plan for the migration and management of systems and applications on Vblock Platforms? SOLUTION BRIEF CA Capacity Management and Reporting Suite for Vblock Platforms can you effectively plan for the migration and management of systems and applications on Vblock Platforms? agility made possible

More information

What Is Microsoft Private Cloud Fast Track?

What Is Microsoft Private Cloud Fast Track? What Is Microsoft Private Cloud Fast Track? MICROSOFT PRIVATE CLOUD FAST TRACK is a reference architecture for building private clouds that combines Microsoft software, consolidated guidance, and validated

More information

An Oracle White Paper July 2011. Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide

An Oracle White Paper July 2011. Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide An Oracle White Paper July 2011 1 Disclaimer The following is intended to outline our general product direction.

More information

Oracle Provides Cost Effective Oracle8 Scalable Technology on Microsoft* Windows NT* for Small and Medium-sized Businesses

Oracle Provides Cost Effective Oracle8 Scalable Technology on Microsoft* Windows NT* for Small and Medium-sized Businesses Oracle Provides Cost Effective Oracle8 Scalable Technology on Microsoft* Windows NT* for Small and Medium-sized Businesses This document describes the procedure for installing the Oracle8 databases onto

More information

COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service. Eddie Dong, Tao Hong, Xiaowei Yang

COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service. Eddie Dong, Tao Hong, Xiaowei Yang COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service Eddie Dong, Tao Hong, Xiaowei Yang 1 Legal Disclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO

More information

Tips and Best Practices for Managing a Private Cloud

Tips and Best Practices for Managing a Private Cloud Deploying and Managing Private Clouds The Essentials Series Tips and Best Practices for Managing a Private Cloud sponsored by Tip s and Best Practices for Managing a Private Cloud... 1 Es tablishing Policies

More information

Scalability of modern Linux kernels

Scalability of modern Linux kernels Scalability of modern Linux kernels September 2010 Andi Kleen, Tim Chen LinuxCon Japan Agenda Presentation is about Linux kernel scalability On single image systems Not applications or clusters Presentation

More information