Everything a DBA Needs to Know About Storage
|
|
- Angelina Fletcher
- 8 years ago
- Views:
Transcription
1 Everything a DBA Needs to Know About Storage Alexey Saltovski, DBA Group Leader, Matrix Didi Atzmony, Director, PM, Kaminario Agenda Enterprise Storage systems SQL Server configuration Storage & Server best practices Monitoring Performance Benchmarking Storage features in the near future 1
2 Enterprise Storage systems - Agenda History / Definition / Types / Services Logical & Physical Components Performance challenge ( What is IOPS/Latency/Throughput) New trends in Storage systems: Solving the Performance I/O challenge High Availability (HA) & Disaster recovery (DR) What is Storage Input Output Non-volatile 2
3 Types of Storage Tape HDD SAS SATA Flash DRAM Major characteristics: 1. Capacity 2. Availability 3. Performance 4. Security 5. Scalability 6. Data integrity 7. Manageability Enterprise storage system Definition 3
4 Enterprise Storage Basic Types DAS Direct Attached Storage Internal Drives Memory Cards Dedicated Storage System NAS Network Attached Storage File based protocol File Server SAN Storage Area Network Block Level Device Disks Enterprise storage system Architecture SAN: Storage Area Network SAN Front End Cache Back End Hard Disk Drives 4
5 The LU LU = Logical Unit The way the storage is exposed Looks like any storage drive Designated by a number LUN A LUN may be shared by many Hosts Many physical disks exposed as one logical disk Security - LUN Masking LUNs are grouped Consistency groups All the LUNs used by Finance All the LUNs use for Development Imperative for backup Useful for Security LUN Masking what a host can see According to WWN Access to a LUN or a Consistency group 5
6 RAID RAID = Redundant Array of Inexpensive Disks RAID 0 Striping RAID 1 Mirroring RAID 10 = RAID 1 + RAID 0 Parity RAID Can we save space? RAID 4 RAID 5 RAID 6 RAID 4 6
7 Enterprise Storage Availability RAID scheme RAID 1, 4, 5, 6, 10 All hardware redundant Controllers IO Paths UPSs At least N+1 A snapshot of data at a point-in-time. Usage: Testing Protection Replication Snaps Prod F Snap V 1 V 2 A A B B C C DF D E E t 10 : Write Snap V1(3) to V2 = F 7
8 Replication / Disaster Recovery Having a remote copy Outside of the storage system For backup or Disaster Recovery RPO Recovery Point Objective How much data is lost during the failover RTO - Recovery Time Objective How long it will take to recover Synchronic or A-synchronic In DR 100 KM Synchronous Replication RPO = 0 Data is always the same on both storage systems Slower as distance grows Two options: Host Host Local Remote Local Remote 8
9 Asynchronous Replication Remote DR site Sync Low performance Solution Asynchronous Replication RPO > 0 Host Local Remote Snap and Replication Snap aside Incremental snap Then Async replication Update Remote Site SNAP Local Site 9
10 The Performance challenge CPU Memory Addressable Memory Network Speed Disk Data Transfer Improvement 0.05 MIPS/$ 0.02 MB/$ 147 MIPS/$ 25 MB/$ 2940x 1250x x 100 Mbps 5 MBPS 100 Gbps 130 MBPS 1000x 26x The Performance challenge Three basic metrics are applied to describe the performance aspects of any storage system: IOPS The number of Input or Output requests per second. Bandwidth (throughput) The number of bytes transferred per second. Response Time (latency) The amount of time each I/O request will take to complete. 10
11 Performance challenge - HDD The HDD is mechanical many performance issues Mechanical actuator Rotational Latency: 7500, 10K, 15K Seek time: Actuator getting to the right location Ways to mitigate: Parallelism Does not manage random or any other badly formed IO patterns. Short Stroking Writing in such a way that the actuator barely moves Still slow Very expensive low utilization All I Want is Bandwidth If you really didn t care about latency how would you get the best bandwidth? FibreChannel? Infiniband? iscsi? 11
12 Maximum Bandwidth - Truck Place 10,000 of 1TB Disks in a TRUCK and move it all to a remote site in Eilatin 8 hours. Bandwidth of transfer is 460 GB/s Latency of the transfer is ~8hours. Storage bottlenecks are rarely bandwidth! Why? Disk RAID Disk bandwidth has increased x Disk Latency 3x Solid State Drive DRAM SSD Uses standard DRAM Volatile Media Requires backup power Battery UPS Pros Fastest Consistent performance for ANY workload Cons Backup Power Power consumption 12
13 Solid State Drive - Flash What is flash? Solid state media The media is divided into blocks The blocks are divided into pages Write: a page Erase: a block Flash types SLC: Single Level Cell MLC: Multi Level Cell (2 bits) Wear out Limited number of writes SLC 100,000 MLC 30,000 Solid State Drive - Flash Form Factor PCIe SAS Writing to Flash -LSA Writing is done in a logging manner B 02 B5 30 B 1 B4 02 B3 02 Write Amplification To write requires sometimes clearing a block Moving pages from one block to another Write Amplification: additional writes to complete the operation Performance impact B 20 13
14 Flash I/O What is flash? Solid state media The media is divided into blocks A E I The blocks are divided into pages Write: a page Erase: B a block F J Flash types SLC: C Single GLevel CellB MLC: Multi Level Cell (2 bits) Wear Z out H L Limited number of writes SLC 100,000 MLC 30,000 M N A D A B C D Z Q Solid State Drive - Flash Performance Read: 70 msec Write: 25 msec(???) NOT good with random writes Pros Non volatile, Lowest power consumption Fast Dense Cons Limited writes Unstable performance Less reliable 14
15 Performance challenge Form Factor Latency (ms) RAM Rack Mount SSD PCIe SSD 0.05 Flash Rack Mount SSD 0.07 HDD 4 to 7 Automatic Tiering Storage controller shifts data around for better Performance According to some heuristic Hot data Predetermined data Prediction algorithms Pros Better utilization of performance resources Cons Not always reliable Doesn t work for random workloads 15
16 The SSD Storage Revolution is Coming SSD will replace FC-HDD Media Cost / GB SSD $/GB FCHDD$/GB HDDSourceIDC SSD SourceGartner The FC HDD storage market is an $18B market in 2011 The SSD Storage Revolution is Coming Enterprise SSD Market Size - $B SourceGartner 16
17 Flash and New trends in Storage systems All SSD FLASH Solutions Many new startups Many flavors to the Flash solution Higher performance Expecting: Lower latency Higher throughput Millions of IOPS GREEN, GREEN, GREEN Lower power consumption Smaller footprint Capacity Availability Redundancy Software Stack Performance Latency IOPS Throughput Flash Performance Density Green Summary -Enterprise Storage systems 17
18 Agenda Enterprise Storage systems SQL Server configuration Storage & Server best practices Monitoring Performance Benchmarking SQL Server Configuration - Agenda SQL Server Architecture (Memory Structure, Process & Files) I/O pattern Basic: Terms and Key Concepts I/O pattern Advanced: I/O sizeof SQL operations. Wait types: user waits Vs. Background waits. DMVs (Dynamic Management Views) 18
19 SQL Server Architecture code area SQL server kernel Stack space Buffer pool Plan cache Buffer cache Net lib dll Open data services Log cache SQLOS Lazywriter Checkpnt MS DTC Log Writer Worker Threads Temp DB User DB Storage system Master DB Model DB Background Processes Client Client User Process User Process Open Data Services Database Cleanup Worker Thread Log Writer Lazy Writer Memory Pool Database Buffer Cache Log Cache Client User Process Worker Thread Database Shrinking Log Files Data Files Users Relational Engine OLE DB Storage Engine 19
20 Database files configuration Logfile(*.ldf) configuration Datafiles(*.mdf, ndf) configuration Filegroups TempDB Sorting, ordering, rebuilding Only one DB per instance ( ). Database Files Types of Systems DSS / DWH Data Reading Oriented Usually, Fewer User Connections, Issuing Complex Aggregative Queries That Generate Sequential Accesses To The Disk Periodic Write Activity Must Be Also Taken Into Account OLTP -(Online transaction processing) Data Manipulation Oriented Usually, Large Number Of User Connections, Using Simple Queries That Generate Random Accesses To The Disk Examples: ERP, CRM 20
21 I/O Patterns I/O Size Small I/O 8 kb Bigger I/O kb Random Vs. Sequential Random -Accessing The Data That Is Scattered Across The Disk. Sequential -Accessing The Data By The Order It Is Physically Stored. Read Vs. Write Read -Accesses The Data From Drive And Writing It To The Buffer Pool. Random read I/O Sequential Read I/O Write -Writing The Data From The Buffer Pool Onto The Hard Drive. Advanced I/O patterns Operation Random / Sequential Read / Write I/O Size Range OLTP Log Sequential Write Sector Aligned Up to 60K OLTP Log Sequential Read Sector Aligned Up to 120K OLTP Data (Index Seeks) Random Read 8K OLTP - Lazy Writer (scatter gather) Random Write Any multiple of 8K up to 256K OLTP Checkpoint (scatter gather) Random Write Any multiple of 8K up to 256K Read Ahead (DSS, Index/Table Scans) Sequential Read Any multiple of 8KB up to 256K (1024 Ent Ed) Bulk Insert Sequential Write Any multiple of 8K up to 128K BACKUP Sequential Read/Write Multiple of 64K (up to 4MB) RESTORE Sequential Read/Write Multiple of 64K (up to 4MB) DBCC CHECKDB Sequential Read 8K 64K ALTER INDEX REBUILD -replaces DBREINDEX (Read Phase) Sequential Read Any multiple of 8KB up to 256K ALTER INDEX REBUILD -replaces DBREINDEX (Write Phase) Sequential Write Any multiple of 8K up to 128K 21
22 Waits What is a wait? App time Application Work Time DB time Wait Time Total Transaction Time Wait types Network. Storage I/O system, configuration Locks, latches, concurrency User Vs. Background waits Useful DMVs sys.dm_os_wait_stats sys.dm_io_virtual_file_stats sys.dm_exec_query_stats sys.dm_exec_sessions sys.dm_os_performance_counters Do remember that DMV data gets re-set with the re-start of the SQL Server service! 22
23 Sys.dm_os_wait_stats Column name Data type Description wait_type nvarchar(60) Name of the wait type. waiting_tasks_count bigint Number of waits on this wait type. This counter is incremented at the start of each wait. wait_time_ms bigint Total wait time for this wait type in milliseconds. This time is inclusive of signal_wait_time_ms. max_wait_time_ms bigint Maximum wait time on this wait type. signal_wait_time_ms bigint Difference between the time that the waiting thread was signaled and when it started running. Wait Types Wait_Type Area Usage Description ASYNC_IO_COMPLETION I/O Resource Used to indicate a worker is waiting on a asynchronous I/O operation to complete not associated with database pages CHECKPOINT_QUEUE Buffer Background Used by background worker that waits on events on queue to process checkpoint requests. This is an "optional" wait type see Important Notes section in blog CHKPT Buffer Background CXPACKET Query Sync DISKIO_SUSPEND BACKUP Sync FT_IFTS_SCHEDULER_IDLE_WAIT Full-Text Background Used to coordinate the checkpoint background worker thread with recovery of master so checkpoint won't start accepting queue requests until master online Used to synchronize threads involved in a parallel query. This wait type only means aparallel query is executing. Used to indicate a worker is waiting to process I/O for a database or log file associated with a SNAPSHOT BACKUP Used by a background task processing full-text search requests indicating it is waiting for work to do: IO_COMPLETION I/O Resource KSOURCE_WAKEUP Shutdown Background LAZYWRITER_SLEEP Buffer Background Used to indicate a wait for I/O for operation (typically synchronous) like sorts and various situations where the engine needs to do a synchronous I/O Used by the background worker "signal handler" which waits for a signal to shutdown SQL Server Used by the Lazywriter background worker to indicate it is sleeping waiting to wake up and check for work to do LOGBUFFER Transaction Log Resource Used to indicate a worker thread is waiting for a log buffer to write log blocks for a transaction 23
24 Wait Types (cont d) LOGMGR_QUEUE Transaction Log Background Used by the background worker "Log Writer" to wait on a queue for requests to flush log blocks to the transaction log. This is an "optional" wait type see Important Notes section in blog MISCELLANEOUS Ignore Ignore This really should be called "Not Waiting". PREEMPTIVE_XXX Varies External Used to indicate a worker is running coded that is not under the SQLOS Scheduling Systems REQUEST_FOR_DEADLOCK_SEARCH Lock Background RESOURCE_QUERY_SEMAPHORE_COMPILE Query Resource Used by background worker "Lock Monitor" to search for deadlocks. This is an "optional" wait type see Important Notes section in blog Used to indicate a worker is waiting to compile a query due to too many other concurrent query compilations that require "not small" amounts of memory. RESOURCE_SEMAPHORE Query Resource SOS_SCHEDULER_YIELD SQLOS Forced SQLTRACE_BUFFER_FLUSH Trace Background Used by background worker Used to indicate a worker is waiting to be allowed to perform an operation requiring "query memory" such as hashes and sorts Used to indicate a worker has yielded to let other workers run on a scheduler THREADPOOL SQLOS Resource Indicates a wait for a task to be assigned to a worker thread WRITELOG I/O Sync Indicates a worker thread is waiting for LogWriter to flush log blocks. XE_DISPATCHER_WAIT XEvent Background XE_TIMER_EVENT XEvent Background Used by a background worker to handle queue requests to write out buffers for async targets Used to indicate a background task is waiting for "expired" timers for internal Xevent engi Script Examples SQL Server IO Statistics example Determing SQL Disk IO Workload 24
25 Agenda Enterprise Storage systems SQL Server configuration Storage & Server best practices Monitoring Performance Benchmarking SQL Server I/O performance: Know Your I/O Pattern Storage Disk VsSSD drivers RAID Levels Server HBAs Multipath configuration Storage network Fabric consideration SQL Server Number of data files and file groups TempDBconsiderations 25
26 Performance No single right way to do it. All environments are different. Latency is crucial. Ensure storage engineers have knowledge of SQL best practices. Validate your configuration before deployment. Storage How many/what size LUNs? It depends :-) Results vary, not all storage implementations perform the same. Test it Use Faster Media Units Use 64KB allocation unit size Array and Driver Firmware Is Important Discuss HBA/Controller Setting With Your Storage Vendor Consider Multi-Path Solution Tune HBA Queue Depth 26
27 Separation of Workloads Separate Random from Sequential Operations Separate Indexes from Tables Isolate Log from Data at the physical level Isolate TEMPDB Database Files Do Not Mix SQL Server Files With Other Data Multiple LUNs are usuallybetter than 1 large LUN More Data Files Be er Performance Determined Mainly By Hardware Capacity Number Of Data Files May Impact Scalability Number Of Processors On Host (Mainly Be Concerned For >= 4 CPUs) 27
28 Database Files cont d For tempdb, configure multiple files. Consider read-only filegroupsfor certain scenarios Autoshrink Do not use it Improve read-ahead operation. Verify object continuity Compression Help reduce the size of the database. Improves the performance of I/O intensive workloads. Extra CPU resources are required to compress and decompress the data. It is important to understand the workload characteristics when deciding which tables to compress. 28
29 Compression (cont d) U: The percentage of update operations on a specific table, index, or partition, relative to total operations on that object. The lower the value of U (that is, the table, index, or partition is infrequently updated), the better candidate it is for page compression. S: The percentage of scan operations on a table, index, or partition, relative to total operations on that object. The higher the value of S (that is, the table, index, or partition is mostly scanned), the better candidate it is for page compression. Agenda Enterprise Storage systems SQL Server configuration Storage & Server best practices Monitoring Performance Benchmarking 29
30 Monitoring Performance OS Level # Parameter Counter 1 IOPS Disk Reads/Sec Disk Writes/Sec 2 Latency Average Disk sec/read Average Disk sec/write 3 Disk Throughput Disk Read Bytes/sec Disk Write Bytes/sec 4 IO Queue Average Disk Queue Length (<=2) Current Disk Queue Length 5 IO Size Average Disk Bytes/Read Average Disk Bytes/Write Monitoring Performance SQL Level Management Studio DMVs 30
31 Monitoring Performance Storage Level Agenda Enterprise Storage systems SQL Server configuration Storage & Server best practices Monitoring Performance Benchmarking 31
32 Benchmarking Do not believe anyone Use benchmarking tools. Benchmark and test before server / storage migration Tools IOMETER SQLIOSim SQLQueryStress IOMeter Ask your storage admin. Or test by yourself Testing must be done after working hours!!! Iometer( consists of two programs: Iometeris the controlling program -Using graphical user interface Dynamo is the workload generator. It has no user interface. 32
33 IOMeter SQLIOSim Utility Starting with SQL Server 2008, SQLIOSimis included with the SQL Server installation. When you install SQL Server, you find the SQLIOSimtool in the BINN folder. 33
34 SQLQueryStress A lightweight performance testing tool, designed to load test individual queries. Includes support for randomization of input parameters in order to test cache repeatability Includes basic capabilities for reporting on consumed server resources SQLQueryStress(cont d) 34
35 Benchmarking Summary IT is all about sizing! Monitor your production I/O pattern What is my Business's I/O characteristics? IOPS / Latency / Through / IO Size / Disk Queue / Read- Ahead Benchmark your storage echo-system(server, HBA, Fabric, Storage) to discover top service time (latency in specific load) What is my SYSTEM I/O Limits? Take Home Message Know the limits of your storage Know the I/O pattern of your system Remember that Latency a key parameter 35
36 Alexey Saltovski, DBA Group Leader, Matrix Didi Atzmony, Director, PM, Kaminario 36
The 5-minute SQL Server Health Check
The 5-minute SQL Server Health Check Christian Bolton Technical Director, Coeo Ltd. Kevin Kline Technical Strategy Manager, Quest Software 2009 Quest Software, Inc. ALL RIGHTS RESERVED Agenda Introducing
More informationThe Technologies & Architectures. President, Demartek
Deep Dive on Solid State t Storage The Technologies & Architectures Dennis Martin Dennis Martin President, Demartek Demartek Company Overview Industry analysis with on-site test lab Lab includes servers,
More informationSolving Performance Problems In SQL Server by Michal Tinthofer
Solving Performance Problems In SQL Server by Michal Tinthofer Michal.Tinthofer@Woodler.eu GOPAS: info@gopas,sk www.gopas.sk www.facebook.com/gopassr Agenda Analyze the overall Sql Server state Focus on
More informationBest Practices for Deploying SSDs in a Microsoft SQL Server 2008 OLTP Environment with Dell EqualLogic PS-Series Arrays
Best Practices for Deploying SSDs in a Microsoft SQL Server 2008 OLTP Environment with Dell EqualLogic PS-Series Arrays Database Solutions Engineering By Murali Krishnan.K Dell Product Group October 2009
More informationBest Practices for Optimizing SQL Server Database Performance with the LSI WarpDrive Acceleration Card
Best Practices for Optimizing SQL Server Database Performance with the LSI WarpDrive Acceleration Card Version 1.0 April 2011 DB15-000761-00 Revision History Version and Date Version 1.0, April 2011 Initial
More informationAdministering Microsoft SQL Server 2012 Databases
Administering Microsoft SQL Server 2012 Databases Install and Configure (19%) Plan installation. May include but not limited to: evaluate installation requirements; design the installation of SQL Server
More informationStorage and SQL Server capacity planning and configuration (SharePoint...
1 of 22 5/1/2011 5:34 PM Storage and SQL Server capacity planning and configuration (SharePoint Server 2010) Updated: January 20, 2011 This article describes how to plan for and configure the storage and
More informationDELL TM PowerEdge TM T610 500 Mailbox Resiliency Exchange 2010 Storage Solution
DELL TM PowerEdge TM T610 500 Mailbox Resiliency Exchange 2010 Storage Solution Tested with: ESRP Storage Version 3.0 Tested Date: Content DELL TM PowerEdge TM T610... 1 500 Mailbox Resiliency
More informationFile System & Device Drive. Overview of Mass Storage Structure. Moving head Disk Mechanism. HDD Pictures 11/13/2014. CS341: Operating System
CS341: Operating System Lect 36: 1 st Nov 2014 Dr. A. Sahu Dept of Comp. Sc. & Engg. Indian Institute of Technology Guwahati File System & Device Drive Mass Storage Disk Structure Disk Arm Scheduling RAID
More informationJune 2009. Blade.org 2009 ALL RIGHTS RESERVED
Contributions for this vendor neutral technology paper have been provided by Blade.org members including NetApp, BLADE Network Technologies, and Double-Take Software. June 2009 Blade.org 2009 ALL RIGHTS
More informationHP Smart Array Controllers and basic RAID performance factors
Technical white paper HP Smart Array Controllers and basic RAID performance factors Technology brief Table of contents Abstract 2 Benefits of drive arrays 2 Factors that affect performance 2 HP Smart Array
More informationDistribution One Server Requirements
Distribution One Server Requirements Introduction Welcome to the Hardware Configuration Guide. The goal of this guide is to provide a practical approach to sizing your Distribution One application and
More informationSAN Conceptual and Design Basics
TECHNICAL NOTE VMware Infrastructure 3 SAN Conceptual and Design Basics VMware ESX Server can be used in conjunction with a SAN (storage area network), a specialized high speed network that connects computer
More informationDirect NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle
Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle Agenda Introduction Database Architecture Direct NFS Client NFS Server
More informationVirtualizing Microsoft SQL Server 2008 on the Hitachi Adaptable Modular Storage 2000 Family Using Microsoft Hyper-V
Virtualizing Microsoft SQL Server 2008 on the Hitachi Adaptable Modular Storage 2000 Family Using Microsoft Hyper-V Implementation Guide By Eduardo Freitas and Ryan Sokolowski February 2010 Summary Deploying
More informationAccelerating Server Storage Performance on Lenovo ThinkServer
Accelerating Server Storage Performance on Lenovo ThinkServer Lenovo Enterprise Product Group April 214 Copyright Lenovo 214 LENOVO PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND, EITHER
More informationBoost SQL Server Performance Buffer Pool Extensions & Delayed Durability
Boost SQL Server Performance Buffer Pool Extensions & Delayed Durability Manohar Punna President - SQLServerGeeks #509 Brisbane 2016 Agenda SQL Server Memory Buffer Pool Extensions Delayed Durability Analysis
More informationThe Data Placement Challenge
The Data Placement Challenge Entire Dataset Applications Active Data Lowest $/IOP Highest throughput Lowest latency 10-20% Right Place Right Cost Right Time 100% 2 2 What s Driving the AST Discussion?
More informationAccelerate SQL Server 2014 AlwaysOn Availability Groups with Seagate. Nytro Flash Accelerator Cards
Accelerate SQL Server 2014 AlwaysOn Availability Groups with Seagate Nytro Flash Accelerator Cards Technology Paper Authored by: Mark Pokorny, Database Engineer, Seagate Overview SQL Server 2014 provides
More informationEnhancing SQL Server Performance
Enhancing SQL Server Performance Bradley Ball, Jason Strate and Roger Wolter In the ever-evolving data world, improving database performance is a constant challenge for administrators. End user satisfaction
More informationWITH A FUSION POWERED SQL SERVER 2014 IN-MEMORY OLTP DATABASE
WITH A FUSION POWERED SQL SERVER 2014 IN-MEMORY OLTP DATABASE 1 W W W. F U S I ON I O.COM Table of Contents Table of Contents... 2 Executive Summary... 3 Introduction: In-Memory Meets iomemory... 4 What
More informationOracle Database Deployments with EMC CLARiiON AX4 Storage Systems
Oracle Database Deployments with EMC CLARiiON AX4 Storage Systems Applied Technology Abstract This white paper investigates configuration and replication choices for Oracle Database deployment with EMC
More informationAgenda. Enterprise Application Performance Factors. Current form of Enterprise Applications. Factors to Application Performance.
Agenda Enterprise Performance Factors Overall Enterprise Performance Factors Best Practice for generic Enterprise Best Practice for 3-tiers Enterprise Hardware Load Balancer Basic Unix Tuning Performance
More informationSQL Server 2012 Optimization, Performance Tuning and Troubleshooting
1 SQL Server 2012 Optimization, Performance Tuning and Troubleshooting 5 Days (SQ-OPT2012-301-EN) Description During this five-day intensive course, students will learn the internal architecture of SQL
More informationServer 2008 SQL. Administration in Action ROD COLLEDGE MANNING. Greenwich. (74 w. long.)
SQL Server 2008 Administration in Action ROD COLLEDGE 11 MANNING Greenwich (74 w. long.) contents foreword xiv preface xvii acknowledgments xix about this book xx about the cover illustration about the
More informationSQL Server Transaction Log from A to Z
Media Partners SQL Server Transaction Log from A to Z Paweł Potasiński Product Manager Data Insights pawelpo@microsoft.com http://blogs.technet.com/b/sqlblog_pl/ Why About Transaction Log (Again)? http://zine.net.pl/blogs/sqlgeek/archive/2008/07/25/pl-m-j-log-jest-za-du-y.aspx
More informationIOmark- VDI. Nimbus Data Gemini Test Report: VDI- 130906- a Test Report Date: 6, September 2013. www.iomark.org
IOmark- VDI Nimbus Data Gemini Test Report: VDI- 130906- a Test Copyright 2010-2013 Evaluator Group, Inc. All rights reserved. IOmark- VDI, IOmark- VDI, VDI- IOmark, and IOmark are trademarks of Evaluator
More informationEnhancements of ETERNUS DX / SF
shaping tomorrow with you ETERNUS - Business-centric Storage Enhancements of ETERNUS DX / SF Global Product Marketing Storage ETERNUS Business-centric Storage Agenda: 1 Overview of the top 3 innovations
More informationImplementing EMC CLARiiON CX4 with Enterprise Flash Drives for Microsoft SQL Server 2008 Databases
Implementing EMC CLARiiON CX4 with Enterprise Flash Drives for Microsoft SQL Server 2008 Databases Applied Technology Abstract This white paper examines the performance considerations of placing SQL Server
More informationServer and Storage Virtualization with IP Storage. David Dale, NetApp
Server and Storage Virtualization with IP Storage David Dale, NetApp SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this
More informationTaking Linux File and Storage Systems into the Future. Ric Wheeler Director Kernel File and Storage Team Red Hat, Incorporated
Taking Linux File and Storage Systems into the Future Ric Wheeler Director Kernel File and Storage Team Red Hat, Incorporated 1 Overview Going Bigger Going Faster Support for New Hardware Current Areas
More informationAnalysis of VDI Storage Performance During Bootstorm
Analysis of VDI Storage Performance During Bootstorm Introduction Virtual desktops are gaining popularity as a more cost effective and more easily serviceable solution. The most resource-dependent process
More informationOracle Aware Flash: Maximizing Performance and Availability for your Database
Oracle Aware Flash: Maximizing Performance and Availability for your Database Gurmeet Goindi Principal Product Manager Oracle Kirby McCord Database Architect US Cellular Kodi Umamageswaran Vice President,
More informationEMC Backup and Recovery for Microsoft SQL Server 2008 Enabled by EMC Celerra Unified Storage
EMC Backup and Recovery for Microsoft SQL Server 2008 Enabled by EMC Celerra Unified Storage Applied Technology Abstract This white paper describes various backup and recovery solutions available for SQL
More informationWhy Computers Are Getting Slower (and what we can do about it) Rik van Riel Sr. Software Engineer, Red Hat
Why Computers Are Getting Slower (and what we can do about it) Rik van Riel Sr. Software Engineer, Red Hat Why Computers Are Getting Slower The traditional approach better performance Why computers are
More informationOPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006
OPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006 EXECUTIVE SUMMARY Microsoft Exchange Server is a disk-intensive application that requires high speed storage to deliver
More informationSolid State Storage in Massive Data Environments Erik Eyberg
Solid State Storage in Massive Data Environments Erik Eyberg Senior Analyst Texas Memory Systems, Inc. Agenda Taxonomy Performance Considerations Reliability Considerations Q&A Solid State Storage Taxonomy
More informationMaximizing SQL Server Virtualization Performance
Maximizing SQL Server Virtualization Performance Michael Otey Senior Technical Director Windows IT Pro SQL Server Pro 1 What this presentation covers Host configuration guidelines CPU, RAM, networking
More informationFlash 101. Violin Memory Switzerland. Violin Memory Inc. Proprietary 1
Flash 101 Violin Memory Switzerland Violin Memory Inc. Proprietary 1 Agenda - What is Flash? - What is the difference between Flash types? - Why are SSD solutions different from Flash Storage Arrays? -
More informationComparison of Hybrid Flash Storage System Performance
Test Validation Comparison of Hybrid Flash Storage System Performance Author: Russ Fellows March 23, 2015 Enabling you to make the best technology decisions 2015 Evaluator Group, Inc. All rights reserved.
More informationSQL Server 2014 New Features/In- Memory Store. Juergen Thomas Microsoft Corporation
SQL Server 2014 New Features/In- Memory Store Juergen Thomas Microsoft Corporation AGENDA 1. SQL Server 2014 what and when 2. SQL Server 2014 In-Memory 3. SQL Server 2014 in IaaS scenarios 2 SQL Server
More informationThe Methodology Behind the Dell SQL Server Advisor Tool
The Methodology Behind the Dell SQL Server Advisor Tool Database Solutions Engineering By Phani MV Dell Product Group October 2009 Executive Summary The Dell SQL Server Advisor is intended to perform capacity
More information2009 Oracle Corporation 1
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material,
More informationHitachi Unified Storage 110 Dynamically Provisioned 27,200 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution
1 Hitachi Unified Storage 110 Dynamically Provisioned 27,200 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 3.0 Test Date: July August 2012 Month Year Notices
More informationExecutive Summary. Methodology
Executive Summary This document describes test procedures for Diskeeper 2011 evaluation. Specifically, the tests described in this document are intended to achieve the following objectives: 1. Evaluate
More informationHitachi Unified Storage 130 Dynamically Provisioned 8,000 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution
1 Hitachi Unified Storage 130 Dynamically Provisioned 8,000 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 3.0 Test Date: October 2012 Month Year Notices and
More informationImprove Business Productivity and User Experience with a SanDisk Powered SQL Server 2014 In-Memory OLTP Database
WHITE PAPER Improve Business Productivity and User Experience with a SanDisk Powered SQL Server 2014 In-Memory OLTP Database 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table of Contents Executive
More informationIntroduction. Part I: Finding Bottlenecks when Something s Wrong. Chapter 1: Performance Tuning 3
Wort ftoc.tex V3-12/17/2007 2:00pm Page ix Introduction xix Part I: Finding Bottlenecks when Something s Wrong Chapter 1: Performance Tuning 3 Art or Science? 3 The Science of Performance Tuning 4 The
More informationSistemas Operativos: Input/Output Disks
Sistemas Operativos: Input/Output Disks Pedro F. Souto (pfs@fe.up.pt) April 28, 2012 Topics Magnetic Disks RAID Solid State Disks Topics Magnetic Disks RAID Solid State Disks Magnetic Disk Construction
More informationDeploying Affordable, High Performance Hybrid Flash Storage for Clustered SQL Server
Deploying Affordable, High Performance Hybrid Flash Storage for Clustered SQL Server Flash storage adoption has increased in recent years, as organizations have deployed it to support business applications.
More informationHP ProLiant DL380p Gen8 1000 mailbox 2GB mailbox resiliency Exchange 2010 storage solution
Technical white paper HP ProLiant DL380p Gen8 1000 mailbox 2GB mailbox resiliency Exchange 2010 storage solution Table of contents Overview 2 Disclaimer 2 Features of the tested solution 2 Solution description
More informationPERFORMANCE TUNING WITH WAIT STATISTICS. Microsoft Corporation Presented by Joe Sack, Dedicated Support Engineer
PERFORMANCE TUNING WITH WAIT STATISTICS Microsoft Corporation Presented by Joe Sack, Dedicated Support Engineer Quick bio and presentation logistics DSE in the Premier Field Engineer team, Microsoft DSE
More informationStoring Data: Disks and Files
Storing Data: Disks and Files (From Chapter 9 of textbook) Storing and Retrieving Data Database Management Systems need to: Store large volumes of data Store data reliably (so that data is not lost!) Retrieve
More informationDisks and RAID. Profs. Bracy and Van Renesse. based on slides by Prof. Sirer
Disks and RAID Profs. Bracy and Van Renesse based on slides by Prof. Sirer 50 Years Old! 13th September 1956 The IBM RAMAC 350 Stored less than 5 MByte Reading from a Disk Must specify: cylinder # (distance
More informationHitachi Unified Storage VM Dynamically Provisioned 24,000 Mailbox Exchange 2013 Mailbox Resiliency Storage Solution
1 Hitachi Unified Storage VM Dynamically Provisioned 24,000 Mailbox Exchange 2013 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 4.0 Test Date: July - August 2013 Month Year Notices
More informationNIMSOFT SLM DATABASE
NIMSOFT SLM DATABASE GUIDELINES AND BEST PRACTICES (May 2010) Address more than 2GB of RAM in 32 bit OS (2003, 2008 Enterprise and Datacenter editions): Add /3GB switch to boot.ini file to force the OS
More informationThe IntelliMagic White Paper: Storage Performance Analysis for an IBM Storwize V7000
The IntelliMagic White Paper: Storage Performance Analysis for an IBM Storwize V7000 Summary: This document describes how to analyze performance on an IBM Storwize V7000. IntelliMagic 2012 Page 1 This
More informationAbout Me: Brent Ozar. Perfmon and Profiler 101
Perfmon and Profiler 101 2008 Quest Software, Inc. ALL RIGHTS RESERVED. About Me: Brent Ozar SQL Server Expert for Quest Software Former SQL DBA Managed >80tb SAN, VMware Dot-com-crash experience Specializes
More informationHitachi Unified Storage VM Dynamically Provisioned 120,000 Mailbox Exchange 2013 Mailbox Resiliency Storage Solution
1 L Hitachi Unified Storage VM Dynamically Provisioned 120,000 Mailbox Exchange 2013 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 4.0 Test Date: July - August 2013 Month Year Notices
More informationCloud Storage. Parallels. Performance Benchmark Results. White Paper. www.parallels.com
Parallels Cloud Storage White Paper Performance Benchmark Results www.parallels.com Table of Contents Executive Summary... 3 Architecture Overview... 3 Key Features... 4 No Special Hardware Requirements...
More informationEvaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array
Evaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array Evaluation report prepared under contract with Lenovo Executive Summary Even with the price of flash
More informationChoosing Storage Systems
Choosing Storage Systems For MySQL Peter Zaitsev, CEO Percona Percona Live MySQL Conference and Expo 2013 Santa Clara,CA April 25,2013 Why Right Choice for Storage is Important? 2 because Wrong Choice
More informationPrice/performance Modern Memory Hierarchy
Lecture 21: Storage Administration Take QUIZ 15 over P&H 6.1-4, 6.8-9 before 11:59pm today Project: Cache Simulator, Due April 29, 2010 NEW OFFICE HOUR TIME: Tuesday 1-2, McKinley Last Time Exam discussion
More informationQ & A From Hitachi Data Systems WebTech Presentation:
Q & A From Hitachi Data Systems WebTech Presentation: RAID Concepts 1. Is the chunk size the same for all Hitachi Data Systems storage systems, i.e., Adaptable Modular Systems, Network Storage Controller,
More informationSummary: This paper examines the performance of an XtremIO All Flash array in an I/O intensive BI environment.
SQL Server Technical Article Writer: Jonathan Foster Technical Reviewer: Karthik Pinnamaneni; Andre Ciabattari Published: November, 2013 Applies to: SQL Server 2012 Summary: This paper examines the performance
More informationSAP HANA - Main Memory Technology: A Challenge for Development of Business Applications. Jürgen Primsch, SAP AG July 2011
SAP HANA - Main Memory Technology: A Challenge for Development of Business Applications Jürgen Primsch, SAP AG July 2011 Why In-Memory? Information at the Speed of Thought Imagine access to business data,
More informationHitachi Unified Storage 110 Dynamically Provisioned 10,400 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution
1 Hitachi Unified Storage 110 Dynamically Provisioned 10,400 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 3.0 Test Date: July August 2012 Month Year Notices
More informationPerformance Baseline of Hitachi Data Systems HUS VM All Flash Array for Oracle
Performance Baseline of Hitachi Data Systems HUS VM All Flash Array for Oracle Storage and Database Performance Benchware Performance Suite Release 8.5 (Build 131015) November 2013 Contents 1 System Configuration
More informationAzure VM Performance Considerations Running SQL Server
Azure VM Performance Considerations Running SQL Server Your company logo here Vinod Kumar M @vinodk_sql http://blogs.extremeexperts.com Session Objectives And Takeaways Session Objective(s): Learn the
More informationNetApp FAS3140 12000 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution
NetApp FAS3140 12000 Mailbox Exchange 2010 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 3.0 Tested Date: May 8, 2010 Content Overview... 3 Disclaimer... 3 Features... 3 Solution
More informationAccelerating I/O- Intensive Applications in IT Infrastructure with Innodisk FlexiArray Flash Appliance. Alex Ho, Product Manager Innodisk Corporation
Accelerating I/O- Intensive Applications in IT Infrastructure with Innodisk FlexiArray Flash Appliance Alex Ho, Product Manager Innodisk Corporation Outline Innodisk Introduction Industry Trend & Challenge
More informationAn Overview of Flash Storage for Databases
An Overview of Flash Storage for Databases Vadim Tkachenko Morgan Tocker http://percona.com MySQL CE Apr 2010 -2- Introduction Vadim Tkachenko Percona Inc, CTO and Lead of Development Morgan Tocker Percona
More informationSQL Server Virtualization
The Essential Guide to SQL Server Virtualization S p o n s o r e d b y Virtualization in the Enterprise Today most organizations understand the importance of implementing virtualization. Virtualization
More informationIBM Systems and Technology Group May 2013 Thought Leadership White Paper. Faster Oracle performance with IBM FlashSystem
IBM Systems and Technology Group May 2013 Thought Leadership White Paper Faster Oracle performance with IBM FlashSystem 2 Faster Oracle performance with IBM FlashSystem Executive summary This whitepaper
More informationHow it can benefit your enterprise. Dejan Kocic Netapp
PRESENTATION Case for flash TITLE GOES storage HERE How it can benefit your enterprise Dejan Kocic Netapp SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise
More informationWHITE PAPER FUJITSU PRIMERGY SERVER BASICS OF DISK I/O PERFORMANCE
WHITE PAPER BASICS OF DISK I/O PERFORMANCE WHITE PAPER FUJITSU PRIMERGY SERVER BASICS OF DISK I/O PERFORMANCE This technical documentation is aimed at the persons responsible for the disk I/O performance
More informationUsing Synology SSD Technology to Enhance System Performance Synology Inc.
Using Synology SSD Technology to Enhance System Performance Synology Inc. Synology_SSD_Cache_WP_ 20140512 Table of Contents Chapter 1: Enterprise Challenges and SSD Cache as Solution Enterprise Challenges...
More informationVirtualisa)on* and SAN Basics for DBAs. *See, I used the S instead of the zed. I m pretty smart for a foreigner.
Virtualisa)on* and SAN Basics for DBAs *See, I used the S instead of the zed. I m pretty smart for a foreigner. Brent Ozar - @BrentO BrentOzar.com/go/san BrentOzar.com/go/virtual Today s Agenda! How Virtualisa7on
More informationHP 85 TB reference architectures for Microsoft SQL Server 2012 Fast Track Data Warehouse: HP ProLiant DL980 G7 and P2000 G3 MSA Storage
Technical white paper HP 85 TB reference architectures for Microsoft SQL Server 2012 Fast Track Data Warehouse: HP ProLiant DL980 G7 and P2000 G3 MSA Storage Table of contents Executive summary... 2 Fast
More informationFlash for Databases. September 22, 2015 Peter Zaitsev Percona
Flash for Databases September 22, 2015 Peter Zaitsev Percona In this Presentation Flash technology overview Review some of the available technology What does this mean for databases? Specific opportunities
More informationMS SQL Performance (Tuning) Best Practices:
MS SQL Performance (Tuning) Best Practices: 1. Don t share the SQL server hardware with other services If other workloads are running on the same server where SQL Server is running, memory and other hardware
More informationThe Revival of Direct Attached Storage for Oracle Databases
The Revival of Direct Attached Storage for Oracle Databases Revival of DAS in the IT Infrastructure Introduction Why is it that the industry needed SANs to get more than a few hundred disks attached to
More informationSSDs and RAID: What s the right strategy. Paul Goodwin VP Product Development Avant Technology
SSDs and RAID: What s the right strategy Paul Goodwin VP Product Development Avant Technology SSDs and RAID: What s the right strategy Flash Overview SSD Overview RAID overview Thoughts about Raid Strategies
More informationCalsoft Webinar - Debunking QA myths for Flash- Based Arrays
Most Trusted Names in Data Centre Products Rely on Calsoft! September 2015 Calsoft Webinar - Debunking QA myths for Flash- Based Arrays Agenda Introduction to Types of Flash-Based Arrays Challenges in
More informationCOS 318: Operating Systems. Storage Devices. Kai Li and Andy Bavier Computer Science Department Princeton University
COS 318: Operating Systems Storage Devices Kai Li and Andy Bavier Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall13/cos318/ Today s Topics! Magnetic disks!
More informationFUSION iocontrol HYBRID STORAGE ARCHITECTURE 1 WWW.FUSIONIO.COM
1 WWW.FUSIONIO.COM FUSION iocontrol HYBRID STORAGE ARCHITECTURE Contents Contents... 2 1 The Storage I/O and Management Gap... 3 2 Closing the Gap with Fusion-io... 4 2.1 Flash storage, the Right Way...
More informationCONSOLIDATING MICROSOFT SQL SERVER OLTP WORKLOADS ON THE EMC XtremIO ALL FLASH ARRAY
Reference Architecture CONSOLIDATING MICROSOFT SQL SERVER OLTP WORKLOADS ON THE EMC XtremIO ALL FLASH ARRAY An XtremIO Reference Architecture Abstract This Reference architecture examines the storage efficiencies
More informationDeploying Microsoft SQL Server 2008 R2 with Logical Partitioning on the Hitachi Virtual Storage Platform with Hitachi Dynamic Tiering
1 Deploying Microsoft SQL Server 2008 R2 with Logical Partitioning on the Hitachi Virtual Storage Platform with Hitachi Dynamic Tiering Reference Architecture Guide By Eduardo Freitas May 2011 Month Year
More informationSQL Server 2008 Designing, Optimizing, and Maintaining a Database Session 1
SQL Server 2008 Designing, Optimizing, and Maintaining a Database Course The SQL Server 2008 Designing, Optimizing, and Maintaining a Database course will help you prepare for 70-450 exam from Microsoft.
More informationUsing Microsoft SQL Server with Dell EqualLogic PS Series Arrays
Using Microsoft SQL Server with Dell EqualLogic PS Series Arrays Best practices and configuration guidelines for deploying SQL Server with EqualLogic storage arrays. Dell EqualLogic Technical Solutions
More informationChapter 12: Mass-Storage Systems
Chapter 12: Mass-Storage Systems Chapter 12: Mass-Storage Systems Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space Management RAID Structure
More informationMind Q Systems Private Limited
MS SQL Server 2012 Database Administration With AlwaysOn & Clustering Techniques Module 1: SQL Server Architecture Introduction to SQL Server 2012 Overview on RDBMS and Beyond Relational Big picture of
More informationPERFORMANCE TUNING IN MICROSOFT SQL SERVER DBMS
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 6, June 2015, pg.381
More informationVirtual SAN Design and Deployment Guide
Virtual SAN Design and Deployment Guide TECHNICAL MARKETING DOCUMENTATION VERSION 1.3 - November 2014 Copyright 2014 DataCore Software All Rights Reserved Table of Contents INTRODUCTION... 3 1.1 DataCore
More informationSQL Server 2012 Database Administration With AlwaysOn & Clustering Techniques
SQL Server 2012 Database Administration With AlwaysOn & Clustering Techniques Module: 1 Module: 2 Module: 3 Module: 4 Module: 5 Module: 6 Module: 7 Architecture &Internals of SQL Server Engine Installing,
More informationDeploying SQL Server 2008 R2 with Hyper-V on the Hitachi Virtual Storage Platform
1 Deploying SQL Server 2008 R2 with Hyper-V on the Hitachi Virtual Storage Platform Reference Architecture Guide By Rick Andersen October 2010 Month Year Feedback Hitachi Data Systems welcomes your feedback.
More informationPerformance Characteristics of VMFS and RDM VMware ESX Server 3.0.1
Performance Study Performance Characteristics of and RDM VMware ESX Server 3.0.1 VMware ESX Server offers three choices for managing disk access in a virtual machine VMware Virtual Machine File System
More informationAirWave 7.7. Server Sizing Guide
AirWave 7.7 Server Sizing Guide Copyright 2013 Aruba Networks, Inc. Aruba Networks trademarks include, Aruba Networks, Aruba Wireless Networks, the registered Aruba the Mobile Edge Company logo, Aruba
More informationBenchmarking Cassandra on Violin
Technical White Paper Report Technical Report Benchmarking Cassandra on Violin Accelerating Cassandra Performance and Reducing Read Latency With Violin Memory Flash-based Storage Arrays Version 1.0 Abstract
More informationDIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION
DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION A DIABLO WHITE PAPER AUGUST 2014 Ricky Trigalo Director of Business Development Virtualization, Diablo Technologies
More information