DFS For Not-So Dummies. Matthew Geddes



Similar documents
SSD and Deduplication The End of Disk?

Big Data Storage Options for Hadoop Sam Fineberg, HP Storage

UNDERSTANDING DATA DEDUPLICATION. Thomas Rivera SEPATON

Cloud and Big Data initiatives. Mark O Connell, EMC

Trends in Application Recovery. Andreas Schwegmann, HP

Understanding Enterprise NAS

Cloud Data Management Interface (CDMI) The Cloud Storage Standard. Mark Carlson, SNIA TC and Oracle Chair, SNIA Cloud Storage TWG

UNDERSTANDING DATA DEDUPLICATION. Tom Sas Hewlett-Packard

UNDERSTANDING DATA DEDUPLICATION. Jiří Král, ředitel pro technický rozvoj STORYFLEX a.s.

How it can benefit your enterprise. Dejan Kocic Hitachi Data Systems (HDS)

How To Migrate To A Network (Wan) From A Server To A Server (Wlan)

An Introduction to Storage Management. Raymond A. Clarke, Oracle

Cloud File Services: October 1, 2014

ADVANCED DEDUPLICATION CONCEPTS. Larry Freeman, NetApp Inc Tom Pearce, Four-Colour IT Solutions

Creating a Catalog for ILM Services. Bob Mister Rogers, Application Matrix Paul Field, Independent Consultant Terry Yoshii, Intel

Scale and Availability Considerations for Cluster File Systems. David Noy, Symantec Corporation

High Performance Computing OpenStack Options. September 22, 2015

WAN Optimization and Cloud Computing. Josh Tseng, Riverbed

WAN Optimization and Thin Client: Complementary or Competitive Application Delivery Methods? Josh Tseng, Riverbed

Accelerating Applications and File Systems with Solid State Storage. Jacob Farmer, Cambridge Computer

How it can benefit your enterprise. Dejan Kocic Netapp

How To Understand And Understand The Risks Of Configuration Drift

Fundamental Approaches to WAN Optimization. Josh Tseng, Riverbed

Solid State Storage in a Hard Disk Package. Brian McKean, LSI Corporation

LEVERAGING FLASH MEMORY in ENTERPRISE STORAGE. Matt Kixmoeller, Pure Storage

Sujee Maniyam, ElephantScale

Interoperable Cloud Storage with the CDMI Standard

SERVER VIRTUALIZATION AND STORAGE DISASTER RECOVERY. Ray Lucchesi, Silverton Consulting

Restoration Technologies. Mike Fishman / EMC Corp.

Unmasking Virtualization Security. Eric A. Hibbard, CISSP, CISA Hitachi Data Systems

Best Practice and Deployment of the Network for iscsi, NAS and DAS in the Data Center

Module 11. Configuring and Managing Distributed File System. Contents:

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

VDI Optimization Real World Learnings. Russ Fellows, Evaluator Group

Visions for Ethernet Connected Drives. Vice President, Dell Oro Group March 25, 2015

How To Create A Cloud Backup Service

Storage Clouds. Karthik Ramarao. Director of Strategy and Technology and CTO Asia Pacific, NetApp Board Director SNIA South Asia

PCI Express IO Virtualization Overview

Big data management with IBM General Parallel File System

Enterprise Architecture and the Cloud. Marty Stogsdill, Oracle

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

Storage Cloud Environments. Alex McDonald NetApp

Cloud Storage Clients. Rich Ramos, Individual

Enterprise Architecture and the Cloud. Marty Stogsdill, Oracle

Deploying Public, Private, and Hybrid Storage Clouds. Marty Stogsdill, Oracle

FAN An Architecture for Scalable, Service-Oriented Data Management

DFS Namespaces. Virtualization for Remote File Systems. Dan Lovinger DFSN Development Lead Microsoft

The Why and How of SSD Performance Benchmarking. Esther Spanjer, SMART Modular Easen Ho, Calypso Systems

Accelerating Application Performance -- Tier-0

Data Center Convergence. Ahmad Zamer, Brocade

Block Storage in the Open Source Cloud called OpenStack

Using Windows Administrative Tools on VNX

EMC Celerra Network Server

Heterogeneous Environments. Paul Long/Microsoft

the client omits the BranchCache identifier from the request message.

New Advanced RAID Level for Today's Larger Storage Capacities: Advanced Data Guarding

Storage Clouds. Enterprise Architecture and the Cloud. Author and Presenter: Marty Stogsdill, Oracle

VMware Backup and Deduplication. Written by: Anton Gostev Product Manager Veeam Software

Using Group Policy to Manage and Enforce ACL on VNX for File P/N REV A01 February 2011

Introducing FedFS On Linux Chuck Lever Oracle Corporation

Creating the Conceptual Design by Gathering and Analyzing Business and Technical Requirements

SMB 3.0 New Opportunities for Windows Environments

High Availability with Windows Server 2012 Release Candidate

Technology Insight Series

RSA Authentication Manager 7.1 to 8.1 Migration Guide: Upgrading RSA SecurID Appliance 3.0 On Existing Hardware

Novell LDAP Proxy Server

Solbox Cloud Storage Acceleration

Using Microsoft Active Directory (AD) with HA3969U in Windows Server

StarWind iscsi SAN: Configuring HA File Server for SMB NAS February 2012

Transcription:

Matthew Geddes

SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual members may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. 2

Abstract DFS is a useful, but often misunderstood or misconfigured piece of technology and has proven to cause some confusion when it comes time to diagnose problems surrounding a DFS namespace. This tutorial is for administrators with existing DFS installations that want to know more or administrators who are considering implementing DFS and wish to know more about what is in store for them. In addition to covering the basics, we'll also delve into essential parts of the protocols to provide a solid foundation for rolling out and supporting a DFS installation. 3

Outline Introduction Core DFS Overview Other DFS-Related Features Practical Uses Of DFS Conclusion Q&A 4

Introduction Distributed File System (DFS to its friends) An implementation of a global namespace for CIFS Can be considered similar to explorer shortcuts or symbolic links that can point to a remote CIFS host Works on top of CIFS transparently to the user 5

Core DFS Overview Client traverses remote filesystem tree Z:\ 6

Core DFS Overview Client requests a filesystem object that is a DFS link Z:\DFSLINK 7

Core DFS Overview Server replies with NT_STATUS_PATH_NOT_COVERED!!! 8

Core DFS Overview Client requests a DFS referral for the object??? \\SERVER2\SHARE 9

Core DFS Overview Client establishes a new session to the target of the DFS referral 10

Core DFS Overview The client contacts the target, never the first server The target may be one or more UNC paths Multiple paths allows for crude load balancing and fault tolerance The client caches the DFS redirect information for an administrator-determined amount of time or until rebooted 11

DFS in SMB2 The DFS_GET_REFERRAL call has been replaced with an IOCTL as part of a protocol cleanup 12

Other DFS-Related Features Management protocol used by MMC and other tools Active Directory DFS roots File Replication Service (FRS) and other replication Proxy redirects 13

Management Protocol Allows remote DFS administration Used by MMC snapins and DFSCMD.EXE Allows creation and modification of: DFS roots shares containing DFS redirects DFS links/redirects and their targets 14

Management Protocol Management using MMC snapin 15

Management Protocol Users' view of DFS redirect on DFS root 16

Active Directory DFS roots It is also possible to have DFS links stored in Active Directory, instead of on the storage devices Needs client Active Directory support Allows redundancy at the DFS root level more easily than standalone DFS 17

Replication Despite claims to the contrary, DFS does not handle replication It is often deployed with other replication mechanisms, such as FRS or the newer DFS-R 18

Proxy redirects It is also possible to create DFS redirects at the share level Users connecting to such a DFS root share will immediately be redirected to the target This can aid in the migration of data from one system to another before users' share mappings are updated This may also aid fault tolerance if multiple targets are specified 19

Practical Uses Of DFS Cost-effective hierarchical storage across multiple storage devices Assisting in transparent data migration 20

Hierarchical storage with DFS Users see a single CIFS share Data may in fact be spread over multiple CIFS hosts DFS used to tie all data sets together into the single CIFS namespace seen by the users 21

Hierarchical storage with DFS Data might be distributed across a range of hosts like this: Infrequently accessed data stored on lower-cost hardware. This hardware may even keep disks spun down when not being accessed More frequently accessed data stored on reasonablyperforming, but somewhat more expensive storage Performance critical data might be stored on a host utilising expensive, but high-performance solid state storage, such as flash 22

Hierarchical storage with DFS Hierarchical storage example 23

DFS To Aid Migration Data migration takes time and often requires significant downtime Data may be migrated a little at a time by: Blocking access to a subset of the data by users Migrating the inaccessible data Replacing the source copy with a DFS redirect to the migrated copy Allow access by users Lather, Rinse, Repeat... Downtime is minimal 24

DFS To Aid Migration Migration may be done in stages using DFS 25

Conclusion DFS has been around long enough to be stable in most implementations DFS is a useful tool and, combined with some lateral thinking, can solve a number of common problems 26

Q&A / Feedback Please send any questions or comments on this presentation to SNIA: trackfilemgmt@snia.org Matthew Geddes Paul Massiglia Many thanks to the following individuals for their contributions to this tutorial. - SNIA Education Committee 27