Data Storage at IBT. Topics. Storage, Concepts and Guidelines

Transcription

1 Data Storage at IBT Storage, Concepts and Guidelines Topics Hard Disk Drives (HDDs) Storage Technology New Storage Hardware at IBT Concepts and Guidelines? 2 1

2 Hard Disk Drives (HDDs) First hard disk: IBM 350 disk storage unit Announced September 4, magnetic disks containing 50,000 sectors, each of which held 100 alphanumeric characters, for a capacity of 5 million characters. Source:

3 Disk interface families Parallel ATA (PATA) Serial ATA (SATA) Small Computer System Interface (SCSI) Fibre Channel (FC) Serial Attached SCSI (SAS) 5 Disk interface families Parallel ATA (PATA) Obsolete Replaced by SATA 6 3

4 Disk interface families Serial ATA (SATA) Western Digital, 7200rpm, 500GB, CHF 70.- Max Storage Capacity? 2 TB 7 Disk interface families Small Computer System Interface (SCSI) Seagate, 15000rpm, 300GB, CHF Max Storage Capacity? 600 GB 8 4

5 Disk interface families Fibre Channel (FC) Expensive Device and Infrastruktur Fibre Network Hitachi Data Systems at D-ITET Host Bus Adapter (HBA) Spitfire 9 Disk interface families Serial Attached SCSI (SAS) Seagate Barracuda ES.2, 7200rpm, 1TB, CHF Supersides Fibre Disk 10 5

6 Storage Technology Storage Area Network (SAN) Network-attached Storage (NAS) Direct-attached storage (DAS) 11 Storage Technology Storage Area Network (SAN) Attach remote computer storage devices to servers Enterprise Market Separate Network Fibre Channel switches Host Bus Adapter (HBA) > Spitfire Rolls-RoyceRoyce 12 6

7 Storage Technology Network-attached storage (NAS) Protocols: NFS, CIFS (SAMBA) Shared network Opel Kastenwagen 13 Storage Technology Direct-attached storage (DAS) Your local disk Not scaleable 14 7

8 IBTNAS01 DALCO TerraServer2 System 2 x Intel Xeon E5410 4x2.33GHz Processor 24 x 2TB S-ATAII Harddisk Drive 7'200rpm RAID-6 Three Volume Groups 12 x 1 TB Scratch Partitions 24 x 500 GB Data Partitions 12 TB unassigned 15 IBTNAS01 12 x 1 TB Scratch Partitions No Backup Data Path: /usr/ibtnas01/scratch SAMBA Share Name: \\ibtnas01.ee.ethz.ch\scratch

9 IBTNAS01 24 x 500 GB Data Partitions Daily Backups Data Path: /usr/ibtnas01/data SAMBA Share Name: \\ibtnas01.ee.ethz.ch\data IBTNAS01 - Supported Access Protocols Network File System (NFS) Common Internet File System (CIFS) Secure Shell (SSH) Secure Copy(SCP) 18 9

10 IBTNAS01 - Supported Access Protocols Network File System (NFS) /usr/ibtnas01/scratch /usr/ibtnas01/data Only selected hosts: casseri IBTNAS01 - Supported Access Protocols Common Internet File System (CIFS) Also known as SAMBA C:\> net use X: \\ibtnas01.ee.ethz.ch\scratch-01\hmueller /user:hmueller C:\> net use C:\> net use X: /delete 20 10

11 21 IBTNAS01 - Supported Access Protocols How can I connect to a server using different user accounts? C:\> net use k: \\ibtnas01\scratch-01 /user:hmueller C:\> net use k: \\ibtnas01.\scratch-02 /user:pgruber C:\> net use k: \\ibtnas01.ee.ethz.ch\scratch-03 /user:gmerz C:\> net use l: \\ \scratch-04 \sc /user:ahuber ube 22 11

12 IBTNAS01 - Supported Access Protocols Mount CIFS as a Root User mount -t cifs -o user=hmueller //ibtnas01.ee.ethz.ch/scratch-01 /usr/ibtnas01/scratch-01 Mount as a normal user Edit File /etc/fstab Use Option user 23 IBTNAS01 - Supported Access Protocols Secure Shell (SSH) / Secure Copy (SCP) Don't run applications on NAS server! Putty ghuber@ibtnas01.ee.ethz.ch scp foobar.txt ghuber@ibtnas01.ee.ethz.ch:/usr/ibtnas01/data-01/guber

13 Where's the right place for my data? Local Disk (DAS) Spitfire (SAN) IBTNAS01 (NAS) Jabba (Tape Library) 25 Where's the right place for my data? Local Disk (DAS) No back-up required Synchroniced with Spitfire Data only used on local host MP3 and so forth

14 Where's the right place for my data? Spitfire (SAN) Backup required Less then 50 GB Active data only 27 Where's the right place for my data? IBTNAS01 (NAS) Data or Scratch Data Partition for large data sets with backup Scratch Partitions for large data sets without backup Static data, archived on Jabba 28 14

15 Where's the right place for my data? Jabba (Tape Library) Archive Data two copies on different tapes Backup Data one copy on tape Closed Projects ethz ch/services/dataarchiving 29 Request Tracker 30 15

16 ? 31 16