SAS SPD Server, applying intelligence to data storage

Transcription

1 SAS SPD Server, applying intelligence to data storage Jochen Kirsten Product Manager Storage Products SAS EMEA

2 Scalable Performance Data Server! History! Performance! Security Model! Reliability, Availability, Serviceability (RAS)! Future 2

3 SPD Server Release History! 1996: SPD Server 1.x (SAS V6)! Multi-threaded WHERE clause! Access Control Lists! 1999: SPD Server 2.x (SAS V6)! SQL-Passthrough support! 64-bit support! 2000: SPD Server 3.0 (SAS V8)! SAS V8 compatibility! New Hybrid Index! 2002: SPD Server 4.0 (SAS V9)! SAS V9 compatibility! Wide table support 3

4 SPD Server Scalability! Multi-threaded full table scan.! Multi-threaded WHERE clause evaluation.! Implicit sorting on BY statement.! Fast Parallel-Group-By execution.! Efficient hybrid index.! Data append with parallel multi-index refresh. 4

5 SPD Server Scalability! HP9000 L3000! Four PA-Risc GB RAM! Two HP SureStore SC10 disk arrays! Ten 36GB disks! Two SCSI Ultra2 Wide LVD controllers 5

6 SPD Server Multi-Threaded Disk I/O CPU 35MB/sec I/O 6

7 SPD Server Multi-Threaded Disk I/O CPU I/O 61MB/sec 7

8 SPD Server Multi-Threaded Disk I/O CPU CPU CPU CPU I/O I/O 244MB/sec I/O I/O 8

9 SPD Server Multi-Threaded Disk I/O! Scans through a 10GB file in about 40 seconds or a 100GB file in 7 minutes.! Add more hardware to get higher throughput.! Only limited by hardware capabilities.! Nee to avoid bottlenecks. 9

10 Scalability With Index Append B ase Table R ow s B ase S A S S P D S erver N um bers below for info only, not in graph! CIM C lient Table Info 84 vars 1173 bytes row len 19 indices Time [secs] Proc APPEND'ing Row s to CIM "C lient" B ase Table w ith 19 Indices Num ber of Rows In B ase Table Base SAS SPD Server 10

11 Subsetting WHERE Clause Indexes column_a column_b column_c Segment 1 Segment 1 Segment 1 Segment 2 Segment 2 Segment 2! Example 2: Segment 3 Segment 3 Segment 3 Where column_a in ( A, B, C ) and column_b in ( R, S, T ) and column_c in (1,2,5,7,8) ; Index Meta data Segment 4 Segment 5 Segment 4 Segment 5 Segment 4 Segment 5 Segment 6 Segment 6 Segment 7 Segment 7 Segment 8 Segment 8 Segment 6 Segment 7 Segment 8.. More Segments... 11

12 Subsetting WHERE Clause Indexes column_a column_b column_c Segment 1 Segment 1 Segment 1 Segment 2 Segment 2 Segment 2! Example 3: Segment 3 Segment 3 Segment 3 Where column_a in ( H, J, L ) and column_b in ( R, S, T ) and column_c in (11,19,61) ; Index Meta data Segment 4 Segment 5 Segment 4 Segment 5 Segment 4 Segment 5 Segment 6 Segment 6 Segment 7 Segment 7 Segment 8 Segment 8 Segment 6 Segment 7 Segment 8.. More Segments... 12

13 SPD Server System Security! Kerberos-type token mechanism for user login validation/authentication.! Secure network protocol.! Data encryption. 13

14 SPD Server User Security Model! Access Control Lists (ACLs)! Three Level Security Concept 1. Client authentication by userid and password. 2. Access Control Lists (ACL) to control access to the data domain 3. ACLs to control access to SPD Server resources 14

15 SPD Server Security Model SPD data server user check User table valid user id / password to connect to SPDS data server libname domain SALES libname domain MKT valid user rights to access the 'libname' libname domain' ACL data set ACL SAS catalog ACL SQL view ACL data set valid ACL entry to access database objects ACL SAS catalog ACL SQL view 15

16 Access Control Lists (ACL)! ACLs define who can access an SPD Server resource and what level of access they have to the resource.! By default, a resource creator (owner) has full access authority for that resource.! Users that do not own a resource must be granted access rights by the resource owner. 16

17 Three Levels of Permission (in order of precedence)! User Access - Access granted to a specific SPD Server user. If there are no specific user rights then the user gets either Group or Universal permissions.! Group Access - If a resource is owned by the same ACL group as the user, the user gets the resource's Group permissions.! Universal Access - If the resource is owned by a different ACL group than the user, the user gets the resource's Universal permissions. 17

18 Four Resource Access Authority Levels! Read - allows read access to a resource.! Write - allows update access to a resource.! Alter - allows user to rename, add, delete, or replace a resource.! Control - allows users to define or update ACLs for a resource. 18

19 Types of Access Control Lists! Generic ACLs - A generic ACL can be added for a class of resources that have a common prefix, such as sale*.! Libname ACLs - Libname ACLs for an entire libname domain can be added for libname domains that have owners.! Persistent ACLs - By default, specific table ACLs are deleted if the table is deleted. Persistent ACLs will remain in the ACL database even after the table is deleted. 20

20 Creating Access Control! ACL-users and groups are created on the server by the server administrator using the psmgr utility.! ACL entries for resources are created with SAS using PROC SPDO.! ACL entries can be! added! modified! listed! deleted 21

21 ACL Example libname spdslib sasspds 'mydomain' server=d375.spdsname user='fred' prompt=yes; proc spdo lib=spdslib; set acluser; add acl mytable/ read; /*grant universal READ*/ modify acl mytable/ henry=(y,y,n,n); /*WRITE*/ list acl _all_; /*list all defined ACLs*/ quit; 22

22 SPD Server RAS Features! Centralised Name Server for logical mapping of database domains to real domains.! Isolation of user environments via separate processes.! Centralised product license file. 23

23 SPD Server RAS Features SPD name server data server location SETINIT SALES (server #1) register domain libname request libname domain SALES SPD data server user check user table domain data request user proxy process communication SPD proxy server query data 24

24 SPD Server RAS Features! Simple install process.! No Super-User privileges required.! Dynamic expansion of data domains to handle out of space condition. 25

25 SPD Server Future in SAS V9! 'Wide table' support! 2G columns! 2 63 rows! Implicit cross domain table joins.! Administration via SAS Management Console.! SPD Server technology reintegrated into new SPDE engine for single-user, multi-threaded I/O. 26

26 27 Copyright 2002, SAS Institute Inc. All rights reserved.