Opdatering af metadata via SAS -programmer

Transcription

1 Opdatering af metadata via SAS -programmer Henrik Dorf, chefkonsulent, PS Commercial

2 Metadata SAS Management Console Meta browser SAS Data Integration Studio

3 SAS Metadata Server Administrerer adgangen til metadata Svarer på alle spørgsmål Håndterer læse-/skriverettigheder Aner ikke, hvad den snakker om.men svarer hurtigt og husker alt SAS Metadata Server Metadata

4 Metadata Metadata Indeholder beskrivelse af omverdenen Skal kunne bruges til at gemme informationer om alt Libames, servere, datasæt, kolonner, filer, brugere, schemas, job, og alt andet Behov for en meget simpel struktur SAS Metadata Server Applikationerne ved, hvordan denne viden skal anvendes

5 Eksempler på metadata Libname INFO D:\SASDatata\info ; Et SAS -bibliotek: " D:\SASDatata\info ; Implicit viden: Indeholder måske tabeller Ligger på en specifik maskine Bestemt operativsystem

6 Eksempler på metadata Proc print data=sashelp.class ; run ; En tabel: sashelp.class Implicit viden: Indeholder kolonner med data Ligger på en specifik maskine Libname findes allerede SAS -versionen er relevant

7 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ; Implicit viden: Kommasepareret: indeholder kolonner af data Ligger på en specifik maskine Der kan være forbehold for lrecl Der kan være kolonnenavne i første linje Der kan være quotes om karakterfelter

8 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ;

9 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ;

10 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ;

11 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ;

12 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ;

13 Eksempler på metadata Filename inclass C:\temp\class.csv ; En flad fil: "C:\Temp\class.csv ;

14 Metadatastruktur Indholdet er styret af et Blueprint; en konstruktionstegning, der beskriver, hvad der kan og skal være med i beskrivelsen af et objekt

15 Blueprint Alle valg medfører et nyt blueprint:

16 Blueprint Forskellige Blueprint for Workspace Server Data Step Batch Server

17 Metadataelementer Objekter opbygges af Attributter Associationer til andre objekter

18 Metadatanavngivning URI: Uniform Resource Identifier omsobj:saslibrary/a5ohx7yd.bl0001jm

19 Metadatanavngivning URI: Uniform Resource Identifier A5OHX7YD.BL0001JM omsobj:saslibrary/a5ohx7yd.bl0001jm What is a Metadata Identifier? The 17-character identifier consists of two parts, separated by a period. It is often represented in documentation as reposid.objectid. The first eight characters (A5OHX7YD) identify the SAS Metadata Repository in which the object is stored. The ninth character is always a period. The second set of eight characters (BL0001JM) identifies the object in the repository.

20 Metadataopbygning Attributter

21 Metadataopbygning Associations

22 Metadataobjekter Database table Libname Database server Database Schema Serverkontekst Server component SAS tabel Kolonne Tree SASLIBRARY SAS tabel Kolonne SAS tabel Kolonne

23 Metadataobjektkæder Database table Libname Database server Database Schema Serverkontekst Server component SAS tabel Kolonne Tree SASLIBRARY SAS tabel Kolonne SAS tabel Kolonne

24 Adgang til metadata SAS Management Console SAS Data Integration Studio Metabrowser PROC METADATA PROC METALIB Alle løsninger og funktioner, der er afhængige af metadata

25 PROC Metadata filename metaout "C:\temp\metaout.xml"; PROC METADATA REPOS="Foundation" Header=simple OUT =metaout IN="<GetMetadataObjects> <Reposid>$METAREPOSITORY</Reposid> <Type>SASLibrary</Type> <Objects/> <Ns>SAS</Ns> <Flags/> <Options/> </GetMetadataObjects>" VERBOSE; RUN; X "C:\temp\metaout.xml"; Eksempel1.sas

26 Batchadgang til metadata filename metaout "C:\temp\metaout.xml"; PROC METADATA REPOS="Foundation" Header=simple OUT =metaout IN="<GetMetadataObjects> <Reposid>$METAREPOSITORY</Reposid> <Type>SASLibrary</Type> <Objects/> <Ns>SAS</Ns> <Flags/> <Options/> </GetMetadataObjects>" VERBOSE; RUN; X "C:\temp\metaout.xml";

27 PROC Metadata Output <?xml version="1.0"?> - <GetMetadataObjects> <Reposid>A A5LDS3MS</Reposid> <Type>SASLibrary</Type> - <Objects> <SASLibrary Id="A5LDS3MS.AY000001" Name="SASApp - SASDATA" /> <SASLibrary Id="A5LDS3MS.AY000002" Name="STP Samples" /> <SASLibrary Id="A5LDS3MS.AY000003" Name="SASApp - wrsdist" /> <SASLibrary Id="A5LDS3MS.AY000004" Name="SASApp - wrstemp" /> <SASLibrary Id="A5LDS3MS.AY000005" Name="ORIONDetailData" /> <SASLibrary Id="A5LDS3MS.AY000006" Name="ORIONCoreData" /> <SASLibrary Id="A5LDS3MS.AY000007" Name="ORIONGoldData" /> <SASLibrary Id="A5LDS3MS.AY000008" Name="ORIONStarData" /> <SASLibrary Id="A5LDS3MS.AY000009" Name="ORIONSumData" /> <SASLibrary Id="A5LDS3MS.AY00000A" Name="SQLSrv ORION Star" /> </Objects> <Ns>SAS</Ns> <Flags /> <Options /> </GetMetadataObjects>

28 Batchadgang til metadata Enkelt objekt PROC METADATA REPOS="Foundation Header=simple OUT =metaout IN="<GetMetadata> <Metadata> <SASLibrary ID='A5LDS3MS.AY000005'/> </Metadata> <Objects/> <Ns>SAS</Ns> <Flags/> <Options/> </GetMetadata>" VERBOSE; RUN;

29 Batchadgang til metadata Flags=1 PROC METADATA REPOS="Foundation Header=simple OUT =metaout IN="<GetMetadata> <Metadata> <SASLibrary ID='A5LDS3MS.AY000005'/> </Metadata> <Objects/> <Ns>SAS</Ns> <Flags>1</Flags> <Options/> </GetMetadata>" <Options/> </GetMetadata>" VERBOSE; RUN;

30 DATA Step API

31 Metadata DATA Step API METADATA_PAUSED Function METADATA_PURGE Function METADATA_RESOLVE Function METADATA_VERSION Function

32 Metadata DATA Step API 40 data _null_ ; 41 if _N_=1 then do; 42 rc=metadata_paused(); IF rc=0 then put "Metaserver is running"; 43 Else put "Metaserver not found/active"; 44 rc=metadata_version(); put "metaserver version " rc ; 45 end; 46 run; Metaserver is running metaserver version 5.01

33 Læse metadata METADATA_GETATTR Function METADATA_GETNASL Function METADATA_GETNASN Function METADATA_GETNATR Function METADATA_GETNOBJ Function METADATA_GETNPRP Function METADATA_GETNTYP Function METADATA_GETPROP Function

34 Læse metadata Mine favoritter METADATA_GETATTR Function METADATA_GETNASL Function METADATA_GETNASN Function METADATA_GETNATR Function METADATA_GETNOBJ Function METADATA_GETNPRP Function METADATA_GETNTYP Function METADATA_GETPROP Function

35 Metadataopbygning Object Association Attribut

36 Blueprint: Tree 82 data _null_; 83 length assoc $256; 84 rc=1; 85 n=1; do while(rc>0); /* Walk through all possible associations of this object. */ '",n,assoc); 92 put n= assoc=; 93 n=n+1; 94 end; 95 run;

37 Blueprint: Tree Associationsliste n=1 assoc=accesscontrols n=2 assoc=associatedpsportlet n=3 assoc=changes n=4 assoc=documents n=5 assoc=extensions n=6 assoc=externalidentities n=7 assoc=groups n=8 assoc=implementors n=9 assoc=keywords n=10 assoc=localizedattributes n=11 assoc=members n=12 assoc=notes n=13 assoc=parenttree n=14 assoc=primarypropertygroup n=15 assoc=properties n=16 assoc=propertysets n=17 assoc=responsibleparties n=18 assoc=softwarecomponents n=19 assoc=sourcetransformations n=20 assoc=specsourcetransformations n=21 assoc=spectargettransformations n=22 assoc=subtrees n=23 assoc=targettransformations n=24 assoc=timestamps n=25 assoc=trees n=26 assoc=usedbyprototypes n=27 assoc=usingprototype n=28 assoc=variables n=29 assoc=properties n=30 assoc=properties

38 Blueprint: SASLibrary 138 data _null_; 139 length assoc $256; assoc=assoc; 140 rc=1; 141 n=1; do while(rc>0); /* Walk through all possible associations of this object. */ Target_data'",n,assoc); 148 put rc= n= assoc=; 149 n=n+1; 150 end; 151 run;

39 Blueprint: SASLibrary Associationsliste rc=35 n=1 assoc=accesscontrols rc=35 n=2 assoc=aliases rc=35 n=3 assoc=aliasfor rc=35 n=4 assoc=changes rc=35 n=5 assoc=defaultlogin rc=35 n=6 assoc=deployedcomponents rc=35 n=7 assoc=documents rc=35 n=8 assoc=extensions rc=35 n=9 assoc=externalidentities rc=35 n=10 assoc=groups rc=35 n=11 assoc=implementors rc=35 n=12 assoc=keywords rc=35 n=13 assoc=libraryconnection rc=35 n=14 assoc=localizedattributes rc=35 n=15 assoc=notes rc=35 n=16 assoc=primarypropertygroup rc=35 n=17 assoc=properties rc=35 n=18 assoc=propertysets rc=35 n=19 assoc=responsibleparties rc=35 n=20 assoc=sascatalogs rc=35 n=21 assoc=schemapackage rc=35 n=22 assoc=sourcetransformations rc=35 n=23 assoc=specsourcetransformations rc=35 n=24 assoc=spectargettransformations rc=35 n=25 assoc=tablecollections rc=35 n=26 assoc=tables rc=35 n=27 assoc=targettransformations rc=35 n=28 assoc=timestamps rc=35 n=29 assoc=trees rc=35 n=30 assoc=usedbypackages rc=35 n=31 assoc=usedbyprototypes rc=35 n=32 assoc=usingpackages rc=35 n=33 assoc=usingprototype rc=35 n=34 assoc=variables rc=35 n=35 assoc=properties rc=-4 n=36 assoc=properties

40 Læse metadata 47 data _null_ ; 48 n=1; 49 length lib_uri $80; 50 antal =metadata_getnobj("omsobj:saslibrary?@id? '.'",1,lib_uri); 51 put antal= lib_uri=; 52 run; antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0002be

41 Find libnames 89 data _null_ ; 90 length lib_uri name $80; 91 lib_uri=lib_uri ; name=name; 92 antal =metadata_getnobj("omsobj:saslibrary?@id? '.'",1,lib_uri); 93 rc = metadata_getattr(lib_uri,"name",name); 94 put antal= lib_uri= rc name = ; 95 run; antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0002be 0 name=oracle_target NOTE: DATA statement used (Total process time): real time 0.03 seconds cpu time 0.01 seconds

42 Find alle libnames 106 data _null_ ; 107 length lib_uri name $80; 108 lib_uri=lib_uri ; name=name; 109 antal =metadata_getnobj("omsobj:saslibrary?@id? '.'",1,lib_uri); 110 do n=1 to antal; 111 rc = metadata_getnobj("omsobj:saslibrary?@id? '.'",n,lib_uri); 112 rc = metadata_getattr(lib_uri,"name",name); 113 put antal= lib_uri= rc name = ; 114 end; 115 run; antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0002be 0 name=oracle_target antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0002bd 0 name=source_oracle1 antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0001jn 0 name=target_data antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0001jm 0 name=source_data antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0001jl 0 name=work antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl0000rt 0 name=sashelp antal=7 lib_uri=omsobj:saslibrary\a5ohx7yd.bl name=atp_data

43 Find alle libnames 129 data _null_ ; 130 length lib_uri path_uri name path $80; 131 lib_uri=lib_uri ; name=name; path_uri=path_uri ; path=path; 132 antal =metadata_getnobj("omsobj:saslibrary?@id? '.'",1,lib_uri); 133 do n=1 to antal; 134 rc = metadata_getnobj("omsobj:saslibrary?@id? '.'",n,lib_uri); 135 rc = metadata_getattr(lib_uri,"name",name); 136 rc =metadata_getnasn(lib_uri,"usingpackages",1,path_uri); 137 rc = metadata_getattr(path_uri,"directoryname",path); 138 put name = path=; 139 end; 140 run; name=oracle_target path=c:\migr\ora_target name=source_oracle1 path=c:\migr\ora_source name=target_data path=c:\migr\target name=source_data path=c:\migr\source name=work path=c:\temp name=sashelp path=sasenvironment\sascode\jobs name=atp_data path=d:\proj\atp\metadata

44 Find alle libnames 141 data libnames ; 142 length lib_uri path_uri name path $80; 143 lib_uri=lib_uri ; name=name; path_uri=path_uri ; path=path; 144 antal =metadata_getnobj("omsobj:saslibrary?@id? '.'",1,lib_uri); 145 do n=1 to antal; 146 rc = metadata_getnobj("omsobj:saslibrary?@id? '.'",n,lib_uri); 147 rc = metadata_getattr(lib_uri,"name",name); 148 rc =metadata_getnasn(lib_uri,"usingpackages",1,path_uri); 149 rc = metadata_getattr(path_uri,"directoryname",path); 150 keep name path; 151 output; 152 end; 153 run; NOTE: The data set WORK.LIBNAMES has 7 observations and 2 variables. NOTE: DATA statement used (Total process time): real time 0.51 seconds cpu time 0.09 seconds

45 Skrive metadata METADATA_SETATTR Function METADATA_SETASSN Function METADATA_SETPROP Function

46 Ret i metadata %let doit=; *OK; *options metaserver= metaport= metauser= metapass= ; data addresser ; length uri_location member_uri uri_user $80 Address $25 navn $50 idtype $15; keep Address idtype ; nobj=metadata_getnobj("omsobj:person?@id contains '.'",1,uri_user); do n=1 to nobj ; nobj=metadata_getnobj("omsobj:person?@id contains '.'",n,uri_user); rc =metadata_getattr(uri_user,"name",navn); antal = metadata_getnasn(uri_user,"locations",1,uri_location); do p=1 to antal; rc = metadata_getnasn(uri_user,"locations",p,uri_location); rc = metadata_getattr(uri_location,"address",address); output; end; end; run;

47 Best practice Kun opdatering, når vi har testet rc = metadata_getattr(uri_location,"address",address); IF address=:"high Street" then do; putlog uri_user navn Address= " rettes til Bredgade" ; IF "&DOIT"="OK" then do; rc = metadata_setattr(uri_location,"address","bredgade"); END; END; Else putlog Address= " rettes ikke ";

48 Fjern metadata METADATA_DELASSN Function METADATA_DELOBJ Function Bedre at gøre i: SAS Data Integration Studio SAS Management Console SAS OLAP Cube Studio Osv.

49 Metadata Security

50 Metadata Security Administration Nyt i SAS 9.2 Genvej til at håndtere opgaver med ACT og tilknytning til objekter Løser de ofte komplicerede problemer med oprettelse og håndtering af ACTs

51 Metadata Security Administration METASEC_APPLYACT Function METASEC_BEGTRAN Function METASEC_DELACT Function METASEC_ENDTRAN Function METASEC_GETACTA Function METASEC_GETNACT Function METASEC_GETNACTA Function METASEC_GETNAUTH Function METASEC_GETNID Function METASEC_NEWACT Function METASEC_REMACT Function METASEC_SETACTA Function METASEC_SETAUTH Function

52 Transaction Context Handle %mdseccon(); * Create context handle ; rc=metasec_begtran(uri,0, tc); Modify ACT definitions and associations * Commit changes ; rc=metasec_endtran(uri,tc, &_SECAD_COMMIT_TC );

53 ACT-manipulation METASEC_NEWACT Function METASEC_GETACTA Function METASEC_GETNACTA Function METASEC_SETACTA Function METASEC_DELACT Function

54 Access Control Definition METASEC_APPLYACT Function METASEC_GETNACT Function METASEC_GETNAUTH Function METASEC_GETNID Function METASEC_REMACT Function METASEC_SETAUTH Function

55 Yderligere dokumentation SAS Intelligence Platform: Data Administration Guide SAS Intelligence Platform: Overview SAS Intelligence Platform: Security Administration Guide SAS Intelligence Platform: System Administration Guide SAS Language Reference: Concepts SAS Metadata Model: Reference SAS Open Metadata Interface: Reference SAS XML LIBNAME Engine: User's Guide

56 Tak for i dag

57 Henrik Dorf Copyright 2006, SAS Institute Inc. All rights reserved.