Grid, Storage and SRM

Transcription

1 Grid, Storage and SRM Jan.30, Gettingsetup Makeaworkingdirectoryforthisexercise.Fortherestofthisexercise,allyourworkshouldbe doneinthere. $ mkdir srmex $ cd srmex Nextsettheenvironmentvariablestouseforexercises.AllexerciseswillbedoneondCache SRMserveratFermiNationalAcceleratorLaboratory(FNAL): There are a few environmental variables already set for you. SRM_HOME : srm client installation directory; /sw/srmclient2 SRMEP : SRM service endpoint; srm://gwdca04.fnal.gov:8443/srm/managerv2 SRMPATH : Working directory on SRM storage; /pnfs/fnal.gov/data/osgedu MYNAME : your login Nextcreateafiletouseforexercises: $ dd if=/dev/zero of=smallfile-$myname bs=1m count=2 $ ls -l -rw-r--r-- 1 train03 train :15 smallfile-train Assumptions Youalreadyhaveusedglobus url copytomoveyourfilesfromyourlocalmachinetooneof designatedtargetmachineandfromaremotegridftpservertoyourlocalmachine. 2 Basicoperations 2.1 CheckingthestatusofSRM Usesrm pingtofindoutthestatusofsrmserveron$srmep. $ srm-ping $SRMEP ThisreturnsSRMversionnumber,similartothefollowing. PingversionInfo=v2.2 Extrainformation Key=backend_type Value=dCache

2 Key=backend_version Value=production PuttingafileintoSRMmanagedstorage FiletransferintoSRMmanagedstoragegoesthroughseveralprotocolsincludinggridftpfile transfer.thisclientoperationcommunicateswithsrmserverthroughseveralinterfaces internally;srmpreparetoputtorequestyourfilerequest,srmstatusofputrequesttocheckyour request,gridftpfiletransferandsrmputdonetofinalizethestateofyourfiletransfer. $ srm-copy file:////home/train99/srmex/smallfile-$myname \ $SRMEP\?SFN=$SRMPATH/smallfile-$MYNAME Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-CLIENT*REQUESTTYPE=put SRM-CLIENT*TOTALFILES=1 SRM-CLIENT*TOTAL_SUCCESS=1 SRM-CLIENT*TOTAL_FAILED=0 SRM-CLIENT*REQUEST_TOKEN= SRM-CLIENT*SOURCEURL[0]=file:////home/train99/srmex/smallfile-$MYNAME SRM-CLIENT*TARGETURL[0]=$SRMEP\?SFN=$SRMPATH/smallfile-$MYNAME SRM-CLIENT*TRANSFERURL[0]=gsiftp://gwdca03.fnal.gov:2811///smallfile-alex SRM-CLIENT*ACTUALSIZE[0]= SRM-CLIENT*FILE_STATUS[0]=SRM_SUCCESS SRM-CLIENT*EXPLANATION[0]=Done 2.3 URLformats AquickreminderonURLformats:We'veseentwokindsofURLssofar. file:////home/train99/srmex/smallfile afilecalled smallfile onthelocalfile system,indirectory /home/train99/srmex/. Theappended $MYNAME isonlytomake thefilenameuniqueinthisgridschool. srm://gwdca04.fnal.gov:8443/srm/managerv2\?sfn=/pnfs/fnal.gov/data/osge du/smallfile-train99 asiteurlforafilename smallfile-train99 onsrm runningonthehostcalled gwdca04.fnal.gov andport8443 withthewebservice handle /srm/managerv2 indirectory /pnfs/fnal.gov/data/osgedu. SFNrepresents SiteFileName. 2.4 BrowsingafileinSRMmanagedstorage NowtrytofindoutthepropertiesofthefilethatyoujustputintoSRM. $ srm-ls $SRMEP\?SFN=$SRMPATH/smallfile-$MYNAME Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-CLIENT*REQUEST_EXPLANATION=srm-ls completed normally SRM-CLIENT*SURL=/pnfs/fnal.gov/data/osgedu/smallfile-alex

3 SRM-CLIENT*BYTES= SRM-CLIENT*FILETYPE=FILE SRM-CLIENT*STORAGETYPE=PERMANENT SRM-CLIENT*FILE_STATUS=SRM_SUCCESS SRM-CLIENT*OWNERPERMISSION=7166 SRM-CLIENT*LIFETIMELEFT=-1 SRM-CLIENT*LIFETIMEASSIGNED=-1 SRM-CLIENT*CHECKSUMTYPE=adler32 SRM-CLIENT*CHECKSUMVALUE=01e00001 SRM-CLIENT*FILELOCALITY=ONLINE SRM-CLIENT*OWNERPERMISSION.USERID=7166 SRM-CLIENT*OWNERPERMISSION.MODE=RW SRM-CLIENT*GROUPPERMISSION.GROUPID=9803 SRM-CLIENT*GROUPPERMISSION.MODE=R SRM-CLIENT*OTHERPERMISSION=R SRM-CLIENT*RETENTIONPOLICY=CUSTODIAL SRM-CLIENT*ACCESSLATENCY=ONLINE SRM-CLIENT*LASTACCESSED= SRM-CLIENT*CREATEDATTIME= GettingafilefromSRMmanagedstorage NowtrytogetthefilethatyoujustbrowsedandputintoSRMfromtheSRMmanagedstorage toyourlocalmachine.thisclientoperationcommunicateswithsrmserverthroughseveral interfacesinternally:srmpreparetogettorequestyourfilerequest,srmstatusofgetrequestto checkyourrequest,gridftpfiletransferandsrmreleasefilestoreleasethefileafteryour transfer. $ srm-copy $SRMEP\?SFN=$SRMPATH/smallfile-$MYNAME \ file:////home/train99/srmex/my-smallfile Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-CLIENT*REQUESTTYPE=get SRM-CLIENT*TOTALFILES=1 SRM-CLIENT*TOTAL_SUCCESS=1 SRM-CLIENT*TOTAL_FAILED=0 SRM-CLIENT*REQUEST_TOKEN= SRM-CLIENT*SOURCEURL[0]=$SRMEP\?SFN=$SRMPATH/smallfile-$MYNAME SRM-CLIENT*TARGETURL[0]=file:////home/train99/srmex/my-smallfile SRM-CLIENT*TRANSFERURL[0]=gsiftp://gwdca03.fnal.gov:2811///smallfile-alex SRM-CLIENT*ACTUALSIZE[0]= SRM-CLIENT*FILE_STATUS[0]=SRM_FILE_PINNED SRM-CLIENT*EXPLANATION[0]=Done Aftersrm copyiscompleted,findoutthefilesizeatthetargetonyourlocalmachine: $ ls l /home/train99/srmex/my-smallfile -rw-r--r-- 1 train99 train :29 my-smallfile 2.6 RemovingafileinSRMmanagedstorage

4 NowtrytoremovethefilethatyouputfromtheSRMmanagedstorage. $ srm-rm $SRMEP\?SFN=$SRMPATH/smallfile-$MYNAME Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-DIR: Total files to remove: 1 explanation=successfully removed files surl=$srmep\?sfn=$srmpath/smallfile-$myname Aftersrm-rmreturnssuccessfully,findoutthefilepropertiesofthesameSURLontheSRM withsrm-ls.youshouldseethatthesurlisinvalid. 2.7 CreatingandremovingadirectoryinSRMmanagedstorage NowtrytocreateadirectoryinSRMmanagedstorage. $ srm-mkdir $SRMEP\?SFN=$SRMPATH/$MYNAME ThiswillcreateadirectoryundertheSRMthatyoucanuseinyourSURLs. Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-DIR: Sat Jan 12 19:04:09 CST 2008 Calling SrmMkdir explanation=success BrowsethedirectorytoseewhatkindofpropertyinformationthatyouretrievefromSRM. NowtrytoremovethedirectoryfromSRM. $ srm-rmdir $SRMEP\?SFN=$SRMPATH/$MYNAME ThiswillremoveadirectoryundertheSRM. Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-DIR: Sat Jan 12 19:06:34 CST 2008 Calling SrmRmdir explanation=success 2.8 Summaryofbasicoperations Experimentwithputtingandgettingfileswithdifferentfilesizesandnumbersofparallel streamstoandfromtheremotesrmsite,andseethedifferences.whenyouuse4parallel datastreamsbyaddingthe -parallelism optionwithanargumentof4,theclientoperation goesthroughthesameprotocol,andtheparallelstreamsareusedinthegridftpfiletransfer. Largerfileswouldmakeasignificantdifferenceinfiletransferperformance.

5 Experimentwithdirectorystructureinyourpath. Note:Remembertoremovethosefilesanddirectoriesthatyoucreatedafterwards. 3 Spacemanagementandrelatedoperations 3.1 ReservingaspaceinSRMforopportunisticuse Now,let smakeaspacereservationfor5mbytesoftotalspace,4mbytesofguaranteedspace andlifetimeof900seconds: $ srm-sp-reserve serviceurl $SRMEP size gsize lifetime 900 Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-SPACE: Status Code for spacestatusrequest SRM_SUCCESS SpaceToken= TotalReservedSpaceSize= Retention Policy=REPLICA Access Latency=ONLINE Uponsuccessfulspacereservation,thiswillshowyouthespacetokenwhichwillbeusedinthe nextexercises.(e.g fromabove,butitisnotnecessarilynumbersalwaysanddifferent storagemayreturndifferentstringformat.)notethatyourreservedspacewasreturnedas4mb. Let ssetthereturnedspacetokenasanenvironmentvariabletore uselateron: $ set SPTOKEN= FindingoutspacepropertiesfromSRM Now,let sfindoutthespaceinformationwiththespacetokenthatyoujustreceivedabove: $ srm-sp-info serviceurl $SRMEP spacetoken $SPTOKEN Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-SPACE:...space token details... SpaceToken= TotalSize= Owner=VoGroup=osgedu VoRole=null LifetimeAssigned=900 LifetimeLeft=463 UnusedSize= GuaranteedSize= RetentionPolicy=REPLICA AccessLatency=ONLINE explanation=ok

6 3.3 RetrievingspacetokensfromSRM Supposedyoulostyourspacetoken,andlet sfindouthowtoretrievethespacetokensthat belongtoyou: $ srm-sp-tokens serviceurl $SRMEP Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-SPACE:... Status=SRM_SUCCESS Explanation=OK SRM-SPACE (0)SpaceToken= Thiswouldshowallthespacetokensthatbelongtoyourgrididentityanditsmappingonthe server. 3.4 UpdatingaspaceinSRM Sometimepassedsincetheabovespacereservation,andthelifetimeofthereservedspace maybeneartheexpiration.now,let supdatethelifetimeofthespaceaswellasthesizeofthe space.we lluse7mboftotalspacewith6mbofguaranteedspace,andmakethelifetime950 seconds: $ srm-sp-update serviceurl $SRMEP spacetoken $SPTOKEN size gsize lifetime 950 Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowingbecausethetarget SRMstoragedoesnotsupportthisfunctionality. SRM-SPACE: Sat Jan 12 19:09:55 CST 2008 Calling updatespace request status=srm_not_supported explanation=can not find a handler, not implemented Request token=null However,whentheSRMstoragesupportsthefunctionalityandtherequestissuccessful,this returnsasummarysimilartothefollowing. SRM-SPACE: Sat Jan 12 21:22:50 PST 2008 Calling updatespace request Request token=null lifetime=950 Min= Max= Yourspacetokenisthesameasbefore,anduponsuccessfulcompletion,thelifetimeandsize ofyourspaceshouldbeupdated.let sfindoutthespaceinformationfromthesrmandverify usingsrm-sp-infotoseethenewupdatedinformation.

7 3.5 PuttingafileintothereservedspaceinSRM Nowlet sputafileintoyourreservedspaceusingthespacetoken.thisclientoperation communicateswiththesrmserver,sameasbefore.however,becauseofyourspacetoken, yourfilewillbewrittenintothespacethatyouhavereserved. $ srm-copy file:////home/train99/srmex/smallfile-$myname \ $SRMEP\?SFN=$SRMPATH/smallfile-space-$MYNAME \ -spacetoken $SPTOKEN Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-CLIENT*REQUESTTYPE=put SRM-CLIENT*TOTALFILES=1 SRM-CLIENT*TOTAL_SUCCESS=1 SRM-CLIENT*TOTAL_FAILED=0 SRM-CLIENT*REQUEST_TOKEN= SRM-CLIENT*SOURCEURL[0]=file:////home/train99/srmex/smallfile-$MYNAME SRM-CLIENT*TARGETURL[0]=$SRMEP\?SFN=$SRMPATH/smallfile-space-$MYNAME SRM-CLIENT*TRANSFERURL[0]=gsiftp://gwdca03.fnal.gov:2811///smallfile-space-alex SRM-CLIENT*ACTUALSIZE[0]= SRM-CLIENT*FILE_STATUS[0]=SRM_SUCCESS SRM-CLIENT*EXPLANATION[0]=Done Aftersuccessfulcompletion,findoutthefilepropertieswithsrm-ls. $ srm-ls $SRMEP\?SFN=$SRMPATH/smallfile-space-$MYNAME Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-CLIENT*REQUEST_EXPLANATION=srm-ls completed normally SRM-CLIENT*SURL=/pnfs/fnal.gov/data/osgedu/smallfile-space-alex SRM-CLIENT*BYTES= SRM-CLIENT*FILETYPE=FILE SRM-CLIENT*STORAGETYPE=PERMANENT SRM-CLIENT*FILE_STATUS=SRM_SUCCESS SRM-CLIENT*OWNERPERMISSION=7166 SRM-CLIENT*LIFETIMELEFT=-1 SRM-CLIENT*LIFETIMEASSIGNED=-1 SRM-CLIENT*CHECKSUMTYPE=adler32 SRM-CLIENT*CHECKSUMVALUE=01e00001 SRM-CLIENT*FILELOCALITY=ONLINE SRM-CLIENT*OWNERPERMISSION.USERID=7166 SRM-CLIENT*OWNERPERMISSION.MODE=RW SRM-CLIENT*GROUPPERMISSION.GROUPID=9803 SRM-CLIENT*GROUPPERMISSION.MODE=R SRM-CLIENT*OTHERPERMISSION=R SRM-CLIENT*SPACETOKENS(0)= SRM-CLIENT*RETENTIONPOLICY=CUSTODIAL SRM-CLIENT*ACCESSLATENCY=ONLINE SRM-CLIENT*LASTACCESSED= SRM-CLIENT*CREATEDATTIME=

8 Notefromtheprevioussrm lsoutputthatthistimeitshowsthespacetokenyouusedwhen puttingyourfileintothesrmmanagedstorage. 3.6 ReleasingthereservedspacefromSRM Nowlet sreleasethereservedspaceusingthespacetoken. $ srm-sp-release serviceurl $SRMEP -spacetoken $SPTOKEN Uponsuccessfulcompletion,thisreturnsasummarysimilartothefollowing: SRM-SPACE: Releasing space for token= explanation=space released Thisoperationmayfailifyouhaveanyfilesinthespaceassociatedwiththespacetoken.In suchcase,removethefileswithsrm-rmtotryreleasingthespaceagain. $ srm-rm $SRMEP\?SFN=$SRMPATH/smallfile-space-$MYNAME Aftersuccessfulreleasingyourreservedspace,findoutthespacepropertieswithsrm-sp-info. 3.7 Summaryofspacemanagementoperations Experimentonreservingspaceswithdifferentspacesizesandlifetimes,andputtingyourfiles intothereservedspaceswithspacetoken.experimentupdatingthereservedspaceafteryou putyourfilesintothereservedspace.experimentwithdirectorystructureinyoursurl. Note:Remembertoremovethosefilesanddirectoriesthatyoucreatedafterwards.Also remembertoreleasethosespacesthatyoureservedifstillactive. 4 Advancedexercises(iftimepermitsorashomework) 4.1 Settingupasmalldisk basedsrm TherearenumberofdifferentSRMimplementations,andforanadvancedexercise,let stryto installandconfigureasmalldiskbasedsrmcalledbestman(berkeleystoragemanager)for yourpersonaluse.yourpersonalsrmwillberunningonyourgridproxy,andonlyyouwillbe abletoaccessit. First,let sdownloadthebestman,ansrmserver,fromtheweb: Thecurrentlatestversionisv tar.gzasofJan.2008.Untarthepackage:tarzxvfbestman tar.gz.Youwillnowhavebestman/directoryinthecurrentworkingdirectory.

9 Aspartofsetupprocess,let screateacachedirectoryandalogdirectoryinthecurrentworking directory:mkdir./cache./log Findoutthecurrentworkingdirectoryforfullpathinformation(normally$PWDcorrespondstoyour currentworkingdirectory). Now,youwillbeusingyourgridproxytolaunchyourpersonalSRM,andfindoutwhereyourgridproxy islocated(it snormallylocatedin/tmp/x509up_u####,and`id u`wouldshowyouruseridfor#### part.let scalltheproxylocationasx509_user_proxy). NextstepistodecidewhichportnumbertoassignforyourpersonalSRM.Intheexamplebelow,it showstwoportstouse,16249and16250.youcanchooseanytwouserportsforthisexercise. Also,themanagedstoragecachesizeissetupto10MB,whichisenoughforyourexercise. Changeyourworkingdirectorytobestman/setupandlet sconfigure../configure\ with replica storage path=$pwd/cache\ with replica storage size=10\ with http port=16249\ with https port=16250\ with proxyfile path=$x509_user_proxy\ with eventlog path=$pwd/log\ with cachelog path=$pwd/log Theconfigurationprocesscreatesnewdirectories,andsbinisoneoftheminthebestmanhome directory.changeyourworkingdirectorytosbin,andlaunchbestmansrmwith./sxxbestman.personalstart.thisstartsupansrmserverforyourownpersonalexercisethatonly youcanaccessto. Tostoptheserver,changethedirectorytobestman/sbin,andtypein./SXXbestman.personalstop Now,youcangothroughtheclientcommandsthatyouhaveexercised,suchassrm ping,srm copy, srm ls,srm rm,etc.andyourownsrmendpointfromtheexampleaboveis srm://`hostname`:16250/srm/v2/server,andyourowndirectorypathwouldbe~. So,oneexampleofantargetURLonyourSRMservercanbe srm://`hostname`:16250/srm/v2/server\?sfn=/srmcache/~/mysmallfile. Foraninstallationforagrouporasite,pleasereferto Havefunonyourgridexperiences,andwhenyouhavefurtherquestionsonSRMs,youcansendan