Setting up TSM Journal Based Backups on Microsoft Clusters / TSM Symposium 2007 in Oxford / Christian de Groot degroot@act-online.

Transcription

1 Setting up TSM Journal Based Backups on Microsoft Clusters Presented by Christian de Groot

2 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

3 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

4 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a About me Born 1980, Essen, Germany Education A-levels in 1999 University of Trier (Economics, Anglistics, Geography) Apprenticeship as IT Specialist Certifications TSM / ITIL Work Storage Administrator (HP Data Protector & TSM) TSM Consultant since Jan customer projects in Germany, Netherlands and Switzerland TSM Support since Jan TSM L1 Support Engineer for Germany & CEMAAS TSM Support Backend since Nov TSM L2 Support Engineer worldwide

5 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a About me Current job roles Employer IT Consultant & TSM L2 Support Engineer (IBM) ACT IT-Consulting & Services AG Founded in 1982 by Werner Bücher, Incorporated in 1999 Board of Directors: Werner Bücher, Norbert Friederichs Number of Employees: 100 Volume: 9 Mio Registered office: Niederkassel-Mondorf (near Bonn) Well-known customers in Germany, Austria, Switzerland More than 300 years of Tivoli experience

6 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

7 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a What is Journal Based Backup? Protocol of changes to the filesystem B-Tree Database on client side Changes are logged to one database per filesystem Configurable location, criteria, size Designed for file systems with small or moderate amounts of change activity Can reduce backup processing times significantly Not intended to be a complete replacement for traditional incremental backups Available on supported Windows and AIX platforms

8 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a What is Journal Based Backup? IBM Tivoli Storage Manager Command Line Backup/Archive Client Interface Client Version 5, Release 4, Level 1.2 Client date/time: 08/28/ :30:01 (c) Copyright by IBM Corporation and other(s) 1990, All Rights Reserved. Node Name: CLUSTER Session established with server SRV1: Windows Server Version 5, Release 4, Level 1.0 Server date/time: 08/28/ :30:20 Last access: 08/28/ :29:22 Incremental backup of volume '\\filecluster\q$' Incremental backup of volume '\\filecluster\x$' Incremental backup of volume '\\filecluster\y$' Querying Journal for '\\filecluster\q$' Processing 2 Journal entries for '\\filecluster\q$' \ Normal File--> 0 \\filecluster\q$\test\christian.tmp [Sent] Normal File--> 738 \\filecluster\q$\test\degroot.jpg [Sent] Querying Journal for '\\filecluster\x$' Processing 0 Journal entries for '\\filecluster\x$' Querying Journal for '\\filecluster\y$' \ Processing 1 Journal entry for '\\filecluster\y$' Expiring--> 1,110 \\filecluster\y$\data\user.txt [Sent] Successful incremental backup of '\\filecluster\q$' Successful incremental backup of '\\filecluster\x$' Successful incremental backup of '\\filecluster\y$' Total number of objects inspected: 3 Total number of objects backed up: 2 Total number of objects updated: 0 Total number of objects rebound: 0 Total number of objects deleted: 0 Total number of objects expired: 1 Total number of objects failed: 0 Total number of subfile objects: 0 Total number of bytes transferred: 1.79 KB Data transfer time: 0.01 sec Network data transfer rate: 30, KB/sec Aggregate data transfer rate: KB/sec Objects compressed by: 0% Subfile objects reduced by: 0% Elapsed processing time: 00:00:07

9 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

10 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a What environment was used? VM Ware 5 Workstation 2x Windows 2003 Advanced Server 2x Microsoft Cluster Service Tivoli Storage Manager Server on Windows 2x Tivoli Storage Manager Client on Windows 2x local TSM Nodes on each Cluster Node 1x and 3x TSM Clusternode(s) for the Cluster

11 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

12 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Some files locally, some files on shared disks Cluster and all disk resources are running on one of the Cluster Nodes Create directory on shared disk, e.g. Q:\TSM Copy files from baclient directory to Q:\TSM tsmjbbd.ini dsm.opt Adjust those two configuration files as shown in the following examples

13 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Configure files on shared disk to be used by Cluster Journal Service (1/2) tsmjbbd.ini [JournalSettings] Errorlog=Q:\TSM\jbberror_cluster.log JournalPipe=\\.\pipe\jnlServiceCluster pp JournalDir=Q:\TSM DeferFSMonStart=1 DeferRetryInterval=5 ; [JournalExcludeList] [JournaledFileSystemSettings] JournaledFileSystems=Q: X: Y: PreserveDBOnExit=1

14 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Configure files on shared disk to be used by Cluster Journal Service (2/2) dsm.opt TCPServeraddress COMMMethod TCPIP TCPPort 1500 JournalPipe \\.\pipe\jnlservicecluster PASSWORDAccessgenerate NODENAME CLUSTER CLUSTERNODE YES DOMAIN Q: X: Y: ERRORLOGNAME Q:\TSM\dsmerror_cluster.log SCHEDLOGNAME Q:\TSM\dsmsched_cluster.log

15 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Install one single Journal Engine to monitor all shared disk resources 1. Open DOS command prompt and change to your baclient directory 2. Install the Cluster Journal Service using dsmcutil command line tool: dsmcutil install journal /name:"tsm Journal Service - CLUSTER" /clientdir:"c:\tsm\baclient" /jbbconfigfile:"q:\tsm\tsmjbbd.ini" /optfile:"q:\tsm\dsm.opt" /node:"cluster" /autostart:yes /startnow:yes 3. Failover the Cluster Group Repeat above steps for each Cluster Node

16 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Output of dsmcutil command [...] Command: Install TSM Client Service Machine: CLUSTER-NODE-1(Local Machine) Installing TSM Client Service: Machine : CLUSTER-NODE-1 Service Name : TSM Journal Service - CLUSTER Client Directory : C:\TSM\baclient Automatic Start : yes Logon Account : LocalSystem The service was successfully installed. Creating Registry Keys... Inserted registry value 'ImagePath'. Inserted registry value 'EventMessageFile'. Inserted registry value 'TypesSupported'. Inserted registry value 'TSM Journal Service - CLUSTER'. Inserted registry value 'ADSMClientKey'. Starting the 'TSM Journal Service - CLUSTER' service... The service was successfully started.

17 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Screenshot Cluster Admin with all resources

18 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Add GENERIC SERVICE cluster resource 1/3

19 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Add GENERIC SERVICE cluster resource 2/3

20 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Add GENERIC SERVICE cluster resource 3/3

21 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (A) Failover cluster resources have dependencies for all cluster disk resources

22 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) All files locally Cluster is running on one, disk resources are running on any of the Cluster Nodes Use your standard baclient directory for the required files when no local TSM node Otherwise copy files from your baclient directory to e.g. C:\TSM\Journal tsmjbbd.ini dsm.opt Settings need to be adjusted equally on all Cluster Nodes Adjust those two configuration files as shown in the following examples

23 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) Configure local files to be used by Cluster Journal Service (1/2) tsmjbbd.ini (equal on all Cluster Nodes) [JournalSettings] JournalPipe=\\.\pipe\jnlServiceCluster\pipe\jnlServiceCluster DeferFSMonStart=1 DeferRetryInterval=5 ; [JournaledFileSystemSettings] JournaledFileSystems=Q: X: Y: PreserveDBOnExit=1 ; [JournaledFileSystemSetting.Q:\] JournalDir=Q:\TSM [JournaledFileSystemSetting.X:\] JournalDir=X:\TSM [JournaledFileSystemSetting.Y:\] JournalDir=Y:\TSM

24 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) Configure local files to be used by Cluster Journal Service (2/2) dsm.opt (equal on all Cluster Nodes) TCPServeraddress COMMMethod TCPIP TCPPort 1500 JournalPipe \\.\pipe\jnlservicecluster PASSWORDAccessgenerate NODENAME CLUSTER CLUSTERNODE YES DOMAIN Q: X: Y: ERRORLOGNAME C:\TSM\BACLIENT\dsmerror_cluster.log SCHEDLOGNAME C:\TSM\BACLIENT\dsmsched_cluster.log

25 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) Install one single Journal Engine to monitor all shared disk resources 1. Open DOS command prompt and change to your baclient directory 2. Install the Cluster Journal Service using dsmcutil command line tool: dsmcutil install journal /name:"tsm Journal Service - CLUSTER" /clientdir:"c:\tsm\baclient" /jbbconfigfile: C:\TSM\Journal\tsmjbbd.ini /optfile: C:\TSM\Journal\dsm.opt /node:"cluster" /autostart:yes /startnow:yes *: Use parameters in light grey only when there is a local TSM node in use Repeat above steps for each Cluster Node

26 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) Output of dsmcutil command [...] Command: Install TSM Client Service Machine: CLUSTER-NODE-1(Local Machine) Installing TSM Client Service: Machine : CLUSTER-NODE-1 Service Name : TSM Journal Service - CLUSTER Client Directory : C:\TSM\baclient Automatic Start : yes Logon Account : LocalSystem The service was successfully installed. Creating Registry Keys... Inserted registry value 'ImagePath'. Inserted registry value 'EventMessageFile'. Inserted registry value 'TypesSupported'. Inserted registry value 'TSM Journal Service - CLUSTER'. Inserted registry value 'ADSMClientKey'. Starting the 'TSM Journal Service - CLUSTER' service... The service was successfully started.

27 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) Journal Services need to be running on both Cluster Nodes Both services monitor all filesystems Config needs to be equal on both Cluster Nodes Journal DB files are shared Use DeferFSMonStart and DeferRetryInterval to notice failover Do not create Generic Service Cluster Resource for Journal Service Following messages might occur when drive Y: is owned by other Cluster Node: Incremental backup of volume '\\filecluster\y$' ANS1076E The specified directory path could not be found.

28 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implementing one Journal Engine (B) Screenshot Cluster Admin with resources on different Cluster Nodes No TSM Journal Service as Generic Service Cluster Resource!

29 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

30 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Some files locally, some files on each shared disk Cluster and disk resources are running independantly on any of the Cluster Nodes Create directory for Q: on local disk, e.g. C:\TSM\Journal_Cluster_Disk-Q Create directory for X: on local disk, e.g. C:\TSM\Journal_Cluster_Disk-X Create directory for Y: on local disk, e.g. C:\TSM\Journal_Cluster_Disk-Y Create directory on each shared disk, e.g. Q:\TSM, X:\TSM, Y:\TSM Copy files from baclient directory into above directories tsmjbbd.ini dsm.opt

31 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Configure files on shared disk Q: to be used by Cluster Journal Service (1/2) tsmjbbd.ini [JournalSettings] Errorlog=Q:\TSM\jbberror_cluster_disk-q.log JournalPipe=\\.\pipe\jnlServiceClusterDiskQ pp JournalDir=Q:\TSM DeferFSMonStart=1 DeferRetryInterval=5 ; [JournalExcludeList] [JournaledFileSystemSettings] JournaledFileSystems=Q: PreserveDBOnExit=1

32 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Configure files on shared disk Q: to be used by Cluster Journal Service (2/2) dsm.opt TCPServeraddress COMMMethod TCPIP TCPPort 1500 JournalPipe \\.\pipe\jnlserviceclusterdiskq PASSWORDAccessgenerate NODENAME CLUSTER CLUSTERNODE YES DOMAIN Q: ERRORLOGNAME Q:\TSM\dsmerror_cluster_disk-q.log SCHEDLOGNAME Q:\TSM\dsmsched_cluster_disk-q.log _

33 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Install one single Journal Engine to monitor shared disk resource Q: 1. Open DOS command prompt and change to your baclient directory 2. Install the Cluster Journal Service using dsmcutil command line tool: dsmcutil install journal /name:"tsm Journal Service CLUSTER DISK Q:" /clientdir:"c:\tsm\journal_cluster_disk-q" /jbbconfigfile:"q:\tsm\tsmjbbd.ini" /optfile:"q:\tsm\dsm.opt" /node:"cluster" /autostart:yes /startnow:yes 3. Failover the Cluster Group Repeat above steps for each Cluster Node and each shared disk resource

34 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Example output of dsmcutil command [...] Command: Install TSM Client Service Machine: CLUSTER-NODE-1(Local Machine) Installing TSM Client Service: Machine : CLUSTER-NODE-1 Service Name : TSM Journal Service CLUSTER DISK Q: Client Directory : C:\TSM\Journal_Cluster_Disk-Q Automatic Start : yes Logon Account : LocalSystem The service was successfully installed. Creating Registry Keys... Inserted registry value 'ImagePath'. Inserted registry value 'EventMessageFile'. Inserted registry value 'TypesSupported'. Inserted registry value 'TSM Journal Service CLUSTER DISK Q:'. Inserted registry value 'ADSMClientKey'. Starting the 'TSM Journal Service CLUSTER DISK Q:' service... The service was successfully started.

35 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Installed TSM Journal Services listed with command line

36 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Screenshot Cluster Admin with 3 Resource Groups

37 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Add GENERIC SERVICE cluster resource 1/3

38 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Add GENERIC SERVICE cluster resource 2/3

39 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Add GENERIC SERVICE cluster resource 3/3

40 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Bring newly defined Journal Services online

41 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Implem. multiple independant Journals Cluster disk resources failed over with the associated Journal Service

42 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

43 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a What to consider? Multiple Journal Services supported with TSM x and above Do not monitor one filesystem with multiple Journal Services Filesystem changes closely after a failover might be missed Run full incrementals regularly, e.g. once a week Each Journal DB entry has approx bytes (wrong information in 5.3 Technical Guide) JBB is only supported on local disks (and SAN attached disks showing up as local) Binaries in standard baclient directory can be shared for multiple services No more than approx changes / backup cycle Try TESTFLAGS JNLINBNPTIMEOUT:<seconds> on comm. timeout problems See JBB FAQ for more considerations

44 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

45 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a References TSM Windows Backup-Archive Clients Installation and User s Guide v5.3 / v5.4 Redbook: IBM Tivoli Storage Manager Version 5.3 Technical Guide Technote: TSM Journal Based Backup FAQ Technote: Steps required to setup the TSM Journaling Service in a MSCS environment Note: No multiple binary directories needed! Tivoli Storage Manager Support Website (Search for TSM and Journal ) ADSM.org Storage Management Technical Discussion Forum

46 agenda about me introduction environment single journal multiple journals considerations references discussion / q & a Agenda ABOUT ME INTRODUCTION ENVIRONMENT IMPLEMENTING ONE SINGLE JOURNAL ENGINE IMPLEMENTING MULTIPLE INDEPENDANT JOURNALS WHAT TO CONSIDER REFERENCES OPEN DISCUSSION / Q & A / LIVE DEMONSTRATION

47 Thank you for your patience! Christian de Groot E: E²: W: