Using Moab Service Manager. Steve Hurst September 17, 2009

Transcription

1 Using Moab Service Manager Steve Hurst September 17, 2009

2 Overview What is Moab Service Manager (MSM) When to use MSM Example MSM Uses Developing MSM plug-ins Explore Apache plug-in Questions 9/17/2009 2

3 What is Moab Service Manager? Moab Service Manager (MSM) is a modular framework for interfacing complex resource or workload management services and tools with Moab. Not a replacement for Native RM scripts, triggers, etc. Just another tool in the integration toolbox 9/17/2009 3

4 What is MSM? Moab RM Module RM Module RM Module MSM RM RM RM 9/17/2009 4

5 What is MSM - Details MSM Daemon iterates independently of Moab s scheduling iterations May be started and stopped independently MSM may run on a different host than Moab Resource and workload information gathered asynchronously, Moab queries database Job and system requests may be asynchronous 9/17/2009 5

6 What MSM Provides Persistent / semi-persistant storage for modules SQLite / MySQL / Postgres Custom Unified: Error handling utilities Logging utilities Configuration for modules Native resource wiki attribute tools Utilities for asynchronously handling requests from Moab 9/17/2009 6

7 When to use MSM Workload or resource actions require significant time to complete Native interface scripts begin to have interdependencies Native interface scripts do not scale well Native interface scripts require persistent data storage 9/17/2009 7

8 Example MSM Modules Provisioning, VM management xcat, HP OO Dynamic storage NFS, Custom Dynamic jobs Apache, Blender Other Schedulers / RMs MS CCS/HPC Simulation Module 9/17/2009 8

9 Developing MSM Modules MSM is written in Perl Template module provides: Skeleton code for all supported request types Detailed comments / instructions Custom development available through professional services 9/17/2009 9

10 Detailed Example - Apache MSM module that coordinates Apache with Balance Starts Apache on the allocated servers Chooses a master server for the job Starts the Balance TCP proxy/balancer on master Aggregates load information about each instance of Apache, provides to Moab to maintain SLAs Maintains state information about resource allocation and proxy configuration 9/17/

11 Apache Load Balancing Moab Apache Plugin MSM Balance Plugin TORQUE /17/

12 Configuration - Moab # moab.cfg (partial) TOOLSDIR PREEMPTPOLICY /opt/moab/tools REQUEUE RMCFG[torque] RMCFG[apache] TYPE=PBS TYPE=NATIVE:msm 9/17/

13 Configuration Moab (Cont) # moab.cfg (partial) JOBCFG[high] IFLAGS=SYNCJOBID JOBCFG[high] PRIORITY=5000 JOBCFG[high] FLAGS=PREEMPTOR JOBCFG[high] RM=torque JOBCFG[low] JOBCFG[low] JOBCFG[low] JOBCFG[low] IFLAGS=SYNCJOBID PRIORITY=1000 FLAGS=PREEMPTEE,RESTARTABLE RM=torque 9/17/

14 Configuration Moab (Cont) # moab.cfg (partial) QOSCFG[service] NODERANGE=1 IFLAGS=SYNCJOBID FLAGS=DYNAMIC,PREEMPTOR,PREEMPTEE SLAHARDTARGET[APPLOAD]=1.0,2.0 ALLOCSIZE=1 DEALLOCSIZE=1 ALLOCDELAY=30 PRIORITY=3000 RM=apache QOS=service NODEACCESSPOLICY=SINGLETASK QFLAGS=DYNAMIC 9/17/

15 Configuration MSM # msm.cfg ( placed in $TOOLSDIR/msm ) RMCFG[msm] PORT=24602 RMCFG[msm] POLLINTERVAL=5 RMCFG[msm] LOGFILE=/opt/moab/log/msm.log RMCFG[msm] LOGLEVEL=8 APPCFG[apache] DESCRIPTION= Apache2 with load balancing" APPCFG[apache] MODULE=Moab::MSM::App::Apache2 APPCFG[apache] LOGLEVEL=9 APPCFG[apache] TEMPLATES=apache APPCFG[apache] _BINDPORT=80 APPCFG[apache] _SERVICEPORT=8080 9/17/

16 Summary MSM is another tool available to assist in complex resource manager integration Unified configuration, logging, storage can greatly ease integration Modules easily developed using the provided template Example Apache module demonstrated unifying two separate resource managers 9/17/

17 Resources Native Interface documentation Section 13.5 of the Moab Admin Guide Wiki Resource Attribute documentation Dynamic Jobs documentation Section 21.3 of the Moab Admin Guide General MSM questions 9/17/

18 Questions? 9/17/