Monitoring z/vm and z/linux. Jürgen Hofmann

Transcription

1 Monitoring z/vm and z/linux Jürgen Hofmann

2 Agenda Architektur Installation Hauptfunktionen Screenshots Testinstallation MV for Linux Servers während Evaluierungsphase Automation Linux BMC Capacity Management for Mainframe Zusammenfassung Copyright 10/4/2010 BMC Software, Inc 2

3 MainView for Linux Servers - Architecture z/vm MMLVSRV VMMAVMSR,PERFSVM,ESASERV RT Server -STC z/os PAS -STC LINUX Perform Collector Data Server COSlite Server LINUX Perform Collector Data Server COSlite Server LINUX Perform Collector Data Server COSlite Server LINUX LINUX Perform Collector LINUX Perform Data Collector Server Perform COSlite Data Collector Server Server COSlite Data Server Server COSlite Server INTEL x86 INTEL x86 INTEL x86 MV Explorer Server WEB CAS-STC TSO Copyright 10/4/2010 BMC Software, Inc 3

5 Voraussetzungen Linux Disk Space Requirements - 62MB in /tmp MB in /opt Software Requirements - Linux SLES 9 or 10, RH Enterprise 3, 4, or 5 - For VM monitoring z/vm 5.1 or higher - VMARC utility for VM Monitoring Product and System Authorization Requirements - APF authorization for BBLINK and PGMLIB - Linux root authority - MML PAS and RTSERVER RACF OMVS TCP/IP access Copyright 10/4/2010 BMC Software, Inc 5

6 SMP/E-Installation Uses the BMC OS/390 and z/os Installer (SMP/E) Copyright 10/4/2010 BMC Software, Inc 6

7 Using AutoCustomization 12 o Add RTSERVER PGMLIB library to your system APF/LNKLST list 13 Create RTSERVER startup procedure 19 Create MainView for Linux PAS (Product Address Space) SYSIN mbr 20 Allocate MainView for Linux PAS IMAGE data set 21 Allocate MainView for Linux PAS RULES data set 22 Allocate MainView for Linux PAS history data sets 23 Create MainView for Linux PAS startup procedure 24 Create MainView for Linux job to FTP RPMS files to Linux 25 Create MainView for Linux job to FTP files to VM Copyright 10/4/2010 BMC Software, Inc 7

8 MainView for Linux z/vm Copyright 10/4/2010 BMC Software, Inc 8

9 MainView for Linux Linux Copyright 10/4/2010 BMC Software, Inc 9

11 MAINVIEW for Linux - Servers Displays Linux and z/vm performance and availability information in realtime and interval time (historical data) frames Provides historical data which allows you to perform trend analysis on the historical performance of your Linux and z/vm systems Provides around 200 different views providing Linux and z/vm performance availability, usage, and configuration information Integrates views from the MAINVIEW family of products Auto-discovery of Linux and z/vm systems Copyright 10/4/2010 BMC Software, Inc 11

12 MAINVIEW for Linux - Servers Provides a view into understanding the Linux system and applications: - Performance - Availability - Supports zseries and Intel Allows you to: - Manage a large number of Linux systems - Define alarm thresholds for event management - Avoid and/or fix problems before they impact your business Copyright 10/4/2010 BMC Software, Inc 12

13 MAINVIEW for Linux - Servers System Metrics System information and statistics - Host name of each Linux system image - Status (inactive or running) - CPU usage - Memory usage - Swap space usage - Average number of processes waiting for CPU service (per second) - Average number of times the run queue is updated during the measurement interval (per second) - Average number of processes ready to run (for 1-, 5-, and 15-minute intervals) - Number of processes running during the measurement interval - Total amount of physical memory in use during the measurement interval Copyright 10/4/2010 BMC Software, Inc 13

14 MAINVIEW for Linux - Servers Process Metrics Processes information and statistics - Process identification number - Process name - Elapsed process time - CPU resources used - Total physical resident memory - I/O rate - Process state - Total virtual memory size - CPU utilization by executing programs and library functions Copyright 10/4/2010 BMC Software, Inc 14

15 MAINVIEW for Linux - Servers File System Metrics File system resources Identifies file systems heavily utilized and running out of space - Path name of the directory - Type of file system - Amount of the file system utilized (percentage) total file system capacity (in kilobytes) free file system space (in kilobytes) used file system space (in kilobytes) - Total number of file system allocation units (in blocks) - Number of free file system allocation units (in blocks) - Number of i-nodes in use (percentage) total number of i-nodes number of free i-nodes number of i-nodes in use Copyright 10/4/2010 BMC Software, Inc 15

16 MAINVIEW for Linux - Servers z/vm Metrics z/vm Performance - CPU utilization - Storage utilization - Resource utilization - Virtual machines - Real devices - Paging and spooling - Privileged operations - Channel Paths - Minidisk and SFS directories - File listing and actions Copyright 10/4/2010 BMC Software, Inc 16

17 MAINVIEW for Linux - Servers Additional Metrics User sessions and processes - Tracks users on the system and identifies which users and processes are placing the greatest demands on system resources Disks and disk usage - Tracks disk I/Os and usage to locate hot (over-utilized) disks Inter-Process Communication (IPC) - Shared Memory Segments - Message Queues - Semaphore Arrays - Action commands Remove shared memory segments Remove message queues Remove semaphore arrays Copyright 10/4/2010 BMC Software, Inc 17

19 MainView 3270 oder Browser? Copyright 10/4/2010 BMC Software, Inc 19

20 Kundenbeispiel Copyright 10/4/2010 BMC Software, Inc 20

21 Übersicht: Alle VM User Copyright 10/4/2010 BMC Software, Inc 21

22 Übersicht: Alle Linux-Systeme Copyright 10/4/2010 BMC Software, Inc 22

23 Detail: Alle Prozesse eines Linux-Systems Copyright 10/4/2010 BMC Software, Inc 23

24 Problemsituation: Loop Copyright 10/4/2010 BMC Software, Inc 24

25 Typische Problem Scenarios Linux 1. Linux process using excessive CPU resource. RENICE or KILL 2. Linux file system running out of space. Move/remove unnecessary files Use lvm (Logical Volume Manager) to to expand and shrink file systems 3. Linux process opening too many files. view cflfsysr: reset the 'file-max' numbers 4. Required Linux process inactive or missing. UBBPARM(MMLTSRP0): required Linux daemon processes. 5. Linux process creates core dump file. RC >= 8 in FSLTEST + Automation 6. Linux process causing excessive swapping. Run swapon command to enable additional swap devices/files Copyright 10/4/2010 BMC Software, Inc 25

26 Typische Problem Scenarios z/vm 1. z/vm virtual machine using excessive CPU resource. CP FORCE LOGOFF CP SET SHARE ABSOLUTE LIMITHARD 2. z/vm minidisk running out of space. Get larger minidisk, and move/remove unnecessary files Use SFS (Shared File Systems) to expand and shrink shared file system by adding/removing minidisks to filepools 3. Required z/vm virtual machine inactive or missing. UBBSAMP(MMLVTST2) and VMFTEST view to monitor if required z/vm virtual machines are missing. 4. z/vm virtual machine using excessive VDISK resource. Run Linux swapon command to enable additional swap devices/files. Copyright 10/4/2010 BMC Software, Inc 26

29 MV AO Automation of z/linux IMFEXEC CMD TYPE(ZLINUX) Specify z/linux and VM CP commands from Rexx Execs - No Rules support Utilizes Hidden view in MV Linux FSLEXEC - However, can secure access to this view using normal MVI security definition Requires: - MV Linux at Put 801B or newer - CASID=xxxx specified in BBPAARM member BBISSPxx Syntax: CMD TYPE(ZLINUX ZLNX) command TARGET(system_name) [SERVER(server_name)] [STEM(stem)] [WAIT(nn)] [DEBUG] Copyright 10/4/2010 BMC Software, Inc 29

30 MV AO Automation of z/linux Example: start a zlinux LNX01CS on the same VM system running zlinux LNX02CS using the VMCP command AUTOLOG. /* REXX */ "IMFEXEC CMD 'vmcp autolog LNX01CS' TYPE(ZLINUX) TARGET(LNX02CS)" if imfcc <> 0 then do if imfcc >= 32 & imfcc <= 44 then do "IMFEXEC MSG 'MV API FAILED CMP="mvapicmp "RSN="mvapirsn"'" do cnt = 1 to line.0 "IMFEXEC MSG 'MSGTEXT="line.cnt"'" end end else "IMFEXEC MSG 'COMMAND FAILED WITH IMFCC="imfcc"'" exit end do cnt = 1 to imfnol "IMFEXEC VGET LINE'cnt "LOCAL" "IMFEXEC MSG 'FILE"cnt"="value("LINE"cnt) end EXIT 0 Copyright 10/4/2010 BMC Software, Inc 30

31 Required Linux process inactive or missing Copyright 10/4/2010 BMC Software, Inc 31

33 Kundenbeispiel MIPS System CPU Utilization VM ZVMPROD on Copyright 10/4/2010 BMC Software, Inc 33

34 Kundenbeispiel MIPS Workload CPU Utilization VM ZVMPROD Workload <ALL> on OTHERCMS PLINUX05 TCPIP LXWAS09P LXWAS08P LXWAS01P LXWAS03P PLINUX02 LXWAS04P PLINUX03 PLINUX06 PLINUX07 PLINUX08 LXWAS02P LXWAS05P PLINUX09 PLINUX11 PLINUX10 PLINUX04 PLINUX01 LXWAS06P Copyright 10/4/2010 BMC Software, Inc 34

35 Kundenbeispiel B195 Host B193 Host B192 Host B191 Host B190 Host B177 Host B16A Host B163 Host B162 Host B125 Host B124 Host B07D Host B07C Host B07B Host B07A Host B079 Host B078 Host B077 Host B076 Host B075 Host B074 Host B073 Host B072 Host B031 Host B027 Host B026 Host B025 Host B023 Host B022 Host B021 Host B01F Host B01E Host B01D Host Device Utilization VM ZVMPROD Device <ALL> on % 3 1, , , [# in range] Copyright 10/4/2010 BMC Software, Inc 35

37 MainView for Linux Servers - Architecture z/vm MMLVSRV VMMAVMSR,PERFSVM,ESASERV RT Server -STC z/os PAS -STC LINUX Perform Collector Data Server COSlite Server LINUX Perform Collector Data Server COSlite Server LINUX Perform Collector Data Server COSlite Server LINUX LINUX Perform Collector LINUX Perform Data Collector Server Perform COSlite Data Collector Server Server COSlite Data Server Server COSlite Server INTEL x86 INTEL x86 INTEL x86 MV Explorer Server WEB CAS-STC TSO Copyright 10/4/2010 BMC Software, Inc 37

38 Questions? Copyright 10/4/2010 BMC Software, Inc 38

39 Welche Datacollector sind aktiv? Copyright 10/4/2010 BMC Software, Inc 39