Monitor Your Engineered Systems From a Single Pane Of Glass

Transcription

1 Monitor Your Engineered Systems From a Single Pane Of Glass Oracle Enterprise Manager and Exadata, Exalogic & Exalytics Prepared By: Alfredo Krieg Sr. Oracle Enterprise Cloud Administrator The Sherwin-Williams Company

2 Visit IOUG at the User Group Pavilion Stop by the User Group Pavilion in the Upper Level of Moscone South and catch up with the user community! Connect with IOUG members and volunteers Learn more about IOUG membership and benefits and how to join the IOUG community, 30,000+ technologists strong Enter to win discounts, free books from IOUG Press and COLLABORATE 16 Registration Visit us Sunday Wednesday!

3 SIG Meetings at Oracle OpenWorld All meetings will be held in User Group Pavilion, Meeting Room, Moscone South Monday, October 26 IOUG Cloud Computing SIG Meet-Up: 10:00 a.m. 11:00 a.m. IOUG Oracle Enterprise Manager SIG: 5:00 p.m. 6:00 p.m. *Location: OTN Lounge, Moscone South* Tuesday, October 27 IOUG IoT SIG: 10:30 a.m. 11:30 a.m. IOUG BIWA SIG: 11:30 a.m. 12:30 p.m. Wednesday, October 28 IOUG Exadata SIG: 10:30 a.m. 11:30 a.m. IOUG RAC SIG: 1:00 p.m. 2:00 p.m. IOUG Oracle 12c SIG: 2:00 p.m. 3:00 p.m.

4 COLLABORATE 16 IOUG Forum April 10-14, 2016 Mandalay Bay Resort & Casino Las Vegas, NV IOUG Forum Advantage Save up to $1,000 on registration and education offerings, like pre-conference workshops Gain access to exclusive IOUG content, including the Strategic Leadership Program Priority access to IOUG hands-on labs Advance access to supplemental session material presentations Special IOUG activities collaborate.ioug.org #C16LV

5 Connect with IOUG Twitter: Facebook: Connect with IOUG on our official Facebook page LinkedIn: Connect and network with other Oracle professionals and experts in the IOUG LinkedIn group

6 Senior Oracle Cloud Administrator at The Sherwin- Williams Company based in Cleveland, OH Oracle ACE Associate About me OEM Cloud Control 12c and Database Performance Tuning Oracle Technologies since 2004 & 11g Certified Blog bitkode.blogspot.com

7 Connect with me Twitter: LinkedIn:

8 The Sherwin-Williams Company Largest Producer of Paint & Coatings in US, among Top 3 worldwide Founded in 1866 in Cleveland, OH 2016 is 150th Anniversary $10.19 billion in sales Business in 120+ Countries 34,000+ employees 4,000+ Company Owned Stores 90+ Manufacturing Facilities Globally

9 Motivation Why use OEM 12c? Single Interface for all Engineered Systems Connectivity between OEM and EMOC for Exalogic for alerts (management?) Use of monitoring templates, administration groups and roles already created Notifications Automation of tasks using Job system and corrective actions

10 Agenda OEM 12c Architecture Oracle OMS, Repository and Agents OEM 12c plug-ins Plug-ins for Exadata, Exalogic and Exalytics Engineered Systems Architecture Exadata DB Machine Exalogic Elastic Cloud Exalytics In-Memory Machine Enabling Monitoring Install, discover and configure components Customize monitoring and automate tasks Tools Repvfy and Exachk

11 OEM 12c Architecture

12 OEM 12c Architecture Modular (Building Block) Approach OEM Components OEM Base + Plug-ins

13 OEM 12c Architecture Customizing OEM OEM Base + Plug-ins Metric Extensions thresholds, etc. Your OEM + = Everything is Awesome!

14 OEM 12c Architecture Plug-ins by default Oracle Database RAC, ASM, DB, etc. Oracle Fusion Middleware WebLogic, SOA, BI, etc. My Oracle Support SRs, Knowledge library, patches, etc. Oracle Exadata Oracle DB Machine targets

15 OEM 12c Architecture Exadata DB Machine Exadata plug-in Exalogic Elastic Cloud (Virtual) Oracle Fusion Middleware plug-in Oracle Virtualization plug-in Oracle ZFS Storage Appliance plug-in Exalytics In-Memory Machine Oracle Fusion Middleware plug-in

17 Engineered Systems Architecture Exadata DB Machine Compute Nodes Infiniband Switches Storage Cells ILOMs CISCO Switch PDUs Exadata Components

18 Engineered Systems Architecture

19 Engineered Systems Architecture Exalogic Elastic Cloud Hardware Compute Nodes Infiniband Switches ILOMs CISCO Switch PDU Exalogic Components

21 Engineered Systems Architecture Exalogic Elastic Cloud Software

22 Engineered Systems Architecture Exalogic Elastic Cloud Software

23 Engineered Systems Architecture Exalytics In-Memory Machine Compute Nodes Exalytics

26 Enabling Monitoring Exadata DB Machine Install OEM 12c Agent Discover Oracle Exadata Database Machine Discovery Agent Infiniband Discovery Prerequisite Check Components discovery Monitoring Agents Monitoring Credential SNMP Subscription Review Discover Cluster and HAS Discover ASM, DB and Listener

27 Exadata DB Machine Prerequisite steps before discovering Exadata DB machine within Oracle Enterprise Manager 12c (Doc ID ) 1. Create a Database Server ILOM Service Processor User (nm2user) 2. Verify permissions. The account running the OEM agent should have read/execute on $ORACLE_HOME/bin/kfod binaries 3. Verify the versions. Exadatas before 2011 should have unsupported versions of the schematic files 4. Verify the values of <ADMINNAME> and <ADMINIP> for components 5. Others Enabling Monitoring

28 Enabling Monitoring Install OEM 12c Agent on compute nodes

29 Enabling Monitoring Discover Oracle Exadata DB Machine

32 Enabling Monitoring Discover Oracle Exadata DB Machine nm2user required (SSH)

33 Enabling Monitoring Discover Oracle Exadata DB Machine $ORACLE_HOME/perl/bin/perl exadatadiscoveryprecheck.pl

34 Enabling Monitoring Discover Oracle Exadata DB Machine Prerequisite script for Exadata Discovery in Oracle Enterprise Manager Cloud Control 12c (Doc ID ) Usage: $ORACLE_HOME/perl/bin/perl exadatadiscoveryprecheck.pl [-dhq] [-aid dir] [-cepass password] [-copass password] [-em file] [-i file] [-ibpass password] [-log file] [-oh dir] [-ot file] [-sch file]

39 Enabling Monitoring

40 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Install OEM 12c Agent Prerequisites Import Ops Center Certificate into Agent s Keystore Import OVM Manager Certificate into the Agent Set OVMM to Read-Only mode Discover Oracle VM Manager Discover Oracle ZFS Storage Appliances Discover the Exalogic Elastic Cloud Target

41 Enabling Monitoring Install OEM 12c Agent on compute nodes

42 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Import Ops Center Certificate into Agent s Keystore Login as root to the EMOC host Change directory to [root@localhost~]# cd $OPS_CENTER_HOME/oemec/security/jsse Export the Certificate [root@localhost jsse]# $JAVA_HOME/jre/bin/keytool - export -alias cacao_agent -file oc.crt -keystore truststore -storepass trustpass Import the Certificate into Agent s Keystore $JAVA_HOME/jre/bin/keytool -import -keystore $AGENT_HOME/agent_inst/sysman/config/montrust/AgentTr ust.jks -alias <alias_name> -file <path_to_oc_certificate_file>/oc.crt Bounce the Agent

43 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Import the OVMM Certificate into the Agent As root on the OVMM host cd /u01/app/oracle/ovm-manager-3/ /opt/oracle/em12c/agent/core/ /jdk/bin/keyto ol -keystore./ovmmcoretcps.ks -exportcert -alias ovmm -file ovmm.cr Password: <Enter> As the OEM Agent user on the OVMM host $AGENT_HOME/bin/emctl secure add_trust_cert_to_jks - trust_certs_loc <Location of the Oracle VM Manager Certificate> -alias ovmm Password: <Enter> Bounce the OEM Agent

44 Enabling Monitoring Exalogic Elastic Cloud (Virtual) How To Configure Oracle Virtual Machine Manager (OVMM) for read-only access by Enterprise Manager Cloud Control (Doc ID ) Set OVMM to Read-Only mode Login into the VM that hosts the OVMM as oracle Perform the below sequence cd /u01/app/oracle/ovm-manager-3/ovm_shell sh ovm_shell.sh --url=tcp://localhost: username=admin ovm = OvmClient.getOvmManager () f = ovm.getfoundrycontext () --password=<ovmm admin user pwd> j = ovm.createjob ( 'Setting EXALOGIC_ID' ); j.begin (); f.setasset ( "EXALOGIC_ID", "<Exalogic ID for the Rack>"); j.commit ();

45 Enabling Monitoring Exalogic Elastic Cloud (Virtual) How To Configure Oracle Virtual Machine Manager (OVMM) for read-only access by Enterprise Manager Cloud Control (Doc ID ) Set OVMM to Read-Only mode

46 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover Oracle VM Manager

47 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover Oracle VM Manager Go to Enterprise -> Cloud -> Oracle VM Infrastructure Home Select Register OVM Manager

48 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover Oracle VM Manager

49 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover ZFS Storage Appliance

51 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover ZFS Storage Appliance Go to Setup -> Add Target -> Add Targets Manually Select Add Targets Declaratively and choose ZFS Storage Appliance

53 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover Exalogic Elastic Cloud

54 Enabling Monitoring Exalogic Elastic Cloud (Virtual) Discover Exalogic Elastic Cloud

56 Enabling Monitoring Exalytics In-Memory Machine Deploy OEM 12c Agent Discover the Exalytics System Target Go to Targets -> Systems

57 Enabling Monitoring Exalytics In-Memory Machine Discover the Exalytics System Target Add the Exalytics System

58 Enabling Monitoring Exalytics In-Memory Machine Discover the Exalytics System Target

60 Enabling Monitoring Exadata Resource Utilization

61 Enabling Monitoring Exalogic Performance Summary

62 Enabling Monitoring Exalytics Performance Summary

64 Tools Repvfy verifyexadata ====================================================================== Exadata components without a backup Agent = = = Action: = - Re-run the discovery of the Database Machine and select a primary and = a backup Agent for each discovered Database Machine component = = Check for DB_BLOCK_CHECKSUM = = = Action: = - Set the database initialization parameter "DB_BLOCK_CHECKSUM" to "TYPICAL" = [default] or "FULL", in a test system and evaluate the performance impact. = If there is no adverse performance impact, set the parameter for both = primary and standby databases. = - For more info, see the Exadata Best Practices = = Oracle Exadata Best Practices (Doc ID )

65 Tools Repvfy Check for DB_LOST_WRITE_PROTECT = = = Action: = - Set the database initialization parameter "DB_LOST_WRITE_PROTECT" to = "TYPICAL" on all reported databases = - For more info, see the Exadata Best Practices = = Check for consistent redolog file sizes = = = Action: = - Add files to the redolog file groups on all reported databases of the = same size = - For more info, see the Exadata Best Practices = = Broken targets = = = Action: = - Either the monitoring configuration of the target is wrong or incomplete = To verify and update the configuration go to the Monitoring Configuration = page of the target in the Console = - Or the Agent is unable to obtain the runtime parameters (dynamic- and = category properties) of the target

66 Exachk Tools Download and deploy the plug-in to the OMS Add the Healthcheck target manually

67 Exachk Configure Healthcheck Tools

68 Exachk Configure exachk Environment variables export RAT_COPY_EM_XML_FILES=1 export RAT_OUTPUT=[exachk output directory] Start exachk daemon./exachk -d start. Run exachk tool./exachk -daemon a Tools Oracle Exadata Database Machine exachk or HealthCheck (Doc ID ) Exachk Health-Check Tool for Exalogic (Doc ID )

69 Exachk Tools

70 Exadata Troubleshoot Issues Enterprise Manager 12c Support For ORACLE EXADATA DATABASE MACHINE X5-2 (Doc ID ) Patch Requirements for Setting up Monitoring and Administration for Exadata (Doc ID ) Exadata Storage software versions supported by the Oracle Enterprise Manager Exadata plug-in (Doc ID ) Release Schedule for Enterprise Manager Cloud Control Plug-ins (Doc ID ) Troubleshooting Exadata Database Machine Discovery in 12c Cloud Control (Doc ID ) Script to Collect Exadata Cell Performance Information (cellperfdiag.sql) (Doc ID ) Steps to shut down or reboot an Exadata storage cell without affecting ASM (Doc ID )

71 Exalogic Troubleshoot Issues Exalogic Virtual : False-Positive Oracle Enterprise Manager (OEM or EM) Alerts claiming that ILOM Storage Nodes are down (irrespective of the Nodes being continuously up) (Doc ID ) After Rediscovery Of An Exalogic Rack In EM 12c Cloud Control, All Compute And Storage Node ILOM Targets Are Shown In "Diagnose for Status Pending" (Doc ID ) Exalogic vservers Not Discovered In Enterprise Manager Cloud Control 12c After Applying April 2015 PSU (Doc ID ) Oracle Exalogic Elastic Cloud Known Issues - Virtualization Release (Doc ID ) How To Monitor Exalogic Virtual Environments through Enterprise Manager Cloud Control (EMCC) (Doc ID ) How To Configure Oracle Virtual Machine Manager (OVMM) for read-only access by Enterprise Manager Cloud Control (Doc ID )

72 Exalytics Troubleshoot Issues Enterprise Manager (EM) 12c Agent On Exalytics Fails With Error: "No Exalytics Property File Found. Please choose a Agent which is on a Exalytics Machine Host." (Doc ID ) Starting EM12c R2 Agent On Oracle Exalytics Fails With Errors: "Init Operation Failed...agent.SecureAgentCmd main Failed to secure the Agent..." (Doc ID ) Adding Exalytics Oracle BI Suite Target In EM12c Fails With Error "Presentation Server not found" (Doc ID )

73 Thank You!