Foglight for SQL Server

Transcription

1 Foglight for SQL Server Managing SQL Server Database Systems

2 2010 Quest Software, Inc. ALL RIGHTS RESERVED. This guide contains proprietary information protected by copyright. The software described in this guide is furnished under a software license or nondisclosure agreement. This software may be used or copied only in accordance with the terms of the applicable agreement. No part of this guide may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for any purpose other than the purchaser s personal use without the written permission of Quest Software, Inc. The information in this document is provided in connection with Quest products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Quest products. EXCEPT AS SET FORTH IN QUEST'S TERMS AND CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, QUEST ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL QUEST BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF QUEST HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Quest makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and product descriptions at any time without notice. Quest does not make any commitment to update the information contained in this document. If you have any questions regarding your potential use of this material, contact: Quest Software World Headquarters LEGAL Dept 5 Polaris Way Aliso Viejo, CA legal@quest.com Refer to our Web site for regional and international office information. Trademarks Quest, Quest Software, the Quest Software logo, AccessManager, ActiveRoles, Aelita, Akonix, Benchmark Factory, Big Brother, BridgeAccess, BridgeAutoEscalate, BridgeSearch, BridgeTrak, BusinessInsight, ChangeAuditor, CI Discovery, Defender, DeployDirector, Desktop Authority, Directory Analyzer, Directory Troubleshooter, DS Analyzer, DS Expert, Foglight, GPOADmin, Help Desk Authority, Imceda, IntelliProfile, InTrust, Invirtus, itoken, JClass, JProbe, LeccoTech, LiteSpeed, LiveReorg, LogADmin, MessageStats, Monosphere, NBSpool, NetBase, NetControl, Npulse, NetPro, PassGo, PerformaSure, Point, Click, Done!, Quest vtoolkit, Quest vworkspace, ReportADmin, RestoreADmin, ScriptLogic, SelfServiceADmin, SharePlex, Sitraka, SmartAlarm, Spotlight, SQL Navigator, SQL Watch, SQLab, Stat, StealthCollect, Storage Horizon, Tag and Follow, Toad, T.O.A.D., Toad World, vautomator, vconverter, vecoshell, VESI, vfoglight, vpackager, vranger, vspotlight, vstream, vtoad, Vintela, Virtual DBA, VizionCore, Vizioncore vautomation Suite, Vizioncore vessentials, Vizioncore vworkflow, WebDefender, Webthority, Xaffire, and XRT are trademarks and registered trademarks of Quest Software, Inc in the United States of America and other countries. Other trademarks and registered trademarks are property of their respective owners. Third Party Contributions Foglight contains some third party components. For a complete list, see the License Credits page in Foglight online help. June 2010 Version

3 Table of Contents Introduction to this Guide...9 About Quest Software, Inc Contacting Quest Software Contacting Quest Support Upgrading to the Current Version...11 Overview Running the Upgrade Wizard The Foglight for SQL Server Instance Homepage...15 Reviewing the Databases Dashboard Components Common to All Foglight for SQL Server Screens Currently Selected Group Status Summary Creating Custom Database Groups Viewing the Foglight for SQL Server Instance Homepage Identifying the Instance Tracking the Instance Data Flow Monitoring Background Processes Monitoring Alarms Adding and Configuring Agents...41 Studying the Foglight for SQL Server Architecture Running the Database Discovery Wizard Monitoring SQL Server in a clustered environment Carrying Out the Automatic Discovery Process Discovering Instances by Host Name... 47

4 4 Foglight for SQL Server Adding a Single Instance Manually Discovering Instances by IP Range Importing Instances from a File Reviewing Memory Usage Viewing the Memory Summary Monitoring the Memory Areas Utilization Monitoring the Hit Rates for the Main SQL Server Caches Monitoring Memory Allocation to the Cache Memories Reviewing Object Types Monitoring Buffer Cache-related Data Reviewing the Top-consuming Objects of the Buffer Cache Tracking the Page Allocation Monitoring the Buffer Cache Hit Rates Monitoring Procedure Cache-related Data Monitoring the Procedure Cache Tracking Memory Allocation to the Procedure Cache by Object Type Reviewing Statistics About Procedure Cache Objects Reviewing SQL Activity Tracking Performance Issues Viewing In-depth Data about the Instance Reviewing the SQL Server Instance Activity Viewing SQL I/O Activity Data Viewing Detailed Sessions Data Tracking Top SQL Statements Data Viewing Wait Statistics Monitoring Locks and Latches Viewing Current Lock Conflicts Tracking Historical Lock Conflicts Viewing I/O Statistics by Database Files Reviewing Database Usage Monitoring SQL Server Databases Overview Transactions

5 Table of Contents 5 Backup Status Properties Monitoring Database Details Monitoring Database Space and History Monitoring File Groups in the Selected Databases Monitoring Data Files Monitoring Transaction Logs in the Selected Databases Monitoring Log Files Monitoring Tables Monitoring Indexes Monitoring Disk Space Reviewing the Support Services Reviewing the Support Service Status Monitoring the Status of the Current Services Tracking the Service Status History Reviewing SQL Agent Jobs Tracking the SQL Agent Jobs Tracking Job Execution Messages Viewing the SQL Agent Jobs History Viewing SQL Agent Alerts Tracking SQL Agent Alerts Tracking Recent Alert Occurrences Monitoring Cluster Services Monitoring the State of the Current Microsoft Cluster Server Monitoring the Log Shipping Tracking the Performance of Servers used in Log Shipping Viewing the Log Shipping Details Tracking the Status of the Mirroring Operation Mirroring Table Viewing the Role and Data Flow of the Selected Database Viewing the Selected Database s Mirroring Performance History Viewing the Partner s Mirroring Page Monitoring SQL Server Transactions via the DTC Panel Monitoring Full-text Indexes via the Full Text Search Panel...159

6 6 Foglight for SQL Server Using the SQL Error Log Drilldown Reviewing the SQL Server Error Logs Reviewing the SQL Agent Error Logs Reviewing the Foglight Agent Error Logs Reviewing Configuration Settings Reviewing SQL Server Configuration Viewing the Server Property Values Viewing the SQL Server Configuration Options Viewing User Metrics Viewing User-Defined SQL Metrics Viewing User-Defined Performance Counters Using the Global Administration Options Reviewing the Global Administration Settings Defining Connection Details Defining the Connection Settings for the Monitored Instances Defining Data Collection and Storage Options Defining Thresholds Excluding Objects from Rules Defining Error Log Scanning Setting User-Defined Metrics Editing the Metric Execution Timeout Adding a User-defined Metric Selecting Requested Performance Counters Configuring Notifications Setting Default Notification Status for the Selected Agents Defining the Notification Settings Configuring Foglight Mail Server Setting Options for Displaying Data in the Buffer Cache Setting Options for Displaying Data in the Sessions Panel Setting Options for Displaying Data in the Procedure Cache Setting Options for Displaying Data in the Locks Panel Defining Retention Policies

7 Table of Contents 7 Defining the Collection and Display of Top SQL Statements Defining the Collection of Database Indexes Defining the Collection of Database Tables Reviewing Foglight for SQL Server Alarms Alarms Displayed in the Sessions Pane Response Time Alarm Packet Errors Alarm Alarms Displayed in the SQL Processes Panel Blocking Alarm Deadlocks Alarm Recompiles Alarm Error Log Alarm Alarms Displayed in the SQL Memory Panel Buffer Cache Hit Ratio Alarm Free Buffers Alarm Page Life Expectancy Alarm Procedure Cache Hit Ratio Alarm Alarms Displayed in the Background Processes Panel Cluster Server Down Alarm Log Shipping Alarm Non-preferred Cluster Node Alarm SQL Agent Alerts Alarm SQL Agent Job Failure Alarm SQL Server I/O Errors Per Second Alarm Support Services Alarm Table Lock Escalation Alarm Alarms Displayed in the Disk Storage Panel Recent Backups Alarm Database Unavailable Alarm Dynamic Data File Growth Remaining Alarm Fixed Data File Space Used Alarm Log Flush Wait Time Alarm Disk Queue Length Alarm...225

8 8 Foglight for SQL Server Generating Reports Generating Reports for a Foglight for SQL Server Instance Studying the Various Reports Glossary Index

9 Introduction to this Guide The Foglight for SQL Server provides configuration instructions, conceptual information and instructions on how to use the Foglight for SQL Server cartridge. This guide is intended for SQL Server database administrators.

10 10 Foglight for SQL Server About Quest Software, Inc. Now more than ever, organizations need to work smart and improve efficiency. Quest Software creates and supports smart systems management products helping our customers solve everyday IT challenges faster and easier. Visit for more information. Contacting Quest Software Mail Web site Quest Software, Inc. World Headquarters 5 Polaris Way Aliso Viejo, CA USA Refer to our Web site for regional and international office information. Contacting Quest Support Quest Support is available to customers who have a trial version of a Quest product or who have purchased a Quest product and have a valid maintenance contract. Quest Support provides unlimited 24x7 access to SupportLink, our self-service portal. Visit SupportLink at From SupportLink, you can do the following: Retrieve thousands of solutions from our online Knowledgebase Download the latest releases and service packs Create, update and review Support cases View the Global Support Guide for a detailed explanation of support programs, online services, contact information, policies and procedures. The guide is available at: support.quest.com.

11 2 Upgrading to the Current Version Starting to work with a Foglight for SQL Server instance requires upgrading to the current version both the instance and the Foglight Agent Manager that runs the instance. This chapter contains instructions for using the upgrade wizard. Overview Any upgrade of Foglight for SQL Server to the latest version, which is not met by similar upgrade of the database cartridge components, is detected upon opening the Databases dashboard, when the upgrade wizard starts automatically. Figure 1 Selecting the check box at the bottom left of the screen prevents this wizard from appearing when entering the Databases dashboard. Nevertheless, if several database cartridge components still require upgrade, the need to upgrade them is indicated in the

12 12 Foglight for SQL Server dashboard. The indication is evident both in the caption Upgrade required, which is displayed in red to the right of the requested instance, and in the button Upgrade now, which appears only if upgrade is required. Note Even though instances whose components need to be upgraded appear in the Databases table, such instances cannot be accessed by clicking them, until they have been fully upgraded Figure 2 Running the Upgrade Wizard To upgrade the requested instances: 1 Select the instances to be upgraded and click Upgrade now. The screen that appears now is the same screen that appears by default upon entering the Databases dashboard when one or more database cartridge components require upgrading. While the need for upgrade is indicated for both Foglight for Oracle and Foglight for SQL Server, the upgrade is carried out separately for each database cartridge type. 2 Select which type of database cartridge to upgrade, by clicking the Database cartridge s name. 3 Use the following screen to select which Foglight Agent Managers and Foglight for SQL Server versions are to be upgraded.

13 Upgrading to the Current Version 13 Running the Upgrade Wizard Note The Other Agents column in the table indicates whether the specified Foglight Agent Manager runs agents of other cartridge types. If a value is displayed in this column, go to Dashboards > Administration > Agents > Agent Status to view which other agents run under the specified Foglight Agent Manager. If the other agents appear in the list below, upgrading Foglight Agent Manager to the latest version is safe. For agents of any other cartridge type, consult the documentation of the respective cartridge types. DB_SQL_Server DB_Oracle DB_Oracle_RAC DB_Oracle_RAC_Instance DB_Auto_Discovery 4 Click the button Upgrade the selected Foglight Agent Managers. A progress bar appears. 5 After the upgrade is complete, click Next. The following screen is used for granting privileges to the users that were previously used for monitoring the instances shown in the table.

14 14 Foglight for SQL Server For further details and instructions regarding the functionality provided via this screen, see Defining the Connection Settings for the Monitored Instances on page 175.

15 1 The Foglight for SQL Server Instance Homepage The Foglight for SQL Server Instance homepage provides a quick and intuitive representation of SQL Server instance architecture and activity. Using this homepage allows efficient, real-time diagnosis and resolution of SQL Server operation and performance issues. The homepage comprises several panes, each of them relating to areas of the SQL Server's architecture through performance metrics. These panes are connected by a series of graphical flows that represent the logical process flows between the areas of SQL Server's architecture. The various graphical elements and metrics change color as their values move through a range of thresholds, and the data flows' values are updated in real time to illustrate the rate at which data is moving through the system.

16 16 Foglight for SQL Server Reviewing the Databases Dashboard The Foglight for SQL Server Instance homepage is launched via the Databases dashboard. To access the Foglight for SQL Server Instance Homepage: 1 Ensure that the navigation panel on the left is open. To open the navigation panel, click the right-facing arrow on the left. 2 On the navigation panel, click Homes > Databases. The Databases dashboard provides an at-a-glance view of the monitored environment. The agent status and instance alarm elements allow for a quick diagnostics of any troublesome activities. The Databases dashboard comprises the sections listed below. Currently selected database group table a list of all monitored databases within the database group that is currently selected in the Databases section. For details, see Currently Selected Group on page 18. The Databases section includes the components listed below. Database Groups includes by default the All list, which contains all of the existing databases. In addition, this component contains the Database Groups list, which serves as the parent group for creating user-defined sub-groups of database instances. Such sub-groups are recognized as Foglight services. For details, see Creating Custom Database Groups on page 21. The Database Groups section also displays the highest severity level of the database groups, under the column Sev. Services displays the configured services that contain at least one object (database topology) that is used by Foglight for SQL Server. All of the Foglight for SQL Server sub-groups, which were created via the Database Groups section, are displayed under Services. In addition, Services displays groupings of monitored resources that were created via the Service Builder dashboard, and contain Foglight for SQL Server database topology. The Services section also contains the column SLC (Service Level Compliance), which indicates the current availability of the selected service over a given period of time. For details about the Service Builder dashboard, see Foglight Online Help.

17 The Foglight for SQL Server Instance Homepage 17 Reviewing the Databases Dashboard Status summary a pie chart, which provides a visual representation of the health status of all databases listed in the Database Group table, including all SQL Server instances and (if relevant) all of the Oracle RACs, RAC nodes, and independent Oracle instances. This chart changes each time a different database group is selected from the Databases section. For details, see Status Summary on page 20. Database Group Table Status Summary Figure 1 Databases section Components Common to All Foglight for SQL Server Screens The following components are common to all Foglight for SQL Server screens and allow performing the following tasks: The Advanced button this button, which is found on the upper right corner of each table, allows creating a custom filter for the table. The filter is created by clicking Advanced and specifying the criteria that the various values should meet in order to be displayed in the table (having a specific name, exceeding a certain size, and so on). For detailed instructions and examples, see Foglight > Working with Dashboards > Working with Tables.

18 18 Foglight for SQL Server The Useful links link this link, which is found at the bottom left corner of each screen, allows carrying out further investigation via several external sources, as shown below. Currently Selected Group This section displays the group that is currently selected from the available database groups under the Databases section of the navigation pane. The Databases table columns are as follows: Name Description Database Sev Name Version Up Since Workload The SQL Server instance s highest severity alarm, which determines the instance s health state. The name of the SQL Server instance The version number of the SQL Server instance. The date and time when the SQL Server instance was last restarted. The workload graph for the SQL Server instance.

19 The Foglight for SQL Server Instance Homepage 19 Reviewing the Databases Dashboard Name Alarms Description The number of warning, critical, and fatal alarms for the instance. The dwell shows the most recent alarms invoked for the specific instance displayed in the row. The alarms are displayed by their severity levels, with the aggregated number for each severity. To view a detailed list of the alarms invoked for the specific instance, click any of the alarm icons displayed. The dialog box Outstanding Alarms appears, allowing to browse through the alarms. See the Foglight Online Help, Monitoring System-Wide Alarms for details on the alarm information. System Utilization Host CPU (%) Memory (%) Disk (% Busy) The name of the computer that hosts the SQL Server instance. The overall operating system CPU usage (including SQL Server). The amount of memory consumed by all operating system processes (including SQL Server), including both RAM resident memory and swapped memory. The percentage of time the busiest device spent serving systemwide input/output requests. This metric serves as a measure for the system I/O load. Agent State The operational status of the monitoring agent. When the agent instance is running, hovering over the State icon displays the status message Collecting Data. When the agent instance is running but not collecting data, hovering over the State icon displays one of the following status messages: Starting Stopped Stopping Unknown

20 20 Foglight for SQL Server Status Summary The values displayed in the Status Summary pie chart are as follows: Name DB Instances configured DB Instances down Description The number of database instances currently configured. The number of database instances that are currently configured, but are down. Pie Chart The pie chart provides a graphic representation of the monitored environment s current state, divided by the number and percentage of instances whose current health state belongs to one of the following categories: Fatal Critical Warning Normal Unknown

21 The Foglight for SQL Server Instance Homepage 21 Reviewing the Databases Dashboard Creating Custom Database Groups The Databases area of the navigation pane allows creating, editing and removing subgroups of database instances. The Edit Group button allows for adding or removing database instances from the sub-group. To create a database group: 1 Select the parent database instance group, Database Group, under Databases in the navigation pane. 2 Click the button. The Add Sub Group dialog box appears. 3 Type a name for the group in the Name field. 4 Type a description for the group (optional). 5 Select an instance in the Available column, and click [>] to move the instance to the Selected column. Alternatively, click [>>] to move all of the databases to the Selected column.

22 22 Foglight for SQL Server 6 Click OK. The sub-group name appears in the Database Groups list. The database instances are listed in the Databases pane. After adding one or more user-defined sub-groups, it is possible to add sub-groups to these sub-groups. To remove a database sub-group: 1 Select the sub group to be removed. 2 Click the button. The verification dialog box appears. 3 Click Remove. The sub-group is removed from the Database Groups list. To edit a database sub-group: 1 Select the requested sub group. 2 Click the button. The Edit Group dialog box appears.

23 The Foglight for SQL Server Instance Homepage 23 Viewing the Foglight for SQL Server Instance Homepage 3 To add an instance to the sub group, select the requested instance in the Available column and click [>]. The selected instance moves to the Selected column. 4 To remove an instance from the sub-group, select the requested instance in the Selected column, and click [<]. The selected instance moves to the Available column. 5 Click OK. Viewing the Foglight for SQL Server Instance Homepage The following image displays the main elements of the Foglight for SQL Server Instance Homepage window. The table that follows the image identifies each element, and provides a link to display more information, corresponding to the logical dataflow within Foglight for SQL Server Instance Homepage.

24 24 Foglight for SQL Server A - Instance Identification D - SQL Memory Pane F - Disk Storage Pane H - Alarms pane B - Sessions pane C - SQL Processes pane G - Background Processes pane E - Physical I/O Operations Figure 2 Part ID Part Name Explained in Section A Instance identification Identifying the Instance on page 25 B Sessions pane Monitoring General Sessions Statistics on page 28 C SQL Processes pane Monitoring Total Activity on page 30 D SQL Memory pane Monitoring the SQL Memory Management on page 33 E Physical I/O operations Tracking Physical I/O Activity on page 35

25 The Foglight for SQL Server Instance Homepage 25 Viewing the Foglight for SQL Server Instance Homepage Part ID Part Name Explained in Section F Disk Storage pane Monitoring the Disk Storage on page 37 G Background Processes pane Monitoring Background Processes on page 39 H Alarms pane Monitoring Alarms on page 40 The main groups (panes) of gathered icons and gauges, which represent the main activity areas in the SQL connection process, are as follows: Instance identification used for identifying the instance, its type, and operation time. See Identifying the Instance on page 25. Components representing instance data flow the main activity area in the Foglight for SQL Server Instance Homepage includes several panes and flows that represent the data flow in the SQL Server operation. The dataflow is described in this guide in a top-down design, namely: from the session to the physical disk storage. See Tracking the Instance Data Flow on page 27. Background Processes pane indicates the status of the SQL Server replication agent and the SQL Server support services. See Monitoring Background Processes on page 39. Alarms pane displays summarized alerts about metrics or workloads, defined in the Foglight for SQL Server Instance Homepage, which have exceeded their preconfigured threshold. If Performance Analysis Agent is installed, this pane displays also alarms regarding this agent s operation and status. See Monitoring Alarms on page 40. Identifying the Instance The Instance identification indicators allow identifying the currently monitored instance, its type and its operation period.

26 26 Foglight for SQL Server Instance name Instance pane Figure 3 These indicators are as follows: Instance Name identifies the currently monitored instance. Instance pane contains the following indicators: DB Type identifies whether the monitored database is SQL Server or Oracle. Version identifies the database version number, along with the most recently installed service packs. Up Since identifies the date and time when the instance was last started. Note In Foglight for SQL Server Instance Homepage, the only possible time range is the last 60 minutes. All values shown on the homepage screen display data collected during the last snapshot (20 seconds), while drilldowns display the data of the last hour.

27 The Foglight for SQL Server Instance Homepage 27 Viewing the Foglight for SQL Server Instance Homepage Tracking the Instance Data Flow SQL Memory pane Disk Storage pane Sessions pane Flow of data packets from the Client to SQL Server and back SQL Processes pane Dataflow to the logical memory (logical reads and compiles) Physical I/O operations The following screen components represent the data flow in the SQL Server operation, from the session to the physical disk storage: The Sessions pane allows examining user sessions only (excluding system and SQL Server Agent sessions). This pane displays the activity on the Client side, including number of Client computers that run SQL Server sessions and the flow of data (packets and batches of SQL Statements) from the Client to the Server and (in the case of packets) back. For details, see Monitoring General Sessions Statistics on page 28. The SQL Processes pane displays total activity (both system and user sessions) that is carried out on the SQL Server. This pane also contains other indicators of issues that may affect the transaction process, such as CPU usage and lock request rate, and allows accessing the error log. In addition, this pane allows tracking the rate of the data flow that would preferably be used by SQL connections - logical page reads, namely: referencing pages in the buffer cache. For details, see Monitoring Total Activity on page 30.

28 28 Foglight for SQL Server SQL Memory pane displays the size of the total SQL memory (both physical RAM and buffer pool), and allows ensuring that the SQL Server appropriately uses its dynamic memory management. The SQL Memory pane s indicators may point out inefficient memory management, which leads to unnecessary use of physical I/O operations. For details, see section Monitoring the SQL Memory Management on page 33. Physical I/O operations displays graphical representations of physical I/O activity. While such activity is necessary to carry out certain operations (for example, accessing a new table), a very high level of physical I/O activity may indicate poorly coded SQL or inadequate indexes, which prevent logical reads. For details, see Tracking Physical I/O Activity on page 35. Disk Storage pane displays the state of the physical disk storage, namely: databases and their backup, data files, and log files. This pane features indicators that refer either to lack of disk space (when a data file is close to reaching its predefined storage ceiling), or performance issues such as high disk queue length. In addition, the Disk Storage pane displays the Log Flush wait time alarm, which may indicate an issue with the logical disk activity. For details, see section Monitoring the Disk Storage on page 37. Monitoring General Sessions Statistics The Sessions pane monitors only the user sessions, namely: all sessions that are not system or SQL Server Agent sessions. Using this pane allows viewing the response time compared with the number of user sessions and the instance s level of activity. A high response time value may result from a long queue, that is: a too high percentage of active users. Long queues can indicate one of the following issues: A massive workload the system handles more users than it was initially designed to do. A bottleneck users cannot carry out their transactions and, as a result, cease to be active.

29 The Foglight for SQL Server Instance Homepage 29 Viewing the Foglight for SQL Server Instance Homepage The Sessions pane displays several parameters, as presented in the following table. Parameter Response (ms) Sessions Computers Active Sessions Active Users Percentage Description The time (in milliseconds) that elapses from the moment a query, which is supposed to represent the general workload, is submitted, until the application indicates that the query was executed. The number of SQL Server user (non-system) sessions, excluding SQL Server Agent sessions. The number of Client computers that currently run at least one SQL Server session. The number of non-system sessions that are actively processing in SQL Server, or are waiting on locks (blocked). The percentage of SQL Server sessions that are active (executing), or waiting on locks (blocked). Issues indicated by this pane are mainly investigated in the SQL Activity drilldown. As the response time is usually the starting point for investigation, the Response parameter leads to the SQL Summary panel in the SQL Activity drilldown, the other parameters in this pane lead to the Sessions panel in this drilldown. For details, see sections Reviewing the SQL Server Instance Activity on page 73 and Viewing Detailed Sessions Data on page 83, respectively, in the chapter Reviewing SQL Activity on page 69. The Client applications represented graphically in the Sessions pane communicate with the SQL Server by sending and receiving network packets and by submitting SQL

30 30 Foglight for SQL Server statements for execution by SQL Server. The flows, detailed in the following table, help indicate performance issues if their values are too low. Flow Network packets sent Network packets received Batches Description The rate at which network packets are being sent from SQL Server to Client applications. When this icon s color is yellow, clicking it displays text that describes the deviations that triggered this display, along with a graphic representation of the rate at which SQL Server is encountering network packet errors. The rate at which network packets are being received by SQL Server from Client applications. When this icon s color is yellow, clicking it displays text that describes the deviations that triggered this display, along with a graphic representation of the rate at which SQL Server is encountering network packet errors. The rate at which batches of SQL statements are being submitted to SQL Server for execution. Monitoring Total Activity The SQL Processes pane allows monitoring the following phase of the data flow within the SQL transaction operation flow: processes run by the SQL Server, both system and user sessions. This pane also features other performance indicators, such as total number of lock requests per second and CPU usage, and allows accessing the error log. The SQL Processes pane displays the following parameters: Parameter Total Description The total number of SQL Server processes, comprising both user and system processes.

31 The Foglight for SQL Server Instance Homepage 31 Viewing the Foglight for SQL Server Instance Homepage Parameter System User Blocked Processes Description The total number of current SQL Server System processes, namely: all background and foreground processes run by the SQL Server, the SQL Agent services or any other non-user session. This includes also processes that carry out physical disk-related operations, such as Checkpoint and Lazy Writes. The number of SQL Server user (non-system) processes, excluding SQL Server Agent sessions. Number of processes that are waiting for another process to release a resource that the process is currently locking. Blocked processes can sometimes lead to bottlenecks. The Blocked Process indicator changes its color when one or more processes become blocked. For details, see Blocking Alarm on page 207 and Deadlocks Alarm on page 208. Error Log The SQL Server and SQL Agent error logs (in SQL Server 2000, SQL Agent error logs are not enabled). When scanning is enabled, Foglight for SQL Server scans the SQL Server logs and raises alarms upon finding error messages that contain any of the error log alert rules. These rules can be specified for all connections or for the current connection via the Log Scanning screen in the Global Administration. For details, see Defining Error Log Scanning on page 186. Hovering over this icon displays the number of errors that were recorded in the SQL Server error log during the selected time range (by default, last 60 minutes). For details about the error log alarms, see Error Log Alarm on page 210.

32 32 Foglight for SQL Server Parameter CPU Usage Description The CPU Usage spinner represents the total percentage of CPU resources being used on the currently monitored computer. For further details, see Reviewing the SQL Server Instance Activity on page 73. To communicate with the SQL memory, the SQL processes use logical reads and compiles, graphically represented as flows in the homepage. Tracking Logical Reads The flow from the SQL Memory pane to the SQL Processes pane indicates the rate at which pages in the buffer cache are being referenced by SQL connections (logical page reads). Normally, the majority of logical reads is satisfied from the cache, but if the required page is not yet in the cache, it is read from disk. For details, see section Viewing the SQL Server I/O Activity on page 74. Tracking Compiles Figure 4 The display indicates CPU consumed by all Windows processes, not just SQL Server. This component spins faster as CPU consumption increases. CPU overload significantly degrades the system s performance, and may indicate excessive physical I/O operations. The Compiles section displays the rate of SQL compilations and re-compilations per second. Preferably, the most frequently used executable query plans should be retrieved from the procedure cache, thereby saving the need to compile, significantly reducing the utilization of CPU resources and speeding up the response time of SQL Server queries. Re-compiling, which is a CPU-intensive process that may degrade performance, can in certain cases be avoided through sound coding practices.

33 The Foglight for SQL Server Instance Homepage 33 Viewing the Foglight for SQL Server Instance Homepage When many recompiles take place, the SQL Server s CPU can become overloaded, thereby slowing down everything running on that computer. As a result, the Recompiles alarm is invoked. For details, see Recompiles Alarm on page 209. The Call Rates chart, displayed in the SQL Summary panel of the SQL Activity drilldown, details the use of compiles and re-compiles during the last 60 minutes. For details, see Monitoring the Call Rates on page 77. Monitoring the SQL Memory Management The SQL Memory pane allows monitoring the SQL Server s dynamic memory management and ensuring its proper handling of the buffer pool. Each page of memory used by SQL Server is assigned to one of several caches. Each cache grows and shrinks in size as required. The main caches are the Buffer Cache, which stores a copy of the SQL Server s most recently used database pages, and the Procedure Cache, which holds recently compiled query execution plans. Both these cache types should satisfy I/O requests and save the need for physical reads from the disk. The Buffer cache s efficiency also affects the Page Life Expectancy, another indicator displayed in the SQL Memory pane. The SQL Memory pane displays several parameters, as presented in the following table. Parameter Total Max Memory Percentage Description Text displaying the total amount of memory, either fixed or dynamically allocated that the SQL Server is currently using. When the amount of SQL Server memory available for immediate reuse drops below a threshold, the Free Buffers alarm is invoked. For details, see Free Buffers Alarm on page 212. Text displaying the amount of memory currently being used by SQL Server as a percentage of the maximum amount of memory that the SQL Server is configured to use. The maximum memory is the lower of two values: either SQL Server's max memory setting or the amount of physical RAM on the server.

34 34 Foglight for SQL Server Parameter Memory Usage Buffer Cache Size Buffer Cache Hit Rate Description A gauge displaying the total amount of memory, either fixed or dynamically allocated, which the SQL server is currently consuming, scaled against the maximum amount of memory it can use. By default, SQL Server manages its total memory automatically, adjusting it to the varying memory requests of both SQL Server processes and Windows processes. Clicking this gauge allows accessing the page in the Memory drilldown that provides an in-detail view of SQL Server s memory management. For details, see section Viewing the Memory Summary on page 57. Text displaying the amount of memory currently allocated to the buffer cache, including database, free, and stolen pages. The buffer cache, which is an in-memory copy of recently used database pages, is normally the largest memory cache used by SQL Server. The value of this metric is calculated as follows: <pages> * 8K / 1024 A gauge displaying the percentage of database page I/O requests that were satisfied from the buffer cache a memory area used by SQL Server to hold recently accessed database pages. If an SQL process needs to access a database page, finding this page in the buffer cache spares the SQL Server the need to read the page from disk, thereby significantly reducing the amount of disk I/O and speeding up queries. High buffer cache hit rate indicates that SQL Server efficiently uses the memory allocated to its buffer cache. Low buffer cache hit rate, on the other hand, indicates that SQL Server is finding fewer pages already in memory, resulting in the need to perform more disk reads. When low buffer cache hit rate is indicated, the Buffer Cache Hit Ratio alarm is invoked. For details, see Buffer Cache Hit Ratio Alarm on page 211.

35 The Foglight for SQL Server Instance Homepage 35 Viewing the Foglight for SQL Server Instance Homepage Parameter Page Life Expectancy Procedure Cache Size Procedure Cache Hit Rate Description Text displaying the current Page Life Expectancy, namely: the length of time in seconds that a database page stays in the buffer cache before it is flushed out. Small values indicate that the buffer cache retains pages for short periods, as a result of high data cycling, and that the buffer cache is not being effective. Microsoft recommends 300 seconds as the minimum value for this metric; any less is indicative of a shortage of memory. For details, see section Page Life Expectancy Alarm on page 213. Text displaying the amount of memory currently allocated to the Procedure Cache, a memory area used by SQL Server to hold recently compiled query execution plans stored procedures, triggers, ad hoc SQL, and so on. The value of this metric is calculated as follows: <pages> * 8K / 1024 A gauge displaying the percentage of procedure cache lookups that found the required plan already in the cache. If a matching plan is found, SQL Server does not need to compile the query/stored procedure. This can save a significant amount of CPU resources, and can speed up SQL Server queries. A low Procedure Cache hit rate may lead to performing extra compilations, thereby degrading SQL Server performance by causing extra CPU load. In a such situation, the Procedure Cache Hit Ratio Alarm is invoked. For details, see Procedure Cache Hit Ratio Alarm on page 213. The procedure cache hit rate is the average hit rate for all procedure cache object types, except for ad hoc SQL. This rate is calculated using a differential sampling method, which gauges only the last few sampled periods. Tracking Physical I/O Activity The physical I/O Operations section of the Foglight for SQL Server Instance Homepage displays graphical representations of the number of pages physically read from and written to disk by SQL Server.

36 36 Foglight for SQL Server In addition, this section allows viewing the SQL Server processes Checkpoint and Lazy Writes. Parameter Physical Reads Physical Writes Read Ahead Reads Checkpoint Page Writes Description A flow representing page reads from the disk per second. Physical reads are used when a connection requests a page that is not already in the buffer cache. Physical read operations are necessary when accessing new table or index pages. Nevertheless, these operations should be avoided when possible, as requested pages should reside in the SQL Server buffer cache. A flow representing data/index pages written to disk per second. Normally SQL users do not have to wait for database write operations to complete. Most modifications to database pages are made in the buffer cache. A flow representing pages per second being read from disk before they are requested, using the Read Ahead process. Read Ahead can improve queries performance when accessing a new table or an existing table with a new filter. However, a high level of Read Ahead activity may indicate poorly coded SQL statements or inadequate indexes. For details, see the glossary definition of Read Ahead on page 254. A flow representing the number of log pages per second being written to disk by the Checkpoint process, which periodically flushes all modified pages from the buffer cache out to disk. Checkpoint writes are carried out at intervals, which are defined by the recovery interval parameter. If this parameter s value is too high, the Checkpoint process may run infrequently, thereby overloading the lazy writer process. High value of checkpoint page writes can result from issues such as the database being in log-truncate mode. In addition, poorly tuned checkpoint duration parameter can adversely affect the response time. For details, see the glossary definition of Checkpoint Process on page 235.

37 The Foglight for SQL Server Instance Homepage 37 Viewing the Foglight for SQL Server Instance Homepage Parameter Lazy Writes Log Flushes Description A flow representing the rate per second of buffer pages that have been modified in the Buffer Cache, which the Lazy Writer process is flushing to disk. High value of lazy writes may indicate that SQL Server is running out of available space in the buffer pool cache. For details, see the glossary definition of Lazy Writer on page 246. A flow representing the number of log pages per second being written to disk by the Log Writer process. For details, see the glossary definition of Log Writer on page 247. For details, see section Monitoring the SQL Server Physical I/O Activity on page 78. Monitoring the Disk Storage The Disk Storage pane displays the status of the storage devices in the SQL Server system, namely: databases and their backup, data files, and log files. Using this pane allows identifying storage issues such as a database that has not been backed up or a data file that has almost exhausted its growth potential and is going to fill completely. In addition, the Disk Storage pane displays the Log Flush wait time alarm, which may indicate excessive I/O operation. Parameter Databases Description The total number of available databases in the currently monitored SQL Server instance. This icon displays an alarm when one or more of the databases becomes unavailable, or if any database has not been backed up in the last few days. For details about handling these alarms, see Recent Backups Alarm on page 219 and Database Unavailable Alarm on page 219.

38 38 Foglight for SQL Server Parameter Data Files Description The total number of data files in all databases of the currently monitored SQL Server. The disk icon represents the total percentage of currently used space within the entire capacity of all data files that reside on all databases. The total percentage is also displayed in text at the bottom of this section, below the text that displays the physical size of data files space used. Data files space used Data file percentage used Figure 5 Additional indicators in this section display the total number of files and file groups in all of the Databases in the currently monitored SQL Server instance. Log Files The log files in all databases of the currently monitored SQL Server. Log file space used Log file percentage used Figure 6 The disk icon represents the total percentage of currently used space within the entire capacity of all log files that reside on all databases. The total percentage is also displayed in text at the bottom of this section. In addition, this section displays the physical size of log files space used and the total number of log files.

39 The Foglight for SQL Server Instance Homepage 39 Viewing the Foglight for SQL Server Instance Homepage Parameter Disk Activity Description Windows disk activity for all disks. This gauge displays the highest disk queue length for all logical disks on the Server. Values that exceed the threshold set in this metric indicate a bottleneck. Monitoring Background Processes The Background Processes pane displays the status of optional SQL Server components, such as the Replication Agent, which is implemented as a job of SQL Server Agent service, and several of the SQL Server support services. Some of the supporting services significantly enhance the database efficiency and accuracy, and therefore should be active at all times (for example: DTC, which ensures successful and complete transactions). Indicator Replication Services Description Indicates whether the SQL Server Replication is configured. If replication is configured, indicates whether the replication was carried out successfully or failed. Replication is an optional component of SQL Server, which synchronizes data between different SQL Server databases. Status of the SQL Server's supporting services that are currently monitored. These services are supplementary to SQL Server and provide capabilities such as mail and full text search. This icon invokes an alarm when any of SQL Server's supporting services are installed, but not active. For details, see Alarms Displayed in the Background Processes Panel on page 215. For details about the drilldowns used for handling the supporting services alarms, see Reviewing the Support Service Status on page 137.

40 40 Foglight for SQL Server Monitoring Alarms The Alarms pane displays an indicator of the Performance Analysis Agent status, as well as the Alarms table. The Alarms table displays an alarm count, which shows the total number of alarms that were active (not cleared) in the course of the reporting period, namely: the last 60 minutes. The alarms are divided into the following types: Advisories provide information about how to enhance the database s performance. Changes provide change tracking information. Agent provides information about changes in the agent status. Thresholds displays alarms about metrics or workloads, displayed in the Foglight for SQL Server Instance Homepage, which have been exceeded. Except for Thresholds, all alarms are generated only when Performance Analysis Agent is installed. When metrics or workload resources behave normally, without any deviations, the alarm graphic representation is displayed in gray. When a configured baseline or threshold has been exceeded, alarms are displayed in colors that represent levels of severity, ranging from blue to red. Indicator Description The following indicators apply to all of the alarm types, including Thresholds. Yellow (Warning) Orange (Critical) Red (Fatal) The metric (or workload resource) has exceeded the configured threshold or deviated from the baseline. The metric (or workload resource) has significantly exceeded a threshold or extremely deviated from the baseline. The SQL Server is not responding, thereby triggering a fatal alarm.

41 2 Adding and Configuring Agents Enabling Foglight Management Server to monitor SQL Server instances requires creating the Foglight agents that monitor these instances and ensuring that these agents communicate properly with Foglight Management Server. Foglight provides a method for creating agents and editing their properties. This method is carried out via the Agent Administration view (see chapter About the Foglight for SQL Server Agent in the Foglight for SQL Server Reference Guide). However, Foglight for SQL Server s installation package, which installs also the Automatic Discovery cartridge, allows creating multiple agents via a database discovery wizard. This wizard provides a common entry point for adding and discovering all of the database instances within a user-specified range, and then configuring these instances to be monitored. This chapter contains instructions for using the database discovery wizard, as well as the steps that should be taken for monitoring the newly added database instances.