Who is my SAP HANA DBA? What can I expect from her/him? HANA DBA Role & Responsibility. Rajesh Gupta, Deloitte. Consulting September 24, 2015

Transcription

1 Who is my SAP HANA DBA? What can I expect from her/him? HANA DBA Role & Responsibility Rajesh Gupta, Deloitte. Consulting September 24, 2015

2 Introduction Rajesh Gupta - rajgupta@deloitte.com Lead SAP HANA Architect, Deloitte Consulting LLP Over 21+ years of consulting experience with around 15+ years in SAP and over 6 Year as Oracle DBA. Rajesh is a lead SAP HANA/NW/BASIS & OS/DB Certified Consultant SAP HANA Distinguished Engineer ASUG HQ - Enterprise Architecture SIG Group Community Facilitator Extensive background in SAP HANA, SAP upgrades, Unicode conversions and OS/DB Migrations. 2 The Deloitte Solutions Network (SNET) Collaborating for success This presentation Copyright should not be 2015 interpreted Deloitte as Development a LLC. All rights reserved. representation about or endorsement of any third party products, including SAP software

3 Agenda Most Common Question from clients SAP HANA Database Administration overview Tools for HANA Database Administration Periodic housekeeping task Performance Tuning Troubleshooting tips 3 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

4 Most Common Question from clients Who is going to manage and operate the HANA database? What skill sets it required? What should we do with our existing DBA s? Can we covert our existing SQL, Oracle or DB2 DBA to HANA DBA? Will HANA reduce the DBA needs? What s the percentage of workload reduction? 4 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

5 SAP HANA DBA Role and Responsibilities Sizing and Architecting Installation and apply HANA support packs/revisions. Update HANA content/ libraries. Starting and stopping Day to day operational support Backup and recovery Cleaning up logs Install and configure SLT server and connections. Install and configure ECC add-on for SLT server. Manual data upload from flat files. HANA DBA Change Management System Refresh Database Renaming Patching HANA DB HANA DBA SAP Basis Linux Admin Full proof coverage for HANA Database Instances Collaborative job Leading technology 5 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

6 Training and Certification for HANA Database Admin Any DBA can be easily converted to HANA DBA by going through the following SAP training and certification Latest available training & Certificaton (SAP HANA SPS09) Free Online Training - Open SAP 6 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

7 SAP HANA DBA Tasks HANA Data base monitor Monitor over all system and alert and resource utilization On-Demand Tasks Daily Tasks Security &Authorizations Create user and assign roles and privilege Cleanup Logs Old DIAGNOSIS/Log FILES & Archive or cleanup of backup files system Routine Operation tasks Monthly Task DBA operation Start/stop SAP, Restart DB service, Configure parameter Fine Tuning HANA DBA 7 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

8 The SAP HANA DBA operational task Logging and tracing Activate and analyze database/jdbc logging and tracing. Performance/Kernel tracing (Only for SAP developers) SQL tracing. Activate and analyze expensive SQL trace. Define Audit policy Backup and Recovery Execute manual on-demand backup. Schedule automatic regular backup. Perform on-demand DB recovery. Checking current license. Request and install license. License Administration System upgrade and update Apply HANA support packs/revisions. Update HANA content/libraries. Distributed landscape Adding or removing additional hosts. Host failover. Table partitioning. Table redistribution. Alert Configuration. Configure alert threshold. Configure notification. Data Provisioning & Config Install and configure SLT server and connections. Install and configure ECC add-on for SLT server. Manual data upload from flat files. Change transport. Migrate HANA Delivery Unit (Export-Import). Migrate HANA packages. Migrate HANA Development artifacts (Attribute view, Calculation view etc.)

9 Tools for HANA Administration Three main tools ª HANA Studio, DBACOCKPIT, HANA Studio: runs on the Eclipse platform 3.6 (included) and runs on Windows 32 or 64-bit platforms from your laptop/desktop, as well as SUSE Linux 11; it is installed using hdbsetup Requires Java JRE 1.6 or 1.7 to run; run 32 or 64-bit to match your studio DBACOCKPIT : Run on an ABAP system is also used as an Administration tool for HANA. The Solution Manager system is a good choice to configure and run this tool. It requires the Diagnostic Agent on HANA to connect to the LMDB of the Solution Manager system. Solution Manager (7.1 SP04 or greater) administration and monitoring is also used to assist with the HANA system, including end-to-end diagnostics HDBSQL Command line tool HANA Studio is the primary tool for Administration of HANA and also the primary tool for developers and includes the SQL tools for HANA 9 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

10 DBA Cockpit In the ABAP system ª transaction DBACOCKPIT, very similar to the HANA Studio Used for Administration Tasks ª Scheduling backups, some configuration changes Performing Monitoring Tasks ª Detailed views of Services, Volumes, Performance Alerting ª Critical monitoring allow 10 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

11 Using the HDBSQL Command Line Tool HDBSQL is a command line tool for: Executing SQL statements Executing database procedures Retrieving data about the Database Catalog Executing Shell Commands Call Options and Commands Run from command line /usr/sap/hdbclient/hdbsql or launch from within the HANA Studio Refer to the HANA Admin Guide and SQL Guides Example: 11 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

12 HANA Studio - Common Admin Tasks Starting/Stopping the database Backup and Recovery of the instance Monitoring of the system and checking the status of the system Making the parameter changes for the configuration of HANA Problem analysis and troubleshooting Main tool for user and role management and security Managing multiple HANA systems from one console Daily checks are performed Quick access to the SQL Console Checking for Alerts 12 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

13 HANA Studio Administration Tasks Both Administrators and the Developers use the same Studio tool to do their work The Studio uses perspectives to present its tools Use the Administration Console perspective to: Start and Stop services Configure system settings Manage users and authorizations Manage licenses Monitor the system (logs, alerts) Monitor disk space Perform backups (and recovery) 13 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

14 HANA Studio Administration Console Daily checks always include the Overview Screen in the Administration Console Perspective Check All Services Started, Alerts and Messages, the Memory, CPU, and the Disk Usages Choose Overview to view the overall status, memory Choose the system Memory Usage Alerts 14 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

15 Using the Administration Console for Memory Memory is the main resource of the HANA database (memory pool) and is managed by its own memory manager Monitoring views and memory indicators are used to understand HANA memory usage Indicators include used memory and peak used memory External indicators can be misleading, such as the size of memory at the host level 15 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved. Source: SAP

16 HANA Studio Administration Console On the Landscape tab, check if all the services are running On the Alerts tab, view the details and priority of the alerts 16 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

17 HANA Studio Administration Console (cont.) Performance tab is important to see the activities on the database and perform system analysis Check the active threads, sessions, blocked transactions, SQL plan cache, expensive statements, job progress, and the load in graphical views 17 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

18 HANA Studio Administration Console Critical changes to configuration are performed here Properties of the HANA system are defined in the parameters of grouped configuration files Example shows changes made to the persistent store path of the data and log volumes on the disk 18 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

19 HANA Studio Administration Console (cont.) System Information and Diagnosis Files tabs provide quick and easy access to common queries about the system and to the logs and traces. Traces are set up in the Trace Configuration tab. 19 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

20 Periodic HANA Housekeeping Tasks and Checks Check the volume configuration (file systems, data and log volumes) Running the reclaim SQL command to reclaim disk space of currently unused log, data volume, version space and data space etc. after major data deletion. Make sure it is backed up; check the logs Check the system status and overall system state, Check the main processes/ services Check and review the Alerts, Logs, and Diagnosis files and Traces (look at warnings and critical messages) Check the performance (threads, SQL Plan Cache, Expensive Statements, Job Progress, Load) Check the file system on the Linux system running HANA; make sure it is not approaching full 20 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

21 Other Administration Tasks Take time to become familiar with the configuration parameter settings and validate that the settings are optimal for your environment Monitoring the memory usage is important. Memory is a fundamental resource of the database and understanding how the database requests, uses, and manages this resource is crucial. HANA Transport System Copy and refreshes Monitor the replication and extractors from other systems SLT monitoring using transaction LTR in the SLT ABAP system Verify the connections are working for the SAP Data Services and SAP BusinessObjects tools. Verify the services are running on these tools. Create a good detailed landscape diagram to assist in troubleshooting connectivity issues 21 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

22 Improved Monitoring and Supportability- SP09 &SP10

23 Improved Monitoring and Supportability SAP HANA Cockpit and SAP DB Control Center 23 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

24 Memory Overview (Since SP07) Launched from the HANA Studio One of two new monitoring views Requires new security role added sap.hana.admin.roles::monitoring 24 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

25 Improved Monitoring and Supportability Launched from the HANA Studio Requires new security role added HANA SP10 Hana SP9 25 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

26 Improved Monitoring and Supportability SAP HANA Cockpit Database status 26 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

30 Improved Monitoring and Supportability SAP HANA Cockpit Further Tiles 30 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

32 HANA DBA Operation

33 Operating HANA Configuring and using the HANA Studio Configuring the HANA database Maintaining global.ini file Maintaining Properties in HANA Studio Maintaining Preferences in HANA Studio Organizing the system landscape Managing Transports Starting and stopping the database Backup and restore/recovery 33 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

34 SAP HANA Operating system Processes Daily checks always include HANA Process Overview Check All Services Started, System Performance, Memory, CPU Usages 34 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

35 Starting and Stopping the HANA Database To be able to start and stop an SAP HANA database system, you must have the credentials of the operating system administrator (user <sid>adm) The SAP Start service (sapstartsrv) is the standard SAP mechanism for starting and stopping systems. It starts and stops all necessary system components, such as the name server, preprocessor server, and index server. Stopping SAP HANA database (three methods): Using sapcontrol as root ª /usr/sap/hostctrl/exe/sapcontrol nr <Instance_Number> function Stop Using HDB as <sapsid>adm ª /usr/sap/<sapsid>/<instance_name>/hdb stop Using the Administration Console Starting SAP HANA database (three methods): Using sapcontrol as root ª /usr/sap/hostctrl/exe/sapcontrol nr <Instance_Number> function Start Using HDB as <sapsid>adm ª /usr/sap/<sapsid>/<instance_name>/hdb start Using the Administration Console 35 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

36 Managing HANA Transports Use HANA Application Lifecycle Manager for Native HANA Content HANA standalone transport management No need for ABAP footprint Lightweight and easy to use transport tool Use Enhanced CTS (CTS+) for Native HANA content or as part of a solution Transported like any other non-abap content Integrated in existing CTS transport landscape Can be integrated in SAP process tools such as ChaRM and QGM HANA Transport Container for HANA content exclusively used by ABAP Transported with standard ABAP transports 36 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

37 Backup and Recovery of SAP HANA User performing the backup must have authorizations BACKUP ADMIN and CATALOG READ During backups, the database is available as usual During recovery, the database is not available to end users and operations It is important to back up after the initial load into HANA database and at regular intervals Data and logs are backed up independently of each other During data backup, only the payload of all data volumes of all services (name server, index server, statistics server) that belong to a database is written to service-specific backups Source: SAP 37 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

38 Steps to Back Up the Database The steps to back up the database include: Database must be online (all services up and running) Set the destination of the backups and logs using the HANA Studio configuration tab and data backup settings Determine the space for the backups using command select sun(allocated_page_size) from M_CONVERTER_STATISTICS and make sure enough space exists for the backups Create a data backup of the database; this is done manually or scheduled and is carried out by using the HANA Studio, the DBA Cockpit, or SQL commands at the command line Configure when logs are backed up. Logs are backed up automatically. This is done using the DBA Cockpit to schedule them or by using SAP scripts to be executed on a schedule. 38 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

39 More Back-Up Information Backups can be written to the file system or using a third-party backup tool (using backint to access third-party tools) Administrator can back up the database with only a few clicks, and the system does the rest automatically: All the relevant service-specific data is backed up, regardless of whether your system has a single node or multiple nodes Please note that backup mode overwrite will only restore save points and not the logs saved between the save points To support point-in-time recovery, set backup mode as normal and not overwrite Scripts are commonly used to perform backups and help automate the process 39 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

40 HANA Database Recovery Using data and log backups (and if available, log entries from the log volumes), the SAP HANA database can be recovered Recovery may be necessary in one of the following situations: Data area is unusable Log area is unusable Logical error The recovery process of the SAP HANA database causes the database to be shut down. Therefore, during recovery, the system is not accessible for end users or applications. 40 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

41 System Copy of HANA Homogenous copy of a database is possible by recovering an existing source database backup to a different compatible target database Target database must be the same or a higher version level Target database must be configured with sufficient disk and memory capacity and identical configurations (same # of hosts, # of services) This is a quick way to set up cloned systems for training, testing, and development The SID and hostnames are adapted during the recovery process Target database is started at the end of recovery The source database backup consists of both the data files and the log back-up files No impact on running source system or processing since this is executed only on the persistence level New license key required on the target system 41 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

42 Security Maintaining Users and Authorizations Security in the HANA environment is quite different from prior SAP environments Instead of User Security being done with SU01 and PFCG, security is done within the HANA Studio All access to data and execution of actions in the database requires authorization Privileges control what users can do. Privileges can be assigned both to roles and users. Some privileges are built-in, others are created in the design time environment of SAP HANA ( repository ) and need to be activated before they can be assigned. There is a privilege concept for both design time (developer use case) and runtime. Privilege types: System privileges: Authorize execution of administrative actions, apply systemwide SQL privileges: Authorize access to data and operations on individual database objects Analytic privileges: Authorize read access on SAP HANA reporting views at run-time; row-level access based on dimensions of the respective view (analytical, calculation, attribute), both static and dynamic values Repository privileges: Authorize access in the repository (modeling environment) at design time 42 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

43 Alert, Log &Traces

44 Analyze Logs, Traces, and Performance Using HANA Studio Check the System Information, double-click each task to execute the SQL command and display the result Check the Diagnosis files, double-click each log file to see the content Activation and Deactivation of traces is done from the Trace tab on the Admin Perspective. Click the Edit button next to each trace to see the details. Turn on traces when encountering problems with the HANA system. Monitor disk space that is used for diagnosis files Monitor performance using the HANA Studio and DBA Cockpit 44 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

45 Database Alerts Actively monitor the status of the system, the services, and the consumption of the resources it uses with the alerts. Alert tab in the Admin perspective in the HANA Studio tool. Alerts for critical situations: Disk is becoming full CPU usage is reaching a critical level Memory usage Services inactive or restarted The statistics server is the main component of the monitoring infrastructure and collects information about status, performance, and resource usage from all components of the database The statistics server issues an alert based on the priority level of the alert (example low priority alert for 90% disk space used and critical alert for 98% used) 45 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

46 HANA Performance Tuning, Housekeeping and Troubleshooting

47 HANA Performance Checks Check how many threads are running, what are they working on, and are any of these threads blocked Check if sessions are blocking current transactions Check if any operations are running for a significantly long time and consuming a lot of resources Compare different hosts in terms of performance Check for blocked transactions or transaction blocked threads since these can impact application responsiveness Check active/inactive sessions and their relation to applications Check statistics like average query runtime Check for long running jobs that are running for an excessively long time and consuming a considerable amount of resources Analyze SQL traces, expensive statements, and SQL plan cache 47 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

48 HANA Performance Checks Delete old audit data from the SAP HANA database audit table. Reorganizing and reclaiming data and log volume spaces, Reclaim disk space of currently unused log segments. Freeing up the unused space inside a SAP HANA database disk. Row store memory reorganization at runtime - ALTER SYSTEM RECLAIM DATA SPACE Table Placement changing the table placement properties for performance, such as MIN_ROWS_FOR_PARTITIONING, INITIAL_PARTITIONS, REPARTITIONING_THRESHOLD, and LOCATION. Cleaning statistics server table, Best practice is to delete alerts that are older than 42 days. statistics server table _SYS_STATISTICS.STATISTICS_ALERTS_BASE is used to store the alert history. Refer SAP note: SAP HANA DB: Big statistics server table leads to performance impact on the system 48 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

49 Troubleshooting SAP HANA Monitor the operational status and resource usage of components such as the index server, name server, and statistics server Monitor the memory usage in the database, as this is a crucial part of the system Backup Log File needs to be reviewed. Go to the diagnosis files area in the HANA Studio tool to review these logs. Ensure there is enough disk space on the disk for data and log volumes (use the Volumes tab in the Admin perspective of the studio) Monitor the host status and failover configuration. Use the Landscape ª Services of the Admin perspective in the HANA Studio. 49 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

50 Troubleshooting HANA Database Issues Using the HANA Studio: Check log and trace files for errors (Diagnosis Files tab) Turn on and configure several traces (Trace Configuration tab) May need to open SAP OSS connection for assistance and send logs to SAP using download files (uses zip format) Crashdumps may be collected and analyzed Note: Monitor disk space that is used for diagnosis files and delete files that are no longer needed located in à /usr/sap/<sid>/hdb<instance>/<host>/trace 50 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

51 Troubleshooting Log Full Situations Avoiding LOG FULL (file system full) situations When the log is backed up, the backed up log segments remain on disk until they have been released automatically after a savepoint After the log has released, the oldest unused log segment can be overwritten with new log entries If there are no unused log segments, new log segments are created If the disk becomes full and no more log segments can be created, a log full situation arises When the log is full, no more logging is possible until the log backup has completed Solution ª Automatic log backup prevents log full situations from arising Do not delete log segments on the operating system level, as the log area will become unusable and the database may stop working 51 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

52 Troubleshooting Backup area full Situations Avoid log backup area becoming full Regularly archive old log backups to a different location using operating system commands Monitor disk space that is used for diagnosis files (Diagnosis Files tab) Use SAP HANA Studio to delete diagnosis files that are no longer needed 52 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

53 Contact Us Rajesh Gupta, Deloitte Solution Network (SNET) SAP Lead General enquiries: Follow us on 53 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved.

54 This publication contains general information only and Deloitte is not, by means of this publication, rendering accounting, business, financial, investment, legal, tax, or other professional advice or services. This publication is not a substitute for such professional advice or services, nor should it be used as a basis for any decision or action that may affect your business. Before making any decision or taking any action that may affect your business, you should consult a qualified professional advisor. Deloitte shall not be responsible for any loss sustained by any person who relies on this publication. As used in this document, "Deloitte" means Deloitte Consulting LLP, a subsidiary of Deloitte LLP. Please see for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. Certain services may not be available to attest clients under the rules and regulations of public accounting. Copyright 2014 Deloitte Development LLC. All rights reserved. 36 USC Member of Deloitte Touche Tohmatsu Limited 54 The Deloitte Solutions Network (SNET) Collaborating for success Copyright 2015 Deloitte Development LLC. All rights reserved. 54