Automate Your BI Administration to Save Millions with Command Manager and System Manager

Transcription

1 Automate Your BI Administration to Save Millions with Command Manager and System Manager Presented by: Dennis Liao Sr. Sales Engineer Date: 27 th January, 2015

2 Session 2 This Session is Part of MicroStrategy World Track 6: Enterprise BI I

3 MicroStrategy s Administration Product Suite MicroStrategy Leads with a Comprehensive Set of Administration Tools Source Cindi Howson, BI Scorecard Strategic and Product Summary

4 MicroStrategy s Administration Product Suite MicroStrategy System Manager MicroStrategy Command Manager Create Automated Workflows ` Create Automated Scripts MicroStrategy Enterprise Manager Monitor Performance and Utilization MicroStrategy Integrity Manager Automate Regression Testing MicroStrategy Object Manager Coordinate Change Management

5 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

6 The Need for Automated Administrative Processes Manage Daily Operations Upgrade Metadata Monitor User Activity Manage Security Ensure Data Integrity Troubleshoot System Errors Fine-tune BI System Modify Intelligence Server Settings Manage Scheduled Requests Bulk Manipulation of Objects

7 THE PROBLEM: Most Tasks Are Repetitive, Manual and Laborious, and Time Consuming Typical Time Spent* (manual hours) Server Maintenance 750 Change Migration 1600 Project & Metadata maintenance 500 Customization Deployments 200 Upgrades, Patches Application to 90% of Daily Administrative Tasks Can Be Automated Saving Time and Effort *Based on sample use cases

8 Agenda Two Administrative Products for Automating Manual Processes MicroStrategy Command Manager Create scripts for automated metadata administration MicroStrategy System Manager Design workflows to automate multi-step, manual processes

9 MicroStrategy Command Manager MicroStrategy Command Manager is a scripting tool that allows administrators to automate nearly all administrative and maintenance tasks. Uses an English like scripting language to convert a manual process into an automated one Executes a script automatically at a scheduled time without any human involvement or on demand

10 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

11 MicroStrategy Command Manager What is a Command Manager Script? It is a collection of Command Manager Commands to carry out Intelligence Server tasks. Where do I create Command Manager Script? In the Command Manager Application GUI.

12 Scripting Made Easy With Templates (called Outlines) Really?! How can scripting ever be easy?!

13 Scripting Made Easy How do I use/apply these outlines? Simply double click or copy paste the template in the command editor Modify it to suit your requirements Check Syntax (as shown below) Execute or Save Script (to automate execution) Outline Command

14 Scripting Made Easy Auto Capitalization and Auto Color Coding of Command Words Comments are highlighted in green Auto Command Completion with a list of options to choose from

15 55 Management Areas 330+ Commands Management Area Description Create users and groups, and manage application access and User and User Group Management privileges associated with each Change access properties for reports and folders for users, groups, and roles Security Management Set authorization parameters, including management of security filters Cluster Management Add or remove Intelligence Server nodes to a cluster Change the database instances associated with projects and other Application Management configuration parameters Database Connection Management Load, unload, idle, or register applications for routine maintenance Event Management Import project and configuration packages List all active database connections Database Connection Management Create, alter, or disconnect specific database connections based on certain conditions Create new event-driven schedules and trigger a specific event Event Management schedule based on certain criteria Job Management Monitor and kill jobs running on Intelligence Server Object Management Create, modify, or delete objects through a script Create and alter users, groups, profiles, and user addresses Subscription And Report Delivery Assign privileges to users, groups, profiles, and security roles Management Assign access control rights to projects, folders, and objects Apply security roles and filters to users and user groups

16 Execute Scripts via Command Line Call cmdmgr.exe Provide Credentials Provide Log File Path Provide Script Path Comman d line help

17 Encryption for added security Save As Encrypted Script Encrypted Script Sensitive information such as Intelligence Server connection information can be in the encrypted file Encrypted scripts does not require decryption during execution Execution Command: cmdmgr connlessmstr f <encrypted script path>

18 MicroStrategy Command Manager Does it support my OS? Runs on all OS supported by Intelligence Server* i.e. deployable on Windows, UNIX, and Linux How can I schedule the scripts I have created? You can save the script as a Batch/Shell script and use the Operating System s Scheduler to schedule it For Windows, use Windows Task Scheduler For UNIX/Linux, use Cron Event Based Scheduling also available * Small subset of schema related commands are Windows-only

19 Features: Integration with Enterprise Manager Enterprise Manager contains Out of the Box reports that generate Command Manager Scripts based on certain criteria Delete Unused Attributes Delete / Disable Unused Users / User Groups Delete Unused Reports Delete Unused Documents Delete Unused Filters Delete Unused Metrics Delete Unused Schedules Delete Unused Security Filters Delete Unused Templates Delete Unused DB Instances

20 Advanced Features: Use of Procedures Commands can be integrated with logic with the help of Procedures Procedures let you harness the power of Java within Command Manager such as if-then-else analysis, looping, parameterized procedures Contains 50+ Sample Procedures Delete Caches having low hit counts, larger than certain size etc. Kill Jobs having low priority by User List DB Logins that have no dependents

21 MicroStrategy Command Manager Overall Architecture And Workflow Of Command Manager Scripts developed using Command Manager UI Script Execution User Interfaces (Graphical & Command Line) Formatting and Displaying Results Syntax Validation, Command Parsing, Java Compiling MicroStrategy Open API Command Execution Intelligence & Narrowcast Server

22 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

23 Benefits & Summary MicroStrategy Command Manager enables automation of tasks with no necessary human attention, saving time and money Apart from automation, Command Manager also helps in Bulk Object Manipulations/Creation Integration with 3rd party tools to maintain company standards Scripts are Cross-Platform and can be executed from the command line interface. Encryption ensures that scripts containing sensitive information can be distributed securely Procedures extend flexibility of Command Manager by incorporating logic within the Command Manager commands

24 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

25 MicroStrategy System Manager MicroStrategy System Manager is a process automating tool that enables BI teams to convert a sequential, multi-step, multi-product, manually executed process into an automated workflow. Available Processes MicroStrategy Processes Cloud Processes Workflow Designer Download file using FTP System Processes TRUE Success? FALSE File Operations ODBC Operations Execute Command Manager Send to notify user Exit

26 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

27 MicroStrategy System Manager GUI Left side displays the different processes, right side has the canvas 2 7

28 MicroStrategy System Manager GUI Simply DRAG and DROP required process on the Canvas 2 8

29 MicroStrategy System Manager GUI Connect the processes using different Connectors 2 9

30 MicroStrategy System Manager GUI Connect the processes using different Connectors 3 0

31 MicroStrategy System Manager Process Properties in the GUI

32 MicroStrategy System Manager Process Properties Each process in the workflow is defined by its properties Property Name FTP Download Process Property Value Passwords are Hidden Property Value = Global Parameters

33 MicroStrategy System Manager Global Parameters Export Global Parameter Parameters File 3 3

34 MicroStrategy System Manager Global Parameters Export Parameter File 3 4

35 MicroStrategy System Manager Global Parameters Import Parameter File C:\Paramaters.smp 3 5

36 MicroStrategy System Manager Global Parameters Global Parameters are available to every process $(x) Global Parameters Workflow Call Parameters in any Process

37 MicroStrategy System Manager Global Parameters Share parameters between workflows by exporting them Export Modify values Import & reuse Workflow Export to file, modify values and re-use the Workflow in different BI Environments BI Env 1 BI Env 2 BI Env 3 Workflow 1 Export Import Export to file and import in other Workflows Workflow 3 Workflow 2

38 MicroStrategy System Manager Automated Workflows Greatly Reduce IT Personnel Time and Eliminate Manual Effort Intelligence Server Maintenance 1. Alert BI team members 2. Re-start Intelligence Server 3. Monitor the system 4. Notify BI team members Daily Report Execution Schedule 1. Monitor ETL completion 2. Publish Cubes 3. Wait for Cubes to publish 4. Trigger Subscription Schedules 5. Notify BI teams BI Object Change Migration 1. Download Update Packages 2. Login to Test system 3. Generate rollback packages 4. Apply changes to each project 5. Alert developers to errors 6. Notify BI Test teams ,175

39 EXAMPLE BI CHANGE MIGRATION With System Manager, Each Step Defined in a Single Workflow Runs Automatically Step 1 Download Update Package Via FTP Step 2 Copy files Into Folders Step 3 Generate Roll Back packages Step 4 Migrate Changes to the project Step 5 Run Integrity Manager tests Step 6 Alert BI Team With FTP Client With MicroStrategy Command Manager With MicroStrategy Integrity Manager PASS Send to BI Team With File copy operatio n With MicroStrategy Object Manager FAIL Send Alert to administrat or

40 MicroStrategy System Manager BI Change Migration Workflow in System Manager File Operations Programmatic c Elements Command Manager Process

41 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

42 MicroStrategy System Manager Demonstration Build & Execute a System Manager Workflow for BI Change Migration and migrate a NEW DASHBOARD to PRODUCTION Download Update Package With FTP Client Generate Roll Back Packages With MicroStrategy Command Manager Send to BI Team PASS Migrate Changes With MicroStrategy Object Manager FAIL Alert Admin Instead of ONE new Dashboard, we will create a Workflow to update our BI Environment with FOUR NEW DASHBOARDS at once

43 MicroStrategy System Manager - Processes A wide variety of processes enables creation of complex workflows MicroStrategy Administrative Processes Non - MicroStrategy Processes Programmatic Elements Command Manager Object Manager Integrity Manager Configuration Wizard Project Merge Project Duplicate Project Mover Server Status Installation Connectivity Wizard Create Package Launch/Terminate Amazon Cloud Instances Manage VMWare VMs and VApps Copy/Delete/Move Files Find/Replace File Content Unzip files Download With FTP Execute Application Execute SQL Send in HTML Create/Rename Files $(x) Node Decisions to control true/false process status Iterative Retrieval File Counter Define global System Manager Parameters Update Parameters Loops to Process Multiple iterations Name Nodes and Add Comments Split/Merge Execution Pause Combine any of these processes in any desired sequence in one workflow

44 Execute Workflows via Command Line Call MaSysMgr.exe Provide Workflow Path Provide Parameter File Path Command line help

45 Presentation Agenda MicroStrategy Command Manager Need for & Introduction Basics & Product Features Summary MicroStrategy System Manager Introduction Products Features Demo Benefits & Summary

46 Success Story MicroStrategy Cloud Automation Process Diagram Create Environment Automation Server MicroStrategy Cloud Customer Environment Linux Development Linux Production 1 Linux Production 2 Windows Utility Windows SQL Server Metadata Notify Users Cloud Admin Cloud Teams

47 Success Story MicroStrategy Cloud Project Statistics System Manager Workflows System Manager Processes Code Files 195 Code Lines 9,346 Log Entries per Run 15,000+

48 Efficiency Benefits to Your Organization Lowered Administrative Costs Improved Process Efficiency & Reliability Simplified BI Administration Just launch a workflow to perform any routine process! Less people required Reduced manual effort No human oversight necessary Manual Automate d Standardized processes Human-induced errors eliminated Training is easy Better Process Tracking and Alerting Workflows run on schedule De-centralization of processes

49 Summary MicroStrategy System Manager Enables Administrators to Convert Manual Processes Into Automated Workflows Workflows can incorporate MicroStrategy & Non-MicroStrategy processes, in any sequence Parameterization of workflows enable the same workflow to be used with different inputs Workflows run on any OS supported by the MicroStrategy Intelligence Server & can be run via Command Line Workflows can be scheduled to run automatically, without any human involvement or can be triggered manually as well

50 QUESTIONS Dennis Liao