ICT Infrastructure Management

Transcription

1 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium Cutting Costs while Improving Service and Increasing Business Agility Pol Huyzentruyt Software Group IBM Belgium Senior IT Architect Systems SWG Technical Manager

2 Liris Blue Academy Program Information Integration November 14, 2006 (11:00-13:00) (HOGM-00.74) [in] Grondslagen van databasemanagement - Presenter: Eric Michiels, Senior IT Architect ICT Security management November (11:00-13:00) (HOGS-01.10) [in] Systeemsoftware - Presenter: Bert Schaekers, Security Software Sales Representative LINUX December 18, 2006 (11:00-13:00) (HOGS-01.10) [in] Systeemsoftware - Presenter: Tim Verhoeven, IT Specialist December 21, 2006 (16:00-18:00) (AV-00.17) [in] Grondslagen van databasemanagement - Presenter: Pol Huyzentruyt, Technical Sales Manager Dynamic Workplaces based on Portal Technology February 20, (11:00-13:00) (HOGM-00.85) [in] Collaborative Systems - Presenter: Ir. Wim Drossaert, IT Specialist Information Scientist in the Future February 28, 2007 (9:00 11:00) (VHI-02.29) [in] Bestuurlijke informatiesystemen - Presenter: Jean-Paul Vander Perren, HR Manager Industrial Relations ICT Outsourcing March 22, 2007 (18:00-20:00) (VHI-00.10) [in] Economics of information systems - Presenters: Jan Depovere, Business Manager Strategic Outsourcing and Menno Koehoorn, Business Executive Strategic Outsourcing Enterprise Search Software for greater Business Intelligence Apr 25, 2007 (11-13) (HOGM-00.85) [in] Business Intelligence - Presenter: Albert Huysmans, IT Specialist Service Oriented Modeling and Architecture Tuesday May 15, 2007 (11:00-13:00) (HOGC-02.28) [in] OO Business Modeling - Presenters: Jan Augustijnen (Consultant), Eric Michiels, Senior IT Architect

3 Agenda: Section 1: The challenges we face with Infrastructure Section 2: Making management of the IT infrastructure more effective through automation Section 3: Simplifying the IT Infrastructure: and techniques 4 Section 4: Room for Questions and Answers

4 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium Section 1: Level Setting What is the problem area?

5 What s on the minds of 450 of the world s leading CEOs CEO needs Revenue growth with cost containment Key competency: responsiveness Critical success factor: enable effectiveness of people and processes Source: CEO Study of 456 WW CEOs IBM Corporation - Feb 2004 CIO challenges Aligning IT and business goals to grow revenue and contain costs Building responsiveness and agility into the organization through IT How can IT help enable people and teams to be more effective Source: Operating Environment Market Drivers Study, IBM Corp. 2004

6 On demand businesses are leveraging IT to reduce their business process cycle time 30 minutes 5 seconds Trading analytics 20 minutes 30 seconds Airline operations 8 hours 10 seconds Call center inquiries 1 day 5 minutes Track financial position 1 day 15 minutes Supply chain updates Mail express fax 3 days 45 seconds Document transfer 3 days 1 hour Phone activation 1 month 1 hour Refresh data warehouse 5 days 1 day Trade settlement 1 week 30 minutes Mortgage Loan Approval 6 weeks 24 hours Build-to-order PC , Seconds Source: Gartner

7 IT complexity is impacting the IT responsiveness to business needs Response Time IT responsiveness Business responsiveness Traditional business On demand business Only 13% of CEO s surveyed believed that their organization could be rated as very responsive. Your Turn The Global CEO Study 2004, IBM Corporation, 456 CEO s surveyed worldwide

8 Fundamental market changes are creating new IT challenges for our customers Complexity Speed of Change Most organizations manage large and complex IT environments to support business processes. Fast-changing external forces and unpredictable workload make it difficult to meet service levels. Cost Compliance COST Infrastructure Infrastructure costs have been outpaced by spending on management and administration. The changing global regulatory and business environment requires security, privacy and ongoing audit capabilities.

9 IT Infrastructure Trends Rising Operational Costs Spending (USB$) $160 $140 $120 $100 $80 $60 $40 $20 $0 No increases in efficiency from increases in scale New server spending (USM$) 3% CAGR Not only do operational costs far exceed the budgets for new hardware, they are growing at approximately two and a half times the compound annual growth rate. IDC, On-Demand Enterprises and Utility Computing: A Current Market Assessment and Outlook IDC #31513, July 2004 Cost of mgmt. & admin. 10% CAGR Installed Base (M Units)

10 A key part of Infrastructure focusing around helping the business by optimizing the IT infrastructure Infrastructure Sense and respond to changes, manage and optimize for the needs of the business through Automation and Virtualization of your IT environment Virtualization Delivering IT Simplification through enterprise-wide fabrics, Grids and the virtualization of internal and external resources Automation Increase flexibility and reduce costs by automating your IT best practices and extend across process disciplines and resources

11 A key part of Infrastructure focusing around helping the business by optimizing the IT infrastructure Virtualization Delivering IT Simplification through enterprise-wide fabrics, Grids and the virtualization of internal and external resources Automation Increase flexibility and reduce costs by automating your IT best practices and extend across process disciplines and resources Resource Virtualization Grid Computing Autonomic Computing IT Service

12 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium Section 2: Making management of the IT infrastructure more effective through automation

13 Agenda: 1 2 Section 1: The challenges we face with Infrastructure Section 2: Making management of the IT infrastructure more effective through automation Autonomic Computing IT Service

14 IT complexity is impacting the IT responsiveness to business needs Response Time IT responsiveness Business responsiveness Traditional business On demand business Only 13% of CEO s surveyed believed that their organization could be rated as very responsive. Your Turn The Global CEO Study 2004, IBM Corporation, 456 CEO s surveyed worldwide

15 Characteristics of an Autonomic Computing System A computing system that senses its operating environment, models its behavior in that environment, and takes policy driven action to change the environment or its behavior. An autonomic computing system has the properties of self-configuration, self-healing, self-optimization and self-protection. Self-managing systems deliver: Increased Responsiveness Adapt to dynamically changing environments Business Resiliency Discover, diagnose, and act to prevent disruptions Secure Information and Resources Anticipate, detect, identify, and protect against attacks Operational Efficiency Tune resources and balance workloads to maximize use of IT resources

16 Moving from Awareness to the Self-Managing State The Human-Intensive Present Corporate data centers are multi-vendor, multi-platform. Installing, configuring, integrating systems is time-consuming, errorprone. The Autonomic Future Automated configuration of components, systems according to high-level policies; rest of system adjusts seamlessly. Web servers, databases have hundreds of nonlinear tuning parameters; many new ones with each release. Adjusted manually. Components and systems will continually strive to improve their own performance and efficiency. Problem determination in large, complex systems can take a team of programmers weeks. Automated detection, diagnosis, and repair of localized software/hardware problems. Manual vulnerability analysis. Manual detection and recovery from attacks, cascading failures. Automated defense against malicious attacks or cascading failures; use early warning to anticipate and prevent system-wide failures.

17 Delivering Autonomic Capabilities to the Market Autonomic Computing Architecture Solutions leveraging self-managing autonomic technology Products delivering or embedding self-managing autonomic technology Autonomic Computing common components Open standards Deliver business solutions leveraging autonomic capabilities for increased value Deliver products with built-in selfmanaging autonomic capabilities Develop common components leveraging open standards and providing an open framework for the industry Create and leverage open standards for autonomic computing Define a base reference architecture which creates a common language and design for autonomic computing

18 Autonomic computing Mission: Address IT complexity in heterogeneous environments through self-managing autonomic capabilities Common overarching architecture Autonomic standards Common technology for end-to-end management Self-managing autonomic capabilities in IBM and partners products Enabling intelligent systems that: Adapt to unpredictable conditions Continuously tune themselves Prevent and recover from failures Provide a safe environment Empowering businesses to: Reduce downtime Increase return on IT investments Improve resiliency and agility Accelerate time to value

19 Autonomic computing Mission: Address IT complexity in heterogeneous environments through self-managing autonomic capabilities Common overarching architecture Autonomic standards Common technology for end-to-end management Self-managing autonomic capabilities in IBM and partners products Enabling intelligent systems that: Define a base reference architecture which creates a common language and design for autonomic computing Adapt to unpredictable conditions Continuously tune themselves Prevent and recover from failures Provide a safe environment Empowering businesses to: Reduce downtime Increase productivity and savings Improve resiliency and agility Accelerate time to value

20 The common functions and management activities performed by IT professionals are be formalized in a common reference architecture: the MAPE control loop The MAPE loop architecture is a common model across IBM for how to develop interoperable autonomic systems an open blueprint used by partners and academia Analyze Plan Monitor Knowledge Execute Data Action Managed Resource

21 The common management activities can be delegated to an autonomic manager implementing the MAPE control loop to automate these functions Diagnose Symptom Autonomic Manager Assess Impact Plan Action Analyze Plan Monitor Knowledge Execute Data Action Sense Symptom Take Action Managed Resource Domain will be the ones who decide what gets delegated

22 Autonomic Computing Architecture: MAPE Control Loop An autonomic manager is a configuration of automated functions that deliver selfmanagement capabilities using automation style that implements a control loop driven by situations observed in the system. Sensors Effectors Analyzes the details to see if something needs to change Analyze Plan Creates or selects a plan to make the necessary changes Collects and organizes details from the system Monitor Knowledge Execute Makes the changes by performing the plan Shares accumulated knowledge across the elements. Autonomic Manager Exposes state and state transitions of Managed Resource Data Manageability Interfaces Sensors Managed Resource Effectors Action Changes state of a Managed Resource

23 Autonomic computing Mission: Address IT complexity in heterogeneous environments through self-managing autonomic capabilities Common overarching architecture Autonomic standards Common technology for end-to-end management Self-managing autonomic capabilities in IBM and partners products Enabling intelligent systems that: Define open standards to simplify the management of heterogeneous IT environment Adapt to unpredictable conditions Continuously tune themselves Prevent and recover from failures Provide a safe environment Empowering businesses to: Reduce downtime Increase productivity and savings Improve resiliency and agility Accelerate time to value

24 Problem Determination for Complex Applications As customers leverage SOA to deploy more complex composite applications in distributed heterogeneous IT environment, they are faced with increasing complexity in identifying the root cause of problems. While business processes execute in minutes, sometime seconds, it can take days, even weeks to determine the cause of problems when they arise. Business Resiliency Discover, diagnose, and act to prevent disruptions Our 4 tier, 30 server, load balanced architecture makes it very difficult to identify the root cause of problems. Mike Dewey, Head of Development Standards, Reuters

25 Why is problem determination so hard? Application Database Application Server Log file Log file Log file Problem determination is typically a manual process for customer support organizations. In some cases it is literally looking at log files visually and comparing time stamps and line items against log files from other components in the system. (Applications, App servers, Databases, Web Services). Web Service Log file The longer it takes the higher the cost to the customer and the lower the satisfaction level of the customer. Visit ibm.com/autonomic/pd

26 But it gets worse. Every vendor formats log information slightly differently Application Database Application Server Log file Log file Log file Log file 1 Sev Level Date Time Error Message Component 1 12/4/05 10:04am Application started B /4/05 10:04am Application failed B6357 Log file 2 Date Time Error Message Sev Level Component 12/4/05 10:05am Database started 0 L /4/05 10:07am Database index 1 L3456 Web Service Log file Log file 3 Component Sev Lev Date Time Error Message LT /4/05 10:04am App Server Start KL /4/05 10:06am Error in Java Runtime Which makes visual correlation even more difficult Visit ibm.com/autonomic/pd

27 The problem Application Database Application Server Servers Proprietary log format Domain specific set of No interfaces between Siloed problem determination Finger pointing resolution Problem determination may take days or weeks Storage devices Networks Proprietar ylog format Specialized skills and

28 Value of common event format Allows the integration and analysis of events from multiple IT resources participating in complex systems for faster problem determination and resolution Events (real-time events) thresholds, availability status, performance status, Problem Determination Events (post-mortem, historical events) Trace, log files Security Events Virus attack, security breach, Business Events business transaction volume, changes in revenue, number of customers using a service at a given point in time * An "event" is a notification of some status change within the IT infrastructure. Events can be triggered by faults affecting an IT resource.

29 Open standard for event reporting: WEF Common approach for manageability to simplify the integration of management solutions of distributed resources from many vendors WS-DM Event Format (WEF) established as an industry wide standard for event report (based on IBM s Common Base Event (CBE)) IBM is the co-chair of Technical Committee formed in OASIS with strong industry participation Technical Committee Participants

30 The solution Application Database Application Server Servers Storage devices Networks Proprietar ylog format Adapters Adapters Generic Log Adapters (GLA) WSDM Event Format WSDM Event Format Log and Trace Analyzer (LTA) Problem determination in minutes-hours Common format for events Common set of Common interfaces among Cross resources correlation Centralized problem determination capability

31 Autonomic computing Mission: Address IT complexity in heterogeneous environments through self-managing autonomic capabilities Common overarching architecture Autonomic standards Common technology for end-to-end management Self-managing autonomic capabilities in IBM and partners products Enabling intelligent systems that: Develop common components leveraging open standards and providing an open framework for the industry Adapt to unpredictable conditions Continuously tune themselves Prevent and recover from failures Provide a safe environment Empowering businesses to: Reduce downtime Increase productivity and savings Improve resiliency and agility Accelerate time to value

32 Autonomic Computing Common Components Business Autonomic Engine Integrated Solutions Console Log Analyzer Generic Log Adapter Active Correlation Technology Common Event Infrastructure Optimize Manage Operations Prioritize& Allocate Deploy Solution Install Govern AC Performance Analyzer Model Business Test Analyze & Design Implement Development Log & Trace Analyzer AC Benchmark Generic Log Adapter AC Toolkit

33 Common Event Infrastructure (CEI) Event Consumer Asynchronous event notifications Synchronous event operations Messaging Messaging destination Messaging destination destination Event Distribution Event Access Event Data Store Event Bus Metadata consumer Event Emitter J2SE Event Source Event Emitter J2EE Event Source Event Emitter WS-Notification Broker Event Catalog Metadata source C/C++ Event Sources

34 Example Solution: Event Using Architectural Building Blocks Symptom Editor Applications, Runtimes CEI M A P E LTA CBE WEF CBE WEF GLA Knowledge repository (Symptom Catalog) CMDB ISV tooling Tivoli tooling Rational tooling ISC

35 Autonomic computing Mission: Address IT complexity in heterogeneous environments through self-managing autonomic capabilities Common overarching architecture Autonomic standards Common technology for end-to-end management Self-managing autonomic capabilities in IBM and partners products Deliver business solutions leveraging autonomic capabilities for increased customer value Enabling intelligent systems that: Adapt to unpredictable conditions Continuously tune themselves Prevent and recover from failures Provide a safe environment Empowering businesses to: Reduce downtime Increase productivity and savings Improve resiliency and agility Accelerate time to value

36 IBM Autonomic Computing Structure Autonomic Computing Architecture Products delivering autonomic features Autonomic Computing Control Loop Autonomic Computing Architecture Blueprint 50 products with 415+ features Partner solutions Installation Provisioning Autonomic Computing Common Components Problem Determination Workload Mgt Open Standards Engine Admin Console Log/Trace Analyzer Generic Log Adapter Solution installation & dependency checking Common Console Autonomic Engine Common log format Solution installation schema

37 Levels of Automation Basic Level 1 Managed Level 2 Predictive Level 3 Adaptive Level 4 Autonomic Level 5 Benefits Skills Characteristics Multiple sources of system generated data Requires extensive, highly skilled IT staff Basic Requirements Met Consolidation of data and actions through management IT staff analyzes and takes actions Greater system awareness Improved productivity System monitors, correlates and recommends actions IT staff approves and initiates actions Reduced dependency on deep skills Faster/better decision making System monitors, correlates and takes action IT staff manages performance against SLAs Balanced human/system interaction IT agility and resiliency Integrated components dynamically managed by business rules/policies IT staff focuses on enabling business needs Business policy drives IT management Business agility and resiliency Manual Autonomic

38 An Evolutionary Roadmap IT Focus Element IT Service Business Focus On Demand Manual processes Reactive and tactically aligned Resource intensive Basic 1 Levels of Automation Managed 2 Automated best practices Proactive and Predictive Automated provisioning Predictive 3 Adaptive 4 Autonomic, self managed environment Dynamic provisioning Autonomic 5

39 Announcing an evolutionary approach INFRASTRUCTURE MANAGEMENT Optimize application performance Rapidly isolate and diagnose application performance issues Automate tasks for maintaining application service levels RESOURCE MANAGEMENT IT SERVICE MANAGEMENT Optimize availability and performance of IT and business services Interconnect IT domains with dynamic role-based work environments Automate and integrate key IT processes Optimize resource availability Maintain resource-specific information Analyze historical and real-time resource data TRADITIONAL ON DEMAND BUSINESS Business environment BASIC MANAGED PREDICTIVE ADAPTIVE AUTONOMIC Levels of IT process automation

40 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium of complex IT environment is organized by expertise domains Windows Internet Linux Network Application Unix Database Integration Mainframe Storage Windows Internet Linux Network Application Unix Database Integration Mainframe Storage People in IT operations are organized in siloed technology domains requiring specific sophisticated skills and to manage IT resources

41 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium IT processes deliver service to the business across IT domains Windows Internet Linux Network Application Unix Database Integration Mainframe Storage Windows Internet Linux Network Application Unix Database Integration Mainframe Storage Availability Incident Release Identity & Access Change & Configuration Mgmt. Coordination and information flow is needed across siloed domain, and crosscutting IT processes to deliver IT service to the business

42 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium IT Processes are Labor and Time Intensive Windows Internet Linux Network Application Unix Database Integration Mainframe Storage Windows Internet Linux Network Application Unix Database Integration Mainframe Storage Availability Release Identity & Access Labor Cost Incident Time Change & Configuration Mgmt. Sense Isolate Diagnose Take Action Evaluate 92% of all IT processes are manual* 50% of the labor cost of the Incident process is in Isolate and Diagnose** *Based on IBM customer engagements **IDC Study 2005

43 The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium Looking Ahead: IT Service Managing the Business of IT Security and Availability Security Mgmt. Network and Application Experts Database and Mainframe People Technology Integrated Automated Role Based Interconnected Productive Technology Service Level Change Information Lifecycle Mgmt. Processes Standardized Federated Secure Process IT Service People Information Information Based on Best Practices Automated Customizable

44 IT Processes and Automation Processes Automated Collaborative CMDB Behavior Seamless Integration Analysis Policy Correlation Self-Managing Autonomic Data Behavior Center Model Planning Policy Scheduling Arbitration Optimization Monitoring Metrics Resources App Topology Relationships Resource Pools Discovery Policies Execution Workflows Virtualized Interfaces Virtualized Interfaces Virtualized Interfaces Virtualized Interfaces Virtualized Interfaces Resources SERVER NETWORK STORAGE MIDDLEWARE APPLICATION Platforms OS Switches Routers Load Balancers Disks SAN NAS J2EE.NET Portal ERP Custom

45 Change : Implementing a Process Labor Cost and Time ROI from Task Automation Manual Process Accept and Classify Change Assess Change Approve and Schedule Change Coordinate Change Implementation Distribute and Install Non-Release Change Review and Close Change Change Self- Managing Manual Autonomic Tasks Features Manual Classification Manual Assessment Manual Assessment Manual Coordination Manual Installs Manual Verification Labor Cost Time

46 Change : Implementing a Process Labor Cost and Time ROI from Process Automation Automated Manual Workflow Process Accept and Classify Change Assess Change Approve and Schedule Change Coordinate Change Implementation Distribute and Install Non-Release Change Review and Close Change Standardize and Share data Change CMDB, Discovery, Process Runtime Self- Managing Autonomic Features Labor Cost Time

47 Key Elements of an IT Service Solution Coordination of Automated and Human Actions Workflows align with IT process model Spans process disciplines to match customer processes Workflow technologies Processes security reqts Security incident Incident recovery info Availability Service Level availability availability reqts Problem problems Determine Availability Requirements info about critical business processes maintenance RFCs IT Service issues Compile Avaiability availability improvements Continuity Mgt Plan Change scheduled changes Monitor Availability capacity info, Configuration CI info, status advice availability info, advice RFCs Provide Availability Info and Advice Capacity Integration Data model (CMDB) Configuration/relationships + operational data (including history) Discovery Data administration Database & federation technology Process model Tools Products enabled for workflow (interfaces match process steps) Automated process steps Manage the components of an automated solution

48 ITIL Service Support Overview Tools incidents Incident Service Reports Incident Statistics Audit Results incidents Problem Problem Statistics Trend Analysis Problem Reports Problem Reviews Diagnostic Aids Audit Reports Change Change Schedule CAB Minutes Change Statistics Change Reviews Audit Reports changes Business, Customers, and Users Release Release Schedule Release Statistics Release Reviews Secure Library Testing Standards Audit Reports releases Service Desk Configuration CMDB Reports CMDB Statistics Policy/Standards Audit Reports Incidents, queries, communication, updates, work-arounds Incidents Problems Known Errors Changes Releases Config Items Relationships CMDB Definitive Software Library

49 Leverage Current Products in Process Solutions Software Process Modeling Workflow Federated CMDB Enterprise Service Bus Cross-Brand Integration Self-Managing Autonomic Technology Architecture Technology Research Standards

50 Elements of Process Automation Solutions Build/Customize Processes Deploy & Configure Processes Approve, Execute & Monitor Process Steps and Tasks Service Level Change Availability Change & Configuration Info Lifecycle Process Runtime Infrastructure Processes are IT Infrastructure Library (ITIL)- based User Interfaces Generate & View Reports Interface with Existing Products Configuration Database (CMDB) Discovery Federation Synchronization IT Infrastructure Products

51 A Comprehensive Approach to IBM Service IBM Service IT CRM & Business Service Delivery & Support Service Deployment Information Business Resilience IT Process Products IT Service Platform Change and Configuration Database (CCMDB) IT Operational Products Best Practices Business Application Server, Network & Device Storage Security IBM Tivoli Unified Process (ITUP) Open Process Automation Library (OPAL) IBM Global Technology Services Ecosystem of System Integrators and Business Partners

52 An Open Vendor Ecosystem Partner Asset Partner Asset CCMDB [ Process Modeler and Choreographer ] SOA Software Cisco Network Administration Software Partner Assets Processes will be integrated across tool vendors Data will be integrated and managed thru CCMDB Process Automation is then extended across previous boundaries Open Process Automation Library (OPAL)

53 In Summary The Liris Blue Academy An initiative from L.I.R.I.S. and IBM Belgium The cornerstones are being placed: Self-Managing Autonomic Technology Architectural foundation Initial open standards The Challenge Ahead: Innovation that Matters From components to composition End-to-end focus on process automation solutions Standards and for increased interoperability and integration