Automating Infrastructure A connectivity perspective for BICSI SEA meeting, November 2011
Opportunities in Automating Infrastructure Why Automation in Data Center? Tiers, compartments and complexity Work flow processes impacts Getting it right is important, tracking it is also important Integration of Automated Systems new futures? Infrastructure offers unique data and in combination with other systems the impact and opportunities will grow in the future
Data Center Tier Ratings Virtualization is driving reliability! Information Week: 2011 State of the Data Center Survey
How to Minimize Human Error in DC? - Automated infrastructure management tools are needed Design & Execution Source: Uptime Institute
Tier IV DC Cabling Infrastructure - Design for Single Point of Failure Free Core switches Aggregation switches Access Switches & Servers/storage Horizontal cable Backbone cable Source: ANSI/TIA-942-A (draft) Tier IV data center cabling architecture Two independent entrance rooms Two main distribution areas (MDAs) should be in different fire protection zones, and be served by different PDUs and different air conditioning equipment Two horizontal distribution areas (HDAs) should be in different fire protection zones, and be served by different PDUs and different air conditioning equipment Two independent cabling routes
DC Infrastructure Requirements Capacity Two independent systems with N capacity; N is the capacity components Redundancy Two simultaneously active distribution paths for the systems Zoned approach Source: Uptime Institute
Modularity at Raised Floor Level - Zone Distribution Architecture OM3/4 10G Cat 6A
Equipment Distribution Area Overhead space Utilization A zero-u solution Intelligent Monitoring Hardware Rack mount servers Complete control, monitor and management of the data center Accurate executions of work orders Precisely locate physical assets Tracing KVM connections in server cabs
Tier IV Data Center Operations Tier IV DC Operational Impact - Specified by Uptime Institute The site is not susceptible to disruption from a single unplanned event The site is not susceptible to disruption from any planned work activities During maintenance, the computer equipment is exposed to an increased risk of disruption. This maintenance configuration does not defeat the Tier rating achieved in normal operations. Operation of the fire alarm, fire suppression, or the emergency power off (EPO) feature may cause a data center disruption Solutions for Cabling Infrastructure Zoned approach - to limit the impact scope from any unexpected failure Automated tools - for planning, provisioning and accurate executions Automated tools - for accurate executions and reducing maintenance time Plenum rated materials - for minimizing the potential harm to human
Growing Interest In DC Management Tools Source: Emerson Network Power. Data Center Users Group Special Report. 2010
A Potential DC Infrastructure Management Hole - Intelligent Management covers it Data Center Resources Application Cisco DCNM + UCS Manager HP SIM EMC Ionix VMware VCenter Microsoft System Center Emerson Aperture OS, VM Server, Switch/router, storage Cabling Automation Other facility Resources
Manage Virtual Machines - Mapping of VMs to cable connections and routes Information Week: 2011 State of the Data Center Survey
Human Error is a Leading Cause of Downtime - Automation can help to minimize the error Emerson Addressing the Leading Root Causes of Downtime white paper 2010 Symatec 2010 state of the DC in NAR
Average IT Downtime and Recovery Time - Automation can help to reduce them Source: CA Technology, Nov. 2010
Accurately Tracking DC Resources is the No. 2 Concern - Tracking connectivity from end to end Source: Information Week 2011
PCI Requirements - Automated documentations PCI Data Security Standard (DSS) Requirements 1.1.1 A formal process for approving and testing all network connections and changes to the firewall and router configurations 1.1.2.a Verify that a current network diagram (for example, one that shows cardholder data flows over the network) exists and that it documents all connections to cardholder data, including any wireless networks. 1.1.2.b Verify that the network diagram is kept current. 9.1.2 Restrict physical access to publicly accessible network jacks. For example, areas accessible to visitors should not have network ports enabled unless network access is explicitly authorized 10.2 Requirement: Implement automated audit trails for all system components 11.2 Run internal and external network vulnerability scans at least quarterly and after any significant change in the network (such as new system component installations, changes in network topology, firewall rule modifications, product upgrades). Intelligent Management
ANSI/TIA-606-B (draft) Specifies Intelligence ADMINISTRATION STANDARD FOR TELECOMMUNICATIONS INFRASTRUCTURE AUTOMATED INFRASTRUCTURE MANAGEMENT SYSTEMS The system should be capable of automatically monitoring patch connections between cross connects with automated management, and of generating alerts and updating documentation when any of these patch connections are changed. Recommended for more complex installations, where staffing attributes make the use of automated systems more effective and efficient, and to meet regulatory compliance requirements
Deploying Intelligent Management An Example
Deploying Sever in a DC???????????? Maintaining network connectivity to suit your Data Center s needs can be challenging But Where? 1 Every time an application needs a new server, the network operations group must provide the necessary connectivity
Deploying Server Process Requester 1 Request Created 2 Planned request submission Approver 3 Approval Given 4 Execution Teams Placement Decision, Assignment, Record into various administration systems 5 7 6 8 Recorded in System 9 Reviewing of information and printing of reports 18 19 10 17 Electronic Work Order Created 16 Execution Teams Work Order Received 11 12 Verification and execution of work order 13 14 15 Work Order completed Legend Without Automation With Automation 20
Life without Intelligent Management: Maintaining network connectivity to suit your Data Center s needs can be challenging But Where? and How? 1 2 Every time an application needs a new server, different functional IT groups must work together to provide the necessary connectivity
Life without Intelligence 1 Where to deploy the Server? Suitable Cabinet with: Available Height Space (Rack Units) Available Deep Space Enough Weight Support Free Electrical Outlets Copper/Fiber Cabled Ports:
Life without Intelligence: Where is the Supporting Documentation? Available Height Space (Rack Units) Spreadsheet / Paper? Available Deep Space Data Sheet Enough Weight Support Data Sheet + Paper Free Electrical Outlets Spreadsheet / Paper? Copper/Fiber Cabled Ports: Spreadsheet / Paper? Definitely this Documentation is not unified, but Is It Updated? Is It Accurate?
Life without Intelligence: 2 How to deploy the Server? Whether your Data Center Network Architecture is Direct Connect:
Life without Intelligence: 2 How to deploy the Server? Whether your Data Center Network Architecture is Zone Distribution:
Life without Intelligence: 2 How to deploy the Server? Whether your Data Center Network Architecture is Top-of-Rack:
Life without Intelligence: 2 How to deploy the Server? For every Port on the Server Primary LAN Secondary LAN LAN Core 1 LAN Core 2 LAN OoB you will need to find a Switch Port according to the expected service.
Life without Intelligence: 2 How to deploy the Server? VLAN to Service Mapping in the rush to provisioning connectivity quickly for new or relocated servers, switch ports that are no longer in use are often left plugged in and money is often spent on new switches that are not actually needed. available Switch Ports.
Life without Intelligence: Once you have a location for the Server and Switch Port Rack Panel Port Status Rack Panel Port MDA Rack 01 Panel 01 to HDA 01 Cabled HDA Rack 02 Panel 01 from MDA 01 HDA Rack 02 Panel 01 from MDA 01 Patched HDA Rack 02 Panel 04 to EDA 07 MDA Rack 01 Panel 01 to HDA 02 Cabled HDA Rack 03 Panel 02 from MDA 02 HDA Rack 03 Panel 02 from MDA 02 Patched HDA Rack 02 Panel 04 to EDA 08 HDA Rack 02 Panel 04 to EDA 07 Cabled EDA Rack 04 Panel 01 from HDA 07 EDA Rack 04 Panel 01 from HDA 07 Patched EDA Rack 04 Srv - 97 01 MDA Rack 01 Panel 01 to HDA 03 Cabled HDA Rack 02 Panel 01 from MDA 03 HDA Rack 02 Panel 01 from MDA 03 Patched HDA Rack 02 Panel 04 to EDA 09 MDA Rack 01 Panel 01 to HDA 04 Cabled HDA Rack 03 Panel 02 from MDA 04 HDA Rack 03 Panel 02 from MDA 04 Patched HDA Rack 02 Panel 04 to EDA 10 HDA Rack 02 Panel 04 to EDA 09 Cabled EDA Rack 04 Panel 01 from HDA 09 EDA Rack 04 Panel 01 from HDA 09 Patched EDA Rack 04 Srv - 99 03 Aggregation /MDF Access / IDF Equipment / EDA You need to find a pathway to connect them
Deploy server Technicians guided to complete Electronic work orders Automatic confirmation Correct service activation detected, service tickets closed Intelligent Server Deployment / Decommissioning Select server template Template includes size, power, weight, ports, required services Select Rack/Cabinet Selection based on available rack units, power, maximum load Schedule deployment Connectivity paths determined electronic work orders issued
Integration Capabilities
Benefits: Higher Security from Layer 1!!! IP Camera monitors critical patching connections 1 2 Detection of unscheduled event - triggers camera to post-event mode Pre-event images Post-event images Camera sends pre-event and post-event 3 image sequence to web server
Proof of Concept Integration with Cisco EnergyWise Real-time location information simplifies and optimizes application of Energy Management Policies Maximum flexibility for moves, adds, and changes Location associated automatically to switch ports True location-based Energy Management Policies ipatch Solution Cisco EnergyWise
Integration with HP Service Manager End - user HelpDesk Helpdesk receives Service Request Integration with Help Desk enables closed loop change and incident management Helpdesk Operator logs the call, creates Service Ticket LAN ipatch Service? Create ipatch Work order Intelligent Infrastructure Solution Helpdesk Operator closes Service Ticket Helpdesk Operator logs information from ipatch to close the ST ipatch generates work order completion event
Integration with DCIM Software Integration with DCIM enables workflow automation for server deployment Server object is created in Aperture Vista Server information is automatically exported to ipatch End - user Server connectivity and server details data is exported to Aperture ipatch creates work orders to connect servers to the network LAN ipatch SNMP device discovery collects name, IP,MAC data for servers ipatch generates work order completion event Intelligent Infrastructure Solution
Lighting is #1 use of electricity in commercial buildings Catering Computing Cooling & Ventilation Hot Water Heating Lighting Other
Conventional controls vs. Redwood controls Conventional Control Features 1 Electrical Panel 2 Fluorescent light fixture junction box occupancy sensor ballast photocell sensor 2 1 light switch Conventional controls: Require costly and sophisticated installation Are separate from the power Have minimal intelligence Have limited flexibility
Conventional controls vs. Redwood controls Redwood Control Features 1 Redwood Engine 2 Redwood Wall Switch 3 Redwood Adapter 4 LED light fixture 3 4 1 2 Conventional controls: Require costly and sophisticated installation Are separate from the power Have minimal intelligence Have limited flexibility Redwood Power and Controls: Provide for simple and costeffective installation Have unified power/control Have maximum intelligence Have maximum flexibility
Summary Transforming the Physical Layer into a key enabler of infrastructure management, able to deliver: Auto documentation of moves, adds, and changes Location awareness for connected devices Instant notification of connectivity events Closed loop incident and change management Improved asset and capacity management Lower maintenance and support costs Enhanced security and network uptime