Cloud3DView: Gamifying Data Center Management

Transcription

1 Cloud3DView: Gamifying Data Center Management Yonggang Wen Assistant Professor School of Computer Engineering Nanyang Technological University November 26, 2013 School of Computer Engineering 1

2 Data Center Challenges by IT Professionals Management Energy SG Emerson, Maximizing data center efficiency, capacity and availability through integrated infrastructure, 2011 School of Computer Engineering 2

3 System Challenges for Data Center Management Non-intuitive Management System Command Line Interface: hard to use and low efficiency Limited Function: one system focusing on one purpose Hard to Deploy: each system has its own architecture Managing Diverse Objectives Infrastructure Environment Network Physical Server Virtual Machines Services School of Computer Engineering 3

4 How can we make DCM simple and fun? School of Computer Engineering 4

5 Presentation Outline Data Centre Management Challenges Gamifying Data Centre Management Case in Point: Cloud3DView Use Cases School of Computer Engineering 5

6 Gamifying Data Center Management School of Computer Engineering 6

7 Conceptualizing DCM Gamification Primary prototype of 3D UI Primary feature of Comprehensive Monitoring Intelligent Management (in progress) Screenshot of Tablet Version Hot Area Networking Monitoring MDC Cold Area Memory Monitoring School of Computer Engineering 7

8 Gamifying Management Console Intuitive & Efficient UI 3D User Interface 3D Model of the MDC Navigation, selection and manipulation in the virtual-reality data center from any place Real-time, visualized data monitoring Service configuration and app management School of Computer Engineering 8

9 Demo Video [SIGCOMM 2013] School of Computer Engineering 9

10 Case in Point: Cloud3DView School of Computer Engineering 10

11 Cloud3DView Cloud3DView is a human-centric Data Center Management System, designed for intuitive data center operations via advanced HCI techniques and gamification concepts. Cloud3DView is designed to provide the life-cycle management of data centre, including: Data centre construction in 3D model Performance verification in virtual model Status monitoring over multiple objects Intelligent control and management School of Computer Engineering 11

12 An Infrastructure View Internal Network Internet tablet PC Modular Dater Center (MDC) Network Operating Center (NOC) IT Administrators & Users Hot Area of MDC Cold Area of MDC School of Computer Engineering 12

13 An Architectural View Heterogeneous System Unified System Open API for Data Consumption MongoDB Analysis & Decision ilo idrac Message Bus (XMPP) Host Adapter VM Adapter Net Adapter Env Adapter Power Adapter School of Computer Engineering 13

14 Infrastructure Management Architecture Open-Source Tools Physical Server: Ganglia -- A distributed monitoring system Virtual Machine: LIBVIRT -- A virtualization API Switch and Router: SNMP -- An network devices managing protocol Network Flow: IPTABLES -- Linux kernel firewall Power Consumption: SNMP Storage with NoSQL: Mongo DB Document-Oriented Storage Flexible Schema Easy Scalability Visualization & Administration Data Center Storage School of Computer Engineering 14

15 Application Management Application Deployment Service Orchestration Configuration Synchronization Automatically User-defined Virtual Machine Requirements Application Monitoring in 3D Apache Hadoop Application Optimization Balance Workload for Apache Hadoop task scheduling Cloud Computing and Big Data School of Computer Engineering 15

16 Use Cases School of Computer Engineering 16

17 Virtual Data Centre Construction School of Computer Engineering 17

18 Cloud Computing Infrastructure School of Computer Engineering 18

19 Big Data Analytic Platform Big Data Application Data Center Infrastructure Future Internet Master Nodes Science Data CSV Intelligence Industry Data Legacy Data Text Video Log SQL Map Stage Reduce Stage Data Center Mgmt System Data XML Source Data Import Data Nodes Data Intensive Computing RDMS statistic visualization Consume Result School of Computer Engineering 19

20 Summary Use Case Analysis: Lifecycle mgmt DC Building Emerging apps Data Centre Management Challenges Functional Spec Architecture Gamifying Data Centre Management DC Challenges DCM Issues Case in Point: Cloud3DView Games for ICT Mgmt New media technologies Conceptualizing DCM Gamification School of Computer Engineering 20

21 Q & A School of Computer Engineering 21