Monitoring a cloud? why what how

Transcription

1 Monitoring a cloud? why what how Rodrigue Chakode Toulouse

2 Why to monitor? Like when you're riding, it's watching where you are going => adjust as you go along and ensure that you're on the right track. 2 2

3 What monitoring is? Regular observation (and recording) of activities taking place in a system. => Routine process gathering information on various aspects of the system Credit: Phil Bartle 3 3

4 Monitoring in a nutshell Analysing the situation in a system Determining whether how the system is operating Identifying problems facing the system Determining whether the way the system is planned is the most appropriate (e.g. performance monitoring) Ensuring all activities in the system are carried out properly, and by the right people and in right time (e.g. IDS) Using lessons from the pass to forecast the future (e.g. capacity planning) 4 4

5 How to monitor? watch, record, analyze, adjust 5 5

6 monitoring system landscape 6 6

7 Monitoring panorama 7 7

8 Choose suitable monitoring system Performance monitoring (realtime) Graphite, Availability monitoring Nagios, Zabbix, Centreon... Business service monitoring Advanced e.g. Grafana, New Relic, AppDynamics... aggregation capabilities built on top of existing systems RealOpInsight SLA Monitoring Advanced consolidation capabilities built on top of existing systems 8 => should be driven by needs 8

9 What to monitor? The question of gold! 9 9

10 Almost everything can be monitored hardware CPU, memory, disk, NIC... software processes, file system... services socket, port, protocol

11 Everything shall not be monitored Too much information can drown useful information You may waste time considering useless information Fact 11 Impression 11

12 What's the best monitoring? The killer question! 12 12

13 Use case: performance monitoring feeding in timeserie data Data collector Timeseries Database Mngt policies - storage - aggregation - retention Visualization (+ aggregation) 13 13

14 Demo: Graphite + Grafana 14 14

15 Use case: availability monitoring 15 15

16 Demo: Nagios 16 16

17 Availability & performance monitoring fail to link IT to business 17 17

18 Don't be confused: ops, managers, CEO... need clear information! 18 18

19 Data is good, but information is better Too many alarms kill alarm S. Bortzmeye

20 Cloud implies new ways of thinking IT Service/application-centric Constraints on SLA Leased resources multi-tenancy 20 20

21 Prioritize and orchestrate work based on business needs 21 21

22 Business Service Monitoring (BSM) Add intelligence in the monitoring Quick assess how each incident impacts your business Business impact vs Low-level incident Prioritization of incidents Delegating management, multitenancy

23 How a failure actually impacts your business? 23 23

24 Business Impact RAID 0 (striping) RAID 1 (mirroring) 24 24

25 More about business impact Redundant databases Merchant-site 25 25

26 Benefits of business service monitoring? Reduces downtime by up to 75% Delivers services up to 30% more efficiently Credit:

27 BSM is a Discipline, and Every IT Environment is Unique 27 27

28 BSM => deal with dependencies 28 28

29 About Dependencies A business service may depend on : IT items (discs, And/or processes, ping...) other business services E.g. Streaming Web Server Databases Network Operating System Hardware Devices

30 BSM => flexible incident management Data collection: only what is useful Delegating management, multitenancy, op-centric views... Specific algorithms for aggregating and propagating severities High-level notifications 30 30

31 Takes the IT you already have, and adds to it the visibility and control of a unified platform 31 31

32 Use case: RealOpInsight Versatile open source BSM toolkit Support to Nagios, Zabbix, Zenoss, Shinken, Centreon, Icinga, Naemon, GroundWork, op5... Multi-sources, multi-backends Easy to deploy, easy to use Binaries, repositories, VM images Cross-plaform (OS X, Windows, Linux), GUI and Web-based user interfaces

33 Flexible Architecture thanks to API-based integration 33 33

34 At-a-glance dashboard 34 Global overview of business services healthy Summary via thumbnails, tab status, tooltips, latest open events feeds Web UI fully compatible with mobiles 34

35 Detailed View 35 Interactive treeview, map, event console and chart Custom severity aggregation and propagation rules... 35

36 Business Views as Descriptive and Interactive Dashboards XML-based description Native WYSIWYG editor Dynamic dashboard generation 36 36

37 Demo? 37 37

38 Rodrigue About.Me PhD HPC/Cloud Former HPC/Cloud engineer Presales in Broadcast area DevOps, cloud & monitoring contributor OpenNebula Author Contributor (addons: oneinsight, SVMSched) & leader RealOpInsight Labs ( Links

39 Thanks, Q/A? Monitor at scale with business 39 39