Monitoring for the next decade Monitoring 2.0?

Transcription

1 Monitoring for the next decade Monitoring 2.0? Olivier Jan

2 About Me Co-founder of CFSL Writer of the french book «Nagios 3 au cœur de la supervision Open Source» Open Source monitoring solutions architect In charge of Capensis Poor english accent!

3 Contents A road trip experience between Predictions about what you may need in the next decade to be the king of monitoring The nowadays trends, good ideas and tools in Open Source monitoring free software inside.

4 #1 Big Distributed Architecture Because 1 mn intervall polling will be the standard You have the project to monitor the whole Internet You finally realize that NDO doesn t scale well

5 Big Setup Mod_Gearman Nagios Daemon Gearman Server Gearman Worker + LiveStatus + Multisite

6 Big Setup IcingaMQ Based on messages bus (ZeroMQ) Don t need anymore DNX or Mod_Gearman

7 Big Setup Shinken + LiveStatus + Shinken UI

8 #2 End User Experience Because You want to know quickly if that service delivered to user just works You cannot put a monitoring agent on Google Mail You know that the sum of the parts monitored is not equal to the whole

9 End User Experience You know that the sum of the parts monitored is not equal to the whole DNS OK HTTP OK OS OK NETWORK OK APPLICATION/USER OK

10 End User Experience Cucumber + Watir Behaviour Driven Monitoring Checks functionnalities Completes the technical checks

11 End User Experience Cucumber + Watir Nagios Collector Cucumber Watir Webdriver CUCUMBER CRITICAL - Critical: 1, Warning: 0, 1 okay passed=1; failed=1; nosteps=0; total=2; time=0

12 Cucumber Scenarios Abstraction layer between application managers and technicians Based on the expected behaviour You write in your native language Fonctionnalité: Achat appareil photo Scénario: Page d'accueil Etant donné que je suis sur la page d'accueil internationale Quand je clique sur le lien "France" Alors je devrais voir "En ce moment sur grosvendeur.com" Scénario: Accès à la page photos Etant donné que je suis sur la page d'accueil française de grosvendeur Quand je clique sur le lien "PHOTO" Alors je devrais voir "Le Top Ventes"

13 #3 Aggregation Correlation Because You don t want to fill mailboxes with notifications You want alignement between technical and business monitoring You want to find root cause problem and have impact analysis

14 Aggregation The tools Correlation Nagios Business Process Addon Multisite and aggregation Shinken and its business views Node Brain

15 #4 Better Charts Because rrdgraph generated charts are not so easy to read You want real values You want to choose the period you render

16 Better Graphs HighCharts What do you prefer?

17 #5 Dashboards Maps Because You want to mix events, performance, availability datas You want top views that lead to detailed views You want big screens in your datacenter

18 Dashboards Maps The tools Nagvis

19 Dashboards Maps The tools Shinken

20 Dashboards Maps

21 Mixed View

22 #6 Deliver Reports in minutes, not days Because Everyone needs SLA reports It s time consuming to prepare monitoring reports You want quickly choose the period and the scope on which you have to report It s not what you prefer

23 Reports Icinga/Jasper Reports integration

24 #7 Real Log Management Because Polling at a 5mn intervall with a check_logs will be a bit old school You catch too much boring events & miss interesting ones You know the Truth is in the logs

25 Real Log Logstash Logs transport Logs sanitizing

26 Real Log Graylog2 Logs centralisation and visual mining

27 #8 Hypervision Because You certainly answered yes to one of the previous predictions we have seen It completes your existing monitoring solutions and sit on top of them You want to enlarge your monitoring

28 Foundations Canopsis heart Sorry no checks Based on AMQP (Active Message Queue Protocol) standard with RabbitMQ Connects to your existing monitoring solutions Renders dashboards and reports you can build from libraries Engines to agregate, correlate differents types of monitoring datas (business rules, inventory )

29 Canopsis Architecture more on

30 Without them CFSL Romuald Fronteau David Guénault Capensis Netways Jean Gabès

31 Questions What Else? Thanks for your attention