A Scalable Network Monitoring System as a Public Service on Cloud

Size: px

Start display at page:

Download "A Scalable Network Monitoring System as a Public Service on Cloud"

Bertram Jones
10 years ago
Views:

1 A Scalable Network Monitoring System as a Public Service on Cloud Network Technology Lab (NTL) NECTEC, THAILAND Chavee Issariyapat Network Technology Lab (NTL), NECTEC, THAILAND [email protected]

2 Network Monitoring System o A system that constantly monitors network for failing components and notifies the network administrator in case of outages. We have a problem! 2

3 Network Monitoring System There are several open source NMS e.g. Nagios, Cacti, OpenNMS, GroundWork Monitor, MRTG

4 Our first attempt : NetHAM A software that runs on a dedicated Linux server. The core engine is based on open source software. Provides a user-friendly web interface. Summarized the status of the network using graphic. Has been used by 100s of users including schools, libraries, hospitals, small enterprises.

5 Lessons learned o NetHAM still has limitations v Need a dedicated server. may not worth for very small networks v Scaling limitation. cannot scale out v Single point of failure. no redundancy

6 Basic Idea INTERNET

7 Basic Idea INTERNET Oh really!?!

8 Basic Idea But If all the gateways are down, the monitoring server will no way be able to send out a notification. INTERNET?!!

9 Basic Idea So, in stead of this INTERNET

10 Basic Idea We do something like this.. Network Network Network

11 Basic Idea With this approach we will never miss the bad news.! Network Sir, you got to see this!! Huh Network Network

12 Basic Idea This leads to a Cloud monitoring platform! Network Sir, you got to see this!! Huh Network Network

13 Our New approach NetHAM nano SaaS. No installation! Extremely user-friendly Highly scalable Self-managed Redundant / Fault tolerant Zero downtime

14 NetHAM nano cloud Probe NetHAM nano Cloud i SMS, Push Notification E- Mail Control API

15 Inside of the cloud Monitoring Monitoring Monitoring Monitoring Gateway NetHAM nano Cloud Gateway Data Store System Notification Server Push Server Web Server Web Server Scalable Fault-tolerance Self-managed User User

16 Homogeneity of NetHAM nano cloud All NetHAM nano nodes are exactly the same! NetHAM nano also works on a single node. Scale out by adding nodes! lication

17 Homogeneity of NetHAM nano cloud When pooling as a cluster, some nodes may have some functionalities disabled. node A node B node C

18 Failover : Layer Failover mechanism is implemented on every layer B B A 1,2,4 3,6 5,7 C A 1,2,4,5 3,6,7 R U OK? C

19 Failover : Layer Database redundancy à no down time for the data store Replica Set Replica Set Replica Set.. scale out by adding shard Primary Secondary Secondary Primary Primary Secondary Primary Secondary Secondary Shard 1 Shard 2 Shard 3 Shard Router Shard Router Shard Router Shard Router.. scale out by adding shard router Web Server

20 Failover : Node Layer

21 Failover : Node Layer

22 Failover : Node Layer

23 The current testbed 5 VMs at Bangkok-Thai Tower 2 VMs at CAT Bangrak 2 VMs at CAT Nonthaburi 1 Android Tablet mobile IP (assigned dynamically) 1 PC at NTL 1 PC at OQC ( private IP ) 2 Raspberry Pi

24 Self Monitoring While monitors others, NetHAM nano is also monitoring itself! Self monitoring performs in an auto-configured & scalable & fault tolerant manner. Every node is monitored by at least one neighbor node. Like a usual host check, cross monitoring can be adapted dynamically according to a cloud manager.

25 Possible NetHAM nano Nodes Android Phones / Tablets Server / Desktop PC Virtualization nodes e.g. Virtualbox, VMWare, Amazon EC2 Embed Linux devices e.g. Raspberry Pi

26 Platform-Specific plugins Server Network service : PING, HTTP, FTP, SNMP, TCP/UDP, DNS Device statistic : CPU, memory load Network Interface : bytes in/out, operational status Home Environment : Temperature, Humidity Network : wifi, devices identified by mac addresses Mobile GPS coordinate Accelerometer, Gyrometer, Proximity sensor, Camera

27 NetHAM nano Front End SSL web integrate with Facebook lication Platform. Real-time status update via the push engine. Hassle-free user interface.

28 Front End Network topology with auto graph layout Interactive chart component with scroll & zoom capability

29 Some future use cases : Network monitoring system To monitor network devices such as switches, routers, servers. To monitor remote service e.g. PING,HTTP,SNMP (more to be added) Support distributed monitoring via multiple agents. Suitable for small networks, small offices, websites etc.

30 Some future use cases : Home applications NetHAM nano can be used to monitor home networks via usual ADSL modems. By doing a port forwarding, NetHAM nano could answer these questions : Will be even more exciting if we have a home agent!

31 Some future use cases : Smart energy By using a smart meter, it is possible to monitor home electricity consumption the same way as Google Power meter does. Monthly electric bill can be predicted. Alerts when there s anything wrong with the electric usage patterns.

32 Some future use cases : Mobile applications By imitating the standard NetHAM nano agent, we can have a compact agent run on mobile phones and tablets. In stead of checking the remote services, a compact agent checks their sensors. NetHAM nano can track device s position, speed, acceleration etc and display on the current UI with a map view. Somchai Preecha

33 Some future use cases : Information monitoring NetHAM nano can gather information from several sources and notify users according to their current locations. NetHAM nano It s going to rain in half an hour! Leave soon if you don t want to be caught in a traffic jam. Diesel price increases tomorrow at 5:00AM.

34 Project Status NetHAM nano project is under development. We are looking for places to deploy nodes to support multiple-point monitoring from different regions/countries. We are looking for innovative applications e.g. home monitoring, location-based service, specific information retrieval for end users e.g. weather alert, traffic alert, disaster report etc. Contact us at : [email protected]

35 Thank you

StruxureWare TM Data Center Expert

StruxureWare TM Data Center Expert Infrastructure management from rack to row to room to building Deploy in minutes, manage from anywhere, analyze instantly, integrate with other management systems. End