A Network Monitoring System with a Peer-to- Peer Architecture

Transcription

1 A Network Moitorig System with a Peer-to- Peer Architecture Paulo Salvador ad Rui Valadas Uiversity of Aveiro Istitute of Telecommuicatios

2 Summary Motivatio Peer-to-peer architecture System elemets Data files types Hierarchy Moitorig fuctios Data maagemet Storage Replicatio Search Dowload

3 Motivatio The growig complexity of moder data etworks requires versatile ad scalable etwork moitorig architectures A peer-to-peer (P2P) architecture allows high tolerace to failures ad distributed storage of measured data

4 System elemets Probes Moitorig elemets Perform passive ad active measuremets Store data files Super-probes Cotrol probes Commuicate with other groups Cliet Network admiistrator iterface Ca itegrate additioal data aalysis modules

5 Moitorig fuctios Active measuremets Oe-way or two-way delays Losses Passive measuremets Packet or flow moitorig Throughput Ay additioal moitorig modules

6 Heavy ad light data files There are two types of data files: Light data files Broadcasted to all probes Store the moitorig system parameters ad summary statistics of the traffic Provide a coarse, but updated ad fully available, view of the etwork status Heavy data files Store the results of all scheduled measuremets Ca iclude detailed packet or flow iformatio, ad statistics of packet delays ad losses measured over a period of time, obtaied through active or passive moitorig techiques Are stored at the probe that created them ad are possibly replicated at other probes

7 System hierarchy Moitorig groups Similar to Gutella 0.6 Aggregates probes ad super probes i the same moitorig area Reduces the cotrol traffic Improves scalability

8 Hadshakig Establish TCP coectio Sed PING message / waits for PONG message PING icludes: Mode (probe or superprobe) Available resources PONG Mode (probe or superprobe) ACK/NAK flag Address of aother superprobe (if kow) Light data file (i case of acceptace)! ( "") #$*+& #$%& ' ( ' " #$%& ' ',- #.& ' ""

9 Probes promotio Probe promotio Triggered whe superprobe is overloaded 1. PONG message set to future super-probe promotio flag activated 2. PONG message set to probes that will be reassiged bye flag activated 3. Reassiged probes coect to ew superprobe Super-probe demotio also possible

10 Moitorig groups Super-probes will be coect through a full mesh of TCP coectios

11 Data storage Distributed data archive system Probes store locally the results of their measuremets i the heavy data files but also replicate these files i some other probes Data remais available eve if the probe that made the measuremets becomes iactive Faster ad more reliable data retrieval usig P2P file sharig techiques amely the Partial File Sharig Protocol is possible Data files are assiged a set of meta-data tags File ame, type of measuremet, date, addresses, origial probe, origial group, file hash

12 Heavy data replicatio! 1. A probe whe obtais a ew heavy data file otifies its super-probe 2. The super-probe seds (immediately or ot) a replicatio order idicatig oe (or more) locatios for storig the data 3. The probe trasfers the heavy data file 4. The destiatio probe sigals the super-probe ackowledgig that the ew replica is available for dowload

13 Data files query The cliet iitiates a search by edig a QUERY message to its probe. The QUERY message will the be broadcasted to super-probes I case of a global search the QUERY message is set to all super-probes of the moitorig system Each super-probe has a list of all heavy data files stored i its probes

14 Data files query Whe a super-probe receives a QUERY message with a file descriptor matchig oe (or more) of its heavy data files, it respods with a QUERYHIT message The QUERYHIT message icludes the address of the probe where the heavy data file is located ad its meta-tags

15 Data dowload Performed directly betwee the cliet ad the probes usig HTTP Ca be made from multiple sources resortig to the Partial File Sharig Protocol The Gutella 0.6 lik compressio extesio ca be used

16 Coclusios We proposed a etwork moitorig system with a peer-to-peer (P2P) architecture Allows high tolerace to failures ad distributed storage of measured data The proposed architecture is flexible i adaptig to various etwork coditios ad available resources