PORTOLAN. Probing the Internet through Smartphone-based Crowdsourcing
|
|
|
- Dennis Chase
- 10 years ago
- Views:
Transcription
1 PORTOLAN Probing the Internet through Smartphone-based Crowdsourcing Adriano Faggiani, Enrico Gregori, Alessandro Improta, Luciano Lenzini, Valerio Luconi, Alessio Vecchio RIPE 67 Athens October 2013
2 Monitoring Regional Internet Infrastructure Discover the map of the Internet at the Autonomous System level of abstraction with active and passive techniques RIPE 67 Athens, October / 18
3 Isolario Project Area Internet AS-level passive measurement Goals Provide ready-to-use AS-level data Become a route collector project do-ut-des: services in change of BGP data RIPE 67 Athens, October / 18
4 Isolario Project Input Data Raw BGP messages provided by RouteViews RIS and PCH Month by month since July 2000 Output Data AS-level Topology (Global and Geographic) Economic AS-level Topology (Global and Geographic) AS characteristics AS Covering RIPE 67 Athens, October / 18
5 Portolan Project Area Internet probing with active measurement Crowdsourcing approach Smartphone-based Client app for Android OS RIPE 67 Athens, October / 18
6 Why crowdsourcing? The power of crowds RIPE 67 Athens, October / 18
7 Why crowdsourcing? Multiple observation points RIPE 67 Athens, October / 18
8 Why crowdsourcing? End user perspective RIPE 67 Athens, October / 18
9 Why smartphones? Exponential growth of devices RIPE 67 Athens, October / 18
10 Why smartphones? High mobility and always on RIPE 67 Athens, October / 18
11 Why smartphones? Easily geolocalized (GPS) RIPE 67 Athens, October / 18
12 Portolan - Mobile App Application for Android OS Available on Italian Google Store since 6th December, 2012 Available on World Google Store since 16th June, 2013 RIPE 67 Athens, October / 18
13 Methodology User-driven measurements (incentive) User can perform Traceroute, AS-Traceroute, Throughput Estimation, Ping or RSS measurement The app shows results and send them to our server The user is responsible for the amount of bandwidth and energy consumed Background measurements Our server can trigger traceroutes in order to discover AS links When user start geolocation apps (e.g. GoogleMaps, SportTracker etc.) Portolan collects RSS samples in background without costs for user Low battery consumption (less than 1%/day) and Low network traffic (less than 2 MB/day) RIPE 67 Athens, October / 18
14 User-driven measurements (incentive) - Network Tools Traceroute RIPE 67 Athens, October / 18
15 User-driven measurements (incentive) - Network Tools Traceroute AS-Traceroute RIPE 67 Athens, October / 18
16 User-driven measurements (incentive) - Network Tools Traceroute AS-Traceroute Visual Traceroute RIPE 67 Athens, October / 18
17 User-driven measurements (incentive) - Network Tools Maximum throughput estimator RIPE 67 Athens, October / 18
18 User-driven measurements (incentive) - Network Tools Maximum throughput estimator Ping RIPE 67 Athens, October / 18
19 User-driven measurements (incentive) - Network Tools Maximum throughput estimator Ping BitTorrent Test (available soon) Check if your ISP blocks or shapes your BitTorrent traffic RIPE 67 Athens, October / 18
20 User-driven measurements (incentive) - Coverage Tools Signal coverage tools Coverage map with every data collected RIPE 67 Athens, October / 18
21 User-driven measurements (incentive) - Coverage Tools Signal coverage tools Coverage map with every data collected Trace signal coverage along user s path RIPE 67 Athens, October / 18
22 Background measurements UDP-traceroute tool based on Paris Traceroute and Multipath Detection Algorithm Regional Traceroute Campaigns Short range measurements Smart measurements driven by collected BGP data Active and passive techniques cooperation Default measurement campaign User-interface to tailor specific measurement campaigns Discover the structure of the periphery of the Internet RIPE 67 Athens, October / 18
23 Results - Setup Measurement campaign for discovering the Italian Internet structure (May - June 2013) Sources: 12 Italian ASes hosting a Portolan monitor Destinations: All the Italian Stub ASes (566 ASes) RIPE 67 Athens, October / 18
24 Results - Statistics Number of Devices: 101 ASes Devices 137 (GARR) (WIND) (Fastweb) (TIM) (Telecom) (Tiscali) (H3G) (Vodafone) (Clouditalia) (McLink) (Piemonte Research Net) (LeoNet) 1 RIPE 67 Athens, October / 18
25 Results - Links 1464 links discovered Results compared with CAIDA IPv4 Routed /24 AS Links dataset 528 links out of 1464 (36.07%) previously unknown Portolan Discovered Links Previously unknown Direct (19.67%) IXP (81.86%) Total (36.07%) RIPE 67 Athens, October / 18
26 Portolan Monitor Distribution Currently Portolan counts about 300 active installations RIPE 67 Athens, October / 18
27 Conclusion Mobile Phones a new opportunity for network monitoring Android OS is more flexible than other mobile OS. ios and WindowsPhone are strongly limited environments Challenge: large user base Smart Traceroute: Short-range BGP driven Collaboration with legacy traceroute infrastructures (such ATLAS) Increase the number of vantage points Use ICMP Paris traceroute (unavailable on Android and able to discover more links than UDP Paris) RIPE 67 Athens, October / 18
28 The end Thank you for your attention! Questions? Available at Google Play store RIPE 67 Athens, October / 18
Internet Infrastructure Measurement: Challenges and Tools
Internet Infrastructure Measurement: Challenges and Tools Internet Infrastructure Measurement: Challenges and Tools Outline Motivation Challenges Tools Conclusion Why Measure? Why Measure? Internet, with
Results from MyConnection SG Pilot (October 2014 March 2015)
Results from MyConnection SG Pilot (October 2014 March 2015) IDA launched the MyConnection SG mobile application in October 2014 to complement the IDA Quality of Service ( QoS ) framework to allow IDA
Performance Monitoring Solution. Service Assurance through QoE and QoS insight
Performance Monitoring Solution Service Assurance through QoE and QoS insight See your network through the eyes of your customers The quest for fewer support calls, reduced churn rates and increased data
The Joint Degree Distribution as a Definitive Metric of the Internet AS-level Topologies
The Joint Degree Distribution as a Definitive Metric of the Internet AS-level Topologies Priya Mahadevan, Dimitri Krioukov, Marina Fomenkov, Brad Huffaker, Xenofontas Dimitropoulos, kc claffy, Amin Vahdat
An Evaluation of Peering and Traffic Engineering in the Pan- African Research and Education Network
An Evaluation of Peering and Traffic Engineering in the Pan- African Research and Education Network *Clifford Sibanda (National University of Science and Technology- Bulawayo) *Josiah Chavula (Mzuzu University
Traceroute The Internet s Diagnostic Tool
Traceroute The Internet s Diagnostic Tool NTT Communications Global IP Network White Paper By Charles Sellers, CISSP May, 2006 NTT, NTT Communications, and the NTT Communications logo are registered trademarks
DOCUMENT REFERENCE: SQ312-003-EN. SAMKNOWS SMARTPHONE-BASED TESTING SamKnows App for Android White Paper. May 2015
DOCUMENT REFERENCE: SQ312-003-EN SAMKNOWS SMARTPHONE-BASED TESTING SamKnows App for Android White Paper May 2015 SAMKNOWS QUALITY CONTROLLED DOCUMENT. SQ REV LANG STATUS OWNER DATED 312 003 EN FINAL JP
Internet topology and performance analytics for mapping critical network infrastructure
CYBER SECURITY DIVISION 2014 R&D SHOWCASE AND TECHNICAL WORKSHOP Internet topology and performance analytics for mapping critical network infrastructure CAIDA/UCSD PI k claffy 16-18 December 2014 1 Team
SIGCOMM Preview Session: Data Center Networking (DCN)
SIGCOMM Preview Session: Data Center Networking (DCN) George Porter, UC San Diego 2015 These slides are licensed under a Creative Commons Attribution- NonCommercial- ShareAlike 4.0 International license
Summary : Mapping Interconnection in the Internet: Colocation, Connectivity and Congestion
Summary: Mapping Interconnection in the Internet: Colocation, Connectivity and Congestion As the global Internet expands to satisfy the demands and expectations of an ever-increasing fraction of the world
Measurement Study on the Internet reachability. 3.1 Introduction. 3. Internet Backbone
3. Measurement Study on the Internet reachability Internet reachability can be assessed using control-plane and data-plane measurements. However, there are biases in the results of these two measurement
How NOC manages and controls inter-domain traffic? 5 th tf-noc meeting, Dubrovnik [email protected]
How NOC manages and controls inter-domain traffic? 5 th tf-noc meeting, Dubrovnik [email protected] Agenda Inter-domain traffic: o how does NOC monitor and control it? Common case as example: new BGP
APP USER MANUAL. Trackunit Virtual Hardware. Status / Tracking / Map
APP USER MANUAL Trackunit Virtual Hardware Status / Tracking / Map Trackunit 2013 Table of Contents 1. Introduction... 2 Features... 2 Get started... 2 2. Status and tracking... 3 Network... 3 Account...
The Benefits. Locator/ID Separation
INL: IP Networking Lab Université Catholique de Louvain The Benefits of Locator/ID Separation AGAVE: A lightweight Approach for Viable End-to-end IP-based QoS Services Joint Work: L. Iannone, O.Bonaventure,
Smart Tips. Enabling WAN Load Balancing. Key Features. Network Diagram. Overview. Featured Products. WAN Failover. Enabling WAN Load Balancing Page 1
Smart Tips Enabling WAN Load Balancing Overview Many small businesses today use broadband links such as DSL or Cable, favoring them over the traditional link such as T1/E1 or leased lines because of the
Efficient strategies for active interface-level network topology discovery
Calhoun: The NPS Institutional Archive Theses and Dissertations Thesis Collection 2013-09 Efficient strategies for active interface-level network topology discovery Baltra, Guillermo P. Monterey, California:
John A. Volpe National Transportation Systems Center. Connected Vehicle and Big Data: Current Practices, Emerging Trends and Potential Implications
John A. Volpe National Transportation Systems Center Connected Vehicle and Big Data: Current Practices, Emerging Trends and Potential Implications March 27, 2014 Purpose and Organization Purpose set the
Outline. Outline. Outline
Network Forensics: Network Prefix Scott Hand September 30 th, 2011 1 What is network forensics? 2 What areas will we focus on today? Basics Some Techniques What is it? OS fingerprinting aims to gather
Characterizing Large-scale Routing Anomalies: A Case Study of the China Telecom Incident
Characterizing Large-scale Routing Anomalies: A Case Study of the China Telecom Incident Rahul Hiran 1, Niklas Carlsson 1, and Phillipa Gill 2 1 Linköping University, Sweden 2 Citizen Lab, Munk School
Infrastructure for active and passive measurements at 10Gbps and beyond
Infrastructure for active and passive measurements at 10Gbps and beyond Best Practice Document Produced by UNINETT led working group on network monitoring (UFS 142) Author: Arne Øslebø August 2014 1 TERENA
Detecting BGP hijacks in 2014
Detecting BGP hijacks in 2014 Guillaume Valadon & Nicolas Vivet Agence nationale de la sécurité des systèmes d information http://www.ssi.gouv.fr/en NSC - November 21th, 2014 ANSSI - Detecting BGP hijacks
A Strategy for Transitioning to BGP Security
NANOG 52 Denver, CO June 14, 2011 A Strategy for Transitioning to BGP Security Sharon Goldberg Boston University Phillipa Gill University of Toronto Michael Schapira Princeton University Princeton University
Internet Firewall CSIS 4222. Packet Filtering. Internet Firewall. Examples. Spring 2011 CSIS 4222. net15 1. Routers can implement packet filtering
Internet Firewall CSIS 4222 A combination of hardware and software that isolates an organization s internal network from the Internet at large Ch 27: Internet Routing Ch 30: Packet filtering & firewalls
Testing & Assuring Mobile End User Experience Before Production. Neotys
Testing & Assuring Mobile End User Experience Before Production Neotys Agenda Introduction The challenges Best practices NeoLoad mobile capabilities Mobile devices are used more and more At Home In 2014,
DOCUMENT REFERENCE: SQ312-002-EN. SAMKNOWS SMARTPHONE-BASED TESTING SamKnows App for Android White Paper. March 2014
DOCUMENT REFERENCE: SQ312-002-EN SAMKNOWS SMARTPHONE-BASED TESTING SamKnows App for Android White Paper March 2014 SAMKNOWS QUALITY CONTROLLED DOCUMENT. SQ REV LANG STATUS OWNER DATED 312 002 EN FINAL
RIPE Atlas. Philip Smith Network Startup Resource Center (NSRC) PacNOG 16 1 st December 2014, Honiara, Solomon Islands
Philip Smith Network Startup Resource Center (NSRC) PacNOG 16 1 st December 2014, Honiara, Solomon Islands Intro https://atlas.ripe.net 3 Atlas in the Pacific 4 Measurement Devices 5 v1 & v2: Lantronix
The Coremelt Attack. Ahren Studer and Adrian Perrig. We ve Come to Rely on the Internet
The Coremelt Attack Ahren Studer and Adrian Perrig 1 We ve Come to Rely on the Internet Critical for businesses Up to date market information for trading Access to online stores One minute down time =
BGP Prefix Hijack: An Empirical Investigation of a Theoretical Effect Masters Project
BGP Prefix Hijack: An Empirical Investigation of a Theoretical Effect Masters Project Advisor: Sharon Goldberg Adam Udi 1 Introduction Interdomain routing, the primary method of communication on the internet,
Traffic Engineering for Pan-African Research and Education Network: Software Defined Internet exchange Points
Traffic Engineering for Pan-African Research and Education Network: Software Defined Internet exchange Points Josiah Chavula Supervisors: A/Prof. Hussein Suleman, A/Prof. Antoine Bagula 1 Introduction
BIG DATA FOR MODELLING 2.0
BIG DATA FOR MODELLING 2.0 ENHANCING MODELS WITH MASSIVE REAL MOBILITY DATA DATA INTEGRATION www.ptvgroup.com Lorenzo Meschini - CEO, PTV SISTeMA COST TU1004 final Conference www.ptvgroup.com Paris, 11
Towards a Next- Generation Inter-domain Routing Protocol. L. Subramanian, M. Caesar, C.T. Ee, M. Handley, Z. Mao, S. Shenker, and I.
Towards a Next- Generation Inter-domain Routing Protocol L. Subramanian, M. Caesar, C.T. Ee, M. Handley, Z. Mao, S. Shenker, and I. Stoica Routing 1999 Internet Map Coloured by ISP Source: Bill Cheswick,
IxChariot Pro Active Network Assessment and Monitoring Platform
IxChariot Pro Active Network Assessment and Monitoring Platform Network performance and user experience are critical aspects of your business. It is vital to understand customers perception of your website,
IP Network Monitoring and Measurements: Techniques and Experiences
IP Network Monitoring and Measurements: Techniques and Experiences Philippe Owezarski LAAS-CNRS Toulouse, France [email protected] 1 Outline 4 Introduction 4 Monitoring problematic 8Only based on network administration
Using IPM to Measure Network Performance
CHAPTER 3 Using IPM to Measure Network Performance This chapter provides details on using IPM to measure latency, jitter, availability, packet loss, and errors. It includes the following sections: Measuring
Webinar: Advanced RIPE Atlas Usage
Webinar: Advanced RIPE Atlas Usage Vesna Manojlovic Christopher Amin RIPE NCC Amsterdam August 2015 Goals 2 Learn how to: Use RIPE Atlas measurements for network monitoring and troubleshooting Use API
TE in action. Some problems that TE tries to solve. Concept of Traffic Engineering (TE)
1/28 2/28 TE in action S-38.3192 Verkkopalvelujen tuotanto S-38.3192 Network Service Provisioning Networking laboratory 3/28 4/28 Concept of Traffic Engineering (TE) Traffic Engineering (TE) (Traffic Management)
Android OS Mobile Dialer Application Manual. Make low cost Internet calls from Android Smartphone or Tablet
Android OS Mobile Dialer Application Manual Make low cost Internet calls from Android Smartphone or Tablet Android Mobile Dialer Application 1. Introduction... 2 2. Signup... 3 3. Download & Setup... 5
Doing Don ts: Modifying BGP Attributes within an Autonomous System
Doing Don ts: Modifying BGP Attributes within an Autonomous System Luca Cittadini, Stefano Vissicchio, Giuseppe Di Battista Università degli Studi RomaTre IEEE/IFIP Network Operations and Management Symposium
An overview on Internet Measurement Methodologies, Techniques and Tools
An overview on Internet Measurement Methodologies, Techniques and Tools AA 2012/2013 [email protected] (Agenda) Lezione 24/04/2013 Part 1 Intro basic concepts ISP Traffic exchange (peering)
Deploying in a Distributed Environment
Deploying in a Distributed Environment Distributed enterprise networks have many remote locations, ranging from dozens to thousands of small offices. Typically, between 5 and 50 employees work at each
How To Manage Outgoing Traffic On Fireware Xtm
Fireware XTM Training Instructor Guide Fireware XTM Multi-WAN Methods Exploring Multi-WAN Through Hands-On Training This training is for: Devices WatchGuard XTM 2 Series /WatchGuard XTM 5 Series / WatchGuard
Active Measurement Data Analysis Techniques
3/27/2000: This work is an Authors version, and has been submitted for publication. Copyright may be transferred without further notice and the accepted version may then be posted by the publisher. Active
IP addressing and forwarding Network layer
The Internet Network layer Host, router network layer functions: IP addressing and forwarding Network layer Routing protocols path selection RIP, OSPF, BGP Transport layer: TCP, UDP forwarding table IP
A Second Look at Detecting Third-Party Addresses in Traceroute Traces with the IP Timestamp Option
A Second Look at Detecting Third-Party Addresses in Traceroute Traces with the IP Timestamp Option Matthew Luckie and kc claffy {mjl,kc}@caida.org CAIDA, UC San Diego, USA Abstract. Artifacts in traceroute
Internet Traffic Measurement
Internet Traffic Measurement Internet Traffic Measurement Network Monitor Placement Measurement Analysis Tools Measurement Result Reporting Probing Mechanism Vantage Points Edge vs Core Hardware vs Software
Multihoming and Multi-path Routing. CS 7260 Nick Feamster January 29. 2007
Multihoming and Multi-path Routing CS 7260 Nick Feamster January 29. 2007 Today s Topic IP-Based Multihoming What is it? What problem is it solving? (Why multihome?) How is it implemented today (in IP)?
Internet Services. Amcom. Support & Troubleshooting Guide
Amcom Internet Services This Support and Troubleshooting Guide provides information about your internet service; including setting specifications, testing instructions and common service issues. For further
Internet Connection Quality Evaluation Tool The NetTest platform
Internet Connection Quality Evaluation Tool The NetTest platform April 2014 Key Issues Of Internet Connection Quality Evaluation Main indicator of internet connection quality = bandwidth available to the
An introduction to peering in Italy
Interconnections among the Italian networks @rfc1036 Seeweb s.r.l. LINX87 meeting - November 18, 2014 The Italian Internet Exchanges The major ones are: MIX-IT - Milano NAMEX - Roma TOP-IX
Distributed Systems. 25. Content Delivery Networks (CDN) 2014 Paul Krzyzanowski. Rutgers University. Fall 2014
Distributed Systems 25. Content Delivery Networks (CDN) Paul Krzyzanowski Rutgers University Fall 2014 November 16, 2014 2014 Paul Krzyzanowski 1 Motivation Serving web content from one location presents
SEACW DELIVERABLE D.1.6
SEACW DELIVERABLE D.1.6 Validation Methodology Specifications Project Acronym SEACW Grant Agreement No. 325146 Project Title Deliverable Reference Number Deliverable Title Social Ecosystem for Antiaging,
shortcut Tap into learning NOW! Visit www.informit.com/shortcuts for a complete list of Short Cuts. Your Short Cut to Knowledge
shortcut Your Short Cut to Knowledge The following is an excerpt from a Short Cut published by one of the Pearson Education imprints. Short Cuts are short, concise, PDF documents designed specifically
Policy Based Forwarding
Policy Based Forwarding Tech Note PAN-OS 4.1 Revision A 2012, Palo Alto Networks, Inc. www.paloaltonetworks.com Contents Overview... 3 Security... 3 Performance... 3 Symmetric Routing... 3 Service Versus
Restorable Logical Topology using Cross-Layer Optimization
פרויקטים בתקשורת מחשבים - 236340 - סמסטר אביב 2016 Restorable Logical Topology using Cross-Layer Optimization Abstract: Today s communication networks consist of routers and optical switches in a logical
Users Get Routed: Traffic Correlation on Tor by Realistic Adversaries
Users Get Routed: Traffic Correlation on Tor by Realistic Adversaries Aaron Johnson 1 Chris Wacek 2 Rob Jansen 1 Micah Sherr 2 Paul Syverson 1 1 U.S. Naval Research Laboratory, Washington DC {aaron.m.johnson,
NETGEAR genie Apps. User Manual. 350 East Plumeria Drive San Jose, CA 95134 USA. August 2012 202-10933-04 v1.0
User Manual 350 East Plumeria Drive San Jose, CA 95134 USA August 2012 202-10933-04 v1.0 Support Thank you for choosing NETGEAR. To register your product, get the latest product updates, get support online,
VirtIX. Virtual Internet Exchange. IPredator et al. virtix.st
Virtual Internet Exchange virtix.st Introducing the Virtual Internet Exchange Managerial summary What is the? The idea of is to build an ISP-level VPN provider for Tier 3 and to allow peering at a Virtual
Defending against Flooding-Based Distributed Denial-of-Service Attacks: A Tutorial
Defending against Flooding-Based Distributed Denial-of-Service Attacks: A Tutorial Rocky K. C. Chang The Hong Kong Polytechnic University Presented by Scott McLaren 1 Overview DDoS overview Types of attacks
BGP Convergence in much less than a second Clarence Filsfils - [email protected]
BGP Convergence in much less than a second Clarence Filsfils - [email protected] 1 Down Convergence T1 Down Convergence T2 Default metric = 1 Src R R 20 F Dst Link L Assume a flow from Src to Dest T1: when
CHAPETR 3. DISTRIBUTED DEPLOYMENT OF DDoS DEFENSE SYSTEM
59 CHAPETR 3 DISTRIBUTED DEPLOYMENT OF DDoS DEFENSE SYSTEM 3.1. INTRODUCTION The last decade has seen many prominent DDoS attack on high profile webservers. In order to provide an effective defense against
A Summary of Network Traffic Monitoring and Analysis Techniques
http://www.cse.wustl.edu/~jain/cse567-06/ftp/net_monitoring/index.html 1 of 9 A Summary of Network Traffic Monitoring and Analysis Techniques Alisha Cecil, [email protected] Abstract As company intranets
User Guide for the Volvo On Call mobile application
User Guide for the Volvo On Call mobile application This document provides basic information on the pre-requisites, functionalities and limitations of the Volvo On Call mobile application. General Information
Performance Measurement of Wireless LAN Using Open Source
Performance Measurement of Wireless LAN Using Open Source Vipin M Wireless Communication Research Group AU KBC Research Centre http://comm.au-kbc.org/ 1 Overview General Network Why Network Performance
Layer Four Traceroute (and related tools) A modern, flexible path-discovery solution with advanced features for network (reverse) engineers
Layer Four Traceroute (and related tools) A modern, flexible path-discovery solution with advanced features for network (reverse) engineers So, what is path discovery and why is it important? Path discovery