Network measurement II. Sebastian Castro NZRS 27 th May 2015 Victoria University

Transcription

1 Network measurement II Sebastian Castro NZRS 27 th May 2015 Victoria University

2 Agenda Network measurement in the wild Common pitfalls in methodologies Network measurement datasets Stories Our work

3 AMP Project Active Measurement Project, Waikato University probes across New Zealand for active network measurement NZRS strong supporter of the project

4 Truenet NZ Organization doing broadband measurement Results used by media and government to decide who s best

5 Netflix ISP speed index Every Netflix client does network measurement: latency, loss, jitter, bandwidth Main objective: maximize user experience, minimize buffering New Zealand case: Best SNAP, worse Spark

6 RIPE DNSMON Active measurement of critical DNS infrastructure Latency, Packet loss

7 RIPE Atlas Distributed measurement platform 8200 probes around the world! Open API to execute measurements DNS, traceroute, ping, HTTP, HTTPS Possibilities are endless!

8 MLab Consortium of research, industry and public-interest partners Platform, data, tools and visualizations Notable tools: NDT, Glasnot

9 Common pitfalls Throughput!= User experience Testing throughput with web traffic Delay!= Web response Different layers A web request includes: DNS query and response, TCP connection, object request, object transfer Use ICMP to test everything Mixed policies how to handle ICMP Could get de-prioritized, dropped, etc. When possible, use application traffic

10 Common pitfalls Bandwidth!= Throughput Throughput is from an application PoV Bandwidth is a measure of capacity UDP will give you something closer to BW TCP will give you something closer to Throughput. The speed of end points matter OS of end-points matter End points are key! ISP X offers plans of 50Mbps download Key question: from where to where?

11 Advise Practical Guide to Correctly troubleshoot with traceroute presentations/sunday/ras_traceroute_n45.pdf Many of the concepts showed before are explained there, excellent read!

12 Datasets Scans.io From University of Michigan Various Internet wide scans Specific application ports Really useful to avoid doing your own

13 Datasets DITL: Day in the Life of the Internet Largest collection of DNS data in the world Two days of packet captures, annually Root servers, TLD, other

14 Datasets RouteViews Near real-time archive of Internet routing data Multiple sites, BGP view of the world Datasets at Nice visualization at Allow us to do stuff like

15 Datasets RIPE RIS Routing Information Service Collection of Internet Routing data by RIPE Similar and complementary to RouteViews Enables query and visualization tools

16 Stories from network research Measure network characteristics Determine protocol compliance Discover support for new features Like IPv6? DNSSEC? Independent data for policy reasons Network neutrality Economics of Internet Security

17 Stories Measuring network characteristics How the Internet looks like?

18 Stories Internet, Brazil and the World Cup More football and Internet data Internet Traffic During Euro

19 Stories Protocol compliance Path MTU Discovery inferring-and-debugging-path-mtu-discoveryfailures

20 Stories New features support IPv6 statistics.html DNSSEC

21 Stories Network Neutrality Project Glasnot from Mlab Detect if ISP is doing application-specific traffic shaping internethealthtest/

22 Stories Economics Who s the biggest Internet provider in the world?

23 Security HeartBleed vulnerability Internet wide scanners to find vulnerable sites Open Resolvers Internet wide scans to find vulnerable servers Open NTP No need to repeat Various Internet wide scans

24 Our Work NZRS:.nz Domain Name Registry Part of InternetNZ: A better world through a better Internet Technical Research DNS Data Analysis Internet Topology Broadband Map

25 Our work Internet Topology BGP Map: IP Map: DNS Data Analysis Domain popularity ranking: Broadband Map To be announced really soon Spark and DNSSEC validation