Network futures: AARNet4, Science DMZ, SDN Network futures: AARNet4, Science DMZ, SDN David Wilde David Wilde
Network futures: AARNet4, Science DMZ, SDN THETA // QuestNet 12 May 2015 David Wilde Network Architect, AARNet
AARNet4 AARNet Copyright 2015
AARNet4 National Darwin Cairns Murchison Radio-Astronomy Observatory Alice Springs Townsville Mackay Rockhampton Gladstone Sippy Downs Brisbane 100Gbps Optical Network 100Gbps Capable Juniper MX Routers Geraldton Perth Adelaide Armidale Sydney Canberra KEY AARNet POP < 1 Gbps Melbourne < 2.5 Gbps < 10 Gbps WDM Transmission Hobart 4
AARNet4 - International Seattle Palo Alto San Jose Los Angeles Guam Honolulu Muana Singapore Suva Perth Sydney Auckland 5
AARNet4 network services Routed access to internet and global R&E networks Connectivity up to 10 or nx10gbps Layer 2 VPN Point-to-point or multipoint VPLS Layer 3 VPN Multipoint, your own IP addressing 6
Supporting the AARNet Portfolio It used to be about the plumbing, now it s so much more 7
AARNet4 customer migration 40 35 7 30 25 8 20 5 38 15 7 10 5 0 5 In the queue 6 Design discussion complete Proposal issued Service Agreement issued Deployment underway Completely migrated All institutions 8
Science DMZ AARNet Copyright 2015
RDSI : cloud storage for researchers www.rdsi.edu.au https://www.rdsi.edu.au/node-statuses Enabling researchers to use, reuse and manipulate significant data collections 10
RDSI : cloud storage for researchers https://www.rdsi.edu.au/node-statuses Enabling researchers to use, reuse and manipulate significant data collections 11
The problem: data sharing AARNet Copyright 2015
The problem: Brisbane-Melbourne (30ms) Perth-Sydney (50ms) Perth-LAX (160ms!) NYC- London (75ms) Image: ESNet 13
Latency 14 14
Latency 15 15
The solution: Science DMZ AARNet Copyright 2015
The solution: Friction free networking 1. Network devices selected for high performance applications 2. Dedicated systems for data transfer 3. Performance and network measurement tools 4. Security mechanisms designed for high performance 17
The solution: Friction free networking Tionette Stoddard - February 14, 2010 - Source: Richard Heathcote/Getty Images North America 18
Science DMZ and RDSI AARNet Copyright 2015
Standard campus connection 20
Campus connection with Science DMZ 21
Science DMZ deployment AARNet backbone network APL Node RDSI Node APL NAP #1 PerfSonar 1 PerfSonar 2 AARNet Layer 3 PE1 APL-NTU1 BES-1 DTN 1 Node network infrastructure Node Storage DTN 2 Inter-Node VPN PE2 APL-NTU2 APL NAP #2 BES-2 22 22
RDSI : high speed network connectivity Primary Node Secondary Node AARNet 4 Routed Access Inter-node VPN 23
PerfSonar 24 24
DTN : Aspera + Globus Online 25 25
Moving forward: Science DMZ on your campus? 26
SDN AARNet Copyright 2015
The AARNet SDN testbed SDN switch Seattle Perth Sydney Melbourne 28
The AARNet SDN testbed 29
The ANZSDN testbed Successful LIEF grant >> 9 universities + CSIRO + AARNet 30
Useful links AARNet SDN testbed: Contact me: david.wilde@aarnet.edu.au (More info coming soon on www.aarnet.edu.au ) LIEF-funded ANZSDN testbed: Talk to Vijay Sivaraman (UNSW): vijay@unsw.edu.au https://sites.google.com/site/anzsdntestbed/ SDN in general: Get involved! http://www.anzsdn.net/ http://www.meetup.com/australian-sdn-meetup 31
David Wilde david.wilde@aarnet.edu.au
Spare slides 33
Components Data transfer nodes: Dell Poweredge 720XD, 64GB RAM, 2 x SSD, 2 x 3.4GHz 8-core CPU 3 x Mellanox Connect3 VPI card (10/40 ethernet 10/40/56 IB) PerfSonar: 2-blade Supermicro + Mellanox NICs PerfSonar Toolkit; MadDash dashboard Data transfer tools: Aspera, Globus/GridFTP Border edge switch: Juniper EX4550; Cisco 6800/NX6K/NX5K; Dell Force10 34
Research Drivers: Really Big Data Large Hadron Collider Square Kilometre Array Climate Change Data Genomics Data 35
Other research projects Catlin Global Reef Record Global research on greenhouse gases Disease transmission among lizards Historical newspaper record 36 https://www.rdsi.edu.au/use-cases
Challenges AARNet Copyright 2015
Latency Solution: tightly manage the DTN: NIC drivers, OS updates Careful choice of TCP congestion avoidance algorithm 12 10 8 6 Series1 4 2 0 1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127 134 141 148 155 162 169 176 183 190 197 204 211 218 225 232 239 246 253 260 267 274 281 288 38 38
Compatibility of storage architectures & vendors 39
Compatibility of storage architectures & vendors AARNet 4 Routed Access Inter-node VPN 40
Compatibility of storage architectures & vendors AARNet 4 Routed Access Inter-node VPN Solution: Science DMZ architecture + L3VPN for inter-node traffic 41
User tools & familiarity Command line tools = Typical Australian researcher 42 Images: fasterdata.es.net and pinterest.com
User tools & familiarity Solution: keep it simple => Focus on one tool (eg. Aspera) => Many users just want a mapped drive although non-web authentication an issue => Partner with eresearch organisations for training and outreach = 43
Moving forward AARNet Copyright 2015
Improved integration with other projects 45
Improved integration with other projects 46
Better integration with cloud providers 47
Add SDN for more flexibility 48
Increased bandwidth Darwin Cairns Murchison Radio-Astronomy Observatory Alice Springs Townsville Mackay Rockhampton Gladstone 100Gbps Optical Network Sippy Downs Brisbane Geraldton Perth Adelaide Armidale Sydney Canberra KEY AARNet POP < 1 Gbps Melbourne < 2.5 Gbps < 10 Gbps WDM Transmission Hobart 49
Increased bandwidth Darwin Cairns Murchison Radio-Astronomy Observatory Alice Springs Townsville Mackay Rockhampton Gladstone 100Gbps Optical Network Sippy Downs Brisbane Geraldton Perth Adelaide Armidale Sydney Canberra KEY AARNet POP < 1 Gbps Melbourne < 2.5 Gbps < 10 Gbps WDM Transmission Hobart 50