Trial of the Infinera PXM Guy Roberts, Mian Usman
LHC Workshop Recap Rather than maintaining distinct networks, the LHC community should aim to unify its network infrastructure Traffic aggregation on few links Concerns If the T1s and T2s upgrade to 100G, then the global infrastructure needs to follow LHCONE Evolution Currently LHCONE exists side-by-side with general R&E infrastructure Traffic is segregated but what's the real benefit?
LHCOPN NRENs are providing LHC with point-to-point Layer2 circuits LHC centers built a virtual routed network out of the circuits LHC centers are providing Network Services to each other: CERN is providing un-restricted transit Some centers are providing limited transit Some LHC centers are peering NRENs support individual link operations & management LHC Sites are responsible for network management (layer 3 configurations) including operations, monitoring, troubleshooting, capacity planning, security management, AUP enforcement, etc.
LHCONE as it exists at the moment LHCONE is currently setup as an overlay VRF on existing NREN infrastructure which are interconnected via regional networks and Open Exchanges NRENs provide the network including core links and routers as a virtual overlay on their regular infrastructure NRENs have a peering or transit relationship with each other LHC centers are strictly users of the services Restrictions apply to the advertised IP Space LHCONE infrastructure includes dedicated access, Trans-Atlantic and some backbone links
Use case LHCOPN/LHCONE LHCOPN: High capacity TDM, but not flexible LHCONE: flexibility of L3 VPN, but no reserved bandwidth Can we give users the best of both solutions?
PXM available 1Q 2015 Packet Switching Module 16x10GE or 16x1GE 1 x 100GE DTN-X Family Built-In 200G Packet Switch Enables QoS Packet Classification VLAN and QinQ MPLS-TP on network side MEF services Point-to-point services EP-LINE, EVP-LINE Multipoint services EP/EVP-LAN, EP/EVP-TREE
Open Transport Switch Open Transport Switch (OTS) provides an Open Flow interface to the DTN-X OTS adds transport extensions to the Open Flow interface Initially REST based interface On Infinera roadmap for Q4 2015 (R12), however, early versions available now for evaluation. Using OTS to control OTN transport circuits not that useful OTS would make a useful API to allow big science users to request EVP-LINE and EVP-LAN services via PXM
Packet OPX optimized EPL & EVPL Services over Layer 1 VPN NREN Tier 2 Campus GÉANT 500G fiber cloud NREN User service requests OF/REST CERN MEF type EVP-LAN or EVP-Line pool of provisionable OTN B/W OTS REST/OF API to allow experimenter s applications to manage connectivity Wigner Data Center
Packet OPX optimized EPL & EVPL Services over Layer 1 VPN NREN NREN GÉANT 500G fiber cloud NREN
Packet OPX optimized EPL & EVPL Services over Layer 1 VPN Tier 2 Campus NREN Tier 2 Campus GÉANT 500G fiber cloud NREN
Packet OPX optimized EPL & EVPL Services over Layer 1 VPN JANET Internet2 LHCONE ESnet LHCONE NORDUNET LHCONE Tier 2 Campus CANARIE LHCONE UK RAL NL-T1 (via Surfnet) NDGF (via NORDUNET) TRIUMF(via CANARIE ANA) BNL (via ESnet) FERMI (via ESNet) Tier 2 Campus GÉANT 500G fiber cloud DFN LHCONE NL-T1 (via Surfnet) NDGF (via NORDUNET) TRIUMF(via CANARIE ANA) BNL (via ESnet) FERMI (via ESNet) DE-KIT
PXM Evaluation and trial Field trial in Q2 2015. Pre-release PXM cards could be trialled. Evaluation and service development Field trial integration of PXM and OTS. Evaluate OTS and PXM together.
LHC Workshop Recap Rather than maintaining distinct networks, the LHC community should aim to unify its network infrastructure Traffic aggregation on few links Concerns If the T1s and T2s upgrade to 100G, then the global infrastructure needs to follow LHCONE Evolution Currently LHCONE exists side-by-side with general R&E infrastructure Traffic is segregated but what's the real benefit?
Questions??
.1.2.9.1.2 GEANT IP Backbone SDH GÉANT GÉANT IP Topology 06/01/2015 TB 100G STM-256 OC-768 40 GE STM-192 OC-576 30 GE STM-128 OC-384 20 GE STM-64 OC-192 10 GE 10 GigE / Shared GigE / 1 Gbps STM-16 OC-48 2.4 Gbps STM-4 OC-12 622 Mbps 300 Mbps STM-1 T3 / E3 155 / 45 / 34 Mbps T3 / 45 Mbps SDH / AS20965 GÉANT PoP Single international connection provided by GÉANT Cynet AS3268 98.102 98.106 200 PT ET H 10 0 98.103.185.97.166 CARIBNET AS54308 TEIN3 AS23911 125.66 IUCC AS378.186.98 VIA OLE FCCN AS1930 RENATER AP1 AS2200 FCCN AS1930 JANET AS786 UBUNTUNET AS36944.165.125.117 125.65.254.253 UK.105.106.118.53.46.54 100 FR.55.56.98.155.138 BELNET AS2611.81.197 98.89.185 HEAnet AS1213 350.82.14 HEAnet AS1213.13 JANET AS786.198 500 IE 1000 98.88 SWITCH/CERN AS559 / AS513.98.154.98.138 250 BE SURFnet AS1103 KAUST AS50999 100 100 RESTENA AS2602.230 ESNET AS293 RESTENA AS2602 ENSTINet AS6879.94.189 195.69.146.137 AMS-IX AS LUX SINET AS2907 TWAREN AS7539.145 62.40.124.188/30.22.161.162 211.79.48.144.226 GARR AS137 CANARIE AS6509 SINET AS2907 SWITCH AS559 CERN AS513 182 BELnet AS2611.184.21.146.229.225.190 62.40.124.92/30.93.25 181.137 CH.3.4.33.125.205 90 250 NL.49.33.50 100.50.162.157.221.78 LEVEL 3 AS3356 RedIRIS AS766 TIFR AS2697 ASGC AS24167.61.62 UBUNTUNET AS36944 CANARIE AS6509 ESNET AS293 NORDUnet Peering AS2603.158 SURFnet AS1103 Internet2 AS11537 IUCC AS378 Internet2 AS11537 RENATER AP2 AS2200 ARN AS3208 CAT.63.64 150 DFN AS680 DE-CIX AS15169.125.18 62.40.112.54/31 124.233 NORDUnet AS2603 NORDUnet AS2603.10.34 125.17.154.49.61 DE.7.8.161 IT.57.58.153.46.38.217 124.149.154.18 149.6.42.73 124.150 90 Cynet AS3268.129 /.181.222 Ulakbim AS8517.77.50.121 DK.47.48 Cogent AS 174 Google AS15169 Google AS36040 CAREN AS197118 VIX AS1121.218 200 NISN AS297 DFN AS680 LEVEL 3 AS3356 ACOnet AS1853 105 150 ACOnet AS1853 Cogent AS 174.2 SILK AS132467 105.1 128.41.254.0/30 AT.1.2 URAN AS12687 SAnet AS2607 175 ARNES AS2107.250 CARnet AS2108 SK SI HR.122.62.37.6.249 RoEduNet AS2614 EE.46 200.45 50.205.206 LV.170 50 LT 445.169.174.173 PL.35.36 CZ.5.6 CARnet AS2108.81.49.82 Primary.50 Primary.125.157.125.158.245 Primary.246.177.178.29.41 ARNES AS2107 Primary.125.53.125.54.125.89.161 Primary HUNGARnet AS1955 CESnet AS2852 RO.9.10 BASNET AS21274 100.125.90.162 CESnet AS2852.30.130 HU.19.20 Ulakbim AS8517 SDH 150 EEnet AS3221 SigmaNet AS5538 LITnet AS2847 PSNC AS8501 LEVEL 3 AS3356 100 HUNGARnet AS1955 MREN AS40981 AMRES AS13092 Cogent AS 174.26 TEIN3 AS24490 350 124.234 Malta AS12046 GARR AS137 GRnet AS5408 500 175 BG BREN AS6802 125.141 RedIRIS AS766 ES.13.14.137.93.138 RedCLARA AS27750 500 GR2 Primary GRnet AS5408 MARnet AS5379 194.149.130.109 194.149.130.105 (protection)
GEANT Dark Fibre Foot Print LON 58 AMS 8 ila 5 5 Ham 10* 5 ~ 10 8 ila FRA 2 58 511 11 ila PRA 54 ~4 ila PAR 511 ~19 ila GEN BRA 58 8ila 50 0 Dark Fiber 5X Number of ILAs MIL 515 VIE