SINET3 for Grid Environments (New Japanese Academic Backbone Network)

Transcription

1 SINET3 for Grid Environments (New Japanese Academic Backbone Network) M. Koibuchi, M. Nakao, and NW groupers National Institute of Informatics (NII), JAPAN 1

2 2 Evolution of Japanese Academic Networks SINET3 is integrated successor network to two academic networks, SINET and Super-SINET, economically and flexibly providing rich variety of services. SINET3 started its operations in April 2007 and completed its migration in May Packet Switching Network Internet backbone for more than 700 universities and research institutions SINET Super-high-speed environment for cutting-edge research Super-SINET Growing traffic and diversified user requirements - Limited abilities of existing IP routers - New trend of end-to-end circuit services SINET3

3 Service Categories in SINET3 SINET3 emphasizes four service aspects: transfer layer, virtual private network (VPN), quality-of-service (QoS), and bandwidth on demand. Best Effort High Priority QoS-guaranteed Fitting to Parallel and Distributed Computing L3VPN Multicast (QoS) Application-based QoS L3VPN Multicast Multi-homing IPv4 IPv6 VPLS (QoS) L2VPN (QoS) VPLS L2VPN On-demand BW-specified L1VPN Lambda L1VPN IP (L3) Ethernet (L2) Lambda/Dedicated (L1) 3

4 4 Multiple Layer Services SINET3: integrated network providing all transfer layer services. Users can freely choose best transfer layer for their applications. It provides economical service provision and flexible network resource assignment for ever-changing and unpredictable service demands. Past Networks SINET3 User Equipment User Equipment Ethernet Switch IP network (Layer 3) Ethernet network (Layer 2) Innovative Integration Ethernet Switch Provides all transfer layer services Integrated network Cutting-edge Device Dedicated line network (Layer 1) Cutting-edge Device

5 5 Multiple VPN Services For collaborative research activity: closed user group environment (virtual private network: VPN) is essential for security reasons. Users can choose from L3VPN (IP), L2VPN/VPLS (Ethernet), and L1VPN services. * Virtual Private Network (VPN); Virtual Private LAN Service (VPLS) Super-SINET SINET3 IP-based VPN (L3VPN) Secure Closed User Group Expansion of Services & Sites L3VPN VPLS L1VPN Ethernet Switch Analysis device

6 L2VPN and VPLS (Ethernet-based VPNs) SINET3 provides two types of Ethernet-based VPNs: Point-to-point-based VPN (L2VPN) Broadcast-based VPN (Virtual Private LAN Service (VPLS)). e.g. Grid computing research e.g. Earthquake research Point-to-point-based VPN (L2VPN) Broadcast-based VPN (VPLS) 6

7 7 Bandwidth on Demand (BoD) Services SINET3 provides BoD services as part of layer-1 services. Users can specify the destinations, duration, bandwidth, and route option. BoD server receives reservation requests, schedules accepted reservations, and triggers layer-1 path setup. Web-based Interface (Destination, Duration, Bandwidth, & Route option) 1 Gbps (13:00-14:00) User On-demand Server Layer-1 path setup trigger 2 Gbps (17:00-18:00) 1 Gbps (15:00-16:00) On-demand layer-1 path SINET3

8 Service Parameters of L1 BoD Services BoD server allows users to specify destinations, duration, bandwidth, & route option via Web-based interface. Connection Style + Destinations Pre-configured interfaces Duration -Start Time & - Finishing Time (by 15 minutes) VPN Extranet Public Bandwidth VC-4 Granularity (about 150 Mbps) Route Option GE STM-16 VC-4-7v VC-4-17v STM-64 GE 10GE VC-4-Av VC-4-Bv STM-64 1 A 7 1 B 64 - Minimum Delay or - Unspecified Lambda Bandwidth-specified 8

9 High-level Network Architecture High-level network architecture is composed of transport network, adaptive network control platform, and user-oriented service control platform. UNI, API, GUI User side User-oriented Service Control Platform - Bandwidth on demand - Enhanced network security - Middleware/application coordination BoD Security Service Control Platform Layer 3 (IP) SINET3 Middleware Network Control Platform IPv6, Multicast, VPN, QoS Layer 2 (Ethernet/MPLS) Layer 1 (TDM/Lambda) Dynamic Control Adaptive Network Control Platform - Dynamic resource control - Resilient network control - Performance monitoring Hybrid Optical and IP/MPLS Network - Multi-layer accommodation - Enriched VPN - Enhanced QoS - High availability - Flexible resource assignment - 40 Gbps (STM-256) lines 9

10 10 Network Structure of SINET3 SINET3 has two-layer structure with edge and core nodes. Edge nodes are edge layer-1 switches with layer-2 multiplexing, which are located in universities or research institutions and accommodate user equipment. Core nodes are composed of high-end IP routers and core layer-1 switches located in public centers. SINET/Super-SINET SINET3 Backbone Backbone Router Super-SINET/SINET Router Core Node Core L1 Switch SINET Router Edge Node 10GE/GE/FE STM-16 Edge L1 Switch With L2 Mux : L3 (IP) : L3 (IP) : L2 (Ethernet) : L1 (Dedicated/On-demand)

11 Has 63 edge nodes and 12 core nodes (75 layer-1 switches and 12 IP routers). Deploys Japan s first 40 Gbps lines between Tokyo, Nagoya, and Osaka. Links form three loops in backbone to enable quick service recovery against link and node failures and for efficient use of network bandwidth. 40 Gbps package Network Topology of SINET3 L1 Switch (NEC UN5000) (Juniper T640) Hong Kong Singapore 622 Mbps 622 Mbps 2.4 Gbps 10 Gbps Los Angeles New York Japan s first 40 Gbps (STM256) lines : 40 Gbps : 10 to 20 Gbps : 1 to 20 Gbps : Core Node (L1 Switch + ) : Edge Node (L1 Switch) 11

12 12 Accommodation of Multi-layer Services L3 and L2 traffic are accommodated in shared bandwidth by L2 multiplexing and transferred to IP router, where each traffic is encapsulated with MPLS labels as needed. L1 traffic is assigned dedicated bandwidth and separated from L2/3 traffic. L2/3 (or IP/MPLS) traffic bandwidth can be hitlessly changed by LCAS to flexibly accommodate multi-layer services. * Multi-protocol Label Switching (MPLS); Link Capacity Adjustment Scheme (LCAS) L3 L2 Ethernet Switch FE/GE/10GE IP Ether IP VLAN Ether Ether L2 Mux VLAN Ether Hitless bandwidth change by LCAS Shared Layer-2/3 traffic Layer-1 traffic STM64/STM16 Flow Control 10GE IP/MPLS MPLS IP VLAN Ether MPLS L1 Edge L1 Switch Core L1 Switch IP/MPLS traffic Cutting-edge device GE/10GE/ STM16 SINET3 STM256/STM64

13 Accommodation of Multi-VPN Services L3VPN, L2VPN, and VPLS are logically separated by internal VLAN tags and logical routers. Each logical router exchanges different protocols for each VPN service. L1VPN and on-demand services need GMPLS protocols to set up layer-1 paths and have separate control planes from that of IP routers. * Generalized MPLS (GMPLS) IP or IP MPLS VLAN Ether MPLS : Logical Router : Virtual routing/forwarding table IPv4/IPv6 (L3) L3VPN (L3) Aggregation IP Ether L3 L2 IPv4/IPv6 L3VPN L2VPN VPLS Ether L2 MUX IP VLAN Ether VLAN Ether Shared Layer-2/3 traffic Layer-1 traffic L2VPN (L2) VPLS (L2) L1 L1VPN L1 VPN Edge Core L1 VPN IP/MPLS traffic GMPLS Control Plane 13

14 Architecture for BoD Services BoD server receives reservation requests, schedules accepted requests, and triggers layer-1 path setup to source layer-1 switch via L1-OPS. Source layer-1 switch sets up layer-1 path toward destination using GMPLS. BoD server changes L2/L3 traffic bandwidth by LCAS via L1-OPS as needed. Destinations, Duration, Bandwidth, & Route Option User Layer-1 BoD Server Path setup trigger Front-end Scheduling Path control Route calculation Resource management L1-OPS Path setup request GMPLS control and management plane On-demand GMPLS Ethernet IP L2 MUX L2 MUX Hitless bandwidth change by LCAS 14

15 Path Calculation in BoD server BoD server calculates best path for route option using two metrics for each link: delay time and available bandwidth for layer-1 services. For Minimum delay, route is uniquely chosen. For Unspecified, route that has largest available bandwidth is chosen. Available bandwidth for L1 changes depending on traffic volume of L2/L3. Fukuoka Hiroshima Kyoto 0.6 Gbps (VC-4-4v) VCAT 1 Gbps (VC-4-7v) Kanazawa Tokyo Sapporo Matsuyama 0.45 Gbps (VC-4-3v) Osaka 1 Gbps (VC-4-7v) Nagoya Tokyo Tsukuba Sendai Route for Minimum Delay Route for Unspecified Route for Unspecified using VCAT Link Bandwidth Available bandwidth for layer-1 services L2/L3 Traffic Pattern Mon Tue Wed Thu Fri Sat Sun 15

16 16 Main Features of SINET3 (Summary) Items Features Examples Services Network Technologies Multiple Layer L3 (IP), L2 (Ethernet), & L1 (dedicated/on-demand) Enriched VPN Virtual Private Network for layers 1 to 3 Enhanced QoS Layer-1 BoD Value-added Hybrid Network Architecture High Flexibility High Availability Large Capacity NG SDH/SONET GMPLS Logical Router Advanced MPLS Fast Detour Support for real-time applications Support for -intensive applications Network performance monitoring Hybrid network of layer-1 switches and IP routers 75 layer-1 switches nationwide 12 IP routers at backbone sites Flexible resource assignment to multiple layers Fast service recovery owing to multi-loop topology Introduction of Japan s first STM-256(40 Gbps) lines GFP, VCAT, & LCAS RSVP-TE, OSPF-TE, GMPLS-UNI, & GMPLS LSP rerouting Logical routers for IPv4/IPv6, L3VPN, L2VPN, & VPLS MPLS-based VPN for L3VPN, L2VPN, & VPLS Multi-layer detour triggered by layer-1 switches

17 Thank you very much! 17