Introduction of TEIN2 NOC Jilong Wang <2005-09 09-10>
Outline 1. NRCT Network Research Center of Tsinghua University Structure TUNET NOC Service CERNET NOC Service CERNET2 NOC Service Other NOC Services 2. TEIN2 NOC Service
1 NRCT Network Research Center of Tsinghua University
MOE MOE Tsinghua Tsinghua University University College College of of Information Information Technology Technology Graduate Graduate School School at at Shenzhen Shenzhen Network Research Center Network Research Center of MOE of MOE CERNET Operation Center CERNET Operation Center Network Network Research Research Center Center of of Tsinghua Tsinghua University University Network Research Center at Shenzhen Wisdom Network Technology Co. Network Operation and Service Center Network Operation and Management Technology Lab. Network and Information Security Technology Lab. Network and Information Application Technology Lab. Network Architecture and IPv6 Lab. Wireless and Mobile Network Technology Lab. Video and Virtual Reality Technology Lab. Network Administration Development and Office Programming Lab. Project Office CNGI-CERNET2 Backbone CERNET2 Backbone Tsinghua Compus Network TUNET Cernet Network Co. NSFCNET IPv6-CJ 863-IPv6
Operation Division of NRCT 1. Network Operation GroupIP management 2. Network Information CenterIP address and Domain name management, directory service 3. Connection Management Group 4. Custom Service Centerhelp help-desk, on-site service 5. System Operation GroupAAA, NMS, DHCP, Email, Dial-up, Website 6. Operation CommitteDecision Making
TUNET NOC Service
TUNET
Status
Performance
log
Statistics Li nk r out er if Avg t r af f i c(i/o) Max t r af f i c(i/o) Min traffic( i / o) Sum( i / o) Bandwith(i / o) ± ±¾ --Ì ì½ò_2. 5G 202. 38. 120. 192 36 39. 07Mbps/ 3. 21Mbps 294. 51Mbps/ 23. 21Mbps 0. 20Mbps/ 0. 27Mbps 12658910. 85MByt es/ 1040270. 13MByt es 99. 96Mbps/ 7. 60Mbps ± ±¾ --É òñ ô_2. 5G 202. 38. 120. 192 37 7. 04Mbps/ 17. 03Mbps 512. 46Mbps/ 205. 13Mbps 0. 00Mbps/ 0. 00Mbps 2280353. 35MByt es/ 5517825. 39MByt es 4. 12Mbps/ 49. 71Mbps ± ±¾ --Ö Ö Ý_2. 5G 202. 38. 120. 192 46 2. 94Mbps/ 14. 82Mbps 40. 07Mbps/ 64. 17Mbps 0. 00Mbps/ 0. 00Mbps 952323. 37MByt es/ 4801406. 88MByt es 5. 38Mbps/ 37. 09Mbps
Service Monitoring System
Traffic
Ticket System
Network Information System
security
Warning
CERNET NOC Service
CERNET NOC
Status
Performance
Routing
Traffic
Flow
Equipment
CERNET2 NOC Service
CERNET2
Status
Aladdin Network Management System
Weather Map
Traffic
Routing
Trouble Ticket System
Other NOC Services
NSFCNET APAN/STAR CERNET POS OC-48 GE GSR12008 GSR12012 DPT Ring GSR12008 GSR12008 GSR12008 CSTNET GSR12008
863
CJ IPv6 MAN/LAN Core Router GE LAN Core Router border Router Beijing To Japan MAN/LAN Core Router Core Router GE LAN 2.5G POS WAN Core Router GE LAN Core Router Shanghai GE LAN GE LAN Edge Router Edge Router GE MA N Edge Router Edge Router Edge Router Guangzho u User Network (IPv6)
CERNET/CERNET2/DRAGONTAP 1.4G Internet CERNET CERNET 2 10G Domestic Peering 10G DRAGONTAP CNGI Peering 155M DRAGONLIGHT CNGI-BJIX 100M 1G 155M 45M 45M HARNET TANET APAN KOREN STARLIGHT JANET
2TEIN2 NOC Service
Task defination Connectivity management implementation incident and problem management IP management Pro-active and reactive monitoring Problem management Inventory Control Hardware, software and configuration Provide online information trouble ticket and statistics Collaboration with other NOCs APAN-JP,...
Team Categories Working levels Numbers Director of NOC technical support 1 Connectivity Engineer daily operation 2 IP Engineer daily operation 2 Technician/operator Help Desk 5
Facility Operation Center Call Center Video Conferencing Facilities Out of Band Network Management Monitoring Wall Testing Tools
Management Systems TT NIS Fault (Ping) Traffic (snmp( snmp) Accounting (netflow( netflow) website Routing (Zebra) Trap and Log Reporting system Connectivity (telnet) Advanced Service management
Website
Procedures Configuration Performance monitoring Problem handling Security Online access of the operation information
Fault Management Procedure Problem alert Tracking Problem identification and isolation Trouble ticket assignment and engineer contact Trouble shooting Problem notification initial status report identification updates closure
IP Monitoring Procedure Pro-active monitoring link statistics packet statistics routing statistics loss and delay statistics network equipment statistics advanced application monitoring Reactive monitoring taking fault reports around the clock
Advanced Management IPv6 fault monitoring traffic and performance monitoring IP Multicast multicast beacon traffic monitoring VPN management Ethernet over MPLS management QoS CoS statistics flow ranking Security IDS host flaw scanner and the database
Services QoS VoIP VConf IPTV Security
Challenges Connectivity problem management BGP policy Open access of the NOC information Shared trouble system Security Level 2 services Advanced services
Possible Paths policy based routing and politics based routing
The Real World Routing
Meet requirement by user AS network Policy Under the framework of TEIN2 Database IRR (who) Configuration AS-path prepend Predefined community Fine tune Traffic and flow monitoring End-to to-end performance tools AS A AS B AS C AS D
BGP Routing Under the framework of TEIN2 Try to provide the BGP routing as more flexible as possible to the connected networks Provide the online access to the routing, traffic and flow information
BGP Implementation (draft) Implement BOGON filters Implement prefix length filtering Implement authenticated BGP sessions Implement maximum prefixes Implement route dampening Implement route filtering (prefix-list or access-list or/and filter-list) Accept community tag Accept MED Accept aggregated prefixes, except for the policy based routing
Open Access of the NOC Information Access policy Under the framework of TEIN2 Tools and user interface Open software tools APAN NOC Abilene Observatory etc. In-house developed tools status/performance/routing/traffic/flow/equipment
Remarks
Remarks Under the framework of the TEIN2, we welcome suggestions and comments for the TEIN2 NOC operation SLA BGP routing Monitoring and measurement
Thoughts Global Academic NOC meeting NANOG, APRICOT, RIPE Video phone no time zone problem Shared trouble ticket system trouble shooting Shared end-to to-end measurement data optimize routing
On Network Operation Be Patient Knowable, Controllable Loging Redundance,, Backup Policy and Procedures One time one thing Loose Coupling Make Allowance
Trouble Ticket System
Measurement DIY