IOMETRIX TECHNICAL REPORT. Cisco ONS & Metro Transport

Transcription

2 Table of Contents Table of Contents... 2 Executive Summary... 3 Test Plan Overview... 5 Introduction... 5 Test Plan Objective... 6 Test Plan Challenges... 8 Network Equipment Test Instruments Test Results Template References Acknowledgements Single 2F-BLSR BER and Connectivity Test 1 (Edge) Single 2F-BLSR Service Disruption Test 2 (Edge) Single 2F-BLSR Service Disruption Reporting Test 3 (Edge) Single 2F-BLSR Service Disruption BER and Connectivity Test 4 (Edge) Single 2F-BLSR Restoration Test 5 (Edge) Single 2F-BLSR Restoration Reporting Test 6 (Edge) Single 2F-BLSR Restoration BER and Connectivity Test 7 (Edge) Multiple 2F-BLSRs BER and Connectivity Test 8 (Core) Multiple 2F-BLSRs Service Disruption Test 9 (Core) Multiple 2F-BLSRs Service Disruption Reporting Test 10 (Core) Multiple 2F-BLSRs Service Disruption BER and Connectivity Test 11 (Core) Multiple 2F-BLSRs Restoration Test 12 (Core) Multiple 2F-BLSRs Restoration Reporting Test 13 (Core) Multiple 2F-BLSRs Restoration BER and Connectivity Test 14 (Core) F-BLSR Manual Switching Test 15 (Core) Manual Switch to Redundant Data Switch Module Test 16 (Core) Automatic Switch to Redundant Data Switch Module Test 17 (Core) Timing Source Switch Test 18 (Core) Hitless Software Download Test 19 (Core) Overall Conclusions Appendix 1 Standard Testbeds Single 2F-BLSR Testbed Multiple 2F-BLSRs Testbed Appendix 2 Detailed Results (Listed by Test) Single 2F-BLSR Service Disruption Test 2 Detailed Test Results Single 2F-BLSR Restoration Test 5 Detailed Test Results Multiple 2F-BLSRs Service Disruption Test 9 Detailed Test Results Multiple 2F-BLSRs Restoration Test 12 Detailed Test Results Iometrix, Inc. All rights reserved. 2

3 Executive Summary SONET stands for reliability. Carriers voice revenue depends on it and ITU standards guarantee it: SONET switching platforms must provide protection switching within 50 milliseconds (ms) of a SONET (Synchronous Optical Network) link failure to ensure that customers experience no degradation in service quality. And because carriers transport data as well as voice over their SONET networks, they can extend the same service quality guarantees to high-revenue corporate data services. Little wonder then that carriers cannot afford to second-guess the reliability of their SONET networks. But as a new generation of high-density multiservice SONET platforms comes to market, the sheer scale of the networks they can support puts the job of verifying SONET reliability beyond the reach of traditional test tools. So what guarantees do carriers have that the latest very-highcapacity multiservice platforms will keep within the standards specified for protection switching when they are subjected to high levels of stress? To answer this question Iometrix joined with Cisco Systems to stress test its newest MSSP (Multiservice Switching Platform), the ONS 15600, and its well-known (Multiservice Provisioning Platform), the ONS. Iometrix turned to Agilent Technologies unique new SONET test tool, the Agilent OmniBER XM network simulator, to provide the massively scaled multiichannel, multiport test set we needed to fully stress the Cisco ONS switching platform. We built a SONET core network using the Cisco ONS MSSP configured to support 16 edge networks and a traffic load equivalent to 368 s. We also built an edge network using 23 Cisco ONS s. With 512 STS-3C circuits, 160 Gb/s of traffic and 80 Gb/s of simultaneous service disruption,we were able to put together the largest stress test ever conducted on a metro SONET network with a multichannel, multiport test set. So at this massive scale, how fast can the combined ONS and protection switch? Starting with the edge network the Cisco s MSSP consistently outperformed the standard s specified protection switching time by 58% in the worst case and went on to beat the spec by 90% in the worst-case reversion time. In the core network, the ONS supported 16 subtended rings concentrating the entire core into a single network element and still beat the spec by 57% worst case, with a maximum switching time of 25.8 ms. The worst-case reversion time of 5.5 ms outperformed the spec by 89%. The results were highly consistent throughout repeated test cycles. The results turned in by Cisco s combined ONS and in this massively scaled SONET stress test set a new industry standard for verified performance. They also pack a lot of good news for carriers looking for a very-high density MSSP that can scale cost-effectively and simultaneously deliver substantially above spec SONET reliability, the principal gauge of customer satisfaction Iometrix, Inc. All rights reserved. 3

4 Iometrix MSSP Test Results Summary Worst case protection switching times Worst case reversion times Cisco ONS & in the core network 57% faster than spec 89% faster than spec Cisco ONS & in the edge network 58% faster than spec 90% faster than spec 2003 Iometrix, Inc. All rights reserved. 4

5 Test Plan Overview Introduction SONET/SDH metropolitan area transport (metro) has evolved into a 2-layer structure with a metro edge and a metro core. The metro edge s primary task is to consolidate (or provision) the different types of data (e.g. Legacy T1 and DS3 and Ethernet) onto a single transport technology, SONET/SDH. The metro core s primary task is to switch data between metro access networks, either directly within a metro area or between metro areas (over long distant transport). The generic term for the network equipment that consolidates all the requirements of the metro edge is Multi-Service Provisioning Platform (). The generic term for the network equipment that consolidates the requirements of the metro core layer is Multi- Service Switching Platform (MSSP). The generic term for both s and MSSP is Multi-Service Platform (MSP). Two Fiber, Bi-directional Line Switched Ring (2F-BLSR) has become the connectivity of choice within the metro edge. This topology offers exceptional levels of reliability for protected data and reuse of the protection channels for unprotected data. The Telecordia standard defining 2F-BLSR limits a ring to 16 MSPs (there are 4 addressing bits), but several proprietary implementations have extended this to 24. Metro Edge Metro Core Figure 1 Today s Metropolitan Transport with a BLSR based Edge Network An ideal metro core is a non-blocking switch that can route data from any metro edge BLSR to any other metro edge BLSR. For smaller networks this may be a single MSSP; for larger networks this may be a BLSR of MSSPs. See Figure 1, above. The method of connection between the metro edge and the metro core is also evolving. Until recently, and when multi-vendor solutions are required, a protected linear connection was used. See Figure 2 below Iometrix, Inc. All rights reserved. 5

6 MSSP Other connections to other Metro Edge BLSRs Metro Edge Metro Core 1+1 or 1:1 Protected Linear Connection Figure 2 Protected Linear Interconnection between Metro Edge and Metro Core. More recently the MSSPs in the metro core network interface directly with the metro edge BLSRs by way of a number of subtended rings. This has the benefit of reducing the quantity of MSPs in the system (improving the reliability while reducing the cost). See Figure 3 below. Connection to other Metro Edge BLSR Metro Core MSSP Metro Edge Connection to other Metro Edge BLSR Figure 3 Subtended Ring Connection between Metro Edge and Metro Core Test Plan Objective The objective of this test plan is to simulate a real-life metro network and evaluate how it performs under realistic major failure conditions. The main measures are bit error rate (BER), service disruption and 2003 Iometrix, Inc. All rights reserved. 6

7 connectivity (i.e. the correct channels are switched and routed correctly), the fundamental measures of customer quality. BER is the most critical static measure of quality of a data network. It is measured by transmitting a pseusdo random binary sequence (PRBS) through the network and detecting any bits out of sequence. PRBS23, the PRBS used in the testing, tests all combinations of 23 bits including runs of 23 1s and 22 runs of 0s. The table below defines the period of time that a BER test must be run, error free, to give a 95% confidence in a BER of 1E-10. Although some of the channels will be less than 2.5G, multi-channel testing will look at all the channels simultaneously, at either 2.5G or 10G. For this reason a 12.5-second measurement time will be used. 10Gb/s 95% confidence 2.48Gb/s 622Mb/s 155Mb/s 95% confidence 95% confidence 95% confidence 3.1s 12.5s 50s 200s 600s 52Mb/s 95% confidence Service disruption measures the dynamic performance of a network during failure conditions. As SONET/SDH is called upon to transport increasing proportions of IP data traffic, these measurements become more fundamental. Whereas we are used to Internet traffic being delivered on a best effort basis, and are used to trying again when it fails, expensive protected SONET/SDH connections are used for mission critical enterprise and defence services. TCP, the layer often used above IP, contains error detection and correction by retransmission, but in secure systems the maximum permitted disruption time is severely limited. The cost of a broken service due to a service disruption may be re-booting an entire operational system! Service disruption is measured by timing from the first bit error to the last bit error in a sequence of 2 or more bit errors. The first bit error is defined as the first bit error after an error free period. The last bit error is defined as the last bit error before an error free period. The length of the error free period is guard band and is set to 200mS throughout this test plan. (Note that a single bit error does not count as a service disruption.) Connectivity tests that all the potentially thousands of channels through a network are routed correctly. Connectivity is measured by the path trace label. Each channel through the network is given a unique label in the path trace label. This label is checked before a service disruption, after a service disruption and after service restoration. Other areas covered in the test plan are mixed mappings and ease of maintenance. Traditional SONET/SDH test sets assume that a SONET/SDH connection is subdivided into fixed size payloads (e.g. An OC 48 is subdivided into 16 x STS-3C). This is not the case in more modern SONET/SDH equipment. Some of the testing in this test plan uses mixed mappings (e.g. An OC48 may be subdivided into 12 x STS-1, 4 x STS-3C, 2 x STS-12C). SONET/SDH Networks will only be installed if they are cost effective for the Service Providers to purchase and operate. This test plan also looks at key aspects of network management:- Fault reporting Automatic Switching to Alternative Timing Source Hitless Software Upgrades Manual Switching to Alternative Data Planes 2003 Iometrix, Inc. All rights reserved. 7

8 Manual Circuit Reconfiguration Test Plan Challenges Simulating a realistic Network A realistic large metro network may consist of over 250 s, so a network of 16 BLSRs, each with at least 16 s is seen as a reasonable simulation (i.e. 256 s). It is not realistic to build such a network, let alone instrument it for thorough testing, so a two-stage approach has been chosen. The first stage is to test a single 2F-BLSR constructed of at least 16 s with a 10Gb/s ring bandwidth (see Figure 4 below). If the manufacturer supports 2F-BLSRs of larger than 16 s, then the maximum number is tested. If the manufacturer supports subtended rings as the interconnection between the metro edge and metro core then one of the s should be a MSSP. or MSSP Figure 4. Test System with a 16 element 2F-BLSR. The second stage is to test a system with 16 2F-BLSRs, but with less s in each ring. One of the 2F- BLSRs will be constructed of 5 s and the other 15 2F-BLSRs of 2 s. If the MSSP supports subtended rings then one of each of the s in the 2F-BLSRs should be a MSSP. By combining the performance of the 16 MSP 2F-BLSR, the 5 MSP 2F-BLSR and the simpler 2 MSP 2F- BLSRs then it can be assumed the network performance is similar to a network of 256 s or greater. If each 2F-BLSR has a ring bandwidth of 10Gb/s, and the metro core network is non-blocking, then the entire network has a bandwidth on 160Gb/s. See Figure 5, below Iometrix, Inc. All rights reserved. 8

9 Metro Core Equipment Figure 5. Test System with a 5 element BLSR and 15 x 2 element BLSRs. Simultaneous Measurements of all Customer Circuits Often traditional test methods are based on generating single events and looking at the response. Whereas this is a valid approach to managing the complexity of testing to appropriate SONET/SDH standards, this test suit looks at a higher-level system view. To measure worst case conditions on systems with many 100s of circuits, on a sample basis, would require 10,000s of measurements and be completely impractical. This challenge is resolved by using the new generation SONET/SDH test sets with concurrent multichannel and multi-port measurements, the Agilent OmniBER XM. Concurrent Fault Generation The most serious fault that can occur in a 2F-BLSR system is a break in the ring. This will cause half the traffic in the ring to be rerouted, with a service disruption. This test plan calls for a break in each of the 2F- BLSR. Multi-ring tests could produce different results depending on how instantaneous the multiple faults are generated. If the test faults all occur at the same instant the system will be dealing with 16 major faults 2003 Iometrix, Inc. All rights reserved. 9

10 concurrently. If the faults occur sequentially then the system may be able to process each fault before the next fault occurs, reducing the switching challenge. Furthermore, in some of the tests, each test data stream goes though 2 circuits, so the results could either give 2 protection switching events or one longer event from the start of the first protection switch to the end of the second. In either case the results will be inaccurate. This issue is resolved by the Glimmerglass Optical Switch, which completes 16 optical breaks in 7 to 10 ms. As an added accuracy measure, channels which traversed two BLSRs where organized to only traverse a single fault. Result Consistency One of the difficulties of testing a system is the consistency of results. How does the test engineer know that the results from a test are typical? It s proposed that each test be repeated 3 times. If the results are not within 20% in all cases then the tests are repeated a further 7 times. (The test will still pass if all the results fall within the prescribed limit). Network Equipment The network equipment tested in this test plan is as follows:- The Cisco ONS, with SONET/SDH 10G and 2.5G tributaries, configured as a 2F-BLSR, with a ring rate of 10G. Between 19 and 24 of these units are used, depending on the test. The Cisco ONS15600 MSSP, configured as a 2F-BLSR, with a ring rate of 10G. In some tests a single 2F-BLSR is tested. In others 16 off 2F_BLSRs are tested, with the supporting 16 subtended rings. A single is used in the tests. The Cisco ONS and ONS support 24 MSPs in a 2F-BLSR and subtended rings as a method to interconnect the metro edge to the metro core, so the tests in this testplan are written with this configuration. The revision of SW used in the ONS15600 is ( I-04.19). The revision of SW used in the ONS was ( F-20.23). Test Instruments The Agilent OmniBER XM is used as the SONET/SDH test system. This product s the only product available today to offer the following required features:- Multi-Channel operation, up to 192 channels in an OC-192. Multi-Port operation, up to 30 ports. 10Gb/s, 2.5Gb/s, 622Mb/s and 155Mb/s ports Mixed mapping and new mapping payloads. Multi-channel, Simultaneous measurement of service disruption, BER, alarms and path trace. The Glimmerglass Photonic Switching System, the Glimmerglass System 300, is used as the primary instrument for the connectivity and reconfiguration of the test-bed. Besides configuring the MSP nodes, the System 300 enables link failures for path restoration testing. The Glimmerglass System 300 features include: Transparent Connectivity switching light, not just information. All-optical switching without electrical switching and regeneration. Scalable, low-loss connections (<3dB) Intelligent software controls and reliable connections 2003 Iometrix, Inc. All rights reserved. 10

11 Instant reconfiguration of the MSP nodes 10ms typical connection establishment time, 2ms typical connection disconnect (not linear, to disconnect 16 connections takes less than 10ms) Network control - link failures at single or multiple locations simultaneously Remote and automated management Test Results Template In the following section the results are reported using the following template: Test Name Object of Test Testbed Procedure Findings Numerical and Graphical results Conclusion References All the testing is completed to the following references:- Ref Document Reference 1 Telecordia GR- 253-CORE 2 Telecordia GR CORE Document Title Synchronous Optical Network (SONET) Transport Systems: Common Generic Criteria Revision Issue 3, Sept 2000 SONET BLSR Criteria Issue 4,4A Dec 1998 Acknowledgements Iometrix would like to sincerely thank Greg Jacobs and Bryan Harlow of Cisco Systems for their untiring help and support in setting up and running the tests Iometrix, Inc. All rights reserved. 11

12 Single 2F-BLSR BER and Connectivity Test 1 (Edge). In the steady state, the system has no alarms, a bit error rate of better than 1E-10 and all the channels are routed correctly. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR Testbed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check and record that the circuits are correctly routed using the path trace labels. 4. Measure the bit errors for a period of 12.5s. Findings Total number of bit errors during 12.5s measurement period = 0. All path trace labels showed that the channels were correctly routed. Numerical and Graphical Results Zero errors for a period of 12.5s, at a data rate of 2.5G, gives a 95% confidence of a residue BER of better than 1E-10. Conclusion This test serves as a baseline to confirm that the system is working correctly in the steady state without any failures. Test Passed 2003 Iometrix, Inc. All rights reserved. 12

13 Single 2F-BLSR Service Disruption Test 2 (Edge). The maximum service disruption should not exceed 110ms. This figure is derived from two parts, switch initiation time and switch completion time. GR1230 states that LOS detection rules, required times and thresholds are as defined in GR253. GR253, R5-41 states that For SF [Signal Failure] conditions caused by LOS, LOF, AIS-L defects the switch initiation should be 10ms or less. GR1230, R6-13, states that the end-to-end switch time for a single ring or span switch on a clean ring with less than 1200km of fiber and 16 nodes shall not exceed 50ms. This does not include detection time. Since we have 24 nodes in the test configuration, it is assumed that GR1230, R6-14 applies: The end-toend switch completion time for any ring or span switch [when R6-13 is not applicable] shall not exceed 100ms after detection. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check record that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on the ring optical fiber between MSSP 1 and Measure the service disruption times on all the tributaries and record the results. 8. Clear the break and wait for the switching to revert. 9. Repeat the procedure steps 6 to 8 twice more. 10. If the service disruption and of each of the cycles differ by more than 20% or there is a general increase of >5% then repeat the procedure steps 6 to 8 seven further times. 11. Cause a unidirectional break on the ring optical fiber between MSSP1 and MSSP Measure the service disruption times on all the tributaries and record the results. 13. Clear the break and wait for the switching to revert. 14. Repeat the procedure steps 11 to 13 twice more. 15. If the service disruption times of each of the cycles differ by more than 20% or there is a general increase of >5% then repeat the procedure steps 11 to 13 seven further times. 16. Cause a bidirectional break on the ring optical fiber between MSSP 1 and Iometrix, Inc. All rights reserved. 13

14 17. Measure the service disruption times on all the tributaries and record the results. 18. Clear the break and wait for the switching to revert. 19. Cause a bidirectional break on the ring optical fiber between MSSP 1 and Measure the service disruption times on all the tributaries and record the results. 21. Clear the break and wait for the switching to revert. Findings All the timing results were well within the 110ms requirements. Only 3 timing measurements were required in each direction, since the results were within better than 10%. 1m of optical cables were used between the ONSs. 70M of optical cabling was used between the ONS and the ONS Numerical and Graphical Results Service Disruption Time, unidirectional break between 1 and 2 (impacting 36 channels, STS-1, STS-3C and STS-12C) 1 st Run 2 nd Run 3 rd Run Mean 38.40ms 38.49ms 36.99ms Max 45.20ms 45.80ms 43.90ms Min 35.20ms 35.00ms 34.30ms 120ms 110ms 100ms 90ms 80ms 70ms 60ms 50ms 40ms 30ms 20ms 10ms 0ms Service Disruption Time, Unidirectional Break between 1 and 2 1 st Run 2 nd Run 3 rd Run Measured Values Maximum Mean Minimum (impacting 36 channels, STS-1, STS-3C and STS-12C) 2003 Iometrix, Inc. All rights reserved. 14

15 Service Disruption Time, unidirectional break between 1 and 24 (impacting 5 channels, STS-12C and STS-48C) 1 st Run 2 nd Run 3 rd Run Mean 38.44ms 36.64ms 38.46ms Max 39.2ms 37.3ms 39.2ms Min 37.5ms 36.1ms 38ms 120ms 110ms 100ms 90ms 80ms 70ms 60ms 50ms 40ms 30ms 20ms 10ms 0ms 1 st Run 2 nd Run 3 rd Run Measured Values Maximum Mean Minimum Service Disruption Time, Unidirectional break between 1 and 24 (impacting 5 channels, STS-12C and STS-48C) 2003 Iometrix, Inc. All rights reserved. 15

16 Service Disruption Time, bidirectional break Between 1 and 2 (impacting 36 channels) Between 1 and 24 (impacting 5 channels) Mean 36.59ms 38.76ms Max 45.40ms 39.5ms Min 31.70ms 38.3ms 120ms 110ms 100ms 90ms 80ms 70ms 60ms 50ms 40ms 30ms 20ms 10ms 0ms Break 1 to 2 Break 1 to 24 Service Disruption Time, Bi-directional break Measured Values Maximum Mean Minimum Conclusion All the measurements came well within the required time switching time of 110ms. The repeatability of the results and the linearity of the graph show that the protection switching in this system is highly stable and determinate, a good reliability indicator. Unidirectional and bidirectional failures have very similar switching times. Cisco would like to point out that these tests were with a total ring length of approximately 160m. A ring length of 1200km would increase is figure by 12ms, twice the total fibre transmission delay. Even adding 12ms to all these values gives results that are still well within the required switching time. Test Passed 2003 Iometrix, Inc. All rights reserved. 16

17 Single 2F-BLSR Service Disruption Reporting Test 3 (Edge). During a service disruption, the LOS and switching should be reported correctly. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on the ring optical fiber between MSSP 1 and Record the management system reporting of the consequential LOS and protection switch. 8. Clear the break and wait for the switching to revert. Findings The following events were correctly reported:- The LOS The switch to protection of the MSP either side of the LOS (MSSP 1 and 2). The bidirectional pass-through of the protection channel on 3 to 24. Numerical and Graphical Results N/A Conclusion The failure and the protection switch were reported correctly. Test Passed 2003 Iometrix, Inc. All rights reserved. 17

18 Single 2F-BLSR Service Disruption BER and Connectivity Test 4 (Edge). After a protection switch, the channels should be correctly routed and error free. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace lables. 4. Check there are no bit errors for a period of 12.5s. 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on the ring optical fiber between MSSP 1 and Check and record there are no bit errors for a period of 12.5s. 8. Check and record the path trace labels are as before the protection switch. 9. Clear the break and wait for the switching to revert. Findings Total number of bit errors during 12.5s measurement period = 0. The path trace labels are as they were before the protection switch. Numerical and Graphical Results Zero errors for a period of 12.5s, at a data rate of 2.5G, gives a 95% confidence of a residue BER of better than 1E-10. Conclusion The protection switch restored the channels, correctly routed and in an error free condition. Test Passed 2003 Iometrix, Inc. All rights reserved. 18

19 Single 2F-BLSR Restoration Test 5 (Edge). The maximum service disruption should not exceed 100ms. GR1230, R6-13, states that the end-to-end switch time for a single ring or span switch on a clean ring with less than 1200km of fiber and 16 nodes shall not exceed 50ms. This does not include detection time. Since we have 24 nodes in the test configuration, it is assumed that GR1230, R6-14 applies: The end-toend switch completion time for any ring or span switch [when R6-13 is not applicable] shall not exceed 100ms after detection. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on the ring optical fiber between MSSP 1 and Clear the break and wait for the switching to revert. 8. Measure the reversion times on all the tributaries and record the results. 9. Repeat the procedure steps 6 to 8 twice more. 10. Cause a unidirectional break on the ring optical fiber between MSSP1 and MSSP Clear the break and wait for the switching to revert. 12. Measure the reversion times on all the tributaries and record the results. 13. Repeat the procedure steps 10 to 12 twice more. 14. Cause a bidirectional break on the ring optical fiber between MSSP 1 and Clear the break and wait for the switching to revert. 16. Measure the reversion times on all the tributaries and record the results. 17. Cause a bidirectional break on the ring optical fiber between MSSP 1 and Clear the break and wait for the switching to revert. 19. Measure the reversion times on all the tributaries and record the results. Findings All the timing results were well within the 100ms requirements. Only 3 timing measurements were required in each direction, since the results were within better than 10% Iometrix, Inc. All rights reserved. 19

20 Numerical and Graphical Results Restoration Time, Unidirectional break between 1 and 2 (impacting 36 channels, STS-1, STS-3C and STS-12C) 1 st Run 2 nd Run 3 rd Run Mean 3.44ms 3.46ms 3.45ms Max 6.20ms 6.20ms 6.20ms Min 1.60ms 1.90ms 1.90ms 120ms 110ms 100ms 90ms 80ms 70ms 60ms 50ms 40ms 30ms 20ms 10ms 0ms 1 st Run 2 nd Run 3 rd Run Measured Values Maximum Mean Minimum Restoration Time, Unidirectional Break between 1 and 2 (impacting 36 channels, STS-1, STS-3C and STS-12C) 2003 Iometrix, Inc. All rights reserved. 20

21 Restoration Time, Unidirectional break between 1 and 24 (impacting 5 channels, STS-12C and STS-48C) 1 st Run 2 nd Run 3 rd Run Mean 2.3ms 2.28ms 2.2ms Max 2.5ms 2.5ms 2.4ms Min 2.1ms 2.1ms 2ms 120ms 110ms 100ms 90ms 80ms 70ms 60ms 50ms 40ms 30ms 20ms 10ms 0ms 1 st Run 2 nd Run 3 rd Run Measured Values Maximum Mean Minimum Restoration Time, Unidirectional Break between 1 and 2 (impacting 5 channels, STS-12C and STS-48C) 2003 Iometrix, Inc. All rights reserved. 21

22 Restoration Time, Bi-directional Break Between 1 and 2 (impacting 36 channels) Between 1 and 24 (impacting 5 channels) Mean 8.21ms 2.3ms Max 8.60ms 2.5ms Min 6.90ms 2.1ms 120ms 110ms 100ms 90ms 80ms 70ms 60ms 50ms 40ms 30ms 20ms 10ms 0ms Break 1 to 2 Break 1 to 24 Measured Values Maximum Mean Minimum Restoration Time, Unidirectional Break between 1 and 2 (impacting 5 channels, STS-12C and STS-48C) Conclusion All the measurements came very well within the required time switching time of 100ms. Like the protection switching, the repeatability of the results and the linearity of the graph show that the protection switching in this system is highly stable and determinate, a good reliability indicator. Cisco would like to point out that these tests were with a total ring length of approximately 160m. A ring length of 1200km would increase is figure by 12ms, twice the total fibre transmission delay. Even adding 12ms to all these values gives results that are still well within the required switching time. Test Passed 2003 Iometrix, Inc. All rights reserved. 22

23 Single 2F-BLSR Restoration Reporting Test 6 (Edge). During a restoration, the wait for restoration and the restoration should be reported correctly. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Cause a unidirectional break on the ring optical fiber between MSSP 1 and Clear the break and wait for the switching to revert. 7. Record the management system reporting of the wait to restore and it s clearing, when the restoration occurs. Findings The following events were correctly reported:- The wait to restore The clearing of the wait to restore Numerical and Graphical Results N/A Conclusion The wait to restore and the clearing of it were reported correctly. Test Passed 2003 Iometrix, Inc. All rights reserved. 23

24 Single 2F-BLSR Restoration BER and Connectivity Test 7 (Edge). After a protection switch and a restoration, the channels should be correctly routed and error free. Objective Verify that the system meets the test requirements. Testbed 23 Cisco ONSs, each with 2 x 10G Line interfaces and 4 x 2.5G tributary interfaces 1 Cisco ONS15600 with 2 x 10G Line interfaces and 1 x 10G tributary interface. OmniBER XM Network simulator, with 1x10G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 6 Single 2F-BLSR TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace lables. 4. Check there are no bit errors for a period of 12.5s. 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on the ring optical fiber between MSSP 1 and Clear the break and wait for the switching to revert. 8. Check and record there are no bit errors for a period of 12.5s. 9. Check and record the path trace labels are as before the protection switch and restoration Findings Total number of bit errors during 12.5s measurement period = 0. The path trace labels are as they were before the protection switch and restoration. Numerical and Graphical Results Zero errors for a period of 12.5s, at a data rate of 2.5G, gives a 95% confidence of a residue BER of better than 1E-10. Conclusion The restoration restored the channels, correctly routed and in an error free condition. Test Passed 2003 Iometrix, Inc. All rights reserved. 24

25 Multiple 2F-BLSRs BER and Connectivity Test 8 (Core). The system has no alarms, a bit error rate of better than 1E-10 and all the channels are routed correctly. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs Testbed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm and record there are no errors or alarms present. 3. Check and record that the circuits are correctly routed using the path trace labels. 4. Measure the bit errors for a period of 12.5s. Findings Total number of bit errors during 12.5s measurement period = 0. All path trace labels showed that the channels were correctly routed. Numerical and Graphical Results Zero errors for a period of 12.5s, at a data rate of 2.5G, gives a 95% confidence of a residue BER of better than 1E-10. Conclusion This test serves as a baseline to confirm that the system is working correctly in the steady state without any failures. Test Passed 2003 Iometrix, Inc. All rights reserved. 25

26 Multiple 2F-BLSRs Service Disruption Test 9 (Core). The maximum service disruption should not exceed 60ms. This figure is derived from two parts, switch initiation time and switch completion time. GR1230 states that LOS detection rules, required times and thresholds are as defined in GR253. GR253, R5-41 states that For SF [Signal Failure] conditions caused by LOS, LOF, AIS-L defects the switch initiation should be 10ms or less. GR1230, R6-13, states that the end-to-end switch time for a single ring or span switch on a clean ring with less than 1200km of fiber and 16 nodes shall not exceed 50ms. This does not include detection time. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on 16 ring optical fibers between the MSSP and s. 7. Measure the service disruption times on all the tributaries and record the results. 8. Clear the break and wait for the switching to revert. 9. Repeat the procedure steps 6 to 8 twice more. 10. If the service disruption and of each of the cycles differ by more than 20% or there is a general increase of >5% then repeat the procedure steps 6 to 8 seven further times. Findings All the timing results were well within the 60ms requirements. Only 3 timing measurements were required, since the results were within better than 10%. Numerical and Graphical Results 2003 Iometrix, Inc. All rights reserved. 26

27 Service Disruption Time, 16 unidirectional breaks (impacting 512 channels, all STS-3C) 1 st Run 2 nd Run 3 rd Run Mean 18.9ms 19.3ms 18.6ms Max 25.1ms 25ms 25.8ms Min 12.2ms 14ms 12.2ms 60ms 55ms 50ms 45ms 40ms 35ms 30ms 25ms 20ms 15ms 10ms 5ms 0ms 1 st Run 2 nd Run 3 rd Run Measured Values Maximum Mean Minimum Service Disruption Time, 16 Unidirectional Breaks Conclusion All the measurements came well within the required time switching time of 60ms. The repeatability of the results and the linearity of the graph show that the protection switching in this system is highly stable and determinate, a good reliability indicator. Test Passed 2003 Iometrix, Inc. All rights reserved. 27

28 Multiple 2F-BLSRs Service Disruption Reporting Test 10 (Core). During a service disruption, the LOS and switching should be reported correctly. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on 16 ring optical fibers between the MSSP and s 7. Record the management system reporting of the consequential LOS and protection switch. 8. Clear the break and wait for the switching to revert. Findings The following events were correctly reported:- The LOS, 16 times. The switch to protection of the MSSP either side of the LOS 16 x 2 times. The bidirectional pass-through of the protection channel on 1b, 1c and 1d. Numerical and Graphical Results N/A Conclusion The failure and the protection switch were reported correctly. Test Passed 2003 Iometrix, Inc. All rights reserved. 28

29 Multiple 2F-BLSRs Service Disruption BER and Connectivity Test 11 (Core). After a protection switch, the channels should be correctly routed and error free. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace lables. 4. Check there are no bit errors for a period of 12.5s. 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on 16 ring optical fibers between the MSSP and s. 7. Check and record there are no bit errors for a period of 12.5s. 8. Check and record the path trace labels are as before the protection switch. 9. Clear the break and wait for the switching to revert. Findings Total number of bit errors during 12.5s measurement period = 0. The 512 path trace labels are as they were before the protection switch. Numerical and Graphical Results Zero errors for a period of 12.5s, at a data rate of 2.5G, gives a 95% confidence of a residue BER of better than 1E-10. Conclusion The protection switch restored the channels, correctly routed and in an error free condition. Test Passed 2003 Iometrix, Inc. All rights reserved. 29

30 Multiple 2F-BLSRs Restoration Test 12 (Core). The maximum service disruption should not exceed 50ms. GR1230, R6-13, states that the end-to-end switch time for a single ring or span switch on a clean ring with less than 1200km of fiber and 16 nodes shall not exceed 50ms. This does not include detection time. Since we have 24 nodes in the test configuration, it is assumed that GR1230, R6-14 applies: The end-toend switch completion time for any ring or span switch [when R6-13 is not applicable] shall no exceed 100ms after detection. In the case of restoration, there is no detection time. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on 16 ring optical fibers between the MSSP and s. 7. Clear the break and wait for the switching to revert. 8. Measure the reversion times on all the tributaries and record the results. 9. Repeat the procedure steps 6 to 8 twice more. Findings All the timing results were well within the 50ms requirements. Only 3 timing measurements were required in each direction, since the results were within better than 10%. Numerical and Graphical Results 2003 Iometrix, Inc. All rights reserved. 30

31 Restoration Time, 16 unidirectional breaks (impacting 512 channels, all STS-3C) 1 st Run 2 nd Run 3 rd Run Mean 4.2ms 4.1ms 4.1ms Max 5.7ms 5.4ms 5.6ms Min 2.6ms 2.6ms 2ms 55ms 50ms 45ms 40ms 35ms 30ms 25ms 20ms 15ms 10ms 5ms 0ms 1 st Run 2 nd Run 3 rd Run Restoration Time, 16 Unidirectional Breaks Measured Values Maximum Mean Minimum Conclusion All the measurements came very well within the required time switching time of 50ms. Like the protection switching, the repeatability of the results and the linearity of the graph show that the protection switching in this system is highly stable and determinate, a good reliability indicator. Test Passed 2003 Iometrix, Inc. All rights reserved. 31

32 Multiple 2F-BLSRs Restoration Reporting Test 13 (Core). During a restoration, the wait for restoration and the restoration should be reported correctly. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Cause a unidirectional break on 16 ring optical fibers between the MSSP and s. 6. Clear the break and wait for the switching to revert. 7. Record the management system reporting of the wait to restore and it s clearing, when the restoration occurs. Findings The following events were correctly reported:- The wait to restore 16 times The clearing of the wait to restore 16 times Numerical and Graphical Results N/A Conclusion The wait to restore and the clearing of it were reported correctly. Test Passed 2003 Iometrix, Inc. All rights reserved. 32

33 Multiple 2F-BLSRs Restoration BER and Connectivity Test 14 (Core). After a protection switch and a restoration, the channels should be correctly routed and error free. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace lables. 4. Check there are no bit errors for a period of 12.5s. 5. Store the received path trace labels in the test equipment, for future comparative measurements. 6. Cause a unidirectional break on 16 ring optical fibers between the MSSP and s. 7. Clear the break and wait for the switching to revert. 8. Check and record there are no bit errors for a period of 12.5s. 9. Check and record the path trace labels are as before the protection switch and restoration Findings Total number of bit errors during 12.5s measurement period = 0. The 512 path trace labels are as they were before the protection switch and restoration. Numerical and Graphical Results Zero errors for a period of 12.5s, at a data rate of 2.5G, gives a 95% confidence of a residue BER of better than 1E-10. Conclusion The restoration restored the channels, correctly routed and in an error free condition. Test Passed 2003 Iometrix, Inc. All rights reserved. 33

34 2F-BLSR Manual Switching Test 15 (Core). The maximum service disruption should not exceed 50ms. GR1230, R6-13, states that the end-to-end switch time for a single ring or span switch on a clean ring with less than 1200km of fiber and 16 nodes shall not exceed 50ms. This does not include detection time. Since we have 24 nodes in the test configuration, it is assumed that GR1230, R6-14 applies: The end-toend switch completion time for any ring or span switch [when R6-13 is not applicable] shall no exceed 100ms after detection. In the case of manual switching and restoration, there is no detection time. Objective Verify that the system meets the test requirements. Testbed 15 Cisco ONSs, each with 2 x 10G Line interfaces and 10G tributary interfaces 5 Cisco ONSs, each with 2 x 10G Line interfaces and 2.5G tributary interfaces 1 Cisco ONS15600 with 32 x 10G Line interfaces. OmniBER XM Network simulator, with 6x10G and 8x2.5G ports. Glimmerglass Reflexion 300 optical switch. See Appendix 1, Figure 7 Multiple 2F-BLSRs TestBed Procedure 1. Configure the network and test equipment according to the testbed in Appendix Confirm there are no errors or alarms present. 3. Check that the circuits are correctly routed using the path trace labels. 4. Check there are no bit errors for a period of 12.5s 5. Institute a simultaneous manual protection switch on all the west trunk interfaces 6. Recode the service disruption time. 7. Clear the manual switches 8. Record the restoration time. 9. Verify Manual switch alarms are clear Findings All the timing results were well within the 50ms requirements Iometrix, Inc. All rights reserved. 34