INTERIM MARKET DOCUMENT CHANGE

INTERIM MARKET DOCUMENT CHANGE Title: MPLS and Alternative Communications for Medium Performance Facilities File #: IESO_IMDC_0169 Version #: 0.2 Part 1 General Information Document Affected: Market Manual 6: Participant Technical Reference Manual IMO_MAN_0024 Market Rule Reference(s) Section 2.2 Participant Network Section 3.1.1 Hardware Requirements Section 3.3 Real Time Network Section 4.1.2 Qualified Devices Section 4.1.7 RTU Site Certification This Interim Market Document Change represents an amendment to the market document noted above. In the event of any inconsistency between the terms of this Interim Market Document Change and the terms of the affected document, the terms of this Interim Market Document Change shall prevail. Date Prepared: Subject: Reason For Change: September 16, 2011 Valid From: September 19, 2011 Valid To: November 1, 2011 MPLS and Alternative Communications for Medium Performance Facilities The reason for this IMDC is two-fold: (1) Technological and equipment changes resulting from IESO s Frame Relay Migration to Multiprotocol Label Switching (MPLS) 1 project. (2) As a result of Market Rule Amendment MR-00362 2 coming into effect on November 1, 2011, embedded variable generators with a capacity of 5 MW or greater are obligated to send the IESO real-time operational and meteorological data. In consultation with the IESO, these medium performance facilities may be provided with an alternative real-time network communication via a site-to-site VPN connection over the Internet, or if available through their Local Distribution Company. 1 Our telecom service provider has notified the IESO of the end of sales of Frame Relay services. An announcement was made at the Information Technology Standing Committee (ITSC) meeting on September 13, 2011. The IESO will start migrating the existing real time and shared networks from Frame Relay to MPLS beginning in 2012 through 2013. Our telecom service provider will continue to maintain the IESO Frame Relay networks until all market participants are migrated to MPLS. Market participants who are currently on the Frame Relay networks will be contacted in advance of any scheduled changes.presented to the Information Technology Standing Committee (ITSC) on September 13, 2011 2 Through the SE-91 Renewable Integration and the Visibility Technical Working Group (VTWG) Page 1 of 8 Public IMO-FORM-1499 v6.0

Part 2 General Information Description of Change The information following will be included in a revision of the affected document, on or about the valid to date provided in Part 1. 2.2 Participant Network 74 There are three methods for a market participant to connect to the IESO. These are defined as PUBLIC over the Internet or as PRIVATE through a facility contracted by the market participant with a telecommunications service provider, or SHARED over the IESO provided Multiprotocol Label Switching (MPLS) or Frame Relay switched frame relay switched network. Market participants who require high performance or reliability may wish to consider the PRIVATE or SHARED network alternatives. 2.2.1 Internet 76 The connectivity bandwidth should be at least 28.8-64Kbps but higher speeds are recommended to maintain optimal performance. 2.2.2 Private Network 83 The current list of preferred telecommunications carriers consists of the following: Allstream, Bell Canada, Hydro One munications, and SprintRogers Communications. 2.2.3 Shared Network 84 Our telecom service provider has notified the IESO of the end of sales of Frame Relay services. An announcement was made at the Information Technology Standing Committee (ITSC) meeting on September 13, 2011. The IESO will start migrating the existing shared networks from Frame Relay to MPLS beginning in 2012 through 2013. Our telecom service provider will continue to maintain the IESO Frame Relay networks until all market participants are migrated to MPLS. Market participants who are currently on the Frame Relay networks will be contacted in advance of any scheduled changes. 8485 The Multiprotocol Label Switching (MPLS)Frame Relay network will be maintained through the service providerat&t with IESO having responsibility for connectivity up to the router/security deviceframe Access Relay Device (FRAD) located on the market participant site. Static routing will be used across the interfaces between IESO and the market participant s network. Reserved internal TCP/IP addresses may not be accepted due to possible conflicting addressing acemes on the network. An incremental cost sharing agreement must be agreed to with the IESO and the proportionate cost will be borne by the market participant. 8586 The market participant must providewill work with the IESO to define a satisfactory internal IP or registered external public IPwith a registered TCP/IP Ethernet address for the Ethernet port that connects to the market participant s internal network. Page 2 of 8 IMO-FORM-1499 v6.0

868787 To arrange for a Frame Relayshared network connection, contact the IESO (see www.ieso.ca) Connecting to the Supplied Ethernet Port 878888 A network connection will need to be established between the an Ethernet Port on the FRAD router/security device and the market participant s Internal Network. 888989 If distance between the Ethernet Port on the router/security devicefrad and the market participant s Internal Network is an issue, then a recommended solution will be to deploy an Ethernet Repeater or Ethernet Extender. Ethernet Repeaters can effectively increase the distance of typical 10BASE-T Ethernet connections from around 182 meters (600 feet) to over 7,300 meters (24,000 feet) using existing ordinary copper telephone wires. 90 The IEEE 802.3 10BASE-T standard requires that 10BASE-T transceivers be able to transmit over a 100-meter (328 feet) link-using 24AWG unshielded twisted pair wire. Due to cable delay, the maximum link length is nearly always limited to about 200 meters (656 feet), regardless of the cable type. 91 As a general rule, links up to 150 meters (492 feet) long are achievable for unshielded and shielded twisted pair cable, with a maximum 200 meters (656 feet) due to cable delay. For each connector or patch panel in the link, subtract 12 meters (39.4 feet) from the 150-meter limit. This will allow for links of up to 126 meters (413.4 feet) using standard 24 AWG UTP wire and two patch panels within the link. Higher quality low attenuation cables may be required when using links greater than 126 meters. Traffic Aggregation 899092 The IESO will preserve the predictable response time of the Real Time network for market participants who chose to use the Frame RelayMPLS Network to submit bids, offers, and access market settlements and metering information over the Frame MPLS Backbone. 909193 A single virtual circuit will be established between the IESO and the market participant with appropriate Quality of Service and queuing controls enabledseparate Permanent Virtual Circuits (PVC s) will be established with an appropriate Committed Information Rate (CIR) for each specific type of function. For example: Browser based HTTP traffic (TCP/IP port 80) will be allocated its own Class of Service to enable it to be prioritized by the Quality of Service and queuing controlsframe Relay PVC. The CIR value will be adjusted to accommodate the individual bandwidth requirements of each market participant. The incremental cost of this will be charged to the market participant. Market Participant Firewall Configuration 919294 Web based network communications will be secured using SSL. Depending on the market participant s internal network configuration, changes may have to be made to allow a SSL connection if firewalls are used. 929395 Changes to the market participant s firewall configuration will be dependent upon the type of firewall in use. For standard and encrypted web traffic, TCP Ports 80 and, 443 will need to be open. In cases where FTP is required by a market participant, TCP Ports 20 & and 21 will need to be open. Page 3 of 8 Public IMO-FORM-1499 v6.0

3.1.1 Hardware Requirements Interface Cards 128129131 The network card must support a high-speed (10 Mbps or greater) network, as it will be required to communicate over Ethernet to an IESO supplied router at the market participant site. The wiring between the dispatch workstation and the router is the responsibility of the market participant. The IESO supplied router will communicate over private network (MPLSframe relay) to the IESO. 3.3 Real Time Network 166 Our telecom service provider has notified the IESO of the end of sales of Frame Relay services. An announcement was made at the Information Technology Standing Committee (ITSC) meeting on September 13, 2011. The IESO will start migrating the existing sharedreal time networks from Frame Relay to MPLS beginning in 2012 through 2013. Our telecom service provider will continue to maintain the IESO Frame Relay networks until all market participants are migrated to MPLS. Market participants who are currently on the Frame Relay networks will be contacted in advance of any scheduled changes. 165167168 The Real Time Network will be used for: a. Real time data acquisition of power system data required by the IESO to operate the power system; b. Dispatch of automatic generation control (AGC) control commands; and c. Dispatch messaging. 166168169 Function (a) and (b) above are typically executed by an RTU, and function (c) by a dispatch workstation. 167169170 Real-time network communication with the IESO Control Center is typically via a MPLS communications network, but could also be via a site-to-site VPN connection over the Internet for medium performance sites. The MPLS network will be made available by the IESO to the market participant, or, in the case of a medium performance site where the VPN option is preferred, the market participant will provide access to the public internet. In some cases, where the size and the location of the market participant s electrical plant warrants, a secondary communications system for increased reliability will also be made availablereal-time network communication with the IESO Control Center is via a Frame Relay communications network, except for dispatch messaging which will also use the Web as an alternative. This real-time network will be made available by the IESO to the market participant. In some cases, where the size and the location of the market participant s electrical plant warrants, a secondary communications system for increased reliability will also be made available. 168170171 The connection to the Real Time Network for an RTU or a functionally equivalent device e.g. PML meter, requires the market participant to provide the following: a. i) Where MPLS access is the preferred method, physical access for the communications carrier and IESO to the market participant site to install a local loop and other required premises equipment such as the MPLS router and a DNP3 communications device must be provided. OR Page 4 of 8 IMO-FORM-1499 v6.0

ii) Where site-to-site VPN is the preferred method for a medium performance site, logical access via Internet Service Provider (ISP) to the public internet from the IESO network security devicea. Access for the communications carrier to the market participant site to install a local loop and other customer premises equipment such as the DSU and FRAD. As well as physical access for IESO to install premises equipment such as a network security device and DNP3 communication device must be provided. b. A dedicated dial-up telephone line connected to the FRAD DNP3 device to enable remote maintenance. c. Space to house the customer premises equipment in a suitable environment (e.g. dry, clean, 0 40 C, free of Electro-Magnetic interference, etc.) d. A suitable power source for the customer premises equipment (typically a reliable source of 120V ac, 60 Hz usually from a UPS with a total load capacity of 500 Watts) with at least 8 hours of survivability after loss of commercial power. e. Access for maintenance personnel as needed. f. Connectivity from the market participant equipment to the customer premises equipment as stated for the particular device. g. A point of contact (a person and telephone number) to enable the IESO to request repairs by the market participant for telemetry failures. Page 5 of 8 Public IMO-FORM-1499 v6.0

MPLS connection diagram: Dial-up telephone line Local Telco Office Local Loop Isolating Device Room Internal Wiring UPS UPS DNP3 Device DSU FRAD Interconnect Cable RTU Market Participant s Premises Equipment Room (Legend: IESO responsibility Market Participant responsibility ) Site-to-Site VPN connection diagram: Dial-up telephone line Ethernet Internal Wiring DNP3 Device Room UPS Interconnect Cable RTU Market Participant s Premises Equipment Room (Legend: IESO responsibility Market Participant responsibility ) Figure 3-2: Responsibilities for munications and Site Readiness for RTUs Page 6 of 8 IMO-FORM-1499 v6.0

169171172 The connection to the Real Time Network for a dispatch workstation requires the market participant to provide the following: a. Access for the communications carrier to the market participant site to install a local loop and other customer premises equipment. b. A dedicated dial-up telephone line connected to the Router to enable remote maintenance. c. Space to house the customer premises equipment (Router) in a suitable environment (e.g. dry, clean, 0 40 C, free of Electro-Magnetic interference, etc.) d. A suitable power source for the customer premises equipment, typically a reliable source of 120V ac, 60 Hz. e. Access for maintenance personnel as needed. Local Telco Office Local Loop Isolating Device (if required) Dial-up Telephone Line Internal Wiring Router Room Market Participant s Premises Interconnect Cable DWS/ ICCP serverr TU (Legend: IESO responsibility Market Participant responsibility ) Figure 3-3: Responsibilities for munications and Site Readiness for DWS/ICCP Server Page 7 of 8 Public IMO-FORM-1499 v6.0

4.1.2 Qualified Devices 216218219 If ICCP (Inter Control Center Protocol) is used for real-time data transfer to the IESO, the market participants will provide their own ICCP server and software or optionally use a third party s ICCP server and software. Co-ordination with the IESO is necessary to establish the communication link between the market participant and the IESO Control Centers. 4.1.7 RTU Site Certification 237239240 The work involved in establishing this connection typically includes: a. installation of a local loop between the RTU location and a telecommunications service provider; b. installation of telecommunication equipment at the market participant s premises. Typically this equipment is comprised of three two small modules, the Frame Relay Access Device (FRAD), the Digital Service Unit (DSU)router/security device and the dial-up modemdnp3 communication device; and c. verifying that the telecommunication connection is working properly. Page 8 of 8 IMO-FORM-1499 v6.0