GRADUATE RELIABILITY TRAINING PROGRAM Initiation Date: September 2012 Board Approved Date: May 2012
GRADUATE RELIABILITY TRAINING PROGRAM Program Description This program is intended for recent college graduates (undergraduate or graduate) who desire a career in the energy field, specifically the analysis of the reliability of the bulk electric transmission and generation system. The program is a total of two years with a rotation among the ReliabilityFirst functional areas, including a three to six month assignment in each area. The graduate trainee, a full time permanent position, will be assigned a mentor throughout the program, who will help with career growth and provide performance coaching. At the end of the program, the trainee will be assigned to one of the departments listed below at ReliabilityFirst. The program begins with an intensified initial period during which a blend of formal training and structured hands-on experiences (in concert with subject matter experts) will form the foundational knowledge base for the entry level person in the field of System Reliability, specifically in the field of Power Systems. More emphasis is focused on depth in Systems Reliability in the beginning moving to breadth in the Systems Engineering near the end, but no solid dividing line in time is required. The program will provide a solid foundation that allows for an exponential growth in individual contributions, especially in the later years. Requirements for Entry into the Program Recent undergraduate degree (master s degree a plus) in an engineering, science, technology, or mathematics field. Willing to travel approximately 10% Willing to shadow a mentor locally or remotely Willing to document the knowledge gained in the program Goals of the Program The overall objective of this program is to create a comprehensive entry level and career path by blending targeted training with a structured exposure to on-the-job experiences within a contextual framework through which knowledge extraction from existing subject matter experts is both accelerated and meaningful with the end result being a growing of our own talent to augment a traditional utility-centric staff with broader Systems Engineering professionals. Some of the aspects of the program include: 1. A program that is interesting to the recent graduate, promoting a lifelong learning process in a positive field of study. 2. Provides participants a path forward to grow into future roles of increasing responsibility at ReliabilityFirst while accelerating productivity and individual contribution thus allowing for a quicker return on investment for the Graduate Program. 3. Establishment of a structured training and work experience program for the first two years, which will serve as a springboard to broaden the knowledge gain throughout the participant s career. 4. Ensures the participant gains career insurance by providing transportable Systems Engineering skills. 5. Establishment of an environment where the participant proactively pursues the requisite knowledge and experience under the guidance of a stable in-house career mentor and coach. 6. Encourages, facilitates, accelerates and memorializes knowledge transfer from the most experienced staff member 1
GRADUATE RELIABILITY TRAINING PROGRAM FUNCTIONAL AREA JOB DESCRIPTIONS Reliability Assessment and Performance Analysis (RAPA) Group The primary purpose of this functional area is to perform resource and transmission reliability assessments for forecasted conditions and to monitor disturbance reporting and carry out Bulk Power System (BPS) event analysis. Resource Adequacy Collection and analysis of demand (i.e. electrical load) and capacity (i.e. generation) forecasts and determination of resource adequacy. Knowledge of demand and capacity data composition, probability techniques and methods (such as Loss of Load Probability and Loss of Load Expectation) used to determine adequacy Reliability Engineering Statistical Transmission System Modeling Collection and assembly of power flow (e.g. nodes and branches) and dynamic (e.g. generator governor) data to build transmission system models of the Eastern Interconnection. Analysis Knowledge of the detailed data and solution of complex transmission system models Developing system models solution techniques Transmission System Studies Protection of transmission and generation equipment Disturbance Reporting and Event Analysis Performing power flow analysis, including transfer capability, voltage analysis, generation redispatch, contingency analysis, etc. Reviewing generator outage data and transmission branch outage data and correlation with reported misoperation data. Reviewing reported disturbances, sequence of events, determining root causes, development of lessons learned. Familiarity with modeling software (e.g. PSS/e) Systems Engineering Verification and Validation Knowledge of how to conduct complex transmission system analyses Developing contingency lists and writing technical reports Familiarity with power flow software (e.g. PSS/e, MUST, TARA) Systems Engineering Verification and Validation Basic knowledge of transmission and generation protection schemes Corrective action for misoperations Basic knowledge of generation and transmission outage data and statistics Systems Engineering Architectural Design Reliability Engineering Probability and Statistical Analysis Levels of events and reporting thresholds Reporting procedures for disturbances and events Reliability Engineering Root Cause Determination Systems Engineering Decision Making 2
Compliance Services and Investigations The primary purpose of this functional area is to support the Compliance Monitoring and Enforcement Programs by performing Investigations, entity functional Certifications, addressing Registration issues or objections, completing reviews of System Events, resolving Complaints, and support of Audits of utility industry stakeholders. Compliance Services Monitor and track entity performance, develop trends and metrics, etc. Knowledge of the Compliance Monitoring Methods and the recognition of meaningful correlations Reliability Engineering Statistical Analysis Investigations Participate in investigations. Knowledge of the investigation process including identifying and interpreting the discrete features of deteriorated system causing the loss of an intended function Reliability Engineering Failure Reporting, Analysis and Corrective Action System (FRACAS) and Root Cause Analysis Certifications Registration of Entities System Events Complaints Compliance Determinations Perform functional entity Certifications for Reliability Coordinators, Balancing Authorities and Transmission Operators. Analyze entity circuit configurations and apply Registration Criteria to determine their proper designation within the Functional Model. Review and perform a compliance analysis of system events. Assess the validity of the facts associated with Complaints and determine any compliance impact. Gather and analyze entity data submittals as per the Annual Implementation Plan. Knowledge of the Functional Model describing the roles each entity plays in assuring reliability and stability of the electrical grid Systems Engineering Verification and Validation Application of abstract models to actual system configurations. Systems Engineering Stakeholder Requirements Definition Perform a post-mortem of system events, including a compliance evaluation Reliability Engineering FRACAS and Root Cause Analysis Techniques for assessing items reported by entities to make compliance determinations Analysis of all data submitted by the entities to make compliance determinations Reliability Engineering Statistical Analysis Annual Reporting Develop and report regional data. Knowledge of all reporting requirements to NERC and FERC Systems Engineering Stakeholder Requirements Definition Portal - Software Maintenance and Upgrading Review, update, and assist in the development of the regional software application. Assist in the development of software initiatives. Development of the business rules associated with compliance software Systems Engineering Architectural Design 3
Planning and Operations Audits The primary purpose of this functional area is to perform Compliance Monitoring of the Registered Entities within the ReliabilityFirst footprint through within the areas of Resource and demand balancing, Communications, Emergency Preparedness, Facility Design, Interchange Scheduling, Modeling, Nuclear, Personnel Training, Protection and Control, Transmission Operations and Planning and Voltage and Reactive Power Management, in order to help ensure the reliability of the Bulk Electrical System. Participate in the completion of audits and spot checks following NERC and auditing standards and practices including the review of electrical power data and information. Planning and Operations Audits/Spot Checks Creation of reports on the findings of audits and spot checks. Knowledge of the BES and the functional interrelationships associated with the operation, planning and maintenance of the BES. Knowledge of the ReliabilityFirst Audit process and execution of key activities to complete the audit/spot-check within the established milestone timelines. Knowledge of Auditing Standards and Practices Entity Impact Evaluation Entity Outreach Utilize Entity Impact Evaluation (EIE) as part of developing of an Audit Plan for ReliabilityFirst audited entities. Support the development of the EIE process. Support registered entities though workshops, initiatives, and communications on compliance, audit processes, and other topics to assist the entities. An understanding and awareness of the impact registered entities may have on the BES. An understanding of the factors which are important to creation of EIEs. Reliability Engineering Probability and Statistics Tools Systems Engineering Risk Management A thorough understanding of Compliance and Operations & Planning to be able to conduct effective training. Systems Engineering Integration 4
Critical Information Protection (CIP) Audits The primary purpose of this functional area is to support the Compliance Monitoring Processes (CMP) by performing compliance reviews and assessments (Audits / Spot checks) of utility industry stakeholders, within the ReliabilityFirst footprint, assessing their performance in the area of Cyber Security for systems within the Bulk Electric System (BES) and assessing their compliance with NERC Critical Infrastructure Protection (CIP) Standards. CIP Audits / Spot Checks Participate in the completion of audits and spot checks following NERC and auditing standards and practices including the review of electrical power data and information. Creation of reports on the findings of audits and spot checks. Knowledge of the BES and the functional interrelationships associated with the operation, planning and maintenance of the BES. Knowledge of the ReliabilityFirst Audit process and execution of key activities to complete the audit/spot-check within the established milestone timelines. Knowledge of Auditing Standards and Practices Technical Feasibility Exception (TFE) Management Mitigation Plan Acceptance and Validation Reviews (MPARs and MPVRs) Risk Based Assessment CIP Outreach Participate in TFE Processing to include reviews and auditing of Approved and Terminated TFEs as part of CIP Audits. For CIP related violations, perform acceptance of mitigation plans and verification of evidence for plans to mitigate risk to the Bulk Electric Systems. Engage in the Risk Based Assessment Committee process and evaluation of ReliabilityFirst audited entities. Obtain and provide CIP Subject Matter Expertise and support, as required and able for the following activities: Assist Visits ERO Workshops ReliabilityFirst Compliance Workshops Registered entity inquiries Compliance Training Needs Knowledge of what a TFE encompasses; and how TFEs are tracked, processed, and managed within the applicable CIP standards Systems Engineering Information Management Knowledge of industry approaches to mitigate violations in an effort to ensure reliability of the BES. Evaluate Root Cause Analysis efforts for validity Reliability Engineering FRACAS and Root Cause Analysis Knowledge about the potential risk to the reliability of the BES that each unique ReliabilityFirst registered entity may pose, based on their entity risk profile assessment Reliability Engineering Probability and Statistics Tools Systems Engineering Risk Management An understanding of the outreach efforts for RFC registered entities as well as Regional Entities, NERC and the Industry Systems Engineering Information Management 5
Analytics and Enforcement The primary purpose of this functional area is to provide technical and logistical support for the case management of all Compliance violation matters and to perform, organize and lead analytical initiatives and projects with the goal of quantification of grid reliability and the determination of risk posed by violative or other entity conduct. Facilitate Events using Brainstorming, C&E, Pareto Analysis Facilitate events in the Analytics and Enforcement group requiring the collaboration of a group of people with the goal of solving a critical problem. Gaining consensus for complex system problem sets. Systems Engineering Stakeholder Perform Gauge R&R Studies Facilitate a Process Mapping Event Participate and Lead Risk Harm Assessments (FMECA Analysis) Perform Design of Experiment Projects Perform Validation of Mitigation Plans Create Settlement Agreements Analyze repetitive sets of data to make sure that the underlying process is statistically significant. Facilitate events in the Analytics and Enforcement group to help a group of individuals to map out and improve a current process. Assess the Risk and Harm to the Bulk Electric System with a group of individuals using classic Failure Modes and Effects Analysis. Use Design of Experiment methodology to reduce the number of tests required to draw a statistically significant conclusion Perform validation of evidence for plans to mitigate risk to the Bulk Electric Systems. Analyze a set of facts and circumstances resulting in a violation of Reliability Standards and determine appropriate settlement terms. Requirements Definition Providing testing, analysis and persuasive writings to support technical positions. Reliability Engineering Probability and Statistics Tools Efficiency analysis and continuous improvement as core competencies. Reliability Engineering FRACAS and Root Cause Analysis Predictive analysis and modeling as a form of a proactive reliability tool. Reliability Engineering Human Calibration and Estimation Ability to derive controlling elements in design or failure analysis. Reliability Engineering Design of Experiments How to evaluate Root Cause Analysis efforts for validity Reliability Engineering FRACAS and Root Cause Analysis Ability to reduce technical analysis to a description suitable for inclusion in a legal document. Systems Engineering Requirements Analysis 6