NYISO DECISION SUPPORT SYSTEM INTRODUCTION TRAINING COURSE Presented by Jack Valentine JValentine@nyiso.com 518 356 6220 If possible, please put your phone on mute. Please do not use the hold button. Webex ideal screen setting is 1024 x 768
Training Agenda Course Background DSS Training Offerings Course Goals Supporting Documentation DSS Background Information What is a Data Warehouse/DSS? NYISO DSS Project Overview Corporate Report Overview Getting Started Application Walkthrough
DSS Training Offerings Introduction Training Course Instructor led online training course covering the basics of NYISO s DSS (WebEx delivered). Intermediate Training Course Instructor led classroom training course covering intermediate topics such as custom report creation. Self-Directed Introduction Training Course Download and view the DSS Introduction Training Course on NYISO s DSS from the NYISO website (planned course). Third Party Offerings Independent training organizations offer a wide variety of training programs on Business Objects.
Course Goals & Objectives WILL PROVIDE An introduction to the DSS An introduction to data warehouses in general A brief overview of the data contained in the DSS A demonstration of the basic features of DSS toolset An overview of DSS Corporate Reports WILL NOT INCLUDE: Training on intermediate features of the DSS Toolset see the NYISO DSS Intermediate Course Advanced Business Objects training available from third parties.
Supporting Documentation The following documents should be used as supplementary documentation for this course: NYISO DSS Users Guide NYISO Billing and Accounting Manual DSS User Administration Technical Bulletin- #109 DSS Release Matrix DSS Customer Settlements Billing Code Mapping Document
Data Warehouse Definition Data Warehouse Repository of integrated, non-volatile and timevariant data, collected from heterogeneous transaction processing applications, and stored in a format optimal for reporting and strategic analysis for an enterprise -- Bill Inmon For NYISO - Data from BAS, MIS and Consolidated Invoice applications is collected, formatted and stored in a single, centralized location for customer reporting and analysis.
Data Warehouse Components Feed Store Use Operational Data Data Preparation (ETL) External Data Data Warehouse User Tools (Business Objects)
Business Objects Introduction Power Suppliers Data Warehouse Load Serving Entities BAS Data Prep & Transfer Transaction Customers MIS Hierarchy ~1200 data elements Virtual Market Customers Etc. Universe: View of a functional set of data within the warehouse Classes/Sub-classes: Groups of objects Objects: Individual data elements (for reporting and filtering) Example: Organization, Interval Start Time
BO Universe Design Examples Universe: Power Suppliers Class/Sub-class: Universe: Virtual Market Customers Class/Sub-class: Organization Virtual Supply Market / Virtual Objects: Supply Bus Organization Name Objects: Organization Type Virtual Supply Bus Name Virtual Supply Bus PTID Class/Sub-class: DAM Energy Settlement / Class/Sub-class: Hourly / Settlement Results Virtual Load Market / BalMkt Objects: Virtual Load Settlement / SCD / Billing Determinants Hourly DAM Energy Settlement ($) Objects: Hourly DAM Loss Settlement Hourly DAM Virtual Load ($) Energy (MW) Hourly DAM Congestion SCD RT Energy Price :Virtual Settlement ($) Load Bus ($/MW) Hourly Total DAM Settlement SCD RT Loss Price :Virtual ($) Load Bus ($/MW) SCD RT Congestion Price :Virtual Load Bus ($/MW)
DSS Versioning Strategy BAS Settlement Versions Advisory 1 Advisory 2 Advisory 3 Advisory 4 Invoice From Version 4 Advisory 5 Invoice DSS Settlement Versions Version 0 Version 0 Version 0 Version 0 Version 1 Invoice Version 0 Version 2 Invoice Key Point: Version 0, when it exist, represents the latest version of settlement data. If Version 0 does not exist, then the latest settlement will be the invoice with the highest Version Invoice #.
DSS Project Goals Data Availability Offer as much data as possible Maximize data availability (when the data is available) 21x7 data loading between 4-7am daily Ease of Use First step is template driven Corporate Reports Easiest to use Reporting/Analytical flexibility is made easy (Covered in the Intermediate Course) Data accuracy as compared to source data
DSS Project Summary Contains 99% of NYISO Settlement Billing Codes and all related Dimensional data elements Power Suppliers Day Ahead & Balancing Market Energy and Bid Production Cost Guarantees Ancillary Services (Black Start, VSS, Regulation, Operating Reserves) Load Serving Entities Day Ahead & Balancing Market Energy Ancillary Services, Residuals, Supplier Uplift Allocations, and Other Charges Transaction Customers Day Ahead & Balancing Market Energy Day Ahead & Balancing Market Replacement Energy Day Ahead & Balancing Market Transmission Usage Charges Day Ahead & Real-Time Bid Production Cost Guarantee Ancillary Services, Residuals, Supplier Uplift Allocations, and Other Charges Virtual Market Customers Day Ahead & Real Time Market Virtual Energy Transmission Congestion Contract Customers Rent Day Ahead Demand Response Program Customers Transmission Owners DAM Congestion Rent and NYPA NTAC
What Makes Up the Settlement Datamart Nearly 25 Million rows per month per version in the largest SCD (five minute interval) fact tables Over 11 million rows in single table per day/version Approximately 10 Terabytes of disk space ~1200 distinct data elements Large data volumes require a solid, scalable architecture Time spent planning up-front will ensure scalability for months and years to come Complex Data Structures and NYISO Business/Settlement Rules It s HUGE!
DSS Data Availability Availability dependent upon release dates. Balancing Market Settlements; July, 2003 DAM, Virtual and TCC markets; October, 2003 Power Supplier and LSE Ancillaries, Transactions and DADRP; December, 2003 As settlements prior to release dates are re-spun, additional data becomes available. See Lists of Interval Days and Invoice Versions in DSS Historic data will not be available
Corporate Reports Summary and Administrative Reports Settlement Summary Reports Settlement Results Report Settlement Version Comparison Report Administrative Reports Settlement Version Control Log List of Interval Days & Invoice Versions Contained in DSS
Corporate Reports - Power Suppliers Power Supplier Settlement Detail Reports Day Ahead Market Energy Day Ahead Market Bid Production Cost Guarantee Balancing Market Energy Real Time Bid Production Cost Guarantee DAM Margin Assurance ELR DAM Margin Assurance Black Start Service Voltage Support Service Credit Voltage Support Service Lost Opportunity Credit Regulation DAM Availability Regulation Supplemental Availability Regulation Lost Opportunity Credit Regulation Penalty 10-Minute Sync DAM Availability 10-Minute Sync Supplemental Availability 10-Minute Sync Reduction 10-Minute Non-Sync DAM Availability 10-Minute Non-Sync Supplemental Availability 10-Minute Non-Sync Reduction 30-Minute Sync DAM Availability 30-Minute Sync Supplemental Availability 30-Minute Sync Reduction Sync Reserve Lost Opportunity Credit (Blocked) Sync Reserve Lost Opportunity Credit (Backed Down) Non-Sync Reserve Lost Opportunity Credit Sync Reserve Penalty Generator Output Charts
Corporate Reports - Load Serving Entities Load Serving Entity Settlement Detail Reports Day Ahead Market Energy Balancing Market Energy Ancillary Services MST Schedule 1 Charges OATT Schedule 1 Charges Black Start Charges Voltage Support Service Charges Regulation Service Allocation Operating Reserve Service Allocation Residuals DAM Energy Residual Allocation DAM Loss Residual Allocation Balancing Market Energy Residual Allocation Balancing Market Loss Residual Allocation Balancing Market Congestion Residual Allocation Supplier Uplift DAM Margin Assurance Allocation Import ECA Supplier Guarantee Allocation NTAC Charges Emergency Sales Allocation Emergency Purchases Allocation
Corporate Reports - Transaction Customers Transaction Customer Settlement Detail Reports DAM TUCs DAM Energy DAM Bid Production Cost Guarantee DAM Replacement Energy Balancing Market TUCs Balancing Market Energy Real-Time Bid Production Cost Guarantee Balancing Market Replacement Energy Ancillary Services MST Schedule 1 Charges OATT Schedule 1 Charges Voltage Support Service Charges Operating Reserve Service Allocation Residuals DAM Energy Residual Allocation DAM Loss Residual Allocation Balancing Market Energy Residual Allocation Balancing Market Loss Residual Allocation Balancing Market Congestion Residual Allocation Supplier Uplift DAM Margin Assurance Allocation Import ECA Supplier Guarantee Allocation NTAC Charges Emergency Sales Allocation Emergency Purchases Allocation
Corporate Reports - Virtual Market Customers Virtual Market Customer Settlement Detail Reports Virtual Load DAM Balancing Market Virtual Supply DAM Balancing Market
Corporate Reports Transmission Congestion Contract Customers TCC Customer Settlement Detail Reports TCC Rent
Corporate Reports Day Ahead Demand Response Program Customers DADRP Customer Settlement Detail Reports Incentive Reduction Load Balance Penalty for Demand Response Providers Penalty for Load Serving Entities Bid Cost Guarantee
Corporate Reports Transmission Owners Transmission Owner Settlement Detail Reports DAM Excess Congestion Residual
Business Objects Functionality Getting Started Infoview (DSS Homepage) Business Objects Accessing Corporate Reports Printing Saving Web Intelligence Questions
Getting Started To Start Using the NYISO DSS: 1. Minimum System Requirements 1GB of disk space 256MB of RAM MS Internet Explorer web browser 500Mhz Processor 2. Obtain DSS User Access See Technical Bulletin 109 3. Download Business Objects
Select the 2 nd radio button,unless you already have an account & wish to add another organization.
New Report Wizard is used to create a new document. We want to access existing Corporate Reports To do so, Go to File Retrieve Document Corporate Documents Once a file has been retrieved, it is stored in your machine and it is not necessary to re-retrieve each time. You can then go to the Report using Open
Handling Documents To Print Corporate Reports: Select File, Page Setup Adjust Fit to print as desired. Corporate Reports are pre-set to fit on pages. Show Preview of print job. To Save and/or Export Reports: Select Save As, select (Highlight) the type of file you wish to save it in (such as pdf) from the drop-down menu. Select Save
Handling Documents (2) To Save a template file: Select Save As, select pdf. From the Save as type drop-down. Select Save. The template with the populated data will be stored in Adobe Acrobat. To Copy to an Excel spreadsheet: Select the table of data for export by placing the cursor on the table. Select Edit, Copy All. Open a blank Excel file, place the cursor on the A1 box and Paste. Custom Reports can be exported much better to Excel because you control the formatting and I suspect you ll use a lot less.
1. 2. 3. 4.
Conclusion Questions? Comments?