texas nodal eds market trials approach wednesday, november 29, 2006

http://nodal.ercot.com 1Lead from the front

Texas Nodal

Texas Nodal

EDS Market Trials ApproachWednesday, November 29, 2006


Texas Nodal

Agenda

• Market Trials Objectives• High Level Schedule• EDS Phases• EDS Timeline / Detailed Drill Down• EDS Detailed Planning

– Define Transition Plan Traceability Matrix– Detail Market Trial Phases and Test Areas– Create Entrance / Exit Criteria Checklists– Define Test Cycles, MP Segmentation, and Test Calendars– Outline Market Trials reporting requirements

• Next Steps– Market Trials Approach comments and approval– Detail out specific sections and review with TPTF– Tentative Schedule


Texas Nodal

Objective of market trials

The objective of market trials is to confirm through a series of structured and unstructured tests that:

“stable and accurate operations of the SCADA, Network Security Analysis, Transmission Constraint Management, SCED, LFC, DAM, RUC, and real time settlement system can be declared”

as outlined in the Nodal Transition Plan.


Texas Nodal

Approach aligns with the Nodal Timeline


Texas Nodal

Market Trials Phases

• EDS 1 – Data and Telemetry• EDS 2 – State Estimator, Network Security Analysis• EDS 3 – Real Time Market Operations• EDS 4 – Day Ahead Market Operations


Texas Nodal

EDS - Market Trials Timeline

EDS 3

Jul 08 Dec 08Sep 08Aug 08Mar 08Feb 08Jan 08 May 08 Jun 08Dec 07 Oct 08 Nov 08Apr 08

Cycle 1 LMP w

Controls

ACE

DR Testing

Compliance

1 hr EECP

Comment Period

ACE – 2 weeks (5.4.8 (2)Compare existing with new ACE results

LMP Market Readiness

Criteria

MET

12/01/08 Realtime

Markets GO LIVE

`12/08/08

Forward Markets GO LIVE

Zonal Markets Shutdown

GO/NO GO

Nov 07

Market Operations Sandbox & ERCOT UAT

Market Trials Start

Resource Registration

All QSEs – Real Time Parallel Operations

AS Qualification

3/31/08 Single Entry

Model GO LIVE

Reasonable LMPs24x7 support

All available MPsReasonableness criteria met

6 months

Oct 07

EDS 4

Feedback

168 hour test

complete

168 Hour Test – 4 weeks to complete; 4 week feedback-fix

168 hour trial

Go-Live & Transition

Jul 07 Sep 07Aug 07May 07 Jun 07

ICCP / Telemetry Validation

SE Validation

SCED testing cycles, voluntary per QSE scripted for 30 daysThereafter all QSEs participate in real time parallel operations

EDS 2

EDS 1

Market Operations Sandbox & ERCOT UAT EDS 4 - Day Ahead Operations

Limited 24x7 support Full 24x7 support

Market Operations Functional Testing


Texas Nodal

Market Trials Timeline and the detailed Market Trials Plan


Texas Nodal


EDS 3


Cycle 1 LMP w

Controls

ACE

DR Testing

Compliance

1 hr EECP

Comment Period



Criteria

MET

12/01/08

Realtime Markets

GO LIVE

`12/08/08

Forward Markets

GO LIVEZonal Markets

Shutdown

GO/NO GO

Nov 07


Market Trials Start



AS Qualification


Model

GO LIVE



6 months

Oct 07

EDS 4

Feedback

168 hour test

complete


168 hour trial




SE Validation


EDS 2

EDS 1




Texas Nodal

The budget is significantly influenced by the recommended timelineNodal Market & Zonal Shutdown December 2008

EMS

Trials & Implementation

MMS

CRR

MIS

NMMS

Commercial Systems

ERCOT & MP Readiness

Q2 2008 Q3 2009Q4 2008Q3 2008Q2 2007Q1 2007Q4 2006 Q4 2007 Q1 2008Q3 2006 Q1 2009

Integration

EDW

Q2 2009

EDS 3

MMS FAT ITEST

CRR Design, Bui ld, Pre -FAT CRR FAT ITEST

Final MP Interface

Specs 3/31

12/01/08Real Time Operations

GO LIVE

MIS (EMS/MMS/CRR) Design, Build, Pre -FAT

EDW FAT ITEST

StatementsLayout

Script tes t

ITESTEMS EMS FATEMS Requirements, Conceptual Design

ITESTMIS (SCED) Des ign, Build, Pre -

FAT MIS FAT

MMS Design, Build, Pre -FATMMS

Requirements, Conceptual Des ign

ITEST

OS Build

FAT

OS Requirements , Conceptual Des ign

CRR Requirements , Conceptual Design

Commercial Sys tems Design, Build, Pre -FAT CS FAT ITEST

EDW Requirements, Conceptual Design

ITESTSCED Build SCED FATSCED


Registration ready

Bus iness Requirements

complete 10/30

Preliminary MP Interface Specs 12/31

CS Requirements, Conceptual Design

EDW Des ign, Build, Pre-FAT

MIS FAT ITEST

EDS 4 Go-live Trans .

EDS 3 Mote & ERCOT UAT

Planning UI

FAT ITEST

Naming Convention DB

Common model update processNMMS Conceptual Design

Naming Convention information collec tion

Model Data Certification Model Data Remediation Reconcil iation

NMMS Build

Outage Scheduler

EDS 1/2

Build FAT ITESTRequirements, Conceptual Design

ITESTOS FAT

6/30/08LMP Market

Readiness Criteria

MET

Q3 2007

Operations UI

Qualification Freeze

Registration complete

168 hour market trials

windowEnd of Trials

MP Nodal Registration MP Financ ial & Operational Qualification

MPSCED Offers

Begin MP trial

partic ipation

3/31/08Single Entry Model

GO LIVE12/08/08

Day Ahead Market/CRR

GO LIVEZonal Shutdown

GO/NO GO

EDS 3 Training

See detailed EDS 1 & 2 plan

See detailed EDS 3 plan



Texas Nodal

Market Trials Transition Plan Alignment

5.4.1(2) ERCOT shall develop procedures for setup and data implementation requirements applicable to TSPs and QSEs. ERCOT shall with the assistance of TSPs and QSEs:

(a) Verify that all data and telemetry requirements specified

in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, have been met and that all data submittals are complete and represent an accurate model of the ERCOT System;

Transition Plan Requirement

Day ahead market4

1-2-08 - MPs submit offers

Real-time market3

3-31-08 – Single entry model go-live

EDS 2 - Assumption: Involves Network Operations Model (only - not planning) and SE/NSA; no outage evaluation/approval

- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)- S.UC2.OP3: Implement Proposed Plan (EMS Operation)- S.UC3.OP1: Update Information (NMMS Operation)- S.UC3.OP2: Analyze Solution (NMMS Operation "Send Network Operations Model"

Network model validation

2

This is a joint ERCOT and Market Participant task.

Will require a EDS type functionality from TSP/QSE

QSE/TSP personnel can SIMULATE analog/digital changes on their EDS and ERCOT EDS will be able to accomplish point-to-point check out with ERCOT operatorsExplore programmatic way to validate – this approach can be used later for periodic verification.

12-31-06 –Preliminary MP Interface Specs

3-30-07 – Final Interface Specs

EDS 1 - Assumption: only testing data coming in FROM the fieldICCP-related operations I can think of:- S.UC1.OP1: Update Frequency (EMS operation)- S.UC1.OP3: Update Generation Levels (EMS Operation)- S.UC1.OP5: Update Responsiveness Information (EMS Operation)- S.UC1.OP6: Update QSE Provider Information (EMS Operation)

- S.UC1.OP7: Use Revised Data (EMS Operation)- S.UC1.OP8: Use Telemetry Data (EMS Operation)

- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)ICCP information TO the field (external):- S.UC2.OP4: Send Base Points- M.UC12.OP1: Clear RT Market (I know Base Points are communicated to QSEs via ICCP, will need to check which other ones do)

Telemetry & ICCP Validation

1

NotesMP Interventions

Use Case/ OperationsDescriptionEDS

Detailed market trials

plan

Nodal Critical Path

Appendix 8.2

Appendix 8.4

Appendix 8.3



Texas Nodal


EDS 3


Cycle 1 LMP w

Controls

ACE

DR Testing

Compliance

1 hr EECP

Comment Period



Criteria

MET

12/01/08

Realtime Markets

GO LIVE

`12/08/08

Forward Markets

GO LIVEZonal Markets

Shutdown

GO/NO GO

Nov 07


Market Trials Start



AS Qualification


Model

GO LIVE



6 months

Oct 07

EDS 4

Feedback

168 hour test

complete


168 hour trial




SE Validation


EDS 2

EDS 1




Texas Nodal

The budget is significantly influenced by the recommended timelineNodal Market & Zonal Shutdown December 2008

EMS

Trials & Implementation

MMS

CRR

MIS

NMMS

Commercial Systems

ERCOT & MP Readiness

Q2 2008 Q3 2009Q4 2008Q3 2008Q2 2007Q1 2007Q4 2006 Q4 2007 Q1 2008Q3 2006 Q1 2009

Integration

EDW

Q2 2009

EDS 3

MMS FAT ITEST

CRR Design, Bui ld, Pre -FAT CRR FAT ITEST

Final MP Interface

Specs 3/31

12/01/08Real Time Operations

GO LIVE

MIS (EMS/MMS/CRR) Design, Build, Pre -FAT

EDW FAT ITEST

StatementsLayout

Script tes t

ITESTEMS EMS FATEMS Requirements, Conceptual Design

ITESTMIS (SCED) Des ign, Build, Pre -

FAT MIS FAT

MMS Design, Build, Pre -FATMMS


ITEST

OS Build

FAT

OS Requirements , Conceptual Des ign

CRR Requirements , Conceptual Design

Commercial Sys tems Design, Build, Pre -FAT CS FAT ITEST

EDW Requirements, Conceptual Design

ITESTSCED Build SCED FATSCED


Registration ready

Bus iness Requirements

complete 10/30

Preliminary MP Interface Specs 12/31

CS Requirements, Conceptual Design

EDW Des ign, Build, Pre-FAT

MIS FAT ITEST

EDS 4 Go-live Trans .

EDS 3 Mote & ERCOT UAT

Planning UI

FAT ITEST

Naming Convention DB

Common model update processNMMS Conceptual Design

Naming Convention information collec tion

Model Data Certification Model Data Remediation Reconcil iation

NMMS Build

Outage Scheduler

EDS 1/2

Build FAT ITESTRequirements, Conceptual Design

ITESTOS FAT

6/30/08LMP Market

Readiness Criteria

MET

Q3 2007

Operations UI

Qualification Freeze

Registration complete

168 hour market trials

windowEnd of Trials

MP Nodal Registration MP Financ ial & Operational Qualification

MPSCED Offers

Begin MP trial

partic ipation

3/31/08Single Entry Model

GO LIVE12/08/08

Day Ahead Market/CRR

GO LIVEZonal Shutdown

GO/NO GO

EDS 3 Training

See detailed EDS 1 & 2 plan




Texas Nodal

Market Trials Transition Plan Alignment

5.4.1(2) ERCOT shall develop procedures for setup and data implementation requirements applicable to TSPs and QSEs. ERCOT shall with the assistance of TSPs and QSEs:

(a) Verify that all data and telemetry requirements specified

in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, have been met and that all data submittals are complete and represent an accurate model of the ERCOT System;

Transition Plan Requirement

Day ahead market4

1-2-08 - MPs submit offers

Real-time market3

3-31-08 – Single entry model go-live

EDS 2 - Assumption: Involves Network Operations Model (only - not planning) and SE/NSA; no outage evaluation/approval

- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)- S.UC2.OP3: Implement Proposed Plan (EMS Operation)- S.UC3.OP1: Update Information (NMMS Operation)- S.UC3.OP2: Analyze Solution (NMMS Operation "Send Network Operations Model"

Network model validation

2

This is a joint ERCOT and Market Participant task.

Will require a EDS type functionality from TSP/QSE

QSE/TSP personnel can SIMULATE analog/digital changes on their EDS and ERCOT EDS will be able to accomplish point-to-point check out with ERCOT operatorsExplore programmatic way to validate – this approach can be used later for periodic verification.

12-31-06 –Preliminary MP Interface Specs

3-30-07 – Final Interface Specs

EDS 1 - Assumption: only testing data coming in FROM the fieldICCP-related operations I can think of:- S.UC1.OP1: Update Frequency (EMS operation)- S.UC1.OP3: Update Generation Levels (EMS Operation)- S.UC1.OP5: Update Responsiveness Information (EMS Operation)- S.UC1.OP6: Update QSE Provider Information (EMS Operation)

- S.UC1.OP7: Use Revised Data (EMS Operation)- S.UC1.OP8: Use Telemetry Data (EMS Operation)

- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)ICCP information TO the field (external):- S.UC2.OP4: Send Base Points- M.UC12.OP1: Clear RT Market (I know Base Points are communicated to QSEs via ICCP, will need to check which other ones do)

Telemetry & ICCP Validation

1

NotesMP Interventions

Use Case/ OperationsDescriptionEDS

Detailed market trials

plan

Nodal Critical Path

Appendix 8.2

Appendix 8.4

Appendix 8.3



Texas Nodal

EDS Detailed Planning Overview

• Define Transition Plan Traceability Matrix• Detail Market Trial Phases and Test Areas• Create Entrance / Exit Criteria Checklists• Define test cycles, MP segmentation, and test calendar• Additional Areas


Texas Nodal

EDS Detailed Planning

EDS Description Transition Plan Requirement

Operations / SoSA Market Trials tasks MP Interventions

Notes

1 Telemetry & ICCP Validation

5.4.1(2) ERCOT shall develop procedures for setup and data implementation requirements applicable to TSP’s and QSE’s. ERCOT shall with the assistance of TSP’s and QSE’s: (a) Verify that all data and telemetry requirements Specified in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, Have been met and that all Data submittals are complete and represent an accurate model of the ERCOT System;

- S.UC1.OP6: Update QSE Provider Information (EMS Operation)- S.UC1.OP7: Use Revised Data (EMS Operation)- S.UC1.OP8: Use Telemetry Data (EMS Operation)- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)ICCP information TO the field (external):- S.UC2.OP4: Send Base Points- M.UC12.OP1: Clear RT Market (I know Base Points are communicated to QSE’s via ICCP, will need to check which other ones do)

All telemetry (SCADA/ICCP) points checked out (programmatically or manually) 100 %Status Report at the end of this activity must indicate that 100 % of all points have been tested and verifiedRequire Professional Engineers Seal from Entities to assure accuracy of data. Can be required from QSE’s/TSP’s due to issues of public safety and public interestAlarm Functionality Revalidated SCADA/ICCP enhancement to detect Forced Outage of equipment Real Time Weather Telemetry revalidated Dynamic Rating telemetry Validate all Transmission Element Limits and ConstraintsCheck TSP’s calculation Transmission Element Ratings that are likely to be active in SCED Telemetry Criteria Developed (protocol 3.10.7.4) Define and implement business processes to repair errors.

12-31-06 – Preliminary MP Interface Specs3-30-07 – Final Interface Specs

This is a joint ERCOT and Market Participant task.Will require a EDS type functionality from TSP/QSEQSE/TSP personnel can SIMULATE analog/digital changes on their EDS and ERCOT EDS will be able to accomplish point-to-point check out with ERCOT operatorsExplore programmatic way to validate – this approach can be used later for periodic verification.

2 Network Model ValidationSE Solution

3 Real-time Market Operations

4 Day ahead Market Operations

Define Transition Plan Traceability Matrix


Texas Nodal

Transition Plan Traceability Matrix Example

Transition Plan Detail:5.4.1(2a) ERCOT shall develop procedures for setup and data implementation

requirements applicable to TSPs and QSEs. ERCOT shall with the assistance of TSPs and QSEs: Verify that all data and telemetry requirements specified in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, have been met and that all data submittals are complete and represent an accurate model of the ERCOT System


Texas Nodal

Transition Plan Traceability Matrix Example (cont.)

Requirement:ERCOT shall verify that all data and telemetry requirements have been met and that all data

submittals are complete and represent an accurate model of the ERCOT System

ERCOT Tasks:• Define data and telemetry verification plan based on NP 3.10• Verify that all submittals are complete and represent an accurate model of the ERCOT

system

MP Tasks:• Review data and telemetry verification section of Market Trials Handbook • TSPs and QSEs assist ERCOT with data and telemetry verification

Comments:• NP-Section 3.10, Network Operations Modeling and Telemetry• Requires NMMS to complete ITEST and in pre-production• Issue an EDS 1 RFP to verify that NMMS systems and processes meet section 3.10 of

the ERCOT protocols

> Each requirement will be further detailed in the EDS Detailed Market Trials Test Plan


Texas Nodal


Detail Market Trial Phases and Test Areas– Define the set of functionality for each EDS phase based on the

transition plan, business requirements, SoSA documentation, etc.– Identify EDS phase for all functionality based on comprehensive

release plan and project schedule.– Define testing scenarios and test plan outlines


Texas Nodal


Create Entrance / Exit Criteria Checklists


Texas Nodal


Define test cycles, MP segmentation, and test calendar

– Testing cycles will be used to optimize the trials schedule and reduce resource conflicts by focusing on specific market areas with a reduced number of participants.

– Participants will be logically segmented into appropriate cycles.

– A weekly test calendar will be used to focus weekly activities. Multiple cycles may be scheduled in a single week or over multiple weeks.


Texas Nodal


Additional Areas• Outline Market Trials reporting requirements• Define Market Trials data requirements• Finalize Market Trial Phase critical inputs

– Interface documentation– Requirements signoff– Design signoff– Market Operations Sandbox timelines


Texas Nodal

Next Steps

• Request comments on Market Trials Approach by 12/6/06• Return for approval in January• Begin EDS detailed planning providing opportunities for

comments as follows:– Review Transition Plan Traceability Matrix TBD

– EDS 1 to 4 Detailed Plan – Drafts for comment TBD

– EDS 1 Detailed Plan – Final Signoff TBD

– EDS 2 Detailed Plan – Final Signoff TBD

– EDS 3 Detailed Plan – Final Signoff 3/30/2007

– EDS 3 Market Trials Handbook – Final Signoff 6/29/2007

– EDS 4 Detailed Plan – Final Signoff 9/28/2007

– EDS 4 Market Trials Handbook – Final Signoff 12/31/2007


Texas Nodal

Questions?


Texas Nodal


Texas Nodal

Transducer (kWh)

RTU

AnalogStatus

Accumulator

Equipment Statuses

Sca

lin

g TSP & QSE EMS

SCADA

ICC

P

ICC

P ERCOT

SCADA

Phone Lines

ICCP Link

One-line Displays

Mapping to network

model

ERCOT Quality codes

PT

CT

QSE/TSP data accuracy assurance points by PE seal

ERCOT data accuracy assurance points by PE seal

A

CB

D

E

FG H I K

M

L

SCADA Telemetry Schematic

Segment Certification Requirement Notes

A to H To be certified by MPs

H to I To be certified by TBD (3rd Party ?)

I to N To be certified by ERCOT – PE Seal and verified by System Operators

J

Quality codes posted by TSP

N

ERCOT EDS scope

texas nodal eds market trials approach wednesday, november 29, 2006

Documents