datasets - energy exemplar€¦ · •product •development of 2019-2025 future years sswg case...
TRANSCRIPT
![Page 1: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/1.jpg)
Datasets
Steve Edburg
Mohamed Abukaram
![Page 2: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/2.jpg)
2 Las Vegas 20192
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• New Products
• Future Plans
![Page 3: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/3.jpg)
3 Las Vegas 20193
Global Datasets Team
Who: • Market research and analysis group providing simulation ready data for all
software products
What: • Datasets in North America, Latin America, Europe, Australia, and New Zealand• New datasets in consideration for Middle East, Africa, Japan and other Asian
countries
Why: • Simulation ready datasets to save you time and improve your analyses
• Research, collect and implement publicly available data • Supplement with expert market research• Properly benchmarked and transparent solutions
• Extensive data documentation, benchmarking analyses, and support
![Page 4: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/4.jpg)
4 Las Vegas 20194
• Growing in numbers, expertise, and automated updates• Local expertise from global offices
• Increased industry expertise
• Investing in process improvements and automation
• Using agile framework for database development
2017
•Three analysts
2018
•Six analysts
2019
•Nine analysts
Global Datasets Team
![Page 5: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/5.jpg)
Data Poll
www.slido.com
Event code = #EMFC
The most importance aspect about data for me is:
![Page 6: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/6.jpg)
6 Las Vegas 2019
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• New Products
• Future Plans
![Page 7: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/7.jpg)
7 Las Vegas 20197
Overall Update Process
Start
Gather &
Process
Data
Implement into
Master DB
End
Analyze in
PLEXOS/Aurora
for Zonal ST/LT
Good?y
n
Good?Benchmarking
Analyses
y
n
Documentation
![Page 8: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/8.jpg)
8 Las Vegas 20198
Benchmarking Process
Start
Download Historical
Drivers
Process Evaluation Data
Process into Simulation Ready
Data
Download Historical
Evaluation Data
EndBenchmarkingAnalyses
DocumentationConduct
Simulations
Implement Data Enhancements
![Page 9: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/9.jpg)
9 Las Vegas 20199
Example Benchmarking Results
![Page 10: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/10.jpg)
10 Las Vegas 201910
Example Benchmarking Results
![Page 11: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/11.jpg)
11 Las Vegas 201911
Transparency of Inputs
• Internal metadata tracking for major variables for increased transparency
• Mapping to ISO sources with IDs• WECC ADS
• ERCOT CDR
• NYISO Gold Book
• ISONE CELT
• PJM RPM
![Page 12: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/12.jpg)
12 Las Vegas 201912
Infrastructure and Tooling
• Cloud infrastructure• Developing & testing datasets
in cloud environment
• Cloud tooling• Version management &
collaboration
![Page 13: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/13.jpg)
13 Las Vegas 201913
Stakeholder Engagement
• Presales • Customer insights
• Priorities
• Engineering • Ease of use
• Well-founded implementation
• Software• Performance improvements
• Algorithm improvements
![Page 14: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/14.jpg)
Data Pollwww.slido.com
Event code = #EMFC
Which regions are you most interested in?
![Page 15: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/15.jpg)
15 Las Vegas 2019
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• U.S. Zonal (WECC focus)
• General PLEXOS enhancements
• PLEXOS ERCOT Nodal
• New Products
• Future Plans
![Page 16: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/16.jpg)
16 Las Vegas 201916
Self Service
• One-stop shop for datasets, software, support, and more
https://portal.energyexemplar.com/
![Page 17: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/17.jpg)
17 Las Vegas 201917
WECC Dataset Update (Q1 2019)
• Updates to:• Demand
• Link losses
• Emissions
• Resources
• RPS
• Fuel forecasts
• Benchmarking
![Page 18: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/18.jpg)
18 Las Vegas 201918
WECC Dataset Update (Q1 2019)
![Page 19: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/19.jpg)
19 Las Vegas 2019
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• U.S. Zonal (WECC focus)
• General PLEXOS enhancements
• PLEXOS ERCOT Nodal
• New Products
• Future Plans
![Page 20: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/20.jpg)
20 Las Vegas 201920
General Data Enhancements (PLEXOS)
Nodal Generator Mapping
• Interconnection queues used
•Regional mapping applied in some cases
•Geolocations for nodes and generators used in mapping
Battery Class
•Generators modeled using battery class for enhance modelling
Fuel Restructure
•Restructured and categorized for ease of use
![Page 21: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/21.jpg)
21
General Data Enhancements (PLEXOS)
BATTERIES BEFORE BATTERIES AFTER
![Page 22: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/22.jpg)
22 Las Vegas 201922
General Data Enhancements (PLEXOS)
FUELS BEFORE
FUELS AFTER
Membership
Property
Membership
Property
1
2
1
![Page 23: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/23.jpg)
23 Las Vegas 2019
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• U.S. Zonal (WECC focus)
• General PLEXOS enhancements
• PLEXOS ERCOT Nodal
• New Products
• Future Plans
![Page 24: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/24.jpg)
24 Las Vegas 201924
PLEXOS ERCOT Nodal
• Product• Development of 2019-2025 future years SSWG case within one dataset
• Features• Detailed generation modeling with long-term expansion plan provided
as a scenario• Base assumptions structured for client-specific scenarios• Expert market research and implementation of interfaces, hub
definitions, and contingencies• Expert analysis to verify power flow with PSS®E and benchmark to
historical observations
• Example Use Cases• Transmission modeling• Resource valuation• Market analysis
![Page 25: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/25.jpg)
25 Las Vegas 201925
Inputs for the ERCOT nodal case
Topology
Steady State Working Group (SSWG)
2019 to 2025
Evaluated with PSSE and PLEXOS
Load Mapping
Load forecasts at Region
Load mapped to nodes via load participation factor
Generator Mapping
Comprehensive generator mapping
Geolocations used
![Page 26: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/26.jpg)
26 Las Vegas 201926
Inputs for the ERCOT nodal case
Interfaces
Market research from ERCOT sources
Hubs
Market research from ERCOT sources
Contingencies
Historical binding constraints reports
Monitored elements provided
![Page 27: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/27.jpg)
27 Las Vegas 201927
Results: Backcast Benchmarking
• Installed capacity & generation by fuel type
27
![Page 28: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/28.jpg)
28 Las Vegas 201928
Results: Backcast Prices
• Houston hub – July 2018, hourly LMPs
28
![Page 29: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/29.jpg)
Data Pollwww.slido.com
Event code = #EMFC
Preference of dataset update delivery?
Preference of dataset delivery frequency?
![Page 30: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/30.jpg)
30 Las Vegas 2019
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• New Products
• Aurora Regional Carveouts
• PLEXOS East Interconnect (EI) Nodal
• Future Plans
![Page 31: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/31.jpg)
31 Las Vegas 201931
Aurora Regional Carveouts
What: • Divide US_Canada database into regions
Why:• Improve your experience
• Smaller database
• Faster load times
• Removes unneeded data
When:• Available in Q4 2019 https://www.eia.gov/todayinenergy/detail.php?id=27152
![Page 32: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/32.jpg)
32 Las Vegas 201932
Aurora Regional Carve Outs
• Process aimed at reducing complexity in database to improve your experience
• Removes unused:
Tables
•RMTs
•Capacity Price
•Conditions
•Examples
Columns
•Demand
•Monthly
•Hourly
•Escalation
• TS Hourly
Records
• Time Series
•Resources
• Fuel
• Zone Def.
•Many others
![Page 33: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/33.jpg)
33 Las Vegas 201933
Aurora Regional Carve Outs
Database Size (MB)
Records in
Resources
Table
Records in TS
Annual Table
Columns in TS
Hourly Table
Columns in
Demand
Tables
US_Canada 89 26,000+ 1,924 214 206
WECC 23 6,000+ 185 69 53
Database properties for full US & Canada DB compared to the WECC Carve out.
![Page 34: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/34.jpg)
34 Las Vegas 201934
PLEXOS East Interconnect Nodal
• PJM Multi-Model Working Group (MMWG) annual base cases (2018 series)• 2019, 2020, 2023, 2028
• Features• All future years in one XML• Regional generator mapping• Generators added from queues• Benchmarked & documented
• Performance• Annual hourly simulation(8760) completes in under 10 hours!
![Page 35: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/35.jpg)
35 Las Vegas 2019
Agenda
• Global Datasets Team
• Database Best Practices
• Recent Database Updates
• New Products
• Future Plans
![Page 36: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/36.jpg)
36 Las Vegas 201936
Data Team Road Map
• Provide simulation-ready datasets for PLEXOS and Aurora
Short-term (months)
•Provide nodal solutions for both tools
•Improve quality of benchmarking
Medium-term (quarters)
•Up-to-date zonal and nodal solutions in parallel
•Improve processes for parallel updates
Long-term (quarters to year)
•Cloud data offering
•Automated updates for some properties
![Page 37: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/37.jpg)
37 Las Vegas 201937
PLEXOS Dataset Release Plan
Q4 2019
• EI Nodal
•WECC zonal
Q1 2020
•Mexico
• Europe
Q2 2020
•WECC nodal
• ERCOT nodal
![Page 38: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/38.jpg)
38 Las Vegas 201938
Aurora Dataset Release Plan
Q4 2019
•WECC zonal
Q1 2020
•Mexico
• Europe
Q2 2020
•WECC nodal
• ERCOT nodal
![Page 39: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/39.jpg)
39 Las Vegas 201939
Delivering World Class Datasets
Team
•Growing in numbers and expertise
•More investments planned for 2020 & beyond
Process
• Process review and improvement plans made
• Investments in automation and cloud tooling continue
Quality
• Improving benchmarking and best practices
• Seeking your feedback during UGM
Next Generation
• Engaging with industry leaders on sub-hourly datasets
![Page 40: Datasets - Energy Exemplar€¦ · •Product •Development of 2019-2025 future years SSWG case within one dataset •Features •Detailed generation modeling with long-term expansion](https://reader034.vdocuments.site/reader034/viewer/2022051908/5ffae5286a67452855742716/html5/thumbnails/40.jpg)
Thank you