empowering data driven upstream on azure · empowering data driven upstream on azure kadri umay...
TRANSCRIPT
Empowering Data Driven Upstream on Azure
Kadri Umay
Hussein Shel
Principal Program Manager, Energy Industry
Microsoft Azure Engineering
What if …
“we can give you back 2-3 hours of time everyday”
where do we spend these 2-3 hours?
Import
Export
Import
…
Find
Copy Process
Azure is the world’s computer
TrustedProductive Hybrid Intelligent
Big data migration
and management
for complex models
High Performance
Compute & Storage
for seismic
processing &
reservoir simulations
Global scale for
Fortune 50
company
operations
Deep security &
broadest
compliance for
critical information
management
Deep IoT, AI
assets and Azure
Stack for digital oil
field and edge
scenarios
Azure for Oil and Gas
© Microsoft Corporation
Factory Layout
Clinical Trial
Simulation
Rocket
DesignSelf-driving
Cars Hard disk designMaterialsScience
Seismic Processing
Architecture &
Engineering
Entertainment
GenomicsDrug Design
Reservoir
Simulation
Computational
Chemistry
Quantum computing
Cancer
Research
Circuit Design
Risk
Management
Diagnostics
Crash Testing
Machine
Learning
Product Design &
Safety Security
Logistics
Data Science
HPC in Oil & Gas
Process raw seismic data
Perform bulk upload of seismic data
Use in-house or commercial
applications to process seismic data
Seismic processing Reservoir simulations Remote Visualization and AI
Accelerate onboarding
and knowledge transfer
Increase collaboration and productivity
of field workers
Create more accurate reservoir models,
optimize drilling, and identify risks
Evaluate production data
to update models
Optimize equipment and enable
predictive maintenance
Help provide development of
new oil fields
Ensure that simulation helps predict
oil production and productivity
Use commercial tools like Nexus or
Intersect to run Reservoir simulation
in Azure
© Microsoft Corporation
On-premises HPC
Demand for HPC infrastructure
On-premises
© Microsoft Corporation
Challenges with On-premises HPC
Demand for HPC infrastructure
On-premises
Keeping up with business demands
Maximizing your investment
Siloed environments limiting
collaboration
Data analytics
AI IOT
New business demands
Regulations
© Microsoft Corporation
Expand your HPC environment to the Cloud
The HPC Cloud Opportunity
Cloud
Demand for HPC infrastructure
On-premises
Fixed
demand
Variable
demand
© Microsoft Corporation
Build your HPC environment in the Cloud
The HPC Cloud Opportunity
Cloud
Demand for HPC infrastructure
All
demand
Azure Specialized Compute Fleet
PGA Microservices –AI/Edge IB Connected
CPU/GPU/Storage available in cloud
NC – Advanced simulation
ND– Artificial Intelligence
A
12
Example F100 Org. v. H-Series
HBv2 HB HC H Cluster 2 Cluster 3
Cores/clust
er80,000+ 38,000+ 28,000+ 7,000+ 8,064 7,500+
Cores/node 120 60 44 16 24 24
CPU AMD ROME AMD NAPLESIntel Xeon
Platinum
Intel Xeon E5
v3
Intel Xeon E5
v3
Intel Xeon E5
v2
Memory4 GB/core
480 total
4 GB/core
240 total
8 GB/core
352 total
14 GB/core
224 total
10 GB/core
256 total
5 GB/core
128 total
Memory
Bandwidth350 GB/sec 280 GB/sec 200 GB/sec 80 GB/sec 102 GB/sec 64 GB/sec
Local Disk 1 TB NVMe 1 TB NVMe 1 TB NVMe 2 TB SATA NA ??
InfiniBand 200 Gb EDR 100 Gb EDR 100 Gb EDR 56 Gb FDR 100 Gb EDR 32 Gb QDR
Network 50 Gb Ethernet 50 Gb Ethernet 50 Gb Ethernet12.5 Gb
EthernetNA 1 Gb Ethernet
Reservoir simulation is highly compute and data intensive. Industry’s first cloud native reservoir simulator. Models that are taking hours can now be run in seconds or minutes. Enables collaboration. Shared data and applications. Co-Engineered by Microsoft and Landmark, fully automated deployment and
optimized for Azure. Now available on customer tenant as a managed application
OSDU : THE FUTURE OF THE SUBSURFACE DATA
A cloud-native subsurface data platform reference
implementation
API Standards
Common Metadata Standards
Vendor Applications/Operator
Proprietary Applications
Cloud Services
Info
rma
tion
Security
End to
end s
upp
ort &
mgt
UX UX UX
Competitive advantage
Domain knowledge,
workflows, algorithms
Platform
Open platform to provide
enabling services,
storage, etc…
OSDU PORTAL
CURRENT ENVIRONMENT FUTURE ENVIRONMENT
?
API Layer
Collective Experience of 70 72 organizations
OS
DU
Co
mp
lia
nt
Clie
nts
Start SMDS Workflow Data Ingestion Pipeline (WF State Machine)
EnrichmentQA Check Store in DB Index in Elastic
Search
Start
SMDSWorkflow
Azure API Gateway
External Vnet
Start
SWPSWorkflow
Start SWPS Workflow
Wellbore Trajectory
Consumer
Wellbore Markers
Consumer
Well Log Consumer
Document Consumer
Wellbore Consumer
Well Master Consumer
Event Hub
Topics
Data Services Vnet
OSDU Data Platform Data Store Layer
Blob Storage CosmosDB Elastic Search Index
OSDU Internal Vnet
Azure
Token Validation
Azure Active Directory
OSDU Implementation Architecture
HB80,000 cores per MPI job
Investments on Data on Azure
Azure Data Share Azure Confidential Compute
Azure Data Lake
Once written will exist for millions of years
We give you time back
Microsoft Azure