update on microsoft...
TRANSCRIPT
Update on Microsoft Technology
Azure Sizing
Datacenter: Dublin, Ireland
Datacenter: Dublin, Ireland
Project Natick
https://natick.research.microsoft.com/
United States
United States
Canada
Mexico
Venezuela
Colombia
Peru
Bolivia
Brazil
Argentina
Atlanta OceanAlgeria
MaliNiger
Nigeria
Chad
Libya Egypt
Sudan
Ethiopia
Dr Congo
AngolaZambia
Nambia
South
Africa
Greenland
Svalbard
Sweden
Norway
United
Kingdom
France
PolandUkraine
Turkey
Saudi
Arabia
Iran
Kazakistan
India
Russia
China
Myanmar
(Burma)
Indian Ocean
Indonesia
Australia
Pacific Ocean
Pacific Ocean
Data centerOwned capacity
Future capacity
Leased capacity
Edge site
DCs and network sites not exhaustive
Azure inter-DC dark fiber backbone
Geos and regions
The world is divided into geographies
A region is defined by a bandwidth and latency envelope
Region 1
Region 2
100’s of km
https://docs.microsoft.com/en-us/azure/best-practices-availability-paired-regions
Availability Zones | intra-region resilienceAZs provide for HA in the face of localized DC and software failures
Customer promise: a failure in one AZ should not cause other AZs within the same region to fail
Different water, power lines, network, generators
Customers can do application-level synchronous replication between AZs
Three is enough for quorum
Regions offer multiple Availability Zones (AZs)
At least three AZs
An AZ consists of one or more datacenters
Region
Subscription 1 Subscription 2
Stamps – Fault Domains – Upgrade Domains
Azure networking
DC Hardware Services Intra-Region WAN Backbone Edge and ExpressRoute CDN Last Mile
• SmartNIC/FPGA• SONiC
• Virtual Networks• Load Balancing• VPN Services• Firewall• DDoS Protection• DNS & Traffic
Management
• DC Networks• Regional Networks• Optical Modules
• Software WAN• Subsea Cables• Terrestrial Fiber• National Clouds
• Internet Peering• ExpressRoute
• Acceleration for applications and content
• E2E monitoring (Network Watcher, Network Performance Monitoring)
Enterprise
DC/Corpnet
Consumers
Regional
Network
Microsoft
WAN
Edge
ExpressRoute
CDN
Enterprise, SMB,
mobile
Azure Region ‘A’
Azure Region ‘B’
Regional
Network
Regional
Network
Regional
Network
Internet
Exchanges
Cable
Carrier
RNG regional architecture
Microsoft
backbone
DC Region
RNG RNG
DC DC DC DC
DC DC
Region
Contiguous geographical area up to roughly 100km in diameter (2.0ms RTT)
Regional network gateway
Massively parallel, hyper scale
DC interconnect
Space and power protected
Data centers
Small, Medium, or Large (T-shirt sizes)
Only contains server racks, DC network
RNGs are sized to support growing the region by adding data centers
Azure Network Emulator
What it isContainerized router VMs linked via VXLAN tunnels to create a faithful replica of production network
“Bug compatible” emulation of production network gives network engineers realistic test environment
StatusUsed daily to de-risk major network operations
Over 12 million core-hours spent on emulation in last six months
Numerous bugs caught before hitting production network
Azure
SONiC
Virtual links
Hyperscale SDN
Management plane Create a tenant
Control planePlumb tenant ACLs to switches
Data plane Apply ACLs to flows
Switch (Host)
Management plane
Data plane
SDN
Control plane
Azure Resource Manager
Controller
Key to flexibility and scale is Host SDN Proprietary appliance
Management
Control
Data
Azure Infrastructure
Azure architecture
Hardware Manager
Resource Provider
Azure Fabric Controller
Compute Networking
Azure Resource Manager
Storage
Azure Portal CLI 3rd party
Au
then
ticati
on
Tele
metr
y &
In
sig
hts
RB
AC
Service Fabric AKS PaaS offeringWeb Apps
Azure Infrastructure
Hardware Manager
Azure SDN architectureAzure SDN
The basis of all NW virtualization in our datacenters
VNet
The logical network for all workloads regardless of chosen service model or application container
Decoupled
SDN allows compute to evolve and converge to a single allocator
Azure Resource Manager
Compute RPNetwork RP
Regional Network
Manager
Network State
Manager
Software load
balancerDirectory
Service
Compute
Controller
Azure Storage architecture
Geo replication
Storage Stamp
LB
Partition Layer
Front-Ends
DFS Layer
Intra-stamp replication
Storage Stamp
LB
Partition Layer
Front-Ends
DFS Layer
Intra-stamp replication
Request
network
resources
Inventory sync Inventory sync
RDSRNMNRPCRP USLB
CDSNSMDCM SLB
Network agent
Datacenter Manager
agent
Tenant Manager
agent
Load balancer
agent
ARM (Azure Resource Manager)
NSM pushes
CA:PA mappings
to RDSCDS pulls
from RDS
NMAgent pulls from CDS
RNM
makes
network
object
updates
RNM gets
info from
TM
SLB finds its
VIP ranges
from USLB
NSM pushes VIP
ranges to USLB
SLBHP is
configured
with SLB
endpoint
Inventory sync
Send goal
state
Send goal
state
Send goal
state
NRP is
pass-through
AllocateNtwkResources
LBProgramming
Ntwk
programming
Global
Regional
Cluster
Node
TM
Azure compute architecture
Azure Hardware
Gen 2
Processor 2 x 6 Core 2.1 GHz
Memory 32 GiB
Hard Drive 6 x 500 GB
SSD None
NIC 1 Gb/s
Gen 3
Processor 2 x 8 Core 2.1 GHz
Memory 128 GiB
Hard Drive 1 x 4 TB
SSD 5 x 480 GB
NIC 10 Gb/s
Gen 4
Processor 2 x 12 Core 2.4 GHz
Memory 192 GiB
Hard Drive 4 x 2 TB
SSD 4 x 480 GB
NIC 40 Gb/s
Godzilla
Processor 2 x 16 Core 2.0 GHz
Memory 512 GiB
Hard Drive None
SSD 9 x 800 GB
NIC 40 Gb/s
Gen 5
Processor 2 x 20 Core 2.3 GHz
Memory 256 GiB
Hard Drive None
SSD6 x 960 GB PCIe Flash and 1 x 960 GB SATA
NIC 40 Gb/s + FPGA
Beast
Processor 4 x 18 Core 2.5 GHz
Memory 4096 GiB
Hard Drive None
SSD4 x 2 TB NVMe, 1 x 960 GB SATA
NIC 40 Gb/s
Gen 6
Processor2 x Skylake 24 Core 2.7GHz
Memory 768GiB DDR4
Hard Drive None
SSD4 x 960 GB M.2 SSDs and 1 x 960 GB SATA
NIC 40 Gb/s
FPGA Yes
Beast v2
Processor 8 x 28 Core 2.5 GHz
Memory 12 TiB
Hard Drive None
SSD4 x 2 TB NVMe, 1 x 960 GB SATA
NIC 50 Gb/s
3x
Beast
Gen 2
Processor 2 x 6 Core 2.1 GHz
Memory 32 GiB
Hard Drive 6 x 500 GB
SSD None
NIC 1 Gb/s
Gen 3
Processor 2 x 8 Core 2.1 GHz
Memory 128 GiB
Hard Drive 1 x 4 TB
SSD 5 x 480 GB
NIC 10 Gb/s
Gen 4
Processor 2 x 12 Core 2.4 GHz
Memory 192 GiB
Hard Drive 4 x 2 TB
SSD 4 x 480 GB
NIC 40 Gb/s
Godzilla
Processor 2 x 16 Core 2.0 GHz
Memory 512 GiB
Hard Drive None
SSD 9 x 800 GB
NIC 40 Gb/s
Gen 5
Processor 2 x 20 Core 2.3 GHz
Memory 256 GiB
Hard Drive None
SSD6 x 960 GB PCIe Flash and 1 x 960 GB SATA
NIC 40 Gb/s + FPGA
Beast
Processor 4 x 18 Core 2.5 GHz
Memory 4096 GiB
Hard Drive None
SSD4 x 2 TB NVMe, 1 x 960 GB SATA
NIC 40 Gb/s
Gen 6
Processor2 x Skylake 24 Core 2.7GHz
Memory 768GiB DDR4
Hard Drive None
SSD4 x 960 GB M.2 SSDs and 1 x 960 GB SATA
NIC 40 Gb/s
FPGA Yes
Beast v2
Processor 8 x 28 Core 2.5 GHz
Memory 12 TiB
Hard Drive None
SSD4 x 2 TB NVMe, 1 x 960 GB SATA
NIC 50 Gb/s
3x
BeastAzure Hardware
Gen 2
Processor 2 x 6 Core 2.1 GHz
Memory 32 GiB
Hard Drive 6 x 500 GB
SSD None
NIC 1 Gb/s
Gen 3
Processor 2 x 8 Core 2.1 GHz
Memory 128 GiB
Hard Drive 1 x 4 TB
SSD 5 x 480 GB
NIC 10 Gb/s
Gen 4
Processor 2 x 12 Core 2.4 GHz
Memory 192 GiB
Hard Drive 4 x 2 TB
SSD 4 x 480 GB
NIC 40 Gb/s
Godzilla
Processor 2 x 16 Core 2.0 GHz
Memory 512 GiB
Hard Drive None
SSD 9 x 800 GB
NIC 40 Gb/s
Gen 5
Processor 2 x 20 Core 2.3 GHz
Memory 256 GiB
Hard Drive None
SSD6 x 960 GB PCIe Flash and 1 x 960 GB SATA
NIC 40 Gb/s + FPGA
Beast
Processor 4 x 18 Core 2.5 GHz
Memory 4096 GiB
Hard Drive None
SSD4 x 2 TB NVMe, 1 x 960 GB SATA
NIC 40 Gb/s
Gen 6
Processor2 x Skylake 24 Core 2.7GHz
Memory 768GiB DDR4
Hard Drive None
SSD4 x 960 GB M.2 SSDs and 1 x 960 GB SATA
NIC 40 Gb/s
FPGA Yes
Beast v2
Processor 8 x 28 Core 2.5 GHz
Memory 12 TiB
Hard Drive None
SSD4 x 2 TB NVMe, 1 x 960 GB SATA
NIC 50 Gb/s
3x
BeastAzure Hardware
Azure Sphere
Processor 1 x A7 Core @ 500 MHz
Memory 4 MiB
Hard Drive BYO
SSD BYO
WiFi 2.4/5.0 GHz 802.11 b/g/n
0.00000000533
Beasts
A History of Azure VM Sizes
History of Series
A History of Azure VM Sizes
Today
Computing options for every workload
ACU per vCPU$ per kACUEverything• Created for comparing
compute performance
across VM families
• Helps to quickly identify
the VM family that meet
your performance goals
• ACUs were first defined
on the “Standard_A1”
• Small “Standard_A1”
= 100 ACU
• All other VM ACU
measurements are
referenced from this
baseline
Av2 B Fv1 Dv2 H Dv3 Ev3 Fv2 M
$ per kACU
ACU per vCPU
Azure Compute Units (ACUs)
0
50
100
150
200
250
300
350
A0 A1 - A4 A5 - A7 A1_v2 -A8_v2
A2m_v2 -A8m_v2
A8 - A11 D1 - D14 D1_v2 -D15_v2
DS1 -DS14
DS1_v2 -DS15_v2
D_v3 Ds_v3 E_v3 Es_v3 F2s_v2 -F72s_v2
F1 - F16 F1s -F16s
G1 - G5 GS1 - GS5 H L4s - L32s L8s_v2 -L80s_v2
M
ACU vs CPU
ACU \ vCPU Benchline
100 ACU/vCPU
$0.36/kACU
~21 ACU/vCPU
$0.57/kACU210 ACU/vCPU
$0.27/kACU
160 ACU/vCPU
$0.30/kACU
160 ACU/vCPU
$0.42/kACU
195 ACU/vCPU
$0.22/kACU
ACUs N/A for GPUs290 ACU/vCPU
$0.33/kACU
D15 v2
DS15 v2
E64i v3
E64is v3
D72s_v2
G5
GS5
M128s
Entry Level
1 vCPU - 128 vCPUsComputationalperformance
Azure Tiers
Standard HDD
✓ Cost effective
✓ Dev & Test
Workloads
Standard SSD
✓ Cost effective
✓ Consistent
performance
✓ Low IO
business
critical apps
Ultra SSD
✓ Sub-ms
Latency
✓ Consistent
performance
✓ Latency
sensitive top
tier apps
Premium SSD
✓ Low Latency
✓ Consistent
performance
✓ IO Intensive
business
critical apps
Resource Group
✓ Simple
✓ Highly available
& scalable
✓ Secure by default
Managed DisksPerformance Tiers
Azure Disks – Performance
Standard HDDUltra SSD Premium SSD Standard SSD
Provisioned Best effort
Project Direct Drive | Ultra SSD
Capacity up to 64* TB
Variable IOPS up to 160,000
Variable throughput up to 2000 MB/s
Low Latency
< 1msHigh throughput
up to 2000 MB/s
per disk
High IOPS
up to 160,000
IOPS per disk
Disk Provisioning Disk Provisioning
SSD Provisioning
VM/Network Provisioning Server
SSD
5k IOPS, 200MB/s 5k IOPS, 200MB/s
4k IOPS, 32MB/s
3,200 IOPS, 48MB/s
8k IOPS, 64MB/s
6,400 IOPS, 96MB/s
32k IOPS, 256MB/s
25,600 IOPS, 384MB/s
Managed
Disk
Managed
Disk
Premium Storage Caching
SLA and high availability in Azure
Single VM
VM SLA99.9%
Availability sets Availability zones Site Recovery & Region pairs
VM SLA99.95%
VM SLA99.99%
Regions
54
Region 1 Region 2
“Poor Man’s” High
Availability -Scenario
• For cases where running two VMs is just too expensive:
• Prepare 2 VMs in an availability Set
• Keep one of them turned off
• When you plan to update one of the VMs, turn on the stand-by VM
• Turn it off again when done
• Gaps:
• Time to recover
• Potential for Data loss
• Update coordination
• Value: easy and better then nothing
Reserved VM Instances (RIs)• Significantly reduce costs, with one-
year or three-year terms on Windows
and Linux virtual machines (VMs)
• Exchange or cancel your Azure RIs at
any time
• Use instance size flexibility to use RIs
across a VM groups
• Integrated recommendations in Azure
portal
Azure Hybrid BenefitWhat is Azure Hybrid Benefit?
An Azure benefit that enables customers with Windows Server Software Assurance licenses to pay the less expensive non-
Windows compute pricing when they upload and run their self-built Windows Server images on Azure
What is the Customer Value Proposition?
• Customer benefits from existing investments in Windows Server when moving to Azure
• Customer receives additional value to their Windows Server Software Assurance investment
• Azure Hybrid Benefit adds additional flexibility and value to Windows Server Standard and Datacenter
CUSTOMER’S ON-PREMISE LICENSE
LICENSE IMPACT FOR CUSTOMER WINDOWS SERVER AZURE ENABLEMENT
No licensing concurrency: a Window Server license cannot be assigned to other hardware while Azure Hybrid Benefit is being used.
Customer with Windows Server Software Assurance are entitled to:
• Two instances of 1 to 8 vCPUs or
• One instance of up to 16 vCPUs
• Stack licenses for VMs larger than 16 vCPUsLicensing concurrency: a Windows Server license can continue to be assigned both on premise and in an Azure environment at the same time.
Azure Hybrid Benefit
CUSTOMER’S ON-PREMISE LICENSE
LICENSE IMPACT FOR CUSTOMER WINDOWS SERVER AZURE ENABLEMENT
No licensing concurrency: a Window Server license cannot be assigned to other hardware while Azure Hybrid Benefit is being used.
Customer with Windows Server Software Assurance are entitled to:
• Two instances of 1 to 8 vCPUs or
• One instance of up to 16 vCPUs
• Stack licenses for VMs larger than 16 vCPUsLicensing concurrency: a Windows Server license can continue to be assigned both on premise and in an Azure environment at the same time.
What is Azure Hybrid Benefit?
An Azure benefit that enables customers with Windows Server Software Assurance licenses to pay the less expensive non-
Windows compute pricing when they upload and run their self-built Windows Server images on Azure