vsan: data placement€¦ · vm component 2. witness. component 1. witness. component 2. component...

#vmworld

vSAN: Data PlacementDeep Dive

Adam Sweetser, VMware, Inc.Ken Werneburg, VMware, Inc.

HCI3291BU

#HCI3291BU

VMworld 2018 Content: Not for publication or distribution

Disclaimer

This presentation may contain product features orfunctionality that are currently under development.

This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

Technical feasibility and market demand will affect final delivery.

Pricing and packaging for any new features/functionality/technology discussed or presented, have not been determined.

“A mind that is stretched by a new experience can never go back to its old dimensions.”

Oliver Wendell Holmes, Jr.

vSAN Datastore

What Is VMware vSAN?

Runs on any standard x86 server

Integrated into hypervisor

Pools HDD/SDD into single cluster-wide shared datastore

Easily scalable

Managed through VM storage policies

vSANvSphere

What Is VMware vSAN?

Runs on any standard x86 server

Integrated into hypervisor

Pools HDD/SDD into single cluster-wide shared datastore

Easily scalable

Managed through VM storage policies

vSAN Datastore

vSphere

Agenda

Objects

Data On Disk

Storage Policies

Maintenance Mode

Objects

Objects Are Pieces of VMs

Name Space – Configuration file (VMX), friendly name, and logs (vmware.log).

VMDK – Storage for the VM’s OS.

vSWP – Used during host memory contention.

Snapshot – A temporary point in time state.

Memory Snapshot – A temporary point in time of the memory state.

Default Storage Policy = One Failure to Tolerate

Name Space Component 1 Component 2

Snapshot

Mem Snap

Objects

Name Space Mirror 1 Mirror 2

Snapshot

Mem Snap

Witness

Component 2 Witness Component 1

Witness Component 2 Component 1

Component 1 Component 2 Witness

Component 2 Witness Witness

Objects

Need more than 50% of the components available.

Hosts Becomes Unavailable No Problem

Snapshot

Mem Snap

Witness

Objects

Double fault - More failures than configured.

Hosts Becomes Unavailable Double Fault

Snapshot

Mem Snap

Witness

Inaccessible Object

Data On Disks

Data On Disks is Intelligently Distributed

Snapshot

Mem Snap

Witness

Double FaultData On Disks is Intelligently Distributed

Max of 1 cache disk per disk group.

Min of 1 capacity disk per disk group.

Max of 7 capacity disks per disk group.

Max of 5 disk groups per host.

Name Space

C1 C2 W

No Problem

Storage Policies

• Mirroring (RAID-1)• Erasure Coding (RAID-5/6)

Failure Tolerance Method (FTM) defines data layout approach

• FTT=1 – accessible with one failure• FTT=2 – accessible with two failures• FTT=3 – accessible with three failures

Level of Failure to Tolerate (FTT) defines level of resilience

Option with Data Protection Levels and SchemesBasic concepts around “failure tolerance method” and level of “failures to tolerate”

100GB VMDK

Storage Policies - RAID 0/FTT 0

Only one component.

Cannot tolerate a failure.

Space savings without redundancy.

100 GBs

Cannot Tolerate a Failure

100 GBRAID-0FTT=0

Development environment

Non-critical VMs

Non-persistent VMs

Cannot Tolerate a Failure

100 GBRAID-0FTT=0

Tolerates One Failure

200 GBs

100 GBRAID-1FTT=1

C1 WC2

200 GBs

Tolerates One Failure No Problem

100 GBRAID-1FTT=1

C1 WC2

Maybe?

Tolerates One FailureCouldn’t I Tolerate Two?

100 GBRAID-1FTT=1

C1 WC2

What other objects do I have?

Tolerates One FailureCouldn’t I Tolerate Two?

100 GBRAID-0FTT=1

C1 C2 W

W C1 C2

C1 = 33 GBs

C2 = 33 GBs

C3 = 33 GBs

P = 33 GBs

133 GBs in total

100 GBRAID-5FTT=1

C1 PC2 C3

C1 = 33 GBs

C2 = 33 GBs

C3 = 33 GBs

P = 33 GBs

133 GBs in total

Tolerate one failure

C1 + C2 + C3 = Parity

100 GBRAID-5FTT=1

C1 PC2 C3

C1 C4C2 C3 P2P1

C1 = 25 GBs

C2 = 25 GBs

C3 = 25 GBs

C4 = 25 GBs

P1 = 25 GBs

P2 = 25 GBs

150 GBs in total

Tolerates Two Failures

100 GBRAID-6FTT=2

C1 = 25 GBs

C2 = 25 GBs

C3 = 25 GBs

C4 = 25 GBs

P1 = 25 GBs

P2 = 25 GBs

150 GBs in total

Tolerates Two Failures

C1 C4C2 C3 P2P1

100 GBRAID-6FTT=2

Can I Change Policies?

Resync Traffic

Change from RAID 1/FTT 1 to RAID 5/FTT 1

vSAN builds a new object on the fly

100 GBRAID-1FTT=1

C1 PC2 C3

C1 WC2

100 GBRAID-5FTT=1

Maintenance Mode

Maintenance Mode - RAID 1/FTT 1

Full Data Migration –Migrates all data, then hosts enters maintenance mode.

Ensure Accessibility –Migrates the minimum amount of components.

No Data Migration –Just goes into maintenance mode.

Maintenance Mode

100 GBRAID-1FTT=1

C1 WC2

Full Data Migration

Migrates ALL data

Fully compliant with storage policy.

Maintenance Mode – Full Data Migration

100 GBRAID-1FTT=1

C1 WC2

Resync Traffic

Need at least four hosts for a full data migration.

Maintenance Mode – Full Data Migration

?100 GBRAID-1FTT=1

C1 WC2

Ensure Accessibility Migration

Validates we can run in a reduce state.

After 60 minutes, vSAN starts a resync.

Maintenance Mode – Ensure Accessibility Migration

100 GBRAID-1FTT=1

Resync Traffic

Maintenance Mode - RAID 1/FTT 1 + RAID 0/FTT 0

Migrates FTT 0 objects first, then puts host in maintenance mode.

Maintenance Mode – Ensure Accessibility Migration

100 GBRAID-1FTT=1

Resync Traffic

100 GBRAID-0FTT=0

No Data Migration

Does not validate our state.

Does not check FTT 0 or already impacted objects.

Maintenance Mode – No Data Migration

100 GBRAID-1FTT=1

Resync Traffic

100 GBRAID-0FTT=0

FTT 0 Object ?Inaccessible Object

Objects

Snapshot

Mem Snap

Witness

Data On Disks

Max of 1 cache disk per disk group.

Min of 1 capacity disk per disk group.

Max of 7 capacity disks per disk group.

Max of 5 disk groups per host.

Name Space

C1 C2 W

200 GBs

Tolerates One Failure No Problem

100 GBRAID-1FTT=1

C1 WC2

Full Data Migration –Migrates all data, then hosts enters maintenance mode.

Ensure Accessibility –Migrates the minimum amount of components.

No Data Migration –Just goes into maintenance mode.

Maintenance Mode

100 GBRAID-1FTT=1

C1 WC2

“Now you know, and knowing is half the battle.”

G.I. Joe

Learn About the Future of Hyperconverged Infrastructure at the

Innovating Beyond HCI Showcase Keynote#HCI3728KU

John GilmartinSenior Vice President & General Manager, Integrated Systems Business Unit,VMware

Door prizes will be awarded at each Showcase Keynote—don’t miss your chance to win!

What is the Digital Foundation?

Yanbing Li Senior Vice President & General Manager,

Storage and Availability Business Unit, VMware

How is VMware expanding to capabilities of HCI?

What are the tools for the multi-cloud world?

Join Us Tuesday at 11AM to find out:

Visit the HCI Zone in the Solutions Exchange

#vSAN #HCIZone#vSANfan

Experience Solutions Powered by vSANEdge

Video Analytics

CloudPKS with containerized MySQL

CoreSAP HANA on vSAN

DataStax

Espresso Bar vSpeaking Podcast Daily Prizes

PLEASE FILL OUTYOUR SURVEY.Take a survey and enter a drawingfor a VMware company store gift card.

#vmworld #HCI3291BU

THANK YOU!

#vmworld #HCI3291BU

vsan: data placement€¦ · vm component 2. witness. component 1. witness. component 2. component...

Documents

adgm courts · 2 are stated. otherwise, affidavits should...

uzbekistan component 2

direct referral in the matter joint expert witness ... ·...

physics – component 2

part 2 – witness appeal

taylor’s eye witness limited, eye witness works, milton

the catholic witness · 2 - the catholic witness •...

8th grade - witness - sections 1 and 2

getuie witness · 2020. 4. 10. · getuienisaksie van die...

irreducible component 2

easter witness: jehovah witnesses. jehovah witnesses jehovah...

emblem ceremony. you are about to witness the emblem...

best practices for using dell emc srdf/metro in a vmware...

aumc witness - annandale-umc.org witness/witness 2013/may...

witness # 57 int #2

2 component es

api witness report perforator system...

kyrgyzstan component 2

general description 2 component specifications 3 · general...

kidsmatter early childhood component 2 literature...