power management in storage systems · das storage – application and storage are co-located –...

23
Tag line, tag line Power Management in Storage Systems Kaladhar Voruganti Technical Director CTO Office, Sunnyvale June 12, 2009

Upload: buidat

Post on 26-Nov-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

Tag line, tag line

Power Management in Storage Systems

Kaladhar VorugantiTechnical DirectorCTO Office, Sunnyvale

June 12, 2009

Page 2: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Ou

tlin

e

�P

ower

Con

sum

ptio

n B

ackg

roun

d in

Dat

a C

ente

rs a

nd S

tora

ge S

yste

ms

�P

ower

Man

agem

ent

Str

ateg

ies

for

Sto

rage

S

yste

ms

�P

ower

Man

agem

ent M

etric

s

�Im

pact

of S

erve

r P

ower

Man

agem

ent

Str

ateg

ies

on S

tora

ge S

yste

ms

Page 3: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Sto

rag

e C

on

sum

pti

on

Co

nst

antl

y In

crea

sin

g

�M

ore

type

s of

info

rmat

ion

are

bein

g di

gitiz

ed

and

stor

ed p

ersi

sten

tly (

emer

genc

e of

new

er

type

s of

app

licat

ions

)

�D

ata

is b

eing

sto

red

pers

iste

ntly

for

long

er

perio

ds o

f tim

e (f

or le

gal a

nd s

entim

enta

l re

ason

s)

�M

ore

peop

le a

re p

ersi

sten

tly s

torin

g th

eir

info

rmat

ion

(co

mpu

ter

usag

e gl

obal

ly is

in

crea

sing

)

Page 4: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Wh

at is

a S

tora

ge

Co

ntr

olle

r?

Tra

ditio

nal S

tora

ge C

ontr

olle

rC

lust

er o

f tho

usan

ds o

f Goo

gle

Ser

vers

Sou

rce:

IBM

Red

book

DS

8000

Sou

rce:

CN

ET

New

s A

pril/

2009

Page 5: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Wh

ere

Do

es t

he

Po

wer

Go

in a

Dat

a C

ente

r?

50

35

94

Ser

ver/

Sto

rag

eC

oo

ling

UP

SL

igh

tin

g

Per

cent

ages

Sou

rce:

ID

C R

epor

t 200

8

Page 6: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Wh

ere

Do

es t

he

Po

wer

Go

in a

Sto

rag

e C

on

tro

ller?

80

3612

50

2510

CP

U (

2)

Mem

ory

(4)

Dis

k (1

)

PC

I Slo

ts (

2)

Mo

ther

bo

ard

(1)

Fan

(1)

27

52

88

He

ad

Dis

ks

+ S

he

lfT

ax

( 1

2)

Sli

3

Goo

gle

Box

Pow

er C

onsu

mpt

ion

Wat

ts

Sto

rage

Con

trol

ler

Box

Con

sum

ptio

n

12 12

24

Dri

ve

Sh

elf

(Fan

s,P

ow

er S

up

ply

)C

oo

lin

g

Wat

ts

Wat

ts

Per

Dis

k T

otal

Pow

er C

ost

Sou

rce:

Goo

gle

Pap

er, I

SC

A 2

007

Sou

rce:

Net

App

Inte

rnal

Stu

dy

Page 7: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Sto

rag

e P

ow

er M

anag

emen

t S

trat

egie

s

�H

ardw

are

–C

an s

elec

t the

app

ropr

iate

sto

rage

arc

hite

ctur

e

–C

an s

elec

t the

app

ropr

iate

sto

rage

sys

tem

–C

an s

elec

t the

app

ropr

iate

har

dwar

e fe

atur

es

�S

oftw

are

–S

tora

ge E

ffici

ency

–M

igra

tion

and

Spi

nnin

g/S

hutti

ng D

isks

Dow

n

Page 8: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Po

wer

Man

agem

ent

Str

ateg

ies

(Har

dw

are)

�H

ardw

are

Tec

hniq

ues

–A

rchi

tect

ural

Lev

el�

DA

S v

ersu

s S

tora

ge C

ontr

olle

rs

�S

ingl

e N

ode

Bat

tery

ver

sus

UP

S T

echn

olog

y

–S

tora

ge B

ox L

evel

�D

isks

ver

sus

SS

Ds

�E

ffici

ent P

ower

Sou

rces

�U

se o

f hig

her

capa

city

dis

ks�

Use

of l

ower

RP

M d

isks

Page 9: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

DA

S v

ersu

s S

tora

ge

Co

ntr

olle

rs

�D

AS

Sto

rage

–A

pplic

atio

n an

d st

orag

e ar

e co

-loca

ted

–P

ower

con

sum

ptio

n is

ef

ficie

nt if

box

is u

sed

to

run

appl

icat

ions

(e.

g. m

ap-

redu

ce a

pplic

atio

ns)

–P

ower

con

sum

ptio

n is

not

ef

ficie

nt if

the

clus

ter

node

s ar

e on

ly u

sed

to

serv

e st

orag

e–

Low

pow

ered

sha

red-

noth

ing

node

s ar

e be

ing

prop

osed

for

arch

ival

st

orag

e (P

erga

mum

wor

k fr

om U

C S

anta

Cru

z)

Page 10: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Sin

gle

No

de

Bat

tery

Ver

sus

Cen

tral

ized

U

PS

�La

rge

UP

Ss

can

reac

h 92

to 9

5 pe

rcen

t ef

ficie

ncy

at fu

ll lo

ad–

Ope

ratin

g at

low

er lo

ad r

esul

ts in

inef

ficie

ncy

whi

ch r

esul

ts in

the

gene

ratio

n of

hea

t–

Nee

d co

olin

g to

rem

ove

the

heat

from

the

data

ce

nter

�B

y ha

ving

12

volt

batte

ry a

t eac

h of

the

stor

age

node

s, G

oogl

e is

abl

e to

get

99.

9 pe

rcen

t ef

ficie

ncy

Sou

rce:

CN

ET

.com

Art

icle

on

Goo

gle,

Apr

il, 2

009

Page 11: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Po

wer

Man

agem

ent

Str

ateg

ies

(Har

dw

are)

�H

ardw

are

Tec

hniq

ues

–A

rchi

tect

ural

Lev

el�

DA

S v

ersu

s S

tora

ge C

ontr

olle

rs

�S

ingl

e N

ode

Bat

tery

ver

sus

UP

S T

echn

olog

y

–S

tora

ge B

ox L

evel

�D

isks

ver

sus

SS

Ds

�E

ffici

ent P

ower

Sou

rces

�U

se o

f hig

her

capa

city

dis

ks�

Use

of l

ower

RP

M d

isks

Page 12: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Eff

icie

nt

Po

wer

Su

pp

ly

�W

ant P

ower

Sup

plie

s th

at a

re E

ffici

ent f

or a

w

ider

ran

ge o

f loa

d–

The

se c

ost m

ore

–B

ut o

ffer

savi

ngs

in

pow

er c

onsu

mpt

ion

due

to le

ss h

eat g

ener

atio

n (le

ss c

oolin

g re

quire

d)

�If

ther

e ar

e m

ultip

le

Pow

er S

uppl

ies

usua

lly

each

one

is r

un a

t les

ser

load

, and

thus

, has

hi

gher

inef

ficie

ncy

90%

Eff

80%

Eff

80%

Eff

Mor

e E

ffici

ent

Pow

er S

uppl

y

(Effi

cien

cy)

75%

Eff

100

% L

oad

75%

Eff

50 %

Loa

d

50 %

Eff

10 %

Loa

d

Less

Effi

cien

tP

ower

Sup

ply

(Effi

cien

cy)

Load

Sou

rce:

Net

App

Inte

rnal

Stu

dy

Page 13: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Hig

her

Cap

acit

y D

isks

Sou

rce:

Net

App

Whi

te P

aper

: WP

701

0-02

07

Page 14: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Po

wer

Man

agem

ent

Str

ateg

ies

(So

ftw

are)

�S

oftw

are

Tec

hniq

ues

–S

tora

ge E

ffici

ency

�R

educ

e ov

erhe

ad p

er a

mou

nt o

f usa

ble

stor

age

�E

ffici

ent C

opie

s�

Dat

a D

e-du

plic

atio

n/C

ompr

essi

on�

Thi

n P

rovi

sion

ing

�N

umbe

r of

cop

ies

�P

rote

ctio

n M

echa

nism

–M

igra

tion

and

disk

shu

tdow

n/sp

in-d

own

Page 15: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Sto

rag

e E

ffic

ien

cy T

ech

niq

ues

�R

educ

ing

Sto

rage

Ove

rhea

d

�T

hin

Pro

visi

onin

g

�E

ffici

ent P

rote

ctio

n M

echa

nism

s

�C

onso

lidat

ion

of P

roto

cols

�E

ffici

ent C

opie

s

�D

e-du

plic

atio

n/C

ompr

essi

on

Sou

rce:

Oliv

er W

yman

Art

icle

, Dec

200

7“M

akin

g G

reen

IT a

Rea

lity”

Page 16: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Dis

k S

pin

-do

wn

/Sh

ut-

do

wn

Tec

hn

iqu

es

�M

igra

te le

ss a

cces

sed

data

to lo

wer

tier

s of

sto

rage

and

shu

t-do

wn

disk

s

�A

rchi

val d

ata

can

be s

tore

d on

dis

ks th

at a

re s

hut d

own

beca

use

of w

rite-

once

and

rea

d-m

aybe

pro

pert

ies

�D

iffic

ult t

o sh

ut-d

own

disk

s fo

r th

ose

appl

icat

ions

that

hav

e st

rict l

aten

cy

requ

irem

ents

and

hav

e lo

ng-t

aile

d di

strib

utio

n ac

cess

pat

tern

s

�S

pinn

ing

thin

gs d

own

to lo

wer

RP

M a

nd th

en s

pinn

ing

them

up

is d

iffic

ult

beca

use

cons

tant

spi

nnin

g up

dis

ks c

an a

ctua

lly r

esul

t in

high

erpo

wer

co

nsum

ptio

n

�C

OP

AN

has

sho

wn

roug

hly

5x ti

mes

pow

er s

avin

gs c

ompa

red

to n

orm

al

stor

age

cont

rolle

rs in

cas

es w

here

thin

gs c

an b

e sh

ut d

own.

–V

ery

dens

e pa

ckag

ing

than

trad

ition

al s

tora

ge c

ontr

olle

rs–

Kee

ps a

pplic

atio

n m

eta-

data

in c

ache

–S

pins

dis

ks d

own

but k

eeps

the

elec

tron

ics

up

Page 17: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

SN

IA G

reen

Sto

rag

e In

itia

tive

Dev

ice

Cla

ssif

icat

ion

Page 18: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

SN

IA C

onfig

urat

ion

& W

orkl

oad

Exa

mpl

e

Page 19: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

SN

IA G

reen

Po

wer

Pro

file

Exa

mp

le

�G

reen

Pow

er P

rofi

le–

Pha

se 0

�P

reco

nditi

onin

g ph

ase

no p

ower

or

IO m

easu

rem

ents

are

ne

cess

ary

�5

min

utes

max

imum

OLT

P w

orkl

oad

�5

min

utes

no

wor

kloa

d (id

le)

�5

min

utes

max

imum

OLT

P w

orkl

oad

–P

hase

1

�Id

le m

easu

rem

ent p

hase

. N

o us

er in

itiat

ed c

omm

ands

allo

wed

60 m

inut

es m

easu

rem

ent p

erio

d

–P

hase

2�

OLT

P w

orkl

oad

�20

min

utes

mea

sure

men

t per

iod

�5

min

utes

res

t no

OLT

P w

orkl

oad

–P

hase

3�

Seq

uent

ial T

hrou

ghpu

t 50%

Rea

d 50

% W

rite

1MB

tran

sfer

�20

Min

utes

mea

sure

men

t per

iod

Page 20: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

SN

IA G

reen

Po

wer

Pro

file

Exa

mp

le

Page 21: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Po

wer

Man

agem

ent

Met

rics

MB

ps/W

att

Seq

uent

ial I

/O

Thr

ough

put

RT

O/W

att

9s/W

att

Ava

ilabi

lity

GB

/Wat

tU

sabl

e C

apac

ity

GB

/Wat

tC

apac

ity

IOP

s/W

att

I/O P

erfo

rman

ce(O

LTP

Typ

e W

orkl

oads

)

Page 22: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Imp

act

of

Ser

ver

Vir

tual

izat

ion

on

Sto

rag

e

�S

erve

r V

irtua

lizat

ion

is b

eing

use

d to

co

nsol

idat

e ph

ysic

al s

erve

rs to

obt

ain

cost

, sp

ace

and

pow

er e

ffici

enci

es

�Im

pact

of S

erve

r V

irtua

lizat

ion

on S

tora

ge–

Nee

d fo

r sh

ared

sto

rage

–N

eed

for

effic

ient

sto

rage

with

de-

dupl

icat

ion

–I/O

inte

rfer

ence

due

to M

ulti-

tena

ncy

–M

is-m

atch

of H

yper

viso

ran

d S

tora

ge c

onst

ruct

s–

Blo

ck M

is-a

lignm

ent d

ue to

laye

rs o

f sto

rage

so

ftwar

e

Page 23: Power Management in Storage Systems · DAS Storage – Application and storage are co-located – Power consumption is efficient if box is used to run applications (e.g. map- reduce

©20

08 N

etA

pp.

All

right

s re

serv

ed.

Co

ncl

usi

on

�K

ey ta

keaw

ays

–S

tora

ge E

ffici

ency

is th

e pr

imar

y m

echa

nism

for

savi

ng p

ower

by

havi

ng fe

wer

num

ber

of d

isks

–F

lash

is e

mer

ging

as

a po

wer

effi

cien

t al

tern

ativ

e to

dis

ks (

pric

e is

stil

l an

issu

e)–

Shu

tting

-dow

n di

sks

is o

nly

attr

activ

e fo

r ar

chiv

al s

tora

ge

�N

eed

for:

–P

ower

Man

agem

ent M

etric

s S

tand

ards

–P

ower

aw

are

stor

age

man

agem

ent t

ools