DELTH

LL™ PERM

POWE

DEL

MAL DERED

R

LL ENTER

DESIGDGE™

Enterp

Round Rock

RPRISE W

GN O™ M-S

prise Therm

One Dell k, Texas 78

www.dell

WHITEPAP

OF THSERIE

K.C. Cmal Enginee

Way 8682 .com

PER

HE ES

Coxe ering

THIS WHERRORS AIMPLIED W AMD andtrademarrefer to einterest in For more Informatio

ITE PAPER ISAND TECHNICWARRANTIES

d Opteron arks of Intel Co

either the entn the marks a

information, on in this doc

S FOR INFORCAL INACCUR

S OF ANY KIND

re trademarkorporation. Otities claimingnd names of

contact Dell.cument is sub

RMATIONAL PRACIES. THE D.

ks of AdvancOther trademg the marks aothers.

. bject to chang

PURPOSES OCONTENT IS

ed Micro Demarks and trad

and names o

ge without no

NLY, AND MS PROVIDED

evices, Inc. de names ma

or their produ

otice.

MAY CONTAINAS IS, WITH

Intel and Xeay be used inucts. Dell dis

2 | P a

N TYPOGRAPHHOUT EXPRES

eon are regisn this documeclaims propr

a g e

HICAL SS OR

stered ent to ietary

1 INTWith enecustomerdevelopmoverall sy The launcblades mathe systemanages some of tare intend A reader blades an

2 DEThe Dell Mof up to performamore typoperatingsignificant The challe

• R• O

The sectithermal m

3 COThe sectithermal sbut will ho

TRODUrgy costs risis. One of th

ment of a highstem power,

ch of the Dearks an evolum stretches cooling to th

the features oded to result

seeking a mod peripherals

ESIGN GM1000e is de

10,000 feet nce requirem

pical data ceng condition. t opportunity

enge that Deleliable opera

Optimized for

ons below wmanagement

OOLINGons below aolution in theopefully prov

UCTIONng, energy e

he key avenuhly efficient th

but it doesn’

ell™ PowerEdutionary leap

from the layhe fan moduof the thermin one of the

ore detailed ds should read

GOALS signed to reli(3,048m).

ments to meenter could b

Even a datay for reducing

l faced in thetion at worsttypical data c

will detail howthrough the I

G SOLUre intended

e Dell PowerEvide the reade

N efficiency in Iues of addreshermal solutit need to.

dge™ M1000ein thermal deyout of eachles that proval design and most therma

description of the Dell M-S

iably operateIn addition,

et such condite supplying a center opeg power-to-co

e developing tt-case, redundcenter condit

w Dell accomIntegrated De

UTION to provide a

Edge M1000eer an apprecia

T equipmentssing energy on. System c

e Modular Eesign efficienh blade to Cvide the airflod discuss the ally efficient s

f the featureseries Archite

e at ambient cthe system stions, howev15-17°C air f

erating at “hool vs. a 35°C

the M1000e wdancy lost coions

mplished thisell Remote Ac

OVERVa general une Modular Encation of the e

t has quickly efficiency at

cooling can co

nclosure andncy by Dell. Thassis Managow. This papunderlying p

servers on the

s of the Powecture Whitep

conditions upsupports reder, are not tyfrom the floigher” tempeenvironment

was to develonditions

s in hardwarccess Control

VIEW derstanding closure. Thesengineering th

become a mt the platformonsume a sig

d PowerEdge The thermal agement Contper will walkprincipals ande market.

erEdge M100paper availabl

p to 35°C (95°dundant coolypical of mosor tiles, a meratures arout.

op a solution

e design as ler (iDRAC) an

of the majose sections arhat has gone

3 | P a

major focus om level lies ignificant porti

M600 and architecture wtroller (CMC)

k the user thrd design goals

00e and assocle at dell.com

°F) and at altiing. The the

st deploymenmuch more bund 25°C off

that is both:

well as in synd CMC.

r elements ore not all-inclinto the desi

a g e

of Dell n the ion of

M605 within ) that rough s that

ciated m.

tudes ermal

nts. A benign fers a

ystem

of the usive, gn.

Figure 1:1

3.1 WThe Powespecific corequiremesystem co

Cooling isFigure 4). from the configuratambient tthe enclos

: Front View 16 Half-Heigh

What proverEdge M1000ooling requireents. Each f

ooling during

s managed by The thermaBMC that runtion on eachtemperature sure.

of PowerEdght Blade Encl

vides th0e is cooled bements of thfan is hot swnormal run t

F

y a combinatil control algo

ns on the Dellh blade, the

of the blade

ge M1000e wilosures

he coolinby 9 custom fe M1000e, in

wappable andime or if redu

Figure 3: Del

ion of blade-orithm runninl PowerEdge thermal condand then co

ith Fig

ng fan modules.ncluding its ad can be indiundancy is los

l M1000e Fan

level (iDRAC)ng on each bl9G servers. Idition create

ommunicate t

gure 2: Rear V

The fan moirflow operatividually speest.

n Module

) and enclosuades’ iDRAC it has the cap

ed by softwarthe blade’s sp

View of Powe

dule was desting point anded controlled

ure-level (CMCis an evolutio

pability to anare load on thpecific coolin

4 | P a

erEdge M1000

signed to meed power effic

d to help opt

C) controllersonary step foralyze the hardhe blade, ang requiremen

a g e

0e

et the ciency timize

s (See rward dware d the nts to

The enclotemperatthe front and powein zones, This desigpower-intsaving lev

3.2 AiThe M10Because modules despite thengineericompone The servethe systemthrough texhaust t

osure (CMC),ure sensors iof the M100

er consumptiowith each zo

gn allows the tensive hardwvel.

ir Manag00e makes uof this, eachin the back heir locationsng, with thent temperatu

er modules arm is dominathe server mo

the air from

, in turn, is n the M1000

00e), and set on – to meet

one mapped tCMC to incre

ware configur

Fi

gement use of parallh of the maj

of the systes in the rear e goal of alure requireme

re cooled withted by inlet aodules, througthe chassis.

designed to0e infrastruct

each fan to tt the cooling to the coolinease only therations, while

igure 4: Fan C

el air paths or subsystemm. Providinof the syste

lowing the ments.

h traditional rea for the ingh vent holes There are p

o interpret eure (such as the lowest sprequirements

ng of a groupe fans needede leaving the r

Control Block

to cool the ms receives ag ambient am, was a mamodules to

front-to-backndividual blads in the midpplenums both

each of the in the IO Mopeed possibles of the syste of blades bad to cool hottrest of the fan

k Diagram

blades, IO Mambient air tir to the IO ajor focus of consume les

k cooling. As des (green higplane, and is th upstream o

16 blades’ idules and the

e – helping toem. The CMCased on locatter blades orns at a lower

Modules, andto help avoiModules andthe early sys

ss airflow w

shown in Figghlighted arethen drawn inof the midpl

5 | P a

nputs, as we control pano minimize aC controls thetion in the chr blades with power and a

d power supd pre-heatind Power Supstem archite

while still me

gure 5, the froea). The air pnto the fans wane, betwee

a g e

ell as nel on irflow e fans hassis.

more irflow

pplies. g the

pplies, ctural eeting

ont of passes which n the

midplane distribute

The Poweinlet air frFigure 6. required v

The IO Minlet, as sThis cool plenum bCMC and

Ser(M1

(

and the blae the cooling p

er Supplies, lorom a duct lo This insures

volume of air

odules use aseen in Figureair is then d

between the mIntegrated Ke

rver Module1000e front

Power Sup(M1000e fro

des, and dowpotential from

Figure 5

ocated in thecated beneat

s that the por needed to co

Figure

bypass duct e 7. This du

drawn down midplane andeyboard/Vide

e Inlet t view)

pply Inlet ont view)

wnstream of m the three c

5: Dell Blade

e rear of the th the server wer suppliesool the powe

e 6: M1000e P

to draw ambct is located through the

d fans. From eo/Mouse (iK

the midplanolumns of fan

Server Modu

system, use modules, as s receive ambr supply.

Power Supply

bient air fromabove the seIO Modules this plenum,

VM) are also

Server Mo(M

Power Sup(M10

ne, between tns across the

ule Cooling P

basic front-tseen in the gbient temper

y Cooling Pat

m the front oerver modulein a top-to-b, the air is excooled by air

odule CoolM1000e side

pply Cooling000e side v

the midplaneserver modu

Path

to-back coolinreen highlighature air, wh

th

of the systemes (again highbottom flow xhausted fromr in this flow p

ing Air Profe view)

g Air Profileview)

6 | P a

e and the fanules.

ng, but drawt in the left s

hich minimize

to the IO Mhlighted in grpath and int

m the systempath.

file

e

a g e

ns, to

their ide of

es the

odule reen). to the . The

4 DETO

4.1 ImDevelopincomputinpoint, yetaccomplisfit the neeit is critica There is slocal electwhen inst

(M

ESIGN CO-COOL

mpedancng a fan to g architecturt fall within shed by identeds of the M1al to an efficie

somewhat of tronics store talled in a PC.

IO Module M1000e fron

Figu

CONSIDL

ce, Airflocool the M1

re provided aa much tigh

tifying a fan e1000e. This sent thermal d

a misconceptfor a desktop. This is calle

Inlet nt view)

ure 7: M1000e

DERATI

ow, and1000e and p unique chalter power b

efficiency targsection will prdesign.

tion about hop PC that is add a “free air”

IO Coo(M100

e IO Module C

IONS A

Fan Effprovide scalalenge. The faudget than oget that requrovide a brief

ow fans perfodvertised as a measureme

oling Air Pro00e side vie

IOM Lo

Cooling Path

AFFECT

ficiencybility for thean needed tooff-the-shelf

uired custom f overview of

orm and are san “80 CFM” fnt of the fan

ofile ew)

ocations and(M1000e b

h

TING PO

y e next severo meet an agfans could ptechnology twhat fan effi

specified. A ffan will not mperformance

d Airflow Dback view)

7 | P a

OWER-

ral generatiogressive oper

provide. Thiso be developiciency is, and

fan purchasemove 80 CFM e, and is how

irection

a g e

ons of rating s was

ped to d why

d at a of air much

air the fancomponeeven list airflow ou The half oflow of a(Pascals inmoves. Aoperating The chartchart, thewater (in.

Why is thelectronicpoint reqfor how mamount othrough afan can be

n moves whents of a comthis value on

utput.

of the fan equair, is measurn SI derived uA fan in free g point of ‘airf

t below is type free-air ratinw.g.).

his importantcs enclosure uired of the s

much power of energy (wha system. Whe determined

0

0.1

0.2

0.3

0.4

0.5

0.6

0

Impe

danc

e (in

.w.g

.)

en sitting on aputer). This

n their datash

uation that isred in pressuunits). The mair has zero

flow at a give

pical of a fan ng is 116 CFM

Figu

t? A thermaand can mesystem fan. is needed to hich can be rhen comparedd.

20

Fan Curve

System ImpCurve

a table with nmethod of dheets, even t

n’t often discure, and in Umore impeda

impedance. en impedance

that might bM, but the act

ure 8: Exampl

al design engasure the imThe operatincool the syst

represented d to the elect

40

pedance

nothing occluescribing a fathough it is o

cussed is impeUS customarynce that a fa In an electr

e.’

be found in a tual operating

le Fan Perform

gineer knowsmpedance of ng point of thtem. The opas power) thtrical power r

60

Airflow (CF

OperatPoint

ding the inletan is so commonly a partial

edance. Impy units is rep

an is loaded wronics system

desktop comg point is clos

mance Curve

s how much the enclosur

he system faperating pointhat needs to required to ru

80 10

FM)

ting

t or outlet (sumonplace thal specification

edance is thepresented bywith, the less

m, however, t

mputer or towser to 80 CFM

e

airflow is rere to determn is a significt of a fan actube put into

un the fan, th

0 120

Free

8 | P a

uch as the intat fan vendorn of a fan’s a

e opposition ty inches of ws airflow it acthe fan runs

wer server. IM at 0.19 inch

equired to comine the opercant driving fually describethe air to fo

he efficiency o

140

e Air

a g e

ternal rs will actual

to the water, ctually

at an

n this hes of

ool an rating factor es the orce it of the

WorWor

=η

Fan efficiequality ofWhat doe

1. Ahcotrmsede

2. Ifpoimisteim

These priimpedanchigher thaachieved custom fo This fan ismarket anblade encunderstanimprovemsubtle chathermal d

4.2 AiThere areair tempe1950 servsystem, a

Operrkrk

in

out =

ency is depenf the motor, aes all this mea

higher efficigher efficienomputing. Aranslated into

more expensivelect a fan weployment.

f a system caower. We

mpedance of s somewhat emperature rmpedance is t

ncipals guidece drove a loan typical 92mthrough opt

orm factor.

s coupled wind a chassis closure and lnd what facto

ment. These anges in the i

design.

irflow ane numerous berature from ver into basic nd a fan (Figu

InFlowrating

ndent on howand can vary an with respe

iency fan wincy fan designAlternatively,o cost savingsve componenith a materia

an be designehave discusthe system. flexible, it o

rise through tthe other vari

ed not only dow-impedancmm or 80mmtimization of

th a blade demidplane thaayouts were ors contributlayout studi

ndustrial des

nd Tempbenefits a cusa server. To thermal build

ures 9 and 10

PowernputOperwrate×

w the fan is bsignificantly,

ect to cooling

ill consume pn, leading to it can resus in the deplnts to build tl cost approp

ed with a lowsed how thWhile the vo

often needs the system (miable that can

development e design as

m form factor f the aerody

esign with upat underwent

studied exteted to the imes resulted i

sign of the bla

peraturestomer can re

illustrate thiding blocks: a

0).

rPressrating

built and des, even from opower? The

proportionallya lower pow

lt in lower ooyment. Thethe fan, so it

priate to the

wer work outpe operating lume of airfloto be maint

more on thatn affect the po

of the M100well. The effans used in m

ynamics, mot

p to half the t several desiensively priorpedance of tin componenade, all to hel

e Rise ealize by lowes effect, cons

an airflow res

sure

signed, from one fan to anre are two im

y less powerwer fan, resuloverall powee higher effict is critical thamount of en

put requirempoint is de

ow required tained at a m later). Assuower-to-cool

00e fan, but tfficiency of tmany PCs curtor, and mot

impedance oign iterationsr to building the module, nt placementp drive lower

ering fan spesider the simsistance, a he

the shape ofnother in the mportant poin

r than a low ts in more p

er consumptiociency may cohat a thermanergy that m

ment, the fan termined by

to cool an eleminimum levming a minim.

the close relahe M1000e frrently on thetor controlle

of competitivs to help optithe first funcand targetings made for ar impedance a

eds and increplification of

eat source, a p

9 | P a

f the blades tsame form fa

nts:

efficiency faower availabon, which caome at the coal design engay be saved i

will consumy the airflowectronics enclvel to contromum fixed ai

ationship witfan is signific

e market. Thir design wit

ve products omize airflowctional systemg certain areaairflow, as wand a lower p

easing the exf a Dell Powepower distrib

a g e

Eq. 1

to the actor.

an. A ble for an be ost of gineer in the

e less w and

osure ol the rflow,

th the cantly is was thin a

on the . The ms to as for

well as power

xhaust rEdge

bution

In this exarunning aRPM, thedecreases

Figur

ample, assumat 9,000 RPM exit air tem

s 55W!

re 10: Block-D

me the serverM, there is an mperature inc

Figure 9:

Diagram Simp

r is under a c8°C rise thro

reases to 22

: PowerEdge

plification of

constant loadough the syst°C above the

1950

f a Server's A

d that requiretem. By dece inlet tempe

Airflow System

es a 300W increasing the ferature, but t

10 | P a

m

put. With thfan speed to the system p

a g e

he fan 3000

power

Figure 1

The reasofan powespeed chaof a fan (E

fi

ini

PowerPower

As an exaconsumptminimize reducing airflow ha An expectimprovemincrease wto its optmatch it temperat

11: Comparis

on for the drar and RPM doange, so smaEq 2).

⎜⎜⎝

⎛=

final

itial

RPMRPM

mple, and ustion! Becausfan speed asystem powe

ave been desi

ted benefit oments in the with a highertimum return

to a dataceure from the

on of Fan Sp

amatic poweo not have a lll decreases i

3

⎟⎟⎠

⎞

final

initial

MM

sing (Eq 2), a e of this relatnd increase er and airfloigned to mee

of the high teM1000e is thr temperaturen temperaturenter deploysystem) can

eed, Power D(botto

r decrease belinear relationin fan speed

10% reductiotionship, theexhaust air tw consumptt the high tem

emperature rhat the capace rise as the re. Care musyment, but thave benefits

Draw, and Exhom) Fan Speed

etween the hnship. In factcan have sign

on in fan RPMre was a constemperature,ion. All of tmperature re

rise that stretcity of the aiCRAC (Compst be taken wthe higher res beyond pow

haust Tempeds

high and low t, power channificant impa

M can result inscious effort , with the inthe componequirements o

tches beyondr conditioneruter Room A

when selectineturn tempe

wer-to-cool at

erature at Hig

fan speeds inges as a cubicts on the po

n a 27% redumade in the tended bene

ents downstrof this design

d the enclosurs in a data cAir Conditioneng air conditerature to tht the IT enclo

11 | P a

gh (top) and L

n Figure 11 isic function ofower consum

ction in fan pM1000e des

efit of significream in the w

condition.

ure-level efficcenter can acer) operates cioning to prohe CRAC (exsure level.

a g e

Low

s that f a fan

mption

(Eq 2)

power ign to cantly warm

ciency ctually closer operly xhaust

4.3 CoWith a chlower pow The M600(Intel Xeoprocessorthe X5355temperat Memory cmore effiDIMMs todependinDIMMs beto-DIMM

5 CAPO

What doethe produservers w

• (2• (4

And also c

• (2• (4

omponehassis designewer and airflo

0, for examplon X5355) ther power, the 5 provides anure, dependi

configurationcient coolingo achieve a g on memoreing populateheating.

ASE STUOWERED

es the customuct’s inceptioith similar ha

2) Intel Xeon 54) 2GB Fully B

consider an M2) AMD Opter4) 2GB DDR2

ent Seleced for therm

ow consumpt

le, is availablermal design lower prehean opportunityng on other c

ns can also afg memory wh

given memory capacity reed in every o

UDY: PDGE 19mer get for a on? Consider

rdware, part5130 process

Buffered DIMM

M605 deploymron™ 2218 H2Rx4 DIMMs

ction mal efficiency,

ion by selecti

e with procepower levels

at placed on y for airflow

components i

ffect cooling hen 4 higher ory capacity.equired and oother slot in t

OWERE950-III

well-designer an M600 deicularly:

sors Ms

ment of 16 blHE processors

, there are sting easier-to-

ssors rangings. In additiodownstreamreductions rn the blade.

power and acapacity DIM

. Airflow reother compothe memory b

EDGE M

ed blade serveployment an

ades with s

till several op-cool compon

g from 40W (n to the pow

m componentsranging from

airflow requirMMS are useeductions of onents in thebank, and the

M600 V

ver with coolind a deploym

pportunities nents and blad

Intel® Xeon®wer savings ass by the 51485% to 40% a

rements. Noted in place of

up to 25% blade. Thise resulting re

VS. M60

ing efficiencyment of 16 P

12 | P a

for a customde configurat

5148LV) to 1ssociated wit8LV as opposat a 25°C am

tably, the M6f 8 lower capcan be achi

s is a result oeduction in D

05 VS.

y designed-in owerEdge 19

a g e

mer to tions.

120W th the sed to

mbient

600 is pacity ieved, of the IMM-

from 950 III

NumRacSerTot AirfAve1 Poand2 Facoo3 Aias t

From Tabairflow thefficiency The Poweefficient cassociated

6 CODesigninginstalling solution tPowerEdgmaximizinoperatingsystems mthe powepower to

Table

mber of Servck-Space to Drver Density tal AC Power Fan Power1,

flow Consumerage Airflowower represend assumes a San power is inling efficiencirflow consumemperature v

ble1, a deployhan the Powey in the coolin

erEdge M605 cooling in thed with DDR2

ONCLUSg the cooling

it in a compthat is optimge M1000e Mng energy efg conditions. management er consumptiobe dedicated

1: Compariso

ers Deploy

Required1 2

med by Deployw per Server3 nted in AC W

SPECjbb workncluded in tocy. mption is basvaries.

yment of 16 rEdge 1950 II

ng solution.

deployment e parallel layoas compared

SIONS solution for

uter, and turmized for poModular Encfficiency and Tools such fan control, a

on of the M1d to computin

on of Deploymvs. 16 Power

Po1916161.04753

yment3 4931

Watts “at the kload.

otal AC powe

sed on a 25°C

M600 bladeII deploymen

shows additout of the CP to FBD mem

r IT equipmerning it on. Aower, airflowlosure and itminimizing as high efficand low airflo1000e therm

ng, as oppose

ment of 16 MrEdge 1950-IIIowerEdge 950 III 6 6U 0 Servers/U

785W 30W 95 CFM 1 CFM wall” after p

r, but is brok

C ambient tem

es deployment. Of the 845

ional power aPU and memoory.

nt can be asA basic appro

w, or coolingts associatedairflow requ

ciency fans, low/high tem

mal solution ad to cooling.

M600 Blades vI Servers

PowerEdM600 16 10U 1.6 Serve3835W 80W 370 CFM23 CFM

power supply

ken out here f

mperature to

nt consumes 5W in power

and airflow sory in the air

s simple as soach like thag. The coold blades werirements whow-impedancperature rise

and allow mo

vs. M605 Blad

dge PowM6016 10U

ers/U 1.6 S366065W

340 21 C

y efficiency is

for compariso

the server an

19% less posavings, 450W

avings, maderflow, as well

selecting a fat, however, wling solution re developedhile still suppce system de are designed

ore of the cu

13 | P a

des

werEdge 05

Servers/U 0W

W CFM FM s considered

on of

nd will vary

ower and 29%W is a result o

e possible by l as power sa

an from a cawill not resul

deployed in with the go

porting worstesign, advancd to help minstomer’s ava

a g e

% less of the

more avings

talog, lt in a n the oal of t-case ces in

nimize ailable