chapter 5b: top500 - freie universität · chapter 5b: top500 top 500 blades ... eserver blue gene...

16
Computer Architecture Summer 2005 5b.1 Chapter 5b: top500 Top 500 Blades Google PC cluster

Upload: lytu

Post on 19-Aug-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.1

Chapter 5b: top500

Top 500BladesGoogle PC cluster

Page 2: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.2

top500: top 10Rank Site

Country/YearComputer / ProcessorsManufacturer

Computer FamilyModel

Inst. typeInstallation Area

RmaxRpeak

Nmaxnhalf

1 DOE/NNSA/LLNLUnited States/2005

BlueGene/LeServer Blue Gene Solution / 65536IBM

IBM BlueGene/LeServer Blue Gene Solution

Research 136800183500

1277951

2 IBM Thomas J. Watson Research CenterUnited States/2005

BGWeServer Blue Gene Solution / 40960IBM

IBM BlueGene/LeServer Blue Gene Solution

ResearchInformation Processing Service

91290114688

983039

3 NASA/Ames Research Center/NASUnited States/2004

ColumbiaSGI Altix 1.5 GHz, Voltaire Infiniband / 10160SGI

SGI AltixSGI Altix 3700

Research 5187060960

1290240

4 The Earth Simulator CenterJapan/2002

Earth-Simulator / 5120NEC

NEC VectorSX6

Research 3586040960

1075200266240

5 Barcelona Supercomputer CenterSpain/2005

MareNostrumJS20 Cluster, PPC 970, 2.2 GHz, Myrinet / 4800IBM

IBM ClusterJS20 CLuster

Academic 2791042144

977816

6 ASTRON/University GroningenNetherlands/2005

eServer Blue Gene Solution / 12288IBM

IBM BlueGene/LeServer Blue Gene Solution

Academic 2745034406.4

516095

7 Lawrence Livermore National LaboratoryUnited States/2004

ThunderIntel Itanium2 Tiger4 1.4GHz - Quadrics / 4096California Digital Corporation

NOW - Intel ItaniumItanium2 Tiger4 Cluster

Research 1994022938

975000110000

8 Computational Biology Research Center, AISTJapan/2005

eServer Blue Gene Solution / 8192IBM

IBM BlueGene/LeServer Blue Gene Solution

Research 1820022937.6

442367

9 Ecole Polytechnique Federale de LausanneSwitzerland/2005

eServer Blue Gene Solution / 8192IBM

IBM BlueGene/LeServer Blue Gene Solution

Academic 1820022937.6

442367

10 Sandia National LaboratoriesUnited States/2005

Red Storm, Cray XT3, 2.0 GHz / 5000Cray Inc.

Cray XT3Cray XT3

Research 1525020000

Page 3: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.3

top500: mare nostrum

2282 blade servers in 27 racks, < 50 m2

blades:very small, slim like a bookminimalistic PC (processor, memory, hard drive)

without power unitwithout USB, peripherals supportwithout video support

typically hot pluggable

energy dissipation of a single blade much smaller than of a PCBUT: higher density in a rack

5 Barcelona Supercomputer CenterSpain/2005

MareNostrumJS20 Cluster, PPC 970, 2.2 GHz, Myrinet / 4800IBM

IBM ClusterJS20 CLuster

Academic 2791042144

977816

Page 4: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.4

blades vs. regular server rack

..\marenostrum\BSC_Outside.mp4

blades classical approach

Page 5: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.5

marenostrum installation

Page 6: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.6

Germany

576 NEC-SX8 processorsbinary compatibility to Earth

Simulator

27 HWW/UniversitaetStuttgartGermany/2005

SX8/576M72 / 576NEC

NEC VectorSX8

IndustryInformation Processing Service

89239216

82944055296

Rank

SiteCountry/Year

Computer / ProcessorsManufacturer

Computer FamilyModel

Inst. typeInstallation Area

RmaxRpeak

Nmaxnhalf

Page 7: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.7

Industry82 Bank

United Kingdom/2004BladeCenter HS20 Xeon 3.06 GHz, Gig-Ethernet / 3200IBM

IBM ClusterxSeries Cluster Xeon

Industry 375519584

83 WestgridCanada/2005

BladeCenter Xeon 3.06 GHz, Gig-Ethernet / 1680IBM

IBM ClusterxSeries Cluster Xeon

Academic 375510281.6

84 Petroleum Company (G)Saudia Arabia/2004

BladeCenter HS20 Xeon 3.2 GHz, Gig-Ethernet / 1536IBM

IBM ClusterxSeries Cluster Xeon

IndustryGeophysics

37559830.4

85 Credit Suisse/First BostonUnited Kingdom/2004

BladeCenter HS20 Xeon 3.06 GHz, Gig-Ethernet / 1500IBM

IBM ClusterxSeries Cluster Xeon

IndustryFinance

37559180

86 Animal LogicAustralia/2005

BladeCenter HS20 Xeon 3.06 GHz, Gig-Ethernet / 1148IBM

IBM ClusterxSeries Cluster Xeon

IndustryDigital Media

37557025.76

87 Geoscience (B)India/2005

HS20 Cluster, Xeon EM64T 3.4 GHz - Gig-Ethernet / 1024IBM

IBM ClusterHS20 Cluster

ResearchGeophysics

37556963.2

88 Geoscience (C)United Kingdom/2004

xSeries Xeon 3.06 GHz - Gig-E / 1128IBM

IBM ClusterxSeries Cluster Xeon

IndustryGeophysics

37556903.36

89 Geoscience (C)United Kingdom/2004

xSeries Xeon 3.06 GHz - Gig-E / 1128IBM

IBM ClusterxSeries Cluster Xeon

IndustryGeophysics

37556903.36

90 Semiconductor Company (D)Israel/2004

xSeries Xeon 3.06 GHz - Gig-E / 1120IBM

IBM ClusterxSeries Cluster Xeon

IndustrySemiconductor

37556854.4

91 Financial Services (H)United States/2005

BladeCenter HS20 Xeon 3.2 GHz, Gig-Ethernet / 1024IBM

IBM ClusterxSeries Cluster Xeon

IndustryFinance

37556553.6

92 Bank (H)Germany/2004

BladeCenter Xeon 3.06 GHz, Gig-Ethernet / 1064IBM

IBM ClusterxSeries Cluster Xeon

IndustryFinance

37556511.68

Page 8: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.8

Germany

d110 Adam Opel AGGermany/2005

eServer pSeries p5 575 1.9 GHz, GigEth / 720IBM

IBM SPSP Power5

IndustryAutomotive

30685472

112 Max-Planck-Gesellschaft MPI/IPPGermany/2005

eServer pSeries p5 575 1.9 GHz, GigEth / 720IBM

IBM SPSP Power5

Research 30685472

165 Deutscher WetterdienstGermany/2003

SP Power3 375 MHz 16 way / 1920IBM

IBM SPSP Power3 375 MHz high node

ResearchWeather and Climate Research

21062880

366 Robert BoschGermany/2005

Cluster Platform 3000 DL360G4 Xeon3.4 GHz, GigEthernet / 360Hewlett-Packard

HP ClusterHP DL360 Cluster

IndustryDatabase

1395.42448

Page 9: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.9

HLRN: virtual supercomputing cluster

368 HLRN at UniversitaetHannover / RRZNGermany/2004

pSeries 690 Turbo 1.3GHz / 512IBM

IBM SPSP Power4

Academic 13842662.4

369 HLRN at ZIB/Konrad Zuse-Zentrum fuerInformationstechnikGermany/2004

pSeries 690 Turbo 1.3GHz / 512IBM

IBM SPSP Power4

Academic 13842662.4

Page 10: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.10

statistics

Page 11: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.11

statistics

Page 12: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.12

statistics

Page 13: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.13

case study: google

goal: no search takes longer than 0.5 seconds (incl. network delays)

1000 queries / second on average

6000 processors, 12.000 disks, 1 petabyte storage

source: Patterson, Hennessy: Computer Organization and Design, Morgan Kaufmann, 2005

Page 14: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.14

google cluster site

40 racks, each 80 PCsfail-over Ethernet switchfail-over network connection (OC48: 2.4 Gbit/s, OC12: 600 Mbit/s)

Page 15: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.15

google PC rack

one 100 Mbit Ethernet switch inthe center

front and back 40 PCs each

Page 16: Chapter 5b: top500 - Freie Universität · Chapter 5b: top500 Top 500 Blades ... eServer Blue Gene Solution / 65536 IBM IBM BlueGene/L ... 4 The Earth Simulator Center Japan/2002

Computer Architecture Summer 2005 5b.16

google rack-unit PC

PC contains:hard disks256 MB RAMpower supplyIntel processor

⇒ not a real blade

energy:55 Watt/PC, 4500 Watt/rack