Download - BSC MARENOSTRUM
![Page 1: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/1.jpg)
BSCMARENOSTRUM
Systems Group
![Page 2: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/2.jpg)
2MareNostrum
MareNostrum
● Proceso
● 2560 JS21, 2.3GHz
● 4 cores por placa
● 8 Gbytes
● 36 Gbytes disco SAS
● Redes
● Myrinet
● 2 Spine 1280
● 10 Clos256
● 2560 Tarjetas Myrinet
● Gigabit
● 10/100 Ethernet
● Disco
● GPFS sobre 40 servidores de disco
● Sistema
● Linux
94,20 TFlops10240 procesadores20 TBytes memoria280 + 90 TBytes disco
Blade centers
Myrinet racks
Storage servers
Operations rack
Gigabit switch
10/100 switches
![Page 3: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/3.jpg)
3MareNostrum
JS21 blade
● Características:
● 2 chips PPC970MP @ 2.3 GHz dual-core
● 8 GB RAM
● Disco duro interno SAS 36.4 GB
● Tarjeta myrinet en (I/O Expansion)
● 2 interfaces Giagabit Ethernet Broadcom
● Soporta instrucciones vectoriales SIMD
● AltiVec
● BMC Conexionado con la Management del
bladecenter
![Page 4: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/4.jpg)
4MareNostrum
JS21: Esquema
![Page 5: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/5.jpg)
5MareNostrum
Bladecenter
● Elemento que puede aglutinar 14 blades
● Elemento que ofrece acceso a recursos compartidos:
● Networking: Ethernet, Myrinet, Infiniband, FiberChannel, …
● Redundancia casi completa de cualquier elemento
● Gestión out-of-band del bladecenter y sus blades
● Monitorización del entorno
● Parte Frontal:
● Blades
● LEDs informativos
● Lector CD-ROM
● Disquetera
![Page 6: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/6.jpg)
6MareNostrum
JS21 Processor Blade
• 2-way 2.3 GHz Power PC 970 MP
• 8GB memory (512KB L2 cache)
• Local SAS drive (36 GB)
• 2x1Gb Ethernet on board
• Myrinet daughter card
Blades, blade center and blade center racks
Blade Center
• 14 blades per chassis (7U)
• 56 processors
• 112GB memory
• Gigabit ethernet switch
6 chassis in a rack (42U)
• 336 processors
• 672GB memory
![Page 7: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/7.jpg)
7MareNostrum
Esquema lógico MareNostrum
![Page 8: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/8.jpg)
8
● 10 Clos 256x256 switches
● Conexión de hasta 256 máquinas
● Conexión a los Spine mediante
● 64 puertos con quad-cables
● 2 Spine 1280
● Interconexión hasta 10 Clos
256x256 switches
● Monitorización de los equipos
mediante interfaz ethernet
Myrinet en MareNostrum
![Page 9: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/9.jpg)
9MareNostrum
Clos 256x256Clos 256x256
Clos 256x256Clos 256x256
Clos 256x256Clos 256x256
Clos 256x256Clos 256x256
Clos 256x256Clos 256x256
Spine 1280 Spine 1280
256 links (1 to each node)
250MB/s each direction
128 Links
MareNostrum Myrinet Layout
![Page 10: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/10.jpg)
10MareNostrum
Robot del BSC: SL8500
![Page 11: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/11.jpg)
11MareNostrum
Robot SL8500 (II)
● 7500 cintas LTO4 de 800 GB cada una ≈ 6 PB nativos
● 6 PB ≈ 6000 TB ≈ 6,000,000 GB sin compresión !!!!
● La misma capacidad en DVD’s puesto uno encima del otro se podría hacer una torre tal alta como el Hotel Arts, si no se caen
antes
● 8 Brazos trabajando en 4 niveles de altura
● 23 Unidades lectoras LTO 4
![Page 12: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/12.jpg)
12MareNostrum
● 5 Servidores (Sun Fire v445, 4 CPU UltraSPARC III,
8 GB RAM)
● 1 Controlador del robot
● 3 Servidores para backup (TSM)
● 1 Servidor para HSM
● Armario de discos
● 40 TB
● 84 discos SATA de 500 GB
● Conexión de red
● Conexionado entre Robot y los
servidores mediante FiberChannel
● 2 enlaces de 10 Gbit/s entre edificio D6
y edificio capilla
Infraestructura hardware
![Page 13: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/13.jpg)
13MareNostrum
Otros sistemas
● Máquina de memoria compartida
● 128 Intel Itanium2 dual core @ 1.6 GHz
● Cache 8 Mbytes
● 2.5 TB RAM
● Bases de datos para Life & Earth Sciences
● 63 TB para datos
● 2 servidores para acceso a los datos mediante NFS y SMB
● PowerPC Cluster
● Entorno de pruebas
● Ejecuciones secuenciales
![Page 14: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/14.jpg)
14MareNostrum
PRACE: Prototipo MariCel
MariCel in 2 racks of
MareNostrum
computer room
IBM QS22 Blade● 72 QS22 IBM Blade servers
● PowerXCell 8i 3.2Ghz cpus
● 864 GB RAM total
● 1296 cores
● 12 JS22 IBM Blade servers● Power6 64 bits 4.0 GHz dual core
cpus
● 96 GB RAM total
● 48 cores
● 4xDDR InfiniBand (16Gb)● MPI, GPFS
● 4 x 24 ports switch
● Peak performance● 14.4 Tflops from 2 rack units
● 20 Kwatts
![Page 15: BSC MARENOSTRUM](https://reader036.vdocuments.site/reader036/viewer/2022070517/62c202fdcbc2641ec40aa595/html5/thumbnails/15.jpg)
15MareNostrum
Gracias !http://www.bsc.es