ic922 | 9183-22x | ibm power systemspublic.dhe.ibm.com/systems/power/community/aix/... · ibm power...

23
05/02/2020 1 IC922 | 9183-22X | IBM Power Systems © Copyright IBM 2020 Version 17 – 4 Feb 2020 Presentation Content Ben Mashak IC922 Power Systems Chief Engineer Grace Liu IC922 Principal Offering Manager Nigel Griffiths EMEA Advanced Technology Support (Powerpoint editor!) Summary AI demands purpose-built infrastructure AC922 remains the best platform for deep learning and training AI models Using those models in production (is called Inferencing) is not as GPU intensive The IC922 server adds a cost efficient inference platform - on-prem or OpenShift Cloud Only IBM delivers an end-to-end AI solution with optimized hardware and software to meet all your business needs Contents GA1 Details Picture Gallery & Highlights Use Cases and Sales Single Pager Processors Memory I/O diagram Storage, I/O & GPU placement Storage & adapter details Acceleration adapters Power Supply & cable management Compare with LC922 & AC922 Extra Slides 1 2

Upload: others

Post on 10-Jun-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

1

IC922 | 9183-22X | IBM Power Systems

© Copyright IBM 2020 Version 17 – 4 Feb 2020

Presentation ContentBen Mashak IC922 Power Systems Chief EngineerGrace Liu IC922 Principal Offering ManagerNigel Griffiths EMEA Advanced Technology Support (Powerpoint editor!)

Summary• AI demands purpose-built infrastructure

• AC922 remains the best platform for deep learning and training AI models

• Using those models in production (is called Inferencing) is not as GPU intensive

• The IC922 server adds a cost efficient inference platform - on-prem or OpenShift Cloud

• Only IBM delivers an end-to-end AI solution with optimized hardware and software to meet all your business needs

Contents• GA1 Details

• Picture Gallery & Highlights• Use Cases and Sales• Single Pager• Processors• Memory• I/O diagram• Storage, I/O & GPU placement• Storage & adapter details• Acceleration adapters• Power Supply & cable management• Compare with LC922 & AC922

• Extra Slides

1

2

Page 2: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

2

IC922 | 9183-22X – InformationDates:

Announcement 28th Jan 2020

eConfig Support AvailableGeneral Availability 7th Feb 2020

IBM KnowledgeCenter manuals for IC922https://www.ibm.com/support/knowledgecenter/9183-22X/p9hdx/9183_22x_landing.htm

IBM POWER9 IC922 Server - Announcement LinksUSA https://www-01.ibm.com/common/ssi/ShowDoc.wss?docURL=/common/ssi/rep_ca/7/897/ENUS120-017/index.htmlEUROPE https://www-01.ibm.com/common/ssi/ShowDoc.wss?docURL=/common/ssi/rep_ca/2/877/ENUSZG20-0022/index.htmlCANADA https://www-01.ibm.com/common/ssi/ShowDoc.wss?docURL=/common/ssi/rep_ca/4/649/ENUSA20-0114/index.htmlJAPAN https://www-01.ibm.com/common/ssi/ShowDoc.wss?docURL=/common/ssi/rep_ca/2/760/ENUSJG20-0022/index.html ASIA PACIFIC

https://www-01.ibm.com/common/ssi/ShowDoc.wss?docURL=/common/ssi/rep_ca/9/872/ENUSAG20-0019/index.html

YouTube

IC922 Data Sheethttps://www.ibm.com/downloads/cas/LVYP6RM2 https://youtu.be/Jc6cFoj2104 https://youtu.be/KEuOAu2x97o

IC922 | 9183-22X

Let us see some picturesthen theFacts & Features

3

4

Page 3: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

3

IC922 | 9183-22X1. Power button2. UID button3. System Fault LED4. USB 3.0 port

5. 24 x 2.5” SAS/SATA Drives

HDD / SSD

6. Six Fans 7. 32xDIMM slots 8. Two POWER9 (under their heatsinks)

10. Two 2000W Power Supplies

9. Two PCIe Risers

5

6

Page 4: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

4

IC922 | 9183-22X – Storage bays & Drives

0 → 70 → 70 → 70 → 70 → 70 → 7

If no disks, you get three disk fillers to fill up the three drive bays

IC922 | 9183-22X – Storage bays & Drives

No disk bays (diskless or FC SAN disks)

1 disk bay with up to 8 drives

2 disk bays with up to 16 drives

1 disk bays with up to 24 drives

7

8

Page 5: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

5

IC922 | 9183-22XRear ViewPower, comms & Adapter Slots

PCIe Slot 5

PCIe Slot 4

PCIe Slot 3

PCIe Slot 10

PCIe Slot 9

PCIe Slot 8

PC

Ie S

lot

2

PC

Ie S

lot

1

PC

Ie S

lot

7

PC

Ie S

lot

6

Low Profile (LP)

High Profile (HP) / Full Height (FH)

Power Supplies Units• PSU1 (top)• PSU2

USB 3.03M cable

3 x Ethernet 1Gb RJ45Auto Negotiate 1000/100/10 Mbs

DedicateBMC IPMI

SharedBMC & POWER9

COM portRS232

VGA

Numbering Rear View:Left to Right and Top to Bottom

LEDs: Power, Error & Identification

Dedicated POWER9

IC922 | 9183-22XRear ViewAdapter Slots

Standard PCIe Riser Type-A

9

10

Page 6: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

6

IC922 | 9183-22X

4 Use cases“Bluffers” Guide to Inferencing1 Large Sale pre-GA1 Pager overview

IC922 | 9183-22X - Use Cases

This OpenPOWER 3rd party developed server addresses four needs:1. GPU based Inferencing AI & other HPC workloads

1. 6 GPU PCIe adapters [8 statement of direction]2. 2 TB memory3. 40 POWER9 CPU cores with SMT=44. Lower cost Inferencing partner for AI on the AC922

2. High density Storage server• 24 internal disk bays for HD, SSD plus NVMe drives

3. Cloud Server (like RHEL OpenShift)• Low cost & flexible set of resource options

4. Generic Linux / KVM VMs on POWER Server• Low cost & flexible set of resource options• KVM supported at a later date

Specialised use

or a mixed

workloads like:

Cloud (OpenShift)

with some GPU

Inferencing +

Data nodes

11

12

Page 7: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

7

Training vs. Inferencing

Source: https://news.developer.nvidia.com/nvidia-deep-learning-inference-platform-performance-study/

IBM Power AI Hardware Portfolio

IBM Power AC922

TRAIN

Powering the Fastest Supercomputer

DATA

IBM Power IC922

INFERENCE

IBM Power IC922Deploy AI into ProductionStorage Dense Server

14IBM Confidential, Statement of Direction Subject to Change

• NVMe dense server with IO rich architecture for superior throughput1

• Enterprise ready cloud deployment with RH OpenShift and PowerSystems reliability

• 2.35x superior price/performance for containerized cloud deployments

• Best training platform with 4x faster model iteration

• ~6x data throughput with NVLinkto GPUs

• Synergistic HW/SW offerings for ease of use and leadership performance

• Superior density (33%) and through-put to inference accelerators

• Open design for accelerator diversity

• Deploy inference at scale with HW and SW solution offerings

NEW! NEW!

13

14

Page 8: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

8

IBM Inference Strategy (3 Pronged Strategy)

WML-CE (Linux)

IC922(Inferencing)

Watson-ML

WML-A – Inference (Elastic Inferencing)2

AC922(Training)

WML-CE

IC922(Inferencing)

WML-CE2

Enterprise Power(CPU Only)

Watson ML-A + Inferencing Low Cost (DIY) Inference Solution

AI on Enterprise Power

Full AI Lifecycle Experience• Ease & flexibility of deployment

• Security, compliance and governance

• Advanced model management capabilities

• Business SLA for high-throughput

and accuracy

Low Cost/DIY• Open source frameworks for

DIY solution

• Dev/Test

Enterprise AI• Run inference close to data

• Leverage spare CPU capacity to

enable AI

• Provide ML inference capabilities to

key ISVs on Power

Industry Leading Inference Accelerators (GPU, FPGA, ASIC) V100 GPU

PowerAI Vision

Flexible Accelerator Technologies

ASICFPGAGPU

• Energy efficient – 70w

• Optimized for scale-out servers

• Purpose built for inferencing

• 40x better low-latency throughput than CPUs

• 2x decoding performance over prior generation GPUs

• Low batch, low latency inferencing solution for ML, video processing, genomics, analytics

• Reconfigurable to optimize for shifting workloads

• 20x versus throughput over CPU’s, 3x reduced latency over GPU’s

• Custom accelerator designed for inferencing workloads

• Designed for power efficiency andcost savings

Statement of Direction Subject to Change Statement of Direction Subject to Change

15

16

Page 9: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

9

Use Case 1

https://www.datacenterdynamics.com/news/us-army-buys-12m-ibm-supercomputer-shipping-container-will-test-tactical-edge-deployments/

IC922 | 9183-22X - Already a Success

IC922 | 9183-22X “One Pager” 9=POWER9, 2U, 2 CPU SocketsForm Factor• 19” Rack (Round or Square hole) and Height 2UPOWER9 Processor• Two 2 Sockets (no single Processor option)• CPU cores: [email protected], [email protected] or [email protected] with SMT=1, 2 or 4Memory• Direct Attached Memory DDR4 RDIMM• 32 @ 2400 MHz (double drop)• 16 @ 2667 MHz (single drop)• DIMM Sizes: 8, 16, 32, 64 GB • Max Memory: 2 TB• Peak memory Bandwidth: 340 GB/s (with single drop)Internal PCIe I/O Slots• 2 PCIe Gen4 x 16 Full Height Full Length (supports double-wide GPU)• 2 PCIe Gen4 x 16 Low Profile • 2 PCIe Gen3 x 8 FHRL (physically x16)• 2 PCIe Gen3 x 8 FHRL• 2 PCIe Gen3 x 16 LPInternal Storage• Integrated storage controller = none (use PCIe adapters):• 24 x 2.5” SAS/SATANative I/O *• 2 x USB 3.0 in rear plus 1 at the front• 1 x 1G BaseT shared POWER9 & BMC +• 1 x 1G BaseT POWER9 only +• 1 x 1G dedicated BMC IPMI• TPM 2.0 with Secure OS and Trusted Boot

OS Support – ppc64le *• RedHat RHEL 7.6-ALTRAS *• Concurrent Maintenance disks• Redundant Hot plug Power Supplies• Customer Install and Repair• Simplified Op Panel• In-rack system servers (cable management arms)BMC Service Processor• Aspeed AST2500• OpenBMCCertification• FCC Class A• ASHRAE A2 environment (10 C - 35 C)• Acoustic Data Center 1A

17

18

Page 10: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

10

IC922 | 9183-22X Summary of Statement of DirectionTaken from the IC922 Announcement

Statements by IBM regarding its plans, directions, and intent are subject to change or withdrawal without notice at the sole discretion of IBM.

IBM currently intends to enable or deliver:1. Up to 8 accelerated devices, such as NVIDIA T4s or Xilinx U50.2. Up to 24 NVMe drives. 3. OpenCAPI technology, such as the Bittware 250-SoC card.

Ask NVIDIA, Xilinx or Bittware for details of their products.

IC922 | 9183-22X

To the Details . . .

19

20

Page 11: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

11

IC922 | 9183-22X - POWER9 Processor options

Feature Code

CPU coresPer POWER9

CPU coresPer Server

SMT = 4 Threads

Base Frequency

Boost Frequency

EK00 12 24 96 2.0 GHz 3.8 GHz

EK01 16 32 128 3.35 GHz 4.0 GHz

EK02 20 40 160 2.9 GHz 3.8 GHz

Note: Both POWER9 CPU sockets must be configured with the same feature codeSimultaneous Multi Threaded Settings (SMT) = 1, 2 and 4

IC922 | 9183-22X - Direct Attached Memory DDR4 RDIMM

Feature Code

Size 4DIMMs

8DIMMs

12DIMMs

16DIMMs

24DIMMs

32DIMMs

EM62 16 GB 64 GB 128 GB 192 GB 256 GB 384 GB 512 GB *

EM63 32 GB 128 GB 256 GB 384 GB 512 GB * 768 GB 1024 GB

EM64 64 GB 256 GB 512 GB * 768 GB 1024 GB 1536 GB 2048 GB

Notes:All Registered DIMMs must be the same sizeNumber of memory DIMMS: 4, 8, 12, 16, 24 or 32 – onlyThe System Planar and internal air baffle clearly shows the DIMM slot numbersAlthough called “Industry Standard” (IS) these must be purchased from IBM- If non-IBM memory is present, it needs to be removed before requesting IBM hardware supportMemory bandwidth: 4 to 16 DIMMs @ 2666 Gb/s. Above 16 DIMMs @ 2400 Mb/s (double drop).Recommended:- Populate 16 slots for maximum bandwidth 340 MB/s- Populate all 32 sockets for maximum size of 2 TB or sizes above 1 TB

Note: €$£ per GB for all three sizes of DIMM are VERY similar (no largest size premium)

Recommended

21

22

Page 12: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

12

IC922 | 9183-22X - Memory PlacementDIMM slot numbers

CPU 0 CPU 1Planar with clear numbering

Feature Code

Number Description

EKMP 2 AC Power Supply, 2000W 220 VAC input, C20 socket

No single PSU option

IC922 | 9183-22X – AC Power Supply

IC922 | 9183-22X – Cable Management Arm (CMA)

Feature Code

Number Description

EC3Z 1 Rack cable management arm, CMA, for MT 9183

Default and recommended for Maintenanceand not having to remove all rear cables for access to fans, adapters, memory, CPU, clock battery, etc.

Rack rails (compatible with round or square hole racks) allowing in-rack service

23

24

Page 13: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

13

IC922 | 9183-22X

Storage

IC922 | 9183-22X - Storage Bays

There are no built-in Storage controllers, Drive bays or Drives Each Storage Bay can be a different type & needs a matching adapter

Storage free (network install OS) or FC based disks are options too

EK3A Storage filler (default)– fills one 8 bay

EK36 2.5" SAS/SATA Backplane with Power Cable + 8 Drive Carriers (8 Drives)- 0 to 3 of these

Three Drive Bays of 8 drives SAS or SATA & HHD or SSD

25

26

Page 14: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

14

IC922 | 9183-22X - Storage PCIe Adapters

There is no built-in Storage adapter So you get to select your choice & place in PCIe slot

Code LP

Code FH

Vendor PCIe Gen Technology Cables Drives Description

EK41 Broadcom 3 x 8 SAS/SATA 2 8 9300-8i SAS/SATA HBA

EK43 Broadcom 3 x 8 SAS/SATA 4 16 9305-16i SAS/SATA HBA

EK47 Broadcom 3 x 8 SAS 2 8 MegaRAID 9361-8i (2GB Cache)*

SAS3 Controller with 8 internal ports (2 GB Cache) PCIe 3.0 x8 with cables

EKWD EKWD Broadcom * Self-encrypting unlock kit (Hardware Key) for MegaRAID 9361-8i

LP = Low ProfileFH = Full Height also called High Profile

HDD Size GB Type HDD Technology Line Speed Format

EK1A 600 2.5” 10K RPM SAS SED 12 Gb/s 4Kn/512e SED

EK1B 1200 2.5” 10K RPM SAS 12 Gb/s 4Kn/512e SED

EK1C 2400 2.5” 10K RPM SAS 12 Gb/s 4Kn/512e NonSED

SSD Size GB Type Solid State Technology Line Speed DWPD Drive Writes/day

EK20 240 2.5” SSD SATA 6Gb/s 1.4 NonSED

EK21 960 2.5” SSD SATA 6Gb/s 2.5 NonSED

EK22 1920 2.5” SSD SATA 6Gb/s 2.5 NonSED

EK23 3840 2.5” SSD SATA 6Gb/s 2.5 NonSED

EK27 3840 2.5” SSD SAS 12Gb/s 1 NonSED

GA1 IC922 | 9183-22X - Storage Drives

SED = Self Encrypting Disks NonSED = Non-Self Encrypting Disks

4Kn = 4 KB blocks512e = 512 byte blocksIndustry trend is toward the 4KB

27

28

Page 15: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

15

IC922 | 9183-22X – Storage options: 8x SAS/SATA

Disk Adapter9300-8iin Slot5

880, 800 mm are the length of the cables

IC922 | 9183-22X – Storage options: 24x SAS/SATA

Disk Adapter9305-16i9300-8i

in slots 5 & 10

580, 650, 880, 800 mm are the length of the cables

29

30

Page 16: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

16

IC922 | 9183-22X

Adapters for I/O

IC922 | 9183-22XBlock DiagramStandards Riser

Double-wide slot

Double-wide slot

Note Upstream BW limitation

POWER9

POWER9

31

32

Page 17: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

17

Code LP

Code FH

Vendor Ports Speed Gb/s

Type PCIe CAPI Description

EL43 EL5B Broadcom 2 16 Fibre Channel Gen3 x8 no LPe16002B-M6

EL5V EL5U Broadcom 2 32 Fibre Channel Gen3 x8 no LPe32002-M2

GA1 IC922 | 9183-22X - Fibre Channel

LP = Low ProfileFH = Full Height also called High Profile

Code LP

Code FH

Vendor Ports Speed Gb/s

Type PCIe CAPI Description

EC62 Mellanox 1 EDR 100 IB CONNECTX-5 Gen3 x 16 YES MCX555A-ECAT

EC64 Mellanox 2 EDR 100 IB CONNECTX-5 Gen4 x 16 YES MCX556A-ECAT

EC67 Mellanox 2 100 ROCE EN CONNECTX-5

Gen4 x 16 no MCX516A-CDAT

GA1 IC922 | 9183-22X – Mellanox Network Adapters

LP = Low ProfileFH = Full Height also called High Profile

Note Two port adapters are Low Profile & Gen 4 & x16 lanesso limited to two adapters slots (1 and 6) in GA1

33

34

Page 18: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

18

Code LP

Code FH

Vendor Ports Speed Gb/s

Type PCIe CAPI Description

EC62 Mellanox 1 EDR 100 IB CONNECTX-5 Gen3 x 16 YES MCX555A-ECAT

EC64 Mellanox 2 EDR 100 IB CONNECTX-5 Gen4 x 16 YES MCX556A-ECAT

EC67 Mellanox 2 100 ROCE EN CONNECTX-5

Gen4 x 16 no MCX516A-CDAT

EL3Z EL55 Marvell 2 2x10/1 Ethernet BaseT RJ45

Gen3 x8 no BCM957810A1008ICDM

EN0T EN0S Marvell 2 + 2 1/10 Ethernet 2x1 2x10SR & RJ45

Gen3 x8 no BCM957800A1006ICDM

EN0V EN0U Marvell 2 + 2 1/10 Ethernet 2x1 2x10SFP+ RJ45

Gen3 x8 no BCM957800A1006ICDM

EL4M EL4L Broadcom 4 1 Ethernet 4 x 1 Gbs Gen1x4 no BCM5719-4P

GA1 IC922 | 9183-22X - Network Adapters

LP = Low ProfileFH = Full Height also called High Profile

IC922 | 9183-22X

Adapters for Acceleration

35

36

Page 19: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

19

IC922 | 9183-22X - Accelerators

Code LP

Code FH

Vendor PCIe Gen Technology Description

EK4L EK4M NVIDIA Gen3 x 16 RAM 16GB NVIDIA Tesla T4 GPUPN=900-2G183-0000-000

NoteLP and FH optionsNVIDIA T4 is a PCIe Gen 3 x 16 Adapter- Works fine in a Gen 4 x 16 slot- IC922 also ready for any future Gen 4 GPU

(not an announcement)- NVIDIA T4 = 70 Watts

IC922 does not use the higher bandwidth- AC922 NVIDIA V100 NVLink for CPU GPU data- NVIDIA V100 = 300 Watts

T4

T4

T4

T4

T4

T4#1 #2

#3 #5 #4 #6

T4 GPU PCIe Adapter Placement (max = 6)

NoteNVIDIA T4 plug order = Yellow numbers highlight the placement order in eConfig Red bordered GPU #5 and #6 are half bandwidth slots

(See earlier Block Diagram PCIe Gen3 x 8 switches)

Six GPUs assume no other highspeed adapters (high speed slots are used)And you need slots for network and possible storage adapters

37

38

Page 20: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

20

IC922 | 9183-22X – Take care with the adapter mix

You may be thinking:• 10 adapters slotsSo1. 6 x T4 GPU2. 2 x 100 Gb Mellanox Network3. 2 HBA’s to have all the disks available

(immediately or later)

Will not work in GA1Mellanox adapters only go in the LP slots& 2 of the 6 GPUs must go in those slots

4 GPUs and 2 Mellanox M

ell

an

ox

10

0 G

b T4

T4

Me

lla

no

x1

00

Gb

T4 T4#

1

#2

FH Gen4 x16LP Gen3 x8

LP Gen3 x8FH Gen4 x16

LP Gen4 x16

LP Gen4 x16

LP Gen4 x16 LP Gen4 x16

+ 8 disks + 16 disks

IC922 | 9183-22X - Physicals

Size: • 19 Inch Rack & 2U high

Temperature: • 10C to 35C - ASHRAE Class A2

Altitude: • 0 to 3050 meters

Max Weight: • 30.9kg (68lbs)

Install OS options:• Red Hat RHEL 7.6 via . . .• USB memory flash key 3.0• USB based DVD• BMC network to remote media• Network install

Electrical Power: • AC Power Supply • 2000W 220 VAC input• C20 connector

39

40

Page 21: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

21

IC922 | 9183-22X Customer Replaceable Units (CRU) Tier 1 = IBM will charge for a CE

• Hard disk drive• Optical drive• Fan• Fan Cage• I/O adapters• Operator panel• Operator panel cable• PCI adapters• Power cord• Power supply• Processor power regulator

• Service processor• RAID card cable• Memory DIMMs• Native USB Serial Card• Keyboard, Mouse, Display• External cables• Sheet metal trays and dividers• Planar• Air duct• Heat sinks• Rails

Tier 2: You can replace or IBM will replace at no chargeServicing the IBM Power System IC922 (9183-22X) Guide http://public.dhe.ibm.com/systems/power/docs/hw/p9/p9iaf_service_9183_22x.pdf

IC922 LC922 (9006-22P)Max # of cores 40 SMT=4 44 SMT=4

# of sockets and SMT 2 1-2

Maximum Boost Frequency 4.0 GHz (16c) 3.8 GHz (16c)

Power TDP per CPU 225W or 160W (12c) 190W

memory channels per CPU 8x DDR4 (16 in total) 4x DDR4 (8 in total)

DDR 4 32x DIMM connectors 2666 MHz DIMM 16x DIMM connectors 2666 MHz DIMM

Max Peak Memory BW per CPU 170 GB/s (340 GB/s total) 85 GB/s

Max Memory 2 TB 1 TB

SMP Bus Fabric ~120 GB/s peak x 2 ~60 GB/s peal x 2

Drives 24x 2.5" 12x 3.5"/2.5"

PCIe slots 10 Integrated I/O Slots 6 Integrated I/O Slots

Inference Accelerators 6 NVIDIA T4 GPU (SOD for 8), FPGA, ASIC None

OpenCAPI 4 None

Integrated SAS/SATA None (use adapter slots) Microsemi PM8069 providing 16x SAS/SATA

Integrated network 2x 1Gb (one shared) + dedicated IPMI 4x 10G baseT (one shared) + dedicated IPMI

PSU 2.0kW, 1+1, C20 receptacle 1.6kW, 1+1, C14 receptacle

Full extension rail Standard (round + square hole) Optionally available

Cable Management Arm Standard Optionally available

41

42

Page 22: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

22

IC922 (9183-22X) AC922 air-cooledMax # of cores 40 SMT=4 40 SMT=4

# of sockets and SMT 2 2

Maximum Boost Frequency 3.8 GHz (40 core) 3.0 GHz (40 core)

Power TDP per CPU 225W or 160W (12 core) 190W (16 core)

memory channels per CPU 8x DDR4 (16 in total) 8x DDR4 (16 in total)

DDR 4 32x DIMM connectors 2666/2400 MHz DIMM 16x DIMM connectors 2666 MHz DIMM

Max Peak Memory BW per CPU 170 GB/s (340 GB/s total) 170 GB/s (340 GB/s total)

Max Memory 2 TB (32 x 64 GB) 2 TB (16x 128 GB)

SMP Bus Fabric 64 GB/s peak x 2 64 GB/s peak x 2

Drives 24x 2.5" 2x 2.5"

PCIe slots 10 Integrated I/O Slots 4=Gen4x16 + 6=Gen3 4 Integrated I/O Slots 2=Gen4x16 +x8 +x4

Inference Accelerators 6 NVIDIA T4 GPU 16GB (SOD for 8), FPGA, ASIC NVIDIA V100 with NVlink 16/32 GB RAM

OpenCAPI 4 4

Integrated SAS/SATA None (use adapter slots) Microsemi PM8069 providing 16x SAS/SATA

Integrated network 2x 1Gb (one shared) + dedicated IPMI 4x 10G baseT (one shared) + dedicated IPMI

PSU 2.0kW, 1+1, C20 receptacle 2.2kW, 1+1, C20 receptacle

Full extension rail Standard no

Cable Management Arm Standard no

IC922 Inferencing Cloud Highlights

19” Rack, 2 Socket 2U Form Factor

OpenPOWER partner design

Two POWER9 chips with SMT4 capability – up to 40 CPU cores

Increased processor core performance – up to 4 GHz

Memory

2 TB maximum system memory 16 DDR4 ports at 2666Mhz = 340 GB/s peak bandwidth 32 DDR4 RDIMM slots for maximum 2TB

10 PCIe Slots

Support for up to 6 Nvidia T4 GPUs [8 T4 SOD]

Additional accelerator options planned [more OpenCAPI adapters]

24 SFF (2.5”) Storage bays

SAS/SATA [NMVe SOD]

Max internal 93 TB

Linux-Only system with BMC

RHEL 7.6 alt

Advantages vs x86: POWER9 doubles x86 performance Accelerator Support

Six GPU adapters PCIe Gen4 & OpenCAPI

33% better I/O BW Memory Bandwidth 50% better

Workload Focus: Accelerated & Inferencing GPUs Memory/IO-intensive Linux apps Data storage - 92 TB internal Cloud, Docker KVM support (later)

SOD = Statement of Direction

43

44

Page 23: IC922 | 9183-22X | IBM Power Systemspublic.dhe.ibm.com/systems/power/community/aix/... · IBM Power AI Hardware Portfolio IBM Power AC922 TRAIN Powering the Fastest Supercomputer

05/02/2020

23

Notices and disclaimers

© 2019 International Business Machines Corporation. No part of this document may be reproduced or transmitted in any form without written permission from IBM.

U.S. Government Users Restricted Rights — use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.

Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. This document is distributed “as is” without any warranty, either express or implied. In no event, shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. IBM products and services are warranted per the terms and conditions of the agreements under which they are provided.

IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”

Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.

Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.

Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.

It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer follows any law.

Notices and disclaimers continued

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products about this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM expressly disclaims all warranties, expressed or implied, including but not limited to, the implied warranties of merchantability and fitness for a purpose.

The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right.

IBM, the IBM logo, ibm.com and [names of other referenced IBM products and services used in the presentation] are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml

45

46