unisys imagine it. done. systems integration. outsourcing. infrastructure. consulting. server...

unisysImagine it. Done.

Systems Integration.Outsourcing.Infrastructure.

Consulting.Server Technology.

The Thoroughly

Modern Mainframe

Dr. Michael Salsburg

NTSMF Users' Group

Dec 9, 2002

Imagine it. Done.unisys

Agenda

Large Scale WINTEL Servers Disruptive technology or trend?

Scale Up or Scale Out ? A Workload-motivated discussion of

SMP and CC-NUMA PCI-Based I/O Consolidation Emerging Technologies


Server Industry TrendsIntel Server Market Position

0%

20%

40%

60%

80%

100%

1995 1996 1997 1998 1999 2000 2001 2002 2003

Ma

rke

t S

ha

re

Units Dollars

Microsoft Windows NT Server Market

0%

20%

40%

60%

80%

1995 1996 1997 1998 1999 2000 2001 2002 2003

Mar

ket

Sh

are

Units Dollars

Source: IDC

Intel will dominate server chip market

Windows 2000 will be pervasive server OS


Unisys ES7000 Aries 230

Unisys ES7000 Orion

Egenera Blade

Frame

HP ProLiant DL760

HP rp8400

IBM eServer

x440

Processors Supported

Intel Xeon

1.4, 1.6 GHz

Intel Xeon

1.4, 1.6 GHz

Intel Xeon

1.4, 1.6 GHz

Intel Xeon

Pentium

700, 900 MHz

HP PA-8700

750, 875 MHz

Intel Xeon

1.4, 1.5, 1.6

GHz

Max Procs 16 32 96 8 16 8 ,16 by 2002

Max Mem 32G 64G 288G 16G 64G 64G

Max PCI Slots

48 96 12 10 16 72

The x440 CompetitionGartner Oct 2002


Comparison of CPU Speed and tpcM

1

10

100

Oct-95 Mar-97 Jul-98 Dec-99 Apr-01 Sep-02

Submittal Date

Speed (100Mhz)

Rating(K tpmC)

18MonthRt

A Comparison using Moore’s Law

Comparison of CPU Speeds / tpcM for 4x cpu WINTEL systems


Rank Company System tpmC Price/ tpmC System

Availability Database

Operating System

TP Monitor

Date Submitted

1

PRIMEPOWER 2000 c/s w 66 Front-

Ends 455,818 28.58 US $ 02/28/02

SymfoWARE Server

Enterp. Ed. VLM 3.0

Sun Solaris 8

BEA Tuxedo

6.5 CFS 08/28/01

2

HP 9000 Model Superdome

Enterprise Server 423,414 15.64 US $ 08/26/02

Oracle 9i Enterprise Database

Server 9.2.0.1

HP UX 11.i 64-bit

BEA Tuxedo

8.0 08/26/02

3

IBM eServer pSeries 690 Turbo 7040-681

403,255 17.80 US $ 11/22/02

Oracle 9i R2 Enterprise Edition

IBM AIX 5L V5.2

Websphere App.

Server Ent.

Edition V 3.0

08/15/02

4

HP 9000 Superdome Enterprise Server

389,434 16.41 US $ 05/15/02

Oracle 9i Database Enterprise Edition

HP UX 11.i 64-bit

BEA Tuxedo

6.4 12/21/01

5

NEC TX7/i9510 C/S with

Express5800/120Rd-2

308,620 14.96 US $ 12/31/02

Microsoft SQL Server

2000 Enterprise Ed. 64-bit

Microsoft Windows

.NET Server 2003

Datacenter Edt.

Microsoft COM+

09/09/02

TPC-C Top 10


Rank Company System tpmC Price/ tpmC System

Availability Database

Operating System

TP Monitor

Date Submitted

6

Compaq AlphaServer

GS320 230,533 44.62 US $ 07/30/01

Oracle 9i Database Enterprise Edition

Compaq Tru64 UNIX

V5.1

Compaq DB Web

Connector V1.1

06/18/01

7

PRIMEPOWER 2000 c/s w /32 Front Ends

222,772 43.42 US $ 06/30/01

SymfoWARE Server

Enterp. Ed. VLM 3.0

Sun Solaris 8

BEA Tuxedo 6.4 CFS

04/13/01

8

IBM eServer pSeries 680

Model 7017-S85

220,807 29.30 US $ 04/13/01

Oracle 8i Enterprise Edition v.

8.1.7

IBM AIX 4.3.3

Websphere App. Server Ent. Edition

V 3.0

06/22/01

9

Unisys ES7000 Orion Enterprise

Server 203,518 13.18 US $ 03/31/03


2000 Enterprise Edition

Microsoft Windows

.NET Server 2003

Datacenter Edt.

Microsoft COM+

11/04/02

10

Unisys e-@ction Enterprise

Server ES7000 165,218 21.33 US $ 03/10/02


2000 Enterprise Edition

Microsoft Datacenter

Server Limited Edition

Microsoft COM+

11/11/01


Scale Up or Scale Out?

Two of the 3-tiers in current application architectures use scale-out for growth Increase # of Web servers Increase # of Application Servers Database back end cannot be scaled out

Scale up is needed for large database applications

Scale out has some inherent down sides additional administrative/management attention Move “headroom” needed for heavy traffic


SMP / NUMA Workload Discussion

As code executes on the processor, memory is referenced. This can be broken into three regions

High Locality of Reference Memory is immediately re-referenced (> 95%)

Working Set – the set of addresses on which the software primarily focuses

Persistent Storage – addresses that are stored on physical devices High Locality of Reference

Working Set

Persistent Storage


Scale Out- SMP or NUMA? Workload Interference

When two processes are running on the same system, their memory references will interfere.

It is preferable to only interfere at the persistent storage level Interference at higher levels can decrease cache efficiency

and slow down processing, effectively reducing the CPU power


SMP / NUMA SMP Topology

A bank of CPUs share a bank of Memory Each CPU has a local cache to optimize high locality of

reference A cache miss has uniform latency time to get data from

memory “Dirty” memory references require fetching the updated

memory from another CPU’s cache The CPU can “stall” waiting for a memory reference

cpu

cache

memory


SMP / NUMA Workload Discussion

Percentages of references based on TPC-C workload profile

Relative time units show orders of magnitude between cache hit and persistent storage

Reference Level Percentage

CPU Cache 98.0%

Main Memory 01.9%

Persistent

Storage00.1%

Reference Level

Time Units

CPU Cache 1

Main Memory 100

Remote Cache 200

Persistent

Storage10,000


SMP / NUMA NUMA (Non-Uniform Memory Access)

Overcome bus congestion and physical fabrication limitations found in a single bus architecture

Two memory latencies – near and far The NUMA ratio is the ratio of far latency over near latency

Originally 30, now it is around 3

cpu

cache

memory


SMP / NUMA Hybrid (Unisys ES7000)

Another level of cache is introduced Memory accesses can be non-uniform when comparing Next

Level Cache hits to memory references Overcomes the fabrication/congestion problems of a single

bus architecture

cpu

cache

memory

Next Level Cache

Crossbar


PCI-Based I/O

Cellular MultiProcessing (CMP) Architecture


PCI-Based I/O

2001 & earlier 2002 2003 2004 2005

1

4

3

2

533MHz

266

PCI-X

16X, or8X@5Gb

PCI-Express

GB

/se c

Max

B

us

or p

er d

i rec

tion

133

66

1X4X8X

PCI

Hyp

erT

rans

port

6.4 GB

0.8 GB

6.4 GB

SP2

SP1

Scalability Port


Enterprise-Level Backup / Restore


Enterprise-Level Backup / Restore

Complete recovery of a 2.5 terabyte database: From tape, the database was recovered in only 88

minutes with a sustained throughput during restore of 2.2 TB/hr.

From the hardware snapshot, the same database was recovered in only 11 minutes.

Complete backup of a 2.5 terabyte database: Backup to tape took only 68 minutes with minimal

impact on online operations and sustained throughput of 2.6 TB/hr.


Consolidation

"[Our] servers were multiplying like rabbits," says Jeff Smith, manager of corporate network services at La-Z-Boy Inc., a Monroe, Mich.-based residential furniture producer that just completed a Windows NT server consolidation project. "Our distributed environment was becoming more and more difficult to manage."

Thinning The Server RanksComputerworld Aug 26, 2002


Consolidation

How do you stuff over 130 CPUs’ worth of workload into a 32x CPU system?

Veeerrrry carefully……

Why are current server farms filled with under-utilized servers?

Web Hosting Sites “New web servers are installed when Peak CPU utilization

reaches above 35%.” “Speed and reliability are very important to your web site.

All of our servers are maintained at less than 15% CPU utilization. This ensures that your web site downloads as fast as possible!”


ConsolidationResponsive Consolidation

Which would you prefer – an average queue size of 0.2 on a 1x or a 32x system?

Response Factor

0

0.2

0.4

0.6

0.8

1

0

10

20

30

40

50

60

70

80

90

10

0

Utilization

1x

4x

8x

16x

32x


ConsolidationBenefits

Simplified Management / Administration Higher Utilization (less “headroom”) Less Variability of Service Less Overall CPU Overhead Less software licenses


Emerging CPU Technologies32x INTEL CPU TPC-C Results

Date Published

tpm-C Chip Speed Cache Memory

11/11/2001 165,218 Pentium III Xeon

900MHz 2MB 64 GB

9/9/2002 308,620 Itanium II 1GHz 3 MB 256 GB

11/4/2002 203,518 Pentium IV Xeon

1.6 GHz 1 MB 64 GB


Itanium IIWhat’s so great about 64 bits?

For transaction processing, memory addressing is increased and therefore the amount of main memory increases

The top 5 TPC-C results were achieved using 64 bit computing

TPC-C is a large database application – this is a sweet spot for 64 bit commercial computing

Bigger is DEFINITELY Better!!

unisys imagine it. done. systems integration. outsourcing. infrastructure. consulting. server...

Documents

unisys slide

unisys consolidation

unisys unisys es7000

memory reference slide

unisys smp numa smp

cpu power slide

unisys tpcc

unisys enterpriselevel