14th April 1999 Hepix 1999 1

Oxford Particle Physics Site Report

Pete Gronbech

Systems Manager

14th April 1999 Hepix 1999 2

Server based computing

Low Cost Seats Central Unix Server Central VMS Server Central Mail Server Central Web Server

14th April 1999 Hepix 1999 3

Goals and Objectives

Flexibility on the Desktop Access to networked services (X, http, IMAP) Access to PC Applications Reduce management overheads Reduce costs

Servers provide Compute power Compatibility with CERN / DESY Provide Code development environments

14th April 1999 Hepix 1999 4

The Server / Desktop Divide

NT PC NT PC NT PC NT PCUnix

Workstation

Des

ktop

sS

erve

rs

General Purpose Unix Server

VMS Server

Mail Server

Web Server

NTServer

14th April 1999 Hepix 1999 5

Goals and Objectives 2

Aim to standardise and centralise as much of the IT infrastructure as provides real benefit across whole department.

Aim to provide HEP specific computing on top of basic infrastructure - basically compute servers

Desktop Strategy - Windows NT Workstation (80 particle physics 200 across physics) MS Office, eXceed, Web browsers, Mail clients etc. Systems generated by cloning (with GHOST) and used by wide range of users

Server Strategy - HEP Computation - Heavy use of remote compute farms, local compute server (Digital UNIX 3 CPU server) for interactive work especially code development. Recently Linux for CDF group

14th April 1999 Hepix 1999 6

Linux

NT PC NT PC NT PC NT PCUnix

Workstation

Des

ktop

sS

erve

rs

CDF Linux

(Dual 400MHz PII)

RAL Linux Farm Porting

Machine

Treat Linux as just another Unix and hence a server OS to be managed centrally.

Wish to avoid badly managed desktop PC’s running Linux.

14th April 1999 Hepix 1999 7

Goals and Objectives 3

Server Strategy - IT in general - NT server (6) for desktop file/print, Exchange 5.5 for email, IIS 4 for web serving, Ntrigue for network access to PC applications. Just installed MS Terminal Server to give NT 4 remote access to replace Ntrigue.

VMS - DAQ systems still important but general purpose service is running down (mail, word processing etc going to NT)

Data Acquisition - LABview on NT for most laboratory DAQ and control (used by wide range of research groups)

Videoconferencing - PC based Intel plus access to ISDN6 Tandberg. MS Netmeeting used frequently to DESY

14th April 1999 Hepix 1999 8

Particle and Nuclear Physics Main Unix Systems

/, /usr

/userdisk2

Alpha 3000/400

File ServerCPU ServerMail Server

al9

/userdisk3 /freedisk /system

/freelong /datastorage2

/datastorage1/zeusdisk2/zeusdisk3/zeusdisk4

/lhcdisk/lhcdisk2/lhcdisk3/snodisk2

/snodisk

/zeus /userdisk1

/usr/local

/ltdata

Alpha3000/400

al2

al3Alpha 3000/400

Personal Workstation500au

Personal Workstation500au

Alpha 3000/400

5.10.98 PDG

al18

al17

al4

4.0GB 4.0GB

4.0GB 4.0GB

4.0GB 4.0GB

4.0GB 4.0GB

9.0GB

4.0GB 4.0GB

4.0GB 4.0GB

4.0GB

1.0GB

1.0GB

1.0GB

1.0GB

4.0GB

4.0GB

1.0GB

al6

al14

al11

al1

Alpha 3000/300

N.West A.Fox

J.Tickner

D.Waters

Graphics Area

J.Edmonds

PDG

M.ThormanX.Chen

S.Biller

Alphastation 200 4/166

Alphastation 200 4/166

Alphastation 3000/400

Alphastation 200 4/166

Alphastation 200 4/166

Alpha Server2100 5/250

1.0GB

1.0GB

1.0GB

2.0GB

2.0GB

re0 (RZ26)

re4 (RZ26)

re2 (Barracuda 4) re6 (Quantum 4)

re2 (Hawk 4) re3 (Hawk 4)

rz8 (Barracuda 9)

re3 (Barracuda 4) re7 (Quantum 4)

re2 (Hawk 4)

re1 (Barracuda 4) re6 (Quantum 4)

re1 (Hawk 4) re3 (Hawk 4)

re5 (Barracuda 4) re7 (Quantum 4)

Alpha 3000/300

al7 al15

al12

1.0GB 1.0GB

1.0GB

Alpha 3000/300

al8 al161.0GB 1.0GB

Approx 164GB Total Disk Storage3 250MHz CPU's

512MB memory

OSF1 V4.0d

CD ROM

DLT

DAT Drive

Exabyte 8505

/dev/nrmt2h

/dev/nrmt1h

/dev/nrmt0h

3COM Linkswitch 300010/100Mb/s

100Mb/s

100Mb/s

14th April 1999 Hepix 1999 9

PerformanceCPU Performance SPEC 95

0

5

10

15

20

25

30

35

Pen

tium

100

Pen

tium

166

Pen

tium

Pro

166

Pen

tium

Pro

200

Pen

tium

II 4

00

SU

N S

parc

stat

ion

2

(

s1)

SU

N S

parc

stat

ion

10/3

0 (

s11)

SU

N S

parc

stat

ion

20/5

0 (

s18)

SU

N S

parc

stat

ion

20/6

1

SU

N U

ltra-

1 14

0

SU

N U

ltra-

1 17

0e

SU

N U

ltra-

2 11

70

SU

N U

ltra

5

Sun

Ultr

a 10

Sun

Ultr

a 30

Sun

Ulta

r 60

Mod

el 2

300

Sun

Ulta

r 60

Mod

el 2

360

Alp

ha s

tatio

n 30

00/3

00

( al

6 -

8 )

Alp

ha s

tatio

n 30

00/4

00

( al

2,3,

4,9

zuka

l01

)

Alp

ha s

tatio

n 20

0 4/

166

( a

l11

- 16

)

Alp

ha s

tatio

n 25

0 4/

266

(zuk

al07

)

Alp

ha s

tatio

n 25

5/23

3

Alp

ha s

tatio

n 60

0 5/

266

Alp

ha s

tatio

n 60

0 5/

333

Alp

ha s

tatio

n 60

0 5/

500

Per

sona

l Wor

kstn

. 433

au

Per

sona

l Wor

kstn

. 500

au

Per

sona

l Wor

kstn

. 600

au

Alp

ha s

erve

r 21

00 5

/250

(al

1)

Workstations

SP

EC

95

Spec int95

Spec fp95

14th April 1999 Hepix 1999 10

Standard NT PC Clone circa 1995

Pentium 100MHz 1GB Hard Disk 16MB Memory Quad Speed CD Rom Sound Capability Diamond Stealth 64 DRAM 17” iiyama Colour Monitor 10Mb/s Network Card

Hardware

Custom Built to our specfor about £1.6K inc. VATand Software Licenses

14th April 1999 Hepix 1999 11

Standard NT PC Clone circa 1999

Pentium II 350MHz 8GB Hard Disk 128MB Memory 32 Speed CD Rom Sound Capability AGP Rage Pro Graphics 17” iiyama Colour Monitor 100Mb/s Network Card

Hardware

Custom Built to our specfor about £1.2K inc. VATand Software Licenses

14th April 1999 Hepix 1999 12

Network Access

al?

al? al?

al?

al?

al?

The Internet

r series commands restricted to within pnp subnet.

No telnet, ssh, or ftp access from outside subnet.

Use telnet or ssh to accessal1.physics.ox.ac.uk from outside the pnp subnet

pnp subnet163.1.243.x163.1.244.x

al1

14th April 1999 Hepix 1999 13

Physics Department Mail Organisation

Clarendon Users.Majority use femail.Some on IndividualUnix machines.Now migrating toExchange.

MildredAbacusetc

femail mailexchng1

Internet

TeachingAstro AtmosTheory

AV1

al1

Particle and NuclearPhysics.Users migrating toExchange Server

Incoming mail to emailaddresses of the formj.bloggs1@physics.ox.ac.ukAll go to mail, where they aredirected to the relevant mailboxes.

14th April 1999 Hepix 1999 14

Plans and Concerns

Look to replace local compute server in 1999 (Alpha?)

NT4 provides all desktop functionality we need. Will look at NT5 /NT2000 but no rush.

choice of OS/platforms for computation. (if Linux which version?)

cost of software licensing

14th April 1999 Hepix 1999 15

Conclusions

Unix servers dictated by experimental collaborations

Standardised NT PC Clone Less variables - Simpler to manage

Commodity Hardware and Software More cost effective

Minimise the systems management