efi.uchicago.educi.uchicago.edu

FAX update

Rob Gardner

Computation and Enrico Fermi InstitutesUniversity of Chicago

Sep 9, 2013

efi.uchicago.educi.uchicago.edu2

FAX Activities Overview

• Start from https://twiki.cern.ch/twiki/bin/view/AtlasComputing/MonitoringFax – Several notable issues in the SSB requiring attention

• Xrootd 3.3.3 and N2N updates– https://twiki.cern.ch/twiki/bin/view/AtlasComputin

g/Xrootd333Upgrade

– The status table shows a long way to go before this is finished.

efi.uchicago.educi.uchicago.edu3

Functional testing notification

• Problems are now reported to ADC cloud support lists on a daily basis

• Need to change to HC-like offline-online notification– Necessary before going into production

efi.uchicago.educi.uchicago.edu4

Stress testing

• Jobs from Ilija submitted using the HC framework• Submitted jobs to US ANALY queues and CERN_PROD• Conditions at each queue:

– Batch of 10 jobs, each coping data from from 7 remote sites– Each job xrdcp’s 10 ~4.5 GB files, randomly chosen from SMWZ FDR data– Total ~ 2.2 TB data to transfer in 70 parallel transfers

• Time to finish, events/s, MB/s for each job & Panda IDs so jobs can be investigated

• All jobs submitted through FDR web interface– http://ivukotic.web.cern.ch/ivukotic/FDR/index.asp

• n.b. we cannot in practice “guarantee” simultaneous starts of jobs, but the workload should be indicative of what generally could be expected.

• Speeds presented are averages per file, aggregates per link are x10.

efi.uchicago.educi.uchicago.edu5

Stress testing US + CERN

AGLT2 BNL_ATLAS BU CERN-PROD MWT2 OU_OCHEP_SWT2 SWT2_CPB0

20

40

60

80

100

120XRDCP US + CERN AGLT2

BNL-ATLAS

BU

CERN-PROD

MWT2

OU_OCHEP_SWT2

WT2

SOURCES

MB/

s

XRDCP MB/s destinationAGLT2 BNL_ATLAS BU CERN-PROD MWT2 OU_OCHEP_SWT2 SWT2_CPB

source

AGLT2 28.54 51.26 1.53 0.57 16.21 64.65 20.27BNL-ATLAS 26.55 81.22 2.97 8.92 14.22 20.28 5.73

BU 15.06 75.92 58.12 2.91 1.44 36.95 10.06CERN-PROD 1.65 24.82 1.15 82.33 1.89 12.66 11.04

MWT2 8.17 57.08 1.44 1.4 87.87 37.64 4.21OU_OCHEP_SWT2 108.83 78.63 68.78 0 88.26 0 9.64

WT2 5.33 7.2 0.68 1.69 6.11 14.73 7.39

Observations & questions• BNL the best as

destination• OU_OCHEP_SWT2

shows great results but was unable to serve to CERN or itself

• AGLT2 was faster to read from OU than itself

• Even using CERN as source or destination is not unreasonable

efi.uchicago.educi.uchicago.edu6

Stress testing T1s

Observations:• Very nice

rates• The only

problematic connection INFN-T1 to FZK

BNL-ATLAS CERN-PROD FZK INFN-T1 RAL0

10

20

30

40

50

60

70

80

90 XDRCP between T1s BNL-ATLASCERN-PRODFZKIN2P3-CCINFN-T1PIC

Source

MB/

s