bnl’s role in atlas howard gordon doe annual hep review brookhaven national lab april 17-19, 2006

BNL’s Role in ATLAS

Howard Gordon

DOE Annual HEP Review

Brookhaven National Lab

April 17-19, 2006

H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006

20 dipoles/week being installed -> 25/week in March leads to a magnet installation completion in Feb. 2007

LHC Machine Status from Dashboard


Lyn Evans said in 2/06, the objective for 2007 is 75 ns operation with 1032


BNL’s Role in ATLAS Overview of BNL Role in ATLAS H. Gordon

U.S. ATLAS Analysis Support Center BNL Role in US ATLAS Management BNL Role in Construction & Research program

Construction/Installation/Commissioning/ATLAS Upgrade D. Lissauer

Construction / Installation / Commissioning: Liquid argon calorimeter Cathode strip chambers (Muon system) ATLAS Technical Coordination

ATLAS upgrade – Tracking/Calorimeter/Muons Upgrade Project Office; Tracking; LAr

ATLAS Computing T. Wenaus Tier I Center Core Software

Physics K. Cranmer Reconstruction – system specific Physics Analysis Plus Parallel Session III (Theory)

Early Physics with ATLAS and LHC; (F. Paige) Implications of non-universal masses: a step beyond mSUGRA: (T. Krupovnickas)


General Approach Construction responsibility matched to unique

technical capability at BNL. Physics & Instrumentation Division were pioneers in

R&D for both LAr calorimeter and cathode strip chambers.

Contribution to the analysis builds on: detector expertise in the calorimeter and muon systems and Core software strength.

Much of computing and software aims at insuring that the U.S. can easily access the ATLAS data: data management, Tier 1 and Tier 2’s

ATLAS upgrade concentrates on the tracking system and Calorimeter readout where we take advantage of unique developments. Major role in overall optimization via Upgrade PO activities.


~ 1 yr at 1034: up to 2.8 TeV

~ 1 yr at 1033: up to 2.3 TeV

~ 1 mo. at 1033: up to 2 TeV

Reach of Multijet + ETmiss

search

SUSY could be found quickly if isolated from SM backgrounds

A Supersymmetry Discovery Could Come SoonWe need to work hard to understand the backgrounds

ATLAS SUGRA Pt. 6

Meff = pT(ji) + ETmiss

This was the older S/B


We now believe SUSY may need a Lepton Trigger

ackgroundSignature for SUSY from Multi-jets and Missing ET is more robust if a lepton is required.

Using more modern generators indicates that the background in the no-lepton channel is higher than we thought.


ATLAS100 fb-1

LHC Point 5

m () spectrumend-point : 109 GeVexp. precision ~0.3%

m (j)min spectrumend-point: 552 GeVexp. precision ~1 %

m (j) spectrumend-point: 479 GeVexp. precision ~1 %

Lq~ q 02

R

~ 0

1

m (j)max spectrumthreshold: 272 GeVexp. precision ~2 %

Example Reconstruction Of a SUSY Decay

Chain

GeV 121 157, 232, 690,)χ ,~ ,χ ,q~( m 12

0R

0L

Frank Paige had a significant role in this strategy


The ATLAS Detector

ATLAS is being assembled in its cavern at CERN


BNL Deliverables to the ATLAS Experiment

Barrel Cryostat and utilities (BNL)CSC (BNL)


Barrel TileCal and Liquid Argon at z=0

Status 8 November 2005


Leading BNL Roles in ATLASNew since 2005

K. Assamagan Analysis Tools Coordinator Kyle Cranmer Co-Coordinator of ATLAS Jet/ETMiss trigger

softwareB. Gibbard International Computing Board (and Grid

Deployment Board)H. Gordon ATLAS Executive Board, National Contact

Physicist F. Lanni LAr Upgrade CoordinatorD. Lissauer Leader of Technical Coordination Project Office

(Task A)Head of Project Office for the Upgrade

H. Ma LAr Database CoordinatorCo-Coordinator of LAr Commissioning Analysis

S. Rajagopalan LAr Calorimeter Performance Co-Coordinator Event Data Model Architecture

LAr Management GroupATLAS Computing and Software Management

GroupsT. Wenaus ATLAS Database Project Co-Leader H. Takai Co-Coordinator Heavy Ion Physics GroupV. Polychronakos Cathode Strip Chamber Leader


BNL Roles in U.S. ATLAS H. Gordon, Construction Project Manager;

Deputy Research Program Manager S. Rajagopalan, Software Subsystem Manager, WBS

2.2 T. Wenaus, Distributed Software Manager, WBS 2.2.4 A. Undrus, Software Infrastructure, WBS 2.2.6 H. Ma, BNL Analysis Support Center Coordinator,

WBS 2.2.7.1 B. Gibbard, Computing Facilities Manager, WBS 2.3

(R. Popescu, Deputy) P. Nevski, Grid Production, WBS 2.3.4 D. Lissauer, Technical Coordination Subsystem

Manager WBS 3.9 T. Maeno, K. Assamagan – Analysis Support Group K. Cranmer, Trigger Forum; F. Paige, SUSY Forum


(1) Analysis Support GroupASG membership:

ASG chair (S. Willocq, U. Mass. Amhearst) ASC coordinators (J. Proudfoot @ ANL, H. Ma @ BNL, S. Loken @

LBNL) CERN contact person Support contacts:

- Software framework (Athena, CMT, how to run, etc.)

- Data management (incl. database)

- Distributed software (incl. grid)

- Software releases (incl. kit installation)

- Physics analysis tools (ESD/AOD/TAG, tools, etc.)

- Generators/Simulation

- InDet tracking, b-tagging & vertexing

- MuSpec tracking & muon ID

- LAr calorimetry & e/gamma ID

- Hadron calorimetry & jets/Etmiss/tau

- Trigger

Detectorperformancesupport


(2) Analysis Support Centers (ASC)

• Main task:• Provide US ATLAS physicists with regional resources,

tutorials, support, leadership and focal point for meetings

• 3 ASCs:• Argonne National Lab: Midwest region• Brookhaven National Lab: Eastern region• Lawrence Berkeley National Lab: Western region

• Choice of 3 centers is motivated by the ability to tap into

the considerable infrastructure and human resources

available at those laboratories

• Also, it facilitates access to support and expertise for US

physicists at ‘nearby’ Universities


(2) Analysis Support Centers• ASC Role: the following is to be made available

• Infrastructure:• Office space for visitors• Access to networking, printers, stationary, copy/fax/coffee machines• Secretarial assistance• Meeting rooms for tutorials and face-to-face analysis meetings• Video and phone conferencing facilities

• Software support: Requires 1 new FTE at each ASC• General software (framework, how to run jobs, etc.)• Physics analysis tools• Distributed analysis, grid use• Liaison to computing facilities


(2) Analysis Support Centers

• ASC Role (cont’d):• Expertise:

• Basic software support as indicated above• Some members of the ASG will be stationed at an ASC,

this reinforces areas of expertise that already exists regionally:• ANL: Hadron calorimetry, jet reconstruction & calibration• BNL: LAr calorimetry, e/gamma ID, trigger for e/gamma, jets, missing

ET

+ regional groups for Muon tracking and ID, analysis tools, b-tagging• LBNL: Inner Detector tracking, b-tagging, vertexing

• Physics analysis through ASC physicist involvement in ATLAS physics• Coordination:

• ASC coordinators oversee local support activities• ASG chair coordinates the activities at the 3 ASCs:

• Tutorial and analysis support coordination across ASCs• Monthly meeting between ASC coordinators and ASG chair• Compilation of ASC-use metrics to assess effectiveness


BNL ASC MOU sectionName Software/ Detector Performance Physics Analysis ATLAS

Fraction Area of Expertise ATLAS

Fraction Area of Activity

Ketevi Assamagan

60% Physics Analysis Tools Muon performance

20% Higgs BSM

Kyle Cranmer 80% Physics Analysis Tools MET/ Jet/ tau Trigger

20% Higgs SUSY

Denis Damazio 40% Calorimeter and egamma Trigger

20% Standard Model

Hong Ma 70% LAr Calorimeter Egamma performance Commissioning

10% Standard Model

Frank Paige 30% Jet & MissingET reco Physics validation

50% SUSY

Srini Rajagopalan 60% Athena Framework LAr Calorimeter Egamma reco/ perf

10% SUSY

George Redlinger 20% Trigger performance

80% SUSY

Scott Snyder 50% Core and Calorimeter Software EM calibration

20% Higgs

Iuliu Stumer 50% Magnetic Field

Total commitment

4.6FTE 2.3FTE


BNL ASC MOU SectionName Available

ASC Fraction ASC Support Areas Source of Support

David Adams 20% Data management US ATLAS Research Program/ SW

Ketevi Assamagan* 20% Analysis Tools BNL HEP Core Program Wensheng Deng 20% Production

Data management US ATLAS Research Program/ Production

Hong Ma

15% ASC coordination Tier-1 usage

BNL HEP Core Program

Tadash Maeno* 10% Distributed Analysis US ATLAS Research Program/ SW

Pavel Nevski 20% Production/ Validation US ATLAS Research Program/ SW

Alex Undrus 50% Basic Software support US ATLAS Research Program/ SW

TOTAL 1.55FTE


(3) Analysis Forums Main task:

Provide US ATLAS physicists with a forum for discussion and exchange of information, and to stimulate activity

AF membership: Analysis forums are led by ‘forum conveners’ who:

Call for presentations to regular video/phone meetings Make sure work is presented in ATLAS-wide meetings Provide input to computing Resource Allocation Committee

(RAC) Notes:

AFs are not substitutes for ATLAS working groups AFs have no approval power (ATLAS working groups do) Participation in AFs is not mandatory AF meetings need to be informal, stimulate discussion &

collaboration


(3) Analysis Forums Analysis Forums:

1. InDet tracking, b-tagging & vertexing

2. MuSpec tracking & muon ID

3. LAr calorimetry & e / gamma ID

4. Hadron calorimetry & jets / Etmiss / tau

5. Trigger

6. Standard Model & Higgs Physics

7. Beyond the Standard Model Physics Notes:

One forum convener for each of the forums 1-5 Two forum conveners for each of the forums 6-7

Physics forums could split into smaller units to maintain smaller, informal nature of each forum (would need only one convener per forum then)

Detectorperformance

Physics


Typical Tutorial by K. Assamagan AnalysisTutorial1105 Introduction - What to do before coming to the Tutorial

Set up CMT Setup for the release 11.0.41 Run Time Setup The Next Time You Login Install Atlantis on your laptop Get The Necessary Files Run the AnalysisSkeleton for 100 Events More Information

Event Selection, Display and Visualization Event Selection

Use the AthenaAwareNTuple for Event Selection Selecting Events at the AOD, ESD and RDO Levels Passing Selected Events to Event Display

Event Display and Visualization 1. Getting started with atlantis: Looking at AOD events 2. Interactive athena/atlantis 3. Use the athena vertexing tools from within atlantis

Distributed Analysis Analysis on CSC samples using DQ2 How to run customized Athena to the Grid (OSG)

Event View


ATLAS Physics Analysis Tools led by K.

Assamagan Objectives:

Propose a unified, baseline framework for Analysis Common classes in the analysis domain Tools to build these objects General/common tools for analysis Navigations and Associations from ROOT NTuple back to AOD, ESD, and the Raw Data Tools to select the events of interest Event Display and visualization tools Tools for interactive analysis in ATHENA Tools for user analysis in the Distributed Analysis Environment Concrete, thorough analysis examples Tools for Multi-variate Analysis – Discriminant Analysis/Maximum Likelihood Analysis

Analysis Model: how all the above tools are integrated to define a model for how to do analysis on ATLAS data

ESD/AOD analysis to ROOT NTuple Concept of the EventView – tools for user analysis dependent, self consistent and

exhaustive view of the Event, containing mutually exclusive, reconstructed, final state particles

Interactions with combined performance groups & physics groups Interaction with the user – use support Common look and feel to the user BNL is heavily involved in the development of these analysis tools and the analysis model:

Overall coordination of various efforts Event Data Model for Analysis Distributed Analysis Tools Analysis Model – Event View


Typical Activities of LAr Calorimeter Performance Coordinator, S. Rajagopalan

Set Priorities for the upcoming software release version 12.0.0 Review of the action items from the recently concluded

calorimeter trigger workshop (end of January) Organize a trigger software code review Update on the status of incorporating realistic geometries in

simulation. Update on the status of usage of the new conditions database

architecture Plan to incorporate schema evolution for calorimeter data

classes. Plans and follow up from the Commissioning Expert Week Defining a series of readiness notes for Calorimeter

performance. These notes are to be completed in one year time ensuring the calorimeter software is ready for data taking.

Defining a procedure to nominate speakers for upcoming conferences.


U.S. ATLAS Project and Research Program Management

BNL is the Host Lab for the 33 U.S. institutions in ATLAS We have (almost) constant reviews We are active in the transition from a successful Construction

Project to the Research Program which includes: Construction Project achieve CD-4A Sept. 30, 2005 – 97% +

Complete M&O – consisting of pre-operations and commissioning

Highlight LAr M&O Technical Coordination and New Upgrade Project Office

Computing: Highlight PanDa and Service Challenge 4 Upgrade R&D: Highlight StripPixel

We are responsible for (monthly and quarterly) reports, budgets, MOUs, and other exercises


Research Program Organization


Safety David Lissauer (BNL) is the leader of the ATLAS Technical Coordination (TC)

Project Office (Activity A). The Project Office includes the ATLAS GLIMOS and therefore David participates in formal and informal meetings on safety issues.

Many U.S. leaders are involved in the preparation of many of the Work Packages which address risks and mitigation as well as training requirements.

There is a safety professional stationed in the Cavern, who is independent of ATLAS. He spends full time supervising all operations and looks for ways to reduce risk as well as enforcing safety rules - such as the wearing of required safety clothing.

Recently, ATLAS TC has applied the same procedures used in the Cavern to other areas where ATLAS work is being done - such as building 180. There is a Territorial Safety Officer (TSO) for each area who is a member of ATLAS TC. The TSO is responsible in these other locations and performs the same functions as 4) above.

We have tasked Steve Kane, who is our U.S. ATLAS Project Engineer and a certified safety professional, to review all ATLAS Work Packages (WP) where any U.S. worker could be involved. The purpose of the WP review will be to recommend what U.S. actions might be necessary, and alert the U.S. ATLAS Research Program Manager and Deputy Research Program Manager of the issues which need to be dealt with. The Deputy will interact with CERN and ATLAS management as appropriate to deal with the issues and follow up with the U.S. ATLAS Level 2 Managers and institutional representatives whose workers will be affected.

The review will include requirements for any additional safety training for U.S. workers.


LAr FEBs and Power Supply System

LVPS locationon the Barrel Cal.

Front End Boards (FEB) in System Crates


FEB Production @ BNL(updated April 2006)

Assembly of analog components (PA, LSB) and cooling.

839 boards (>~50% of total production) Status: shortage of 25Ohm 5mA preamplifiers

prevented us from completion in Feb 2006. Missing about ~200 PAs (without counting spares).

Delivered to CERN: 830 boards All EMB boards delivered All EMEC boards delivered 9 FCAL board missing

Completion: June 06 Low Voltage DC/DC converters are now being

retrofitted and are working fine –


BNL LAr M&O Tasks

1. LVPS Commissioning2. Front-End Crate [FEC] Cooling Commissioning3. Front-End Detector Control System Commissioning

[DCS]4. Front-End Installation and Commissioning5. Cryostat and proximity service commissioning6. Cryogenics7. Databases8. Phase-III Analysis Commissioning

(David Lissauer will go into more detail on these points)

Topics


Cathode Strip Chambers (CSC)

CSCs fabrication was completed at BNL in 2005 and sent to CERN.

At right is a chamber in its frame at CERN in pre-operation.


Technical Coordination (TC) organization

ATLAS management

C) Systems Construction

Liaison

E) Common systems

D) Electronics and Signal processing Ph. Farthouat

G) Logistics + experimental areas

INIGO-GOLFIN

H) Commissioning

activities

[spokesperson deputy spokesperson resources co-ordinator technical co-ordinator ]

TMB

(technical management board)

chairperson: M. Nessi

[activity managers, ATLAS management ]

A) TC Project Office. D. Lissauer

B) CERN Divisional Relations. M. Nessi

F1) IntegrationM. Hatch

F2)Installation

G. Tappern


US InvolvementUS Physicists Involved in TC:US Physicists Involved in TC:

D. LissauerD. Lissauer - TC Activity A, Placement Strategy (BNL)- TC Activity A, Placement Strategy (BNL)

M. ShupeM. Shupe - Radiation/Activation Studies (Arizona)- Radiation/Activation Studies (Arizona)

J. BensingerJ. Bensinger - Forward Muon Integration (Brandeis)- Forward Muon Integration (Brandeis)

B. StanekB. Stanek - - - Movements (ANL)- Movements (ANL)

M. SharpM. Sharp - Installation Data Base (Nevis@ CERN)- Installation Data Base (Nevis@ CERN)

TC Support @ CERN:TC Support @ CERN:

K. PommesK. Pommes Project Management – Eng.Project Management – Eng.

T. Klioutchnikova T. Klioutchnikova Senior Designer – Conf. ControlSenior Designer – Conf. Control

A. FoussardA. Foussard Installation Feet/Magnet. Installation Feet/Magnet.

BNL:BNL:

S. NortonS. Norton Senior Designer – Conf. ControlSenior Designer – Conf. Control

A. GordeevA. Gordeev Engineer – AccessEngineer – Access

J. FarrellJ. Farrell DesignerDesigner

ANL:ANL:

J. Grudzinski J. Grudzinski Movements/FEA Calc. Movements/FEA Calc.

LBL:LBL:

E. AndersonE. Anderson Pixel/Beam Interface.Pixel/Beam Interface.


Upgrade Project Office (PO) (D. Lissauer, head)

1. ATLAS upgrade PO is being established to implement the ATLAS organization for the upgrade R&D.

• Planning, Review, Configuration Control, Safety, Infrastructure Services, Integration

2. Resources from the collaboration will be needed to fill key positions in the upgrade plan. (As manpower become available in the institutions please contact us to see how best to integrate the effort – especially from outside institutions)

3. The PO will play an active role in maintaining the R&D focused on the ATLAS upgrade needs.


Tracking R&D for Upgrade


New Software Project: Panda PanDA – Production and Distributed Analysis system Project started Aug 17, 2005 Baby Panda growing! New system developed

by U.S. ATLAS team Rapid development from scratch Leverages DC2/Rome experience

Lack of scalability Inspired by Dirac & other systems: pilot jobs in each site Already in use for CSC production in the U.S. Better scalability/usability compared to DC2 system Will be available for distributed analysis users in few months

One-stop shopping for all ATLAS computing users in U.S. Co-leader: T. Wenaus


US ATLAS Tier 1 Service Challenge Participation

BNL’s current connection is 20 Gb/s via ESNET – but not redundant

Need to insure ESNET upgrade in FY07

BNL Contributed to the Service Challenge 4 from the beginning

BNL is participating like other world centers.

BNL


Conclusions BNL is playing a leading role in U.S. ATLAS

and ATLAS overall: Physics Management Detector Construction/Technical

Coordination Installation Commissioning M&O

Computing Upgrade R&D

The erosion of the “Core Research” Program support prevents us from reaching our full potential BNL has little flexibility

bnl’s role in atlas howard gordon doe annual hep review brookhaven national lab april 17-19, 2006

Documents

atlas detector atlas

atlas overview of bnl

atlas data

us atlas management

backgrounds atlas sugra

s atlas upgrade concentrates

dashboard slide

krupovnickas slide