General introduction of version 10.4 and prospects

Makoto Asai SLAC National Accelerator Laboratory May 17th, 2018 @ EIC Software Consortium Meeting

Version10.4

•  ReleasedonDecember8th,2017•  Mar6th,2018–Geant410.4-patch01release•  Geant410.4-patch02isinpreparaAon.Tobereleasedinafewdays.

•  Cmake3.3orhigherisrequired.•  PlaMorms:

–  Linux,gcc-4.8.5.•  Testedon64bitarchitectures(IntelorAMD)withCERNCentOSLinux7(CC7)(basedonCentOSLinux7).

–  MacOSX10.13High-Sierrawithclang-4.0(AppleLLVM/Clang-9.0.0)–  Windows-10withVisualC++14.11(VisualStudio2017)

•  MoreverifiedandtestedconfiguraAons(64bits):–  Linux,gcc-4.9.3,gcc-5.3.0,gcc-6.3.0,gcc-7.2.0,clang-3.9–  Linux,Intel-icc18.0–  MacOSX10.10,11,12withclang-3.6,3.7,3.8–  Windows-7,10withVisualC++14.0(VisualStudio2015)–  LinuxforIntelXeonPhiwithIntel-icc16.0(gcc-4.9compaAbilitylayer)

•  Note:WindowsplaMormsaresupported/verifiedonlyforthesequenAalmode.MulAthreadingcapabilityisnotyetsupportedonWindows.

General introduction of version 10.4 and prospect - M. Asai (SLAC) 2

We moved to a new Drupal site •  http://geant4.org/ ( http://cern.ch/geant4/ )

•  We will continue updating/enriching pages.

General introduction of version 10.4 and prospect - M. Asai (SLAC) 3

10.4camewithnewuser’sguidesandnewlogo

General introduction of version 10.4 and prospect - M. Asai (SLAC) 4

Releasesandevents

•  Asannounced,2018workplanislistedhere.–  hcp://geant4.web.cern.ch/support/planned_features

•  Comingreleases–  Nextpublicrelease:December7th,2018

•  Nextbetarelease:June29th,2018–  Patchreleasesforversion10.4willbemadeasneeded.–  Patchesforolderversionsmaybediscussed.

•  Otherevents–  SeveraltutorialcoursesarelistedontheeventsecAonofthecollaboraAonhome

page.–  Futuretutorialswillbeannounced.

•  2019Geant4CollaboraAonMeeAngwillbeheldatJLAB(orHamptonU.)–  NuclearPhysicswillbehighlighted.–  Associatedusers’meeAngwillbearranged.

•  SLACconAnuesacAngasaliaisontoEIC(andnuclearphysicsingeneral).

5 General introduction of version 10.4 and prospect - M. Asai (SLAC)

MediumTermEvolu.onsSomeHighlights

General introduction of version 10.4 and prospect - M. Asai (SLAC) 6

Sub-EventLevelParallelism

•  Geant4MTiniAallydesignedtoprocesseventsinparallel–  Withindependentprocessing

perthreadofseriesofevents•  Independenceofthreadsmakes

nexttoperfectscalingofthroughputwith#threads

–  Butschemeassumeseventsaresmallenoughtofitintothememoryofonethread

•  Sub-eventparallelismgeneralizestheapproach:–  ToservethecaseofapplicaAonsrequesAnglargememoryperevent:

•  e.g.:ALICE,HL-LHC,airshower–  Oneeventissplitinto“sub-events”

•  e.g.:eachprimarytrack=asub-event–  Eachsub-eventissenttoathread,andmergedbacktotheoriginalfullevent

later•  Geant4willprovidetoolstoeasilyenablethisfeature•  ATLASalreadyhasthismechanismwithinATHENA

Version 10.2-p02 on KNL

1 thread/core hyperthreading

General introduction of version 10.4 and prospect - M. Asai (SLAC) 7

Ions,muonicatoms,radicals,hyper-nuclear…•  MostcommonparAcles– 𝑒↑± , 𝜇↑± ,𝑝,𝑛,𝛼, 𝜋↑±,0 …–areeachrepresentedbyadedicatedclass•  Ions(>𝛼)haveacommontreatmentthroughone“genericion”class

–  Allowstotreatmorethan7000ionsspecies–  WithasingleandcommoninstanAaAonoftherelatedphysics

•  Butionsphysicsvectorsaccessedthroughaspecialcaseduringtracking–  i.e.an“if”statement

•  Recently,forIntensityFronAer,muonicatomswereintroduced:–  i.e.atomsinwhichan𝑒↑− isreplacedbya𝜇↑− –  Mechanismforionsisduplicated,andrelatedcodeisprotectedbyan“#ifdef”…

•  Andfurther:–  Radicals,e.g. 𝑂𝐻↑− ,arealsohandledatlowenergyintheDNAmodule–  Hyper-nuclearphysicsisplanned:

•  Hyper-nucleus=nucleusinwhichanhyperonstandsinplaceofaprotonorneutron•  StarAngwithhyperon=lambda,andnucleustransported(todayitisdecayed

immediately)

•  InflaAonofparAclespecies(≫10k)inatleastfourdifferentfamilies–  Eachbeingaspecialcase

•  Plantodesignanuniformtreatmentofthese“non-most-common”parAcletypes

General introduction of version 10.4 and prospect - M. Asai (SLAC) 8

RefactoringTransporta.on[1/2]

•  The“transportaAon”isaGeant4process•  ItmanagesthenavigaAoninthe

geometry:–  Itcaresaboutvolumeboundaries–  Ittakesintoaccountthefieldsinthe

propagaAonofparAclessensiAvetosuchfields

•  Currently,onlyonetransportaAonexists:–  ItdealswithallparAcletypes:

•  neutralandchargedones,•  opAcalphotons,•  phonons,etc.

–  Resultsinfrequent“if”branches•  onthechargetodecidetoapplyfield

computaAonornot,•  tousegroupvelocityornot•  …

Sources of CPU consumption Geant4 CMS simulation Courtesy of Vladimir Ivanchenko

General introduction of version 10.4 and prospect - M. Asai (SLAC) 9

UseofHPC

Geant4ranonMiraBluegene/QSupercomputer@ANLwithallofits3millionthreads,inasingleapplicaAon

•  Setup:–  CombinaAonofMPIandMulA-threading–  Full-CMSgeometry&field

•  Goodlinearityobserved–  EvenifsomeissuesondatareducAon

(collecAon)exist,tobetackledin2018

•  WhytargeAngdetectorsimulaAonhere?–  Processingcanstartquickly(nodataaccess,fewseedstoset,…)–  AllowsforanopportunisAccompuAngstrategy:

•  ExploitremainingAmeleubyheavyconsumers.•  WhichsAllrepresentsalotofcompuAngpower.

Single color, full squares = one application occupies Mira all

General introduction of version 10.4 and prospect - M. Asai (SLAC) 10

Physics&CodeEvolu.on

•  Extensionofphysicscoveragebothtohigherandlowerenergies:–  HighEMandhadronicphysicsforHL-LHCandFCC

•  SeeFarah’spresentaAonthisauernoon–  Verylowenergieswithelectron-holeandphonontransport

•  Extensiontocrystallinestructureontheway–  Use-caseofbeamextracAonwithbentcrystals,basedonchanneling

•  Furtherandeasier-to-useeventbiasingschemes•  RevisionandsimplificaAonofthephysicsprocessesframework

–  Generalize“process={setofmodels}”atbaseclasseslevel–  SimplificaAonofthetrackinglogicwrtthevariouswaysprocessescanact–  RefactoringofINCL,reengineeringandeasieruseofLEND,etc.

•  FollowingC++languageevoluAons:–  C++11standardadopted&evoluAontowards(C++14)C++17

•  withconAnuoustransformaAonofpastcode–  FulladopAonofC++11threadingmodelsandworkspace/tasks-basedparallelism

•  willallowGeant4totransparentlysupportMTonWindowsplaMorms•  becercompaAbilitywithexternaltasks-basedframeworks

General introduction of version 10.4 and prospect - M. Asai (SLAC) 11

LongerTermEvolu.ons

General introduction of version 10.4 and prospect - M. Asai (SLAC) 12

GPGPU&HybridCompu.ng,andmore…•  GPGPU:

–  SomeGeant4membersparAcipatetosimulaAononGPU–  GPUcanbeexcellentinaddressingspecificuse-cases:

•  Radiotherapy,imaging•  OpAcalphotontransport•  Thermalneutrontransport•  Radicaltransportinmicrodosimetry

–  ImpressiveboostsO(100)evenO(1000)obtained–  Butonlyusedwithlimitedphysics&limitedgeometry

•  Eg:radiotherapy:E<1GeV&onlyboxes•  OpAcalphoton:fewsurfaceandabsorpAonprocesses

–  GeneralcaseofHEPdoesnotfithere.•  HybridCompuAng:

–  Canmorebeoffered?–  ByoffloadingtheCPUfromsomeheavycomputaAon?WithfastCPU↔GPUcommunicaAons?

–  IssueoffutureHPC:hybridcompuAngmightbethechoiceofHPC•  More:

–  Machinelearning:•  NoGeant4membersinvolvedfornow,butinterestinwhatcouldbeobtained

–  QuantumCompuAng:•  SomeAmesmenAoned….

GATE GATE-GPU

Head CT scan simulation Courtesy of OpenGate Collaboration

(Note GPU project note anymore developed by GATE)

General introduction of version 10.4 and prospect - M. Asai (SLAC) 13