Download - Virtual Laboratory for e-Science (VL-e)
![Page 1: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/1.jpg)
Virtual Laboratory fore-Science (VL-e)
Henri Bal
Department of Computer ScienceVrije Universiteit Amsterdam
vrije Universiteit
![Page 2: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/2.jpg)
Outline
• e-Science and virtual laboratories• The VL-e project• VL-e and networking• Case studies:
o Visualizationo Interactive problem solving environments o Distributed supercomputing
• Computing/networking infrastructure
![Page 3: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/3.jpg)
e-Science
• Web is about exchanging information
• Grid is about sharing resourceso Computers, data bases, instruments, services
• e-Science supports experimental science by providing a virtual laboratory on top of Grids
![Page 4: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/4.jpg)
Managementof comm. & computing
Managementof comm. & computing
Managementof comm. & computing
Potential Genericpart Potential Generic
partPotential Generic
part
ApplicationSpecific
Part
ApplicationSpecific
Part
ApplicationSpecific
Part
Virtual Laboratory Application oriented services
GridHarness multi-domain distributed resources
Virtual LaboratoriesDistributed computing
Visualization & collaboration
Knowledge
Data & information
![Page 5: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/5.jpg)
Optical NetworkingHigh-performance
distributed computingSecurity & Generic
AAA
Virtual lab. &System integration
Interactive PSE
Collaborative information Management
Adaptive information
disclosure
User Interfaces & Virtual reality
based visualization
Bio
-div
ers
ity
Bio
-In
form
ati
cs
Te
les
cie
nc
e
Da
ta I
nte
ns
ive
Sc
ien
ce
Fo
od
In
form
ati
cs
Me
dic
al
dia
gn
os
is &
im
ag
ing
Virtual Laboratory for e-Science
![Page 6: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/6.jpg)
The VL-e project• 40 M€ (20 M€ BSIK funding)• 2004 - 2008
vrije Universiteit
• 20 partners• Academic - Industrial
![Page 7: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/7.jpg)
VL-e and networking
• e-Science applications generate much (distributed) datao High-resolution imagingo Bio-informatics querieso Particle physics:
o Currently: 1 PByte per yearo LHC (2007): 10-30 PByte per year
• Virtual laboratories need high-speed networks foro Remote visualization o Interactive problem solving environmentso Distributed supercomputing
![Page 8: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/8.jpg)
VL-e and networking
Optical NetworkingHigh-performance
distributed computingSecurity
Virtual labi PSE CIMA.I.D. Visualization
Bio
-div
Bio
-In
f
Te
les
cie
nc
e
Da
ta
Inte
ns
ie
Fo
od
Me
dic
al
ima
gin
g
![Page 9: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/9.jpg)
Visualization on the Grid
![Page 10: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/10.jpg)
Visualization on the Grid
![Page 11: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/11.jpg)
Visualization on the Grid
![Page 12: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/12.jpg)
Visualization on the Grid
![Page 13: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/13.jpg)
Visualization on the Grid
![Page 14: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/14.jpg)
MRI, PET Monolith, Cluster Cave, Wall, PC, PDA
From Medical Image Acquisition to Interactive Virtual Visualization…
MD login and Grid Proxy creation
Bypass creation LB mesh generation
Job submission Job monitoring
Virtual Node navigation Simulated
Blood Flow
Patient at MRI scanner
MR image MR image Segmentation
Shear stress, velocitiesSimulated blood flow
se (e.g., Leiden)ce (e.g., Valencia) ce (e.g., Bratislava)
ui (VRE)
P.M.A. Sloot, A.G. Hoekstra, R.G. Belleman, A. Tirado-Ramos, E.V. Zudilova, D.P. Shamonin, R.M. Shulakov, A.M. Artoli , L. Abrahamyan
Interactive Problem Solving Environments
![Page 15: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/15.jpg)
Distributed supercomputing (parallel computing on grids)
VU (72 nodes) UvA (32)
Leiden (32) Delft (32)
GigaPort
Utrecht (32)
DAS-2
Distributed ASCI Supercomputer 2
![Page 16: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/16.jpg)
Distributed supercomputing (parallel computing on grids)
![Page 17: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/17.jpg)
• Can grids be used for High-Performance Computing applications that are not trivially parallel?
• Key: grids usually are hierarchicalo Collections of clusters, supercomputerso Fast local links, slow wide-area links
• Can optimize algorithms to exploit this hierarchyo Message combining + latency hiding on wide-area linkso Optimized collective communication operations (broadcast etc.)o Often gives latency-insensitive, throughput-bound algorithms
HPC on a grid?
![Page 18: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/18.jpg)
Ibis: a Java-centric grid programming environment
• Written in pure Java, runs on heterogeneous gridso “Write once, run everywhere ”
• Many applications:o Electromagnetic simulation (Jem3D)o Automated protein identification
(VL-e application from AMOLF)o N-body simulationso SAT-solvero Raytracer
Jem3D (see SC’04)
Available from www.cs.vu.nl/ibis
![Page 19: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/19.jpg)
Networking demands
• Low latency is needed foro Interactive visualizationo Interactive Problem Solving Environmentso Synchronous, latency-sensitive parallel algorithms
• High throughput is needed foro Data-intensive e-Science applicationso Visualization of large data setso Asynchronous, throughput-bound parallel algorithms
• Efficient collective (group) communication foro Collaborative visualization between multiple siteso Collective operations in parallel algorithms
![Page 20: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/20.jpg)
Outline
• e-Science and virtual laboratories• The VL-e project• VL-e and networking• Examples:
o Visualizationo Interactive Problem Solving Environments o Distributed supercomputing
• Computing/networking infrastructure
![Page 21: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/21.jpg)
Grid Middleware
Gigaport Network Service (lambda networking)
Application specificservice
Application Potential
Generic service &
Virtual Lab. services
Grid &
NetworkServices
Virtual Laboratory
VL-E Experimental Environment
VL-E Proof of concept Environment
Telescience Medical Application Bio ASP
Virtual Lab.rapid prototyping
(interactive simulation)
Additional Grid Services
(OGSA services)
VL-e environments
![Page 22: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/22.jpg)
DAS-3
• Proposed next generation grid in the Netherlands• Partners:
o ASCI research school (VU, UvA, TU Delft, Leiden)o Gigaport-NG/SURFnet: DWDM computer backplane
(dedicated optical group of 8 lambdas)o VL-e and MultimediaN BSIK projects
• Topology controlled by applications through the Network Operations Center
![Page 23: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/23.jpg)
DAS-3C
PU
’s
RCPU’s
R
CPU’s
R
CP
U’s
R
CPU’s
R
NOC
![Page 24: Virtual Laboratory for e-Science (VL-e)](https://reader036.vdocuments.site/reader036/viewer/2022062810/56815aa3550346895dc82bee/html5/thumbnails/24.jpg)
Summary
• VL-e (Virtual Laboratory for e-Science) studies entire e-Science chain, including applications, middleware and grids
• High networking demands from applications and generic methods
• New state-of-the-art Grid infrastructure planned for 2006 using optical networking