There are 6 Research Councils in total:

EPSRC – Engineering and Physical Sciences Research Council

NERC – Natural Environment Research Council

PPARC – Particle Physics and Astronomy Research Council

BBSRC – Biotechnology and Biological Science Research Council

ESRC – Economic and Social Research Council

MRC – Medical Research Council

And:

CCLRC – Council for the Central Laboratory of the Research Councils

Funding Sources for Academic Research

Nearly all academic research in the UK is funded by the government through Research Councils.

The UK e-Science Programme

Kerstin Kleese van Dam

(For Tony Hey

Director of UK e-Science Core Programme

Tony.Hey@epsrc.ac.uk)

e-Science and the Grid

‘e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.’

John Taylor Director General of Research Councils Office of Science and Technology

GRID Vision

Computing resources

Data

Knowledge

Instruments

PeopleSolution

Complex problem

GRID

The Grid as an Enabler for Virtual Organisations

Ian Foster, Carl Kesselman and Steve Tueke• ‘The Grid is a software infrastructure that

enables flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions and resources’

• - includes computational systems and data storage resources and specialized facilities

• Enabling infrastructure for transient ‘Virtual Organisations’

UK e-Science Initiative: First Phase • £120M Programme over 3 years from April 2001

• £75M is for Grid Applications in all areas of science and engineering

• £10M as first installment for UK HPC(X)

• £35M ‘Core Program’ to encourage development of generic ‘industrial strength’ Grid middleware

Require £20M additional ‘matching’ funds from industry

Collaborative projects

Director’s Management Role

Director’sAwareness and Co-ordination Role

Generic Challenges EPSRC (£15M), DTI (£20M)

Industrial Collaboration (£20M)

Pilot ApplicationProgramme

PPARC (£26M) BBSRC (£8M) MRC (£8M) NERC (£7M) ESRC (£3M) EPSRC (£17M) CLRC (£5M)

Research Councils (£74M)

UK e-Science Programme TechnicalAdvisory

Group

UK e-Science Management

e-Science Steering Committee

Research Councils e-Science Directors

Relevant National/ International bodies:

e.g. JISC, CERN

e-Science Support Based at EPSRC

and at DTI

Core Programme Project Teams

Technical AdvisoryGroup

Directore-Science Core

Programme

DGRC/CERCs CEO/EPSRC

Excerpt from e-Science CP Director’s job objectives

‘Develop effective collaborative Core Programme projects between the science base, industry and national funding agencies, and ensure the application and outcomes from the projects.’

UK e-Science Projects£75M for e-Science Grid Application ‘pilots’

- spanning all sciences and engineering

Particle Physics and Astronomy (PPARC)- £17M GridPP and £5M AstroGrid

Engineering and Physical Sciences (EPSRC)- funding 6 projects at around £3M each

Biology, Medical and Environmental Science- funding projects with total value of £23M

UK Grid Projects: First Phase (1)Particle Physics and Astronomy (PPARC)• GRIDPP • ASTROGRID

Engineering and Physical Sciences (EPSRC)• Comb-e-Chem • DiscoveryNet • GEODISE • myGrid • RealityGrid

Comb-e-Chem Project

X-Raye-Lab

Analysis

Properties

Propertiese-Lab

SimulationVideo

Diff

ract

omet

er

Grid Middleware

StructuresDatabase

APPLICATION SERVICE

PROVIDERCOMPUTATION

GEODISE PORTAL

OPTIMISATION

Engineer

Parallel machinesClusters

Internet Resource ProvidersPay-per-use

Optimisation archive

Intelligent Application Manager

Intelligent Resource Provider

Licenses and code

Session database

Design archive

OPTIONSSystem

Knowledge repository

Traceability

Visualization

Globus, Condor, SRB

Ontology for Engineering,

Computation, &Optimisation and

Design Search

CAD SystemCADDSIDEASProE

CATIA, ICAD

AnalysisCFDFEMCEM

ReliabilitySecurity

QoS

GEODISE Project

Computational science

• Molecular dynamics

• Mesoscale modelling

• High throughput experiments

• High performance visualization

• Computational steering

• Terascale parallel computing

myGrid Project

• Imminent ‘deluge’ of data

• Highly heterogeneous• Highly complex and

inter-related• Convergence of data

and literature archives

Using Distributed Resources

ScientificInformationScientific

InformationScientific Discovery

In Real Time

LiteratureLiterature

DatabasesDatabases

OperationalData

OperationalData

ImagesImages

InstrumentData

InstrumentData

Discovery Net Project

Real Time Integration

Dynamic ApplicationIntegration

Workflow Construction

Interactive Visual Analysis

Nucleotide Annotation Workflows

How It Works

Download sequence

from Reference

Server

Save to Distributed Annotation

Server

InteractiveEditor &

Visualisation

Execute distributed annotation workflow

NCBIEMBL

TIGR SNP

InterPro

SMART

SWISSPROT

GO

KEGG

1800 clicks 500 Web access200 copy/paste 3 weeks work in 1 workflow and few second execution

UK Grid Projects: First Phase (2)

Natural Environment Applications (NERC)• Climateprediction.com • Oceanographic Grid • Molecular Environmental Grid • NERC DataGrid (with CP)

Biotechnology and Biological Sciences (BBSRC)• Biomolecular Grid • Proteome Annotation Pipeline • High-Throughput Structural Biology • Global Biodiversity

BioSim GRID

Structure of the proposed biosimulation database

1st Level Metadata – Describing the Simulation Data…

2nd Level Metadata – Describing the Results of Generic Analyses…

…

distributed ‘raw’ data

York

Nottingham

Birmingham

OxfordRAL

Southampton

London

A biosimulation GRID for the UK

Integrating Different Levels of Simulation

An e-science challenge – non-trivial

NASA IPG as a possible paradigm

Need to integrate rigorously if to deliver accurate & hence biomedically useful results

Noble (2002) Nature Rev. Mol. Cell.Biol. 3:460

Sansom et al. (2000) Trends Biochem. Sci. 25:368

molecular

cellular

organism

UK Grid Projects: First Phase (3)

Medical Applications (MRC)

• Biology of Ageing (with BBSRC)

• Sequence and Structure Data

• Molecular Genetics

• Cancer Management (with PPARC)

• Clinical e-Science Framework

• Neuroinformatics Modeling Tools

CLEF - Clinical e-Science Framework

Partners:

• AstraZeneca, GSK, BMJ Publishing Group • CSW Informatics, iSoft plc, Sun Microsystems Limited • UK National Health Service

– NHS Information Authority Stakeholder Relations

– Camden & Islington Health Authority

– Central Manchester and Manchester Childrens' Health Authority

– Royal Brompton and Harefield NHS Trust

• Universities of Cambridge, Manchester, Freiburg and University College London

• High quality, integrated clinical information is key to:

– clinical research

– evidence-based health care

– the clinical application of genetic and genomic research

• Capture, integration, and presentation of descriptive information is a major barrier to achieving an integrated framework

• Data includes:– clinical histories

– radiology and pathology reports

– annotations on genomic and image databases

– technical literature and Web based resources

CLEF - Integrating information

e-Science and Grid Middleware

‘e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.’

John Taylor

Requirements of e-Science Grid Application Projects determine services required by Grid middleware

UK Projects focus more on Grid Data Services than Teraflop/s HPC systems

e-Science Core Program: First Phase

£15M OST + £20M DTI + £20M Industry

1. Network of e-Science Centres UK e-Science Grid

2. Support for e-Science Applications3. Grid Network Issues4. Generic/Industrial Grid Middleware5. e-Health Grid ‘Grand Challenges’ 6. Outreach/International Activities

Cambridge

Newcastle

Edinburgh

Oxford

Glasgow

Manchester

Cardiff

Southampton

London

BelfastDL

RAL Hinxton

UK e-Science Grid

UK e-Science Grid • All e-Science Centres donating resources plus four

dedicated compute/data clusters– Supercomputers, clusters, storage, facilities

• All Centres run same Grid Software– Starting point is Globus 2 and Condor: Storage

Resource Broker (SRB) • Standard Grid middleware supported

– e-Science Grid now at ‘Level 2’: moving towards production Grid with real users

Access Grid – Group Conferencing

Multi-site group-to-group conferencing system

Continuous audio and video contact with all participants

Globally deployed

All UK e-Science Centres have AG rooms

Widely used for technical and management meetings

Support for e-Science Projects• Grid Support Centre in operation

– supported Grid middleware & users– see www.grid-support.ac.uk

• National e-Science Institute – Research Seminars– Training Programme – See www.nesc.ac.uk

• National Certificate Authority– Issue digital certificates for projects– Goal is ‘single sign-on'

Anatomy of a Digital Certificate

ABCDEFGHIJKLMNOPQRSTUV

Signature from CA’s private key

Validity Data

Public Key

A text string

Extensions

How a certificate is issued

• The Registration Authority (RA) approves a request for a certificate. The RA is local to the users.• The CA then issues the corresponding certificate.

How does it work?

1. Scientist wishes to access a resource, so he sends a copy of the certificate to the resource

2. Resource says: prove it’s yourcertificate

3. Scientist proves that he has the corresponding private key4. Resource is convinced thatscientist is who he claims to be and decides to give him access

Private Key

Challenge

Response

UK CA Statistics, February 2003

• 250 valid certificates issued

• 24 RAs (more waiting for approval/training etc)

• Issuing 60 certificates /month

• Adding 3 RAs / month

• Adding 6 RA operators /month

• UK certificates recognized by EU and US projects

Grid Network Team• Expert group to identify end-to-end network

bottlenecks and other network issues

- e.g. problems with multicast for Access Grid

• Identify e-Science project requirements

• Funding (with PPARC and EPSRC) a number of network QoS, scheduling and monitoring projects

• ‘UKLight’ lambda connection to Chicago and Amsterdam now approved

UK Backbone Infrastructure

• Based on SuperJANET4 academic network run by UKERNA for JISC

• WorldCom(!) providing national backbone for SJ4 – now at 20Gbps

• Connections to universities via MANs at up to 2.5Gbps

• ‘Last mile’ problem?

• Research network use versus teaching, web-searching, email – differential services?

SuperJANET4

One source sending same data to 3 receivers only has to have one copy of data (more copies are made only when necessary)

Multicast

Access Grid

Networking Research Projects

Network Infrastructure

GRS, GRID resource management

MB-NG, QoS Features

GRIDprobe, backbone passive monitoring at 10Gbps

‘FutureGRID, P2P architecture

GridMcast, Multicast-enabled data distribution

GRID Infrastructure

Service Infrastructure

CP Collaborative Industrial Projects: First Phase

• 9 Centres with ring-fenced allocations

• £11M CP + £11M Industry funding

• £5M Open Call Projects

• All First Phase funds now committed

• Over 60 Companies involved

CP Centre Projects

6 projects CeSC, 4 OeSC 5 NEReSC 4 NeSC), 5 SeSC 2 LeSC5 WeSC7 eSNW5 BeSCTotal of 43 projects

68 different companiesRange of disciplines (IT, Engineering, Pharma, Environmental etc)New sectors engaged (broadcasting, defence, banking etc)Industrial Funds more than match DTI fundsAll Centres have spent money allocated or have projects under consideration

CP Open Call Projects

Visualization Middleware for e-Sciencee-Science Technologies in the Simulation of Complex MaterialsPerformance-based Middleware for Grid ComputingA scalable monitoring platform for the GRID (GridProbe)eDiamond distributed mammographic archiveEnd-to-End traffic management servicesInformation eXtraction from Images (IXI)Deductive Synthesis Techniques to the Rapid Assembly of Grid ApplicationsTrustworthy GRID Resource ManagementA Grid-based approach to the validation and testing of lubrication modelsSelf-Organising GRID Resource ManagementJigsaw: Distributed and dynamic visualisation generationFutureGRID: a program for long-term research into GRID systems architecture Total of 13 projects

OGSA – DAI Project

• Design Specification completed– Papers for GGF WG on Database Access and

Integration Services• Three Prototypes delivered:

– Distributed Query Service– XML Database Interface– Relational Database Interface

• Alpha versions delivered January 2003– Integrate with Globus GT3

Open Grid Services Architecture • Development of Web Services• OGSA will provide

Naming /Authorization / Security / Privacy/… Projects looking at higher level services: Workflow,

Transactions, DataMining, Knowledge Discovery… Exploit Synergy: Commercial Internet

with Grid Services

• Equator: Technological innovation in physical and digital life

• AKT: Advanced Knowledge Technologies

• DIRC: Dependability of Computer-Based Systems

• MIAS: From Medical Images and Signals to Clinical Information

IRC ‘Grand Challenge’ Projects

e-Health Grid ‘Grand Challenges’ • Grid-Enabled Knowledge Services for Medical

Informatics

- Triple Assessment in Breast Cancer:

Clinical, Radiological and Cytological data fusion

• Grid-based Medical Devices for Everyday Health

- Patient sensors, mobile wireless communication

• eDiamond Digital Mammography

- Normalized archive of mammograms

- Oxford, IBM (£2M), Mirada and Hospitals

Mammograms have different appearances, depending on image settings and acquisition systems

SMF is a normalised representation independent of scanner settings

eDiamond

eDiamond Applications of SMF

Training and Differential Diagnosis “Find one like it”

Teleradiology and QC VirtualMammo

Epidemiology SMFcomputed breast density

?

Advanced CAD SMF-CAD workstation

International Involvement

• Funding UK participation in the Global Grid Forum Research/Working Groups

• Funding for International CS ‘Grid Fellowships’– CERN DataGrid and USA iVDGL

• International members on TAG• Participation in EU FP5 Grid Activities

– e.g. EU DataGrid and DataTAG projects • Development of FP6 Grid Projects

– First call closes April/May– EGEE, EU Open Middleware Infrastructure Institute?

e-Science Demonstrators

• Dynamic Brain Atlas• Biodiversity• Chemical Structures• Mouse Genes• Robotic Astronomy• Collaborative Visualisation • Climateprediction.com• Medical Imaging/VR• Seamless Access to Multiple Databases

UK e-Science Funding

First Phase: 2001 –2004• Application Projects

– £74M– All areas of science

and engineering• Core Programme

– £35M– Collaborative

industrial projects

Second Phase: 2003 –2006• Application Projects

– £96M– All areas of science and

engineering• Core Programme

– £16M + £25M (?)– Core Grid Middleware

Core Programme 2

Overall Rationale: Four major functions of CP

– Assist development of essential, well-engineered, generic, Grid middleware usable by both e-scientists and industry

– Provide necessary infrastructure support for UK e-Science Research Council projects

– Collaborate with the international e-Science and Grid communities

– Work with UK industry to develop industrial-strength Grid middleware

Core Programme 2

6 Key Activities for Second Phase

1. UK e-Science Grid/Centres and e-Science Institute

2. Grid Support Centre and Network Monitoring

3. Core Middleware engineering

4. National Data Curation Centre

5. e-Science Exemplars/New Opportunities

6. Outreach and International involvement

Core Grid Middleware

• Need to develop open source, open standard compliant, Grid Middleware stack that will integrate and federate with industrial solutions

• Software Engineering focus as well as R&D

Aim is to produce robust, well-documented, re-usable software that is maintainable and can evolve to embrace emerging Grid Service standards

Major focus of Core Programme 2

National Data Curation Centre

• In next 5 years e-Science projects will produce more scientific data than has been collected in the whole of human history

• In 20 years can guarantee that the operating and spreadsheet program and the hardware used to store data will not exist

Need to research and develop technologies and best practice for curating digital data

Need to liaise closely with individual research communities and data archive centres

DIRECTORCORE PROGRAMME National

CentreProgramme

EPSRC/DTIFinance

Grid Network

Team

e-ScienceSteering

CommitteeCCLRCProjects

GridSupportTeam

Director GeneralOST

e-ScienceOperations Committee

Research CouncilPilots

HPCCentres

4 IRC+Projects

Open Call Projects

9 GridDemos

ReportsInternational

Deputy DirectorTechnical Advisory

Group

Information

International

DirectorCore Programme National

Centre

e-ScienceInstitute

Data BaseTaskforce

ArchitectureTaskforce

8 RegionalCentres

SecurityTaskforceUKERNA

EPSRC/DTIFinance

Grid Network

Team

Global Grid Forum

e-ScienceSteering

CommitteeCCLRCProjects

NERCPilots

GridSupportTeam

Dir GenOST

e-ScienceOperations Committee

ESRCPilots

MRCPilots

BBSRCPilots

PPARCPilots

EPSRCPilots

HPCCentres

CERN

OtherInternational

Projects

EUFramework

Projects

USPlayers

4 IRCs5 Projects

GridUSERS

ICTSuppliers

JISC

Open Call Projects

SR2002Bid

9 GridDemos

DTIOutreach

Reports

Hinxton

NetworkMonitoring

Gridnet

NHSNet

GridFellowships

Publicity

Keyworth

GEANT

£20M of50 Projects

CCLRCRAL & DL

Web sites

Deputy DirectorTechnical Advisory

Group

“HEFCE”

4 IRCs5 Projects

GridUSERS

ICTSuppliers

Open Call Projects

Data BaseTaskforce

ArchitectureTaskforce

SecurityTaskforceUKERNA

Grid Network

Team

JISC

Reports

NetworkMonitoringGlobal Grid

Forum

NationalCentre

e-ScienceInstitute8 Regional

Centres£20M of

50 Projects

CCLRCProjects

NERCPilots

GridSupportTeam

ESRCPilots

MRCPilots

BBSRCPilots

PPARCPilots

EPSRCPilots

CERN

EUFramework

Projects

USPlayers

GridnetGrid

Fellowships

GEANTInternational

CCLRCRAL & DL

9 GridDemos

DTIOutreach

Publicity

Web sites

Information

OtherInternational

Projects

Information

International

DirectorCore Programme National

Centre

e-ScienceInstitute

Data BaseTaskforce

ArchitectureTaskforce

8 RegionalCentres

SecurityTaskforceUKERNA

EPSRC/DTIFinance

Grid Network

Team

Global Grid Forum

e-ScienceSteering

CommitteeCCLRCProjects

NERCPilots

GridSupportTeam

Dir GenOST

e-ScienceOperations Committee

ESRCPilots

MRCPilots

BBSRCPilots

PPARCPilots

EPSRCPilots

HPCCentres

CERN

OtherInternational

Projects

EUFramework

Projects

USPlayers

4 IRCs5 Projects

GridUSERS

ICTSuppliers

JISC

Open Call Projects

SR2002Bid

9 GridDemos

DTIOutreach

Reports

Hinxton

NetworkMonitoring

Gridnet

NHSNet

GridFellowships

Publicity

Keyworth

GEANT

£20M of50 Projects

CCLRCRAL & DL

Web sites

Deputy DirectorTechnical Advisory

Group

“HEFCE”

Industry& Commerce

IBMMicrosoftSunLogicaSGIBAE SystemsRolls RoyceWelcomeCompaqOraclePlatformAvakiEntropiaHPABBBayerIntelPfizerNAGAvantiumGSK

QinetiqData Systs RocheBMTCCDCFujitsuMet OfficeCFS ConsBPPallasAVSRTZEpistemicsFluentBNFLDelta DotRVCO ltdInfosenseMerckAstraZenecaUnilever

Technical Advisory Group

Information

International

DirectorCore Programme National

Centre

e-ScienceInstitute

Data BaseTaskforce

ArchitectureTaskforce

8 RegionalCentres

SecurityTaskforceUKERNA

EPSRC/DTIFinance

Grid Network

Team

Global Grid Forum

e-ScienceSteering

CommitteeCCLRCProjects

NERCPilots

GridSupportTeam

Dir GenOST

e-ScienceOperations Committee

ESRCPilots

MRCPilots

BBSRCPilots

PPARCPilots

EPSRCPilots

HPCCentres

CERN

OtherInternational

Projects

EUFramework

Projects

USPlayers

4 IRCs5 Projects

GridUSERS

ICTSuppliers

JISC

Open Call Projects

SR2002Bid

9 GridDemos

DTIOutreach

Reports

Hinxton

NetworkMonitoring

Gridnet

NHSNet

GridFellowships

Publicity

Keyworth

GEANT

£20M of50 Projects

CCLRCRAL & DL

Web sites

Deputy DirectorTechnical Advisory

Group

“HEFCE”

Industry& Commerce

IBMMicrosoftSunLogicaSGIBAE SystemsRolls RoyceWelcomeCompaqOraclePlatformAvakiEntropiaHPABBBayerIntelPfizerNAGAvantiumGSK

QinetiqData Systs RocheBMTCCDCFujitsuMet OfficeCFS ConsBPPallasAVSRTZEpistemicsFluentBNFLDelta DotRVCO ltdInfosenseMerckAstraZenecaUnilever

Technical Advisory Group

IBM

Information

International

DirectorCore Programme National

Centre

e-ScienceInstitute

Data BaseTaskforce

ArchitectureTaskforce

8 RegionalCentres

SecurityTaskforceUKERNA

EPSRC/DTIFinance

Grid Network

Team

Global Grid Forum

e-ScienceSteering

CommitteeCCLRCProjects

NERCPilots

GridSupportTeam

Dir GenOST

e-ScienceOperations Committee

ESRCPilots

MRCPilots

BBSRCPilots

PPARCPilots

EPSRCPilots

HPCCentres

CERN

OtherInternational

Projects

EUFramework

Projects

USPlayers

4 IRCs5 Projects

GridUSERS

ICTSuppliers

JISC

Open Call Projects

SR2002Bid

9 GridDemos

DTIOutreach

Reports

Hinxton

NetworkMonitoring

Gridnet

NHSNet

GridFellowships

Publicity

Keyworth

GEANT

£20M of50 Projects

CCLRCRAL & DL

Web sites

Deputy DirectorTechnical Advisory

Group

“HEFCE”

International

USAFranceGermanyBrazilHollandJapanChinaItalyScandinaviaAustraliaSwitzerlandAustriaSingaporeBelgiumCanadaIrelandPolandSpainSouth- America

Information

International

DirectorCore Programme National

Centre

e-ScienceInstitute

Data BaseTaskforce

ArchitectureTaskforce

8 RegionalCentres

SecurityTaskforceUKERNA

EPSRC/DTIFinance

Grid Network

Team

Global Grid Forum

e-ScienceSteering

CommitteeCCLRCProjects

NERCPilots

GridSupportTeam

Dir GenOST

e-ScienceOperations Committee

ESRCPilots

MRCPilots

BBSRCPilots

PPARCPilots

EPSRCPilots

HPCCentres

CERN

OtherInternational

Projects

EUFramework

Projects

USPlayers

4 IRCs5 Projects

GridUSERS

ICTSuppliers

JISC

Open Call Projects

SR2002Bid

9 GridDemos

DTIOutreach

Reports

Hinxton

NetworkMonitoring

Gridnet

NHSNet

GridFellowships

Publicity

Keyworth

GEANT

£20M of50 Projects

CCLRCRAL & DL

Web sites

Deputy DirectorTechnical Advisory

Group

“HEFCE”

A viable Core Programme must have this scope and

an infrastructure to support it!

e-Science and the Grid

‘e-Science will change the dynamic of the way science is undertaken.’

John Taylor, 2001

Need to convince university IT Directors!

e-Government and the Grid

‘[The Grid] intends to make access to computing power, scientific data repositories and experimental facilities as easy as the Web makes access to information.’

Tony Blair, 2002