database taskforce and the ogsa-dai project norman paton university of manchester
TRANSCRIPT
Database Taskforce and the OGSA-DAI Project
Norman PatonUniversity of Manchester
Outline Database Taskforce (DBTF):
who, what and why. Databases and the Grid:
context and capabilities. OGSA Database Access and
Integration Project: what, where and when.
Relevant Web Pages http://www.cs.man.ac.uk/grid-db
Membership Malcolm Atkinson (NESC) Vijay Dialani (Southampton
University) Norman Paton (Manchester
University) Dave Pearson (Oracle UK) Tony Storey (IBM Hursley) Paul Watson (Newcastle University)
Aims/Actions: Requirements To identify the
requirements of database and information management applications within a Grid setting.
Requirements analysis underway, with visits to Grid projects.
Preliminary report by Dave Pearson tabled at GGF4 and on Web.
Series of meetings at NESC.
Aims/Actions: Roadmap To develop a
roadmap for research and development of database functionalities in a Grid setting.
Proposal involves a collection of Grid Database services.
Initial collection of Grid Database Services tabled at GGF4 and on Web.
Aims/Actions: Standards To propose
standards for Grid/Database links through the GGF.
Birds of a Feather Session run as part of GGF4.
Hope to establish a Working Group before GGF5, involving wider community.
Aims/Actions: Implementation To foster the
development of reference implementations of proposed Grid standards.
OGSA-DAI (Database Access and Integration Project just funded through Core Programme).
GGF WG to encourage wider involvement with reference implementations.
Aims/Actions: Architecture To advise the
Architecture Task Force on architectural requirements for database support.
Meet periodically with ATF.
In line with ATF in terms of services focus.
Aims/Actions: Education To encourage
greater awareness of needs and best practice in respect to databases and the Grid.
Requirements analysis building links with users.
Series of meetings at NESC on Database/Grid issues.
Input on use of developed software, plus good practice.
Outline Database Taskforce (DBTF):
who, what and why. Databases and the Grid:
context and capabilities. OGSA Database Access and
Integration Project: what, where and when.
Databases in the Grid
Computational Complexity
DataComplexity
Grid Middleware
Gri
d P
roto
co
ls a
nd
Gri
d S
ec
uri
ty I
nfr
as
tru
ctu
re
Combining Grid and Web ServicesC
lien
ts
ApplicationPortals
WebServices
Grid Services:Collective and Resource Access
Resources
Compute(many)
Storage(many)
Communi-cation
Instruments(various)
GRAM
GridFTPData Replica and Metadata Catalog
GridMonitoring
Architecture
GridInformation
Service
We
b B
row
ser
Grid Web ServiceDescription (WSDL)& Discovery (UDDI)
Grid X.509Certification
Authority
SRB/MetadataCatalogue
Condor-G
CORBA
MPI
Secure, Reliable
Group Comm.
Discipline /Application
SpecificPortals
(e.g. SDSCTeleScience)
ProblemSolving
Environments(AVS, SciRun,
Cactus)
EnvironmentManagement(LaunchPad,
HotPage)
Job Submission /Control
File Transfer
Data Management
CredentialManagement
Monitoring
Events
WorkflowManagement
other services:•visualization•interface builders•collaboration tools•numerical grid
generators•etc.
Apache Tomcat&WebSphere&Cold Fusion=JVM + servlet
instantiation + routing
CoG Kits implementingWeb Services in
servelets, servers, etc.Python, Java, etc.,
JSPs
compositionframeworks(e.g. XCAT)
XM
L /
SO
AP
ov
er
Gri
d S
ec
uri
ty In
fra
str
uc
ture
Gri
d P
roto
co
ls a
nd
G
rid
Sec
uri
ty I
nfr
astr
uct
ure
Apache SOAP,.NET, etc.
……
htt
p,
htt
ps
. e
tc.
X W
ind
ow
sP
DA
Grid ssh
Scope of Database Services Discovery. Statements. Delivery. Metadata. Transactions. Distributed queries.
Statement Service For queries involves:
The query notation. The query to be evaluated. The parameters for the query. The result delivery mechanism.
Invoking a query operation: Prepares and validates the query, reporting
back success or failure. Provides access to the results collection.
Query Operation Specified here even more abstractly than in
WSDL. Several operations: synchronous,
asynchronous, etc. Service descriptions start off data model and
language independent, then instantiated.
query( IN queryNotation, IN query, OPTIN values, OPTIN expires, INOUT resultHandle, OUT fail)
Outline Database Taskforce (DBTF):
who, what and why. Databases and the Grid:
context and capabilities. OGSA Database Access and
Integration Project: what, where and when.
OGSA-DAI Project OGSA - Data Access and Integration
Services project. IBM (Tony Storey, Brian Collins). Oracle (Dave Pearson). NESC/EPCC (Malcolm Atkinson, Rob Baxter). Manchester University (Norman Paton). Newcastle University (Paul Watson).
£1.5 Million (plus matching industrial contributions) over 18 months.
Project Plan Well defined deliverables for first 6 months:
Core Relational Services. Core XML Services.
Less well defined deliverables over following 12 months: Intercept emerging GT3 releases. Comprehensive delivery services. Metadata. Specialist data types. Distributed queries.
Short Term Deliverables GGF5:
DAI Framework Document. Instantiation for RDBs and XML repositories.
Provisional dates for core services (given resolution of licensing/collaboration agreements):
Early-adopters
Public
XML 1st May 19th July
RDB 1st July 1st Sept
Short Term Tensions Multiple database
paradigms/platforms. Multiple language interfaces. Users contexts:
Web services. Globus 2. Globus 3.
Relationship to GGF WG To be established, but:
Contribute insights into design of DAI services.
Contribute to documents that feed into the GGF standardisation activity.
Provision of reference implementations of standard proposals.
Contribute to the development of OGSA proposal as early adopters.
Relationship to other UK e-Science Projects To be established, but:
Seeks to address requirements found in (UK) e-Science projects.
Development activity designed to provide core functionality early.
Formal relationship with some as early adopters (myGrid, AstroGrid).
Could be possible to collaborate on certain development activities.
Summary: DBTF Interfaces
Working GroupRecommendations
Database ServiceDevelopmentRequirements
Community-building