www.see-grid-sci.eu

SEE-GRID-SCI

Branko MarovicUniversity of Belgradebranko@rcub.bg.ac.rs

The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

JRA1 progress

PSC07 Meeting, Žabljak, 22-23 January 2010

The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 2

Deliverables

Three JRA1 deliverables produced DJRA1.1 - Grid application requirements and commonalities

assessment M06, 7 PM, UoB-RCUB, Editor: B.M.

DJRA1.2 - Application-specific monitoring and control tools design

M08, 12 PM, IPP, Editor: E.A. DJRA1.3 - Application services design report

M12, 10 PM, UoB-RCUB, Editor: B.M. DJRA1.4 - Application services implementation and

deployment report M22, 30 PM, UoB-RCUB, Editor: B.M.

DJRA1.5 - Assessment of operational tools developed M23, JRA1 28,5 PM, ICI, Editor: A.S.

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 3

Milestones

MJRA1.1 - Baseline analysis of operational tools M03, IPP: wiki, informal report

MJRA1.2 - Application commonalities assessed and areas of development identified M06, UoB-RCUB: DJRA1.1

MJRA1.3 - Operational tools implemented and running M16, IPP: wiki, informal report 5 in production, Logwatch-G and AMS in beta

MJRA1.4 - Selected application services implemented and deployed M24 Demonstration at review

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 4

Ongoing Developments and Metrics (PSC06 -> PSC07)

11 AS (7 major, 3 pre-existing as prototypes, 1 small effort with some initial interest) Described in DJRA1.1, DJRA1.3 and DJRA1.4

7 OT Described in DJRA1.2 and DJRA1.5

Black: As in DoWGreen: Achieved

M0 M12 M16 M19 M22 M24

MTJRA1.1AS developed

0/3 preexisting

2/4 production + 4 alpha/beta

6+5 7+4 8+3->1 α

6

MTJRA1.2OT developed

0/0 2/4 production + 2 alpha

5+2 6+1 7+0 4

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 5

Application Services(PSC06 -> PSC07)

Name Status Availability datePartners

SEE-GRID File Management Java API Production/stable Available UOBData Management Web Portal Production/stable Available UOBEvent Logger Production/stable October 08 UOB

Work BinderProduction/live -> Production/stable

October 08 UOB

SDS (Seismic Data Server) Applications Service

Beta -> Production/live

January 09

ULAKBIM TUBITAK

User Level Monitoring Tool Beta

Since beginning of 09Production version in second half of 09

UKIM

Common Workflow Repository Extension of P-GRADE Portal

Production/live -> Production/stable

May 09 SZTAKI

Environment oriented Satellite Data Processing Platform

Production/live1. October 09 (Phase 1)30. March 10 (Final)

UTCN

Mathematical Expressions Web Service Production/live June 09 ETFBG

Rendering Application Service M-PSC06Alpha ->Beta

July 09 FGA

Advanced-Workflow Development Tool and Orchestration Service

Alpha September 09 UKIM

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 6

Operational Tools(PSC06 -> PSC07)

Name Status Availability date Partners

JTS, Job Track ServiceM-PSC06, M-PSC07

Production/live February 09 IPP-BAS/UKIM

BBmSAM ExtensionsM-PSC06

Production/live March 09 UoBL

Grid Site Software Vulnerability Analyzer

Production/live-> Stable

March 09 SZTAKI

No Mercy Trouble Ticketing System M-PSC06

Production/live May 09 ICI

User/application specific grid infrastructure monitoring extension

Production/live-> Stable

OperationalRelease in July 09

SZTAKI

Logwatch Plug-ins for Grid Services M-PSC06

Beta ->Prod/stable

September 09 RBI

Alert Messaging ServiceBeta ->Production/live

September 09 UoB, IPP/UoBL/ICI

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 7

Status (OT + AS)

Status

M16

M16

M16

M16

M19

M19

M19

M19

M22

M22

M22

M22

0

2

4

6

8

10

12

Alpha Beta Production/live Production/stable

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 8

Internal JRA1 MetricsMeasure and compare the progress of AS & OT

Current status (only one of offered values, maximum is 8 points): 1 - Planning - Conceptual description, possibly with initial functional specification, or architectural

description 3 - Development - in progress, no working version available 5 - Alpha - working version exists, available only to developers 6 - Beta - working version exists, available to users 7 - Production/live - released, open to adding new features and bug-fixes 8 - Production/stable - released, developers still work on bug-fixes but it is closed for new features 7 - Production/closed - final version released, development closed NaN - Abandoned/Inactive - project abandoned before being released to production

Usage (additive for each named usage, up to 6 points): 2 – per each application currently using an application service (AS only) 1 - per each site having tool deployed (if applicable, OT only) or 1 - per each user (e.g. grid site administrator) using it in last 3 months (for OT only)

Presentation (only one of offered values, maximum is 6 points): 0 - No presentation or outdated presentation 2 - Up-to-date brief presentation (based on JRA1 presentation template) available (not more than 3 months

old) 4 - Up-to-date detailed presentation available (not more than 3 months old) 6 - Detailed presentation available with usage or performance analysis and live or recorded demo

Publications (additive 0.5 for each, up to 6 points)Visibility towards wider community (additive for each fulfilled indicator, but up to maximally 8 points)

1 - Software license defined and declared 1 - Introductory web site or Wiki with basic data and functional overview 2 - Architectural description available, online or within the corresponding JRA1-related project deliverable 2 – User documentation available (preferably online) fully covering typical usage, including deployment, if

applicable 1 - Source code available publicly or to all eligible users (in accordance with license), e.g. via download. 1 - Source code repository with version control available publicly or to eligible users

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 9

Visibility towards wider community

Visibility

0

2

4

6

8

10

12

14

16

18

Licensedefined and

declared

Basic site orWiki

Architecturaldescription

Userdocumentation

available

Source codeavailable

Source coderepository

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 10

JRA Metrics Reporting

Did not respond by the start of PSC06 BBmSAMeX (Mihajlo) JTS (Emanouil/Dimitar) Logwatch-G (Valentin) NMTT (Alex) RAS (Davor/Mirsad)

AWT added in an APExpected to provide an overview report at PSC07!

JRA1 Wiki has been greatly improved – also visible in metrics 51 edit since PSC06

JTS was late in reporting for PSC07 (again)50 conference and publication references reportedIn 2 cases there is a slight regression due to outdated presentations

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 12

Access to JRA1 Developments

http://wiki.egee-see.org/index.php/JRA1_CommonalitiesSignificant progress since PSC06: 51 editsMissing summary BBmSAMeX JTS NMTT ESIP-P MEWS

Issues persist Missing summaries Resource links Missing publications Collaborations (applications etc.)

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 14

Per-application conclussions

In good standing AMS, DM-Web, Event Logger, FM-J-API, Work Binder, CWRE,

USGIME, GSSVA, SDSAS, BBmSAMeX, ESIP Platform, Logwatch-G, JTS

Need to improve metrics RAS, MEWS, NMTT, AWT, ULMON

Need to improve usage AMS, USGIME

Need to improve presentation (PPT and Web/Wiki) Event Logger, FM-J-API, Work Binder, SDSAS, ESIP Platform,

Logwatch-GOK, but should improve visibility towards wider community GSSVA, JTS

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 18

Dissemination and Plans

EGEE UF5 JRA1 umbrella presentation at EGEE UF5 in Uppsala, Sweden, April 12-

15 by Anastas Mišev

Possible external verification: should advertise our software and collaborate with other related projects and user communities Information exchange (and possible collaboration) with Grid

Observatory – more details at EGEE UF5 Work Binder and ESIP-P made submissions to RESPECT program

Focus on (unchanged bullets!) Improvement of existing documentation, installation and user

documentation Making both code and packaged (installable) software available Start promotion of developments when they reach adequate level of

maturity

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 23

Source code availability and repository usage

Source and download 11Source only 2Download 2In metrics, 9 confirmed usage of a repositoryNo source or download links for BBmSAM, JTS, RAS

Should provide at least source code, if OK with licensingEGEE-SEE/SEE-GRID-SCI SVN-Trac Repository is available, anonymous R/O access also worksDownload of binaries is a nice commodity

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 24

Ongoing issues

Final push for usage by applications AMS - NMTT? BBmSAM – applications? Alignment with application commitments

Usage of sites/admins od OTs E.g.Logwatch-G looks rather handy, Valentin is a bit shy in

promotionMissing user documentation RAS, GSSVA, AWT, JTS

AWT still alpha!

Address reviewer OT recommendations in DJRA1.5 (there is also an analogy for AS in DJRA1.4)

SEE-GRID-SCI PSC07 Meeting, Žabljak, 22-23 January 2010 25

Actions to be Taken

One slide each AS/OT for EGEE UF Contributions to DJRA1.5Wiki, wiki wiki DJRA1.4 helped AS DJRA1.5 for OT User documentation (4 missing) At least basic installation instructions, as done for RESPECT

Make at least source code available

Final metrics report at M24