16 february 2006 ictp/infm workshop on porting scientific application on computational grids pag 1...

16 February 2006

ICTP/INFM Workshop on Porting Scientific Application on Computational Grids Pag 1

COMPANY PROFILE 2005

ENGINEERING ENGINEERING GROUPGROUP

Andrea Manieri

Grid Initiatives Coordinator

[email protected]

16 February 2006


100%

99,95%

55%

98%

100%

51%

ENGINEERING ENGINEERING SANITA’ ENTI LOCALISANITA’ ENTI LOCALI

ENGINEERING ENGINEERING PROGETTI SPECIALIPROGETTI SPECIALI

ENGINEERING MANAGEMENT ENGINEERING MANAGEMENT CONSULTINGCONSULTING

100%

70%

100%

100%

55%

OVERITOVERIT80%

CARIDATACARIDATA

55%

NETANETA

NEXENNEXEN

SITELSITEL

ENGITECH LTD.ENGITECH LTD.

ENGIWEB SECURITYENGIWEB SECURITY

SOFTLABSOFTLAB

Nuova Nuova TRENDTREND

BIP - BUSINESS BIP - BUSINESS INTEGRATION PARTNERSINTEGRATION PARTNERS

ENGINEERING INGEGNERIA INFORMATICAENGINEERING INGEGNERIA INFORMATICA

The Engineering GroupThe Engineering Group

16 February 2006


ENGINEERING INGEGNERIA INFORMATICA

System e Business Integration projects

Application Management Services

Outsourcing

Co-founders67%

Market33%

Stocks distribution

The Group LeaderThe Group Leader

16 February 2006


System & Business Integration, Outsourcing

ENGINEERING INGEGNERIA INFORMATICAENGINEERING SANITÀ ENTI LOCALI CARIDATAENGITECH LTDNETA

Managerial Consultancy

BIP-BUSINESS INTEGRATION PARTNERS ENGINEERING MANAGEMENT CONSULTING NEXEN

Services and Software Development

SOFTLABENGINEERING PROGETTI SPECIALI

Security and Logistic

ENGIWEB SECURITYSITEL

Training

SCUOLA DI FORMAZIONE ICT “Enrico Della Valle”

Technologies and Products

ENGINEERING SANITÀ ENTI LOCALIENGIWEB SECURITYOVERIT NETANUOVA TREND

The business segmentsThe business segments

16 February 2006


38 offices

4.100 employees

About 750 customers

More than 1400 consultants

DublinoDublino

BruxellesBruxelles

Engineering and the territoryEngineering and the territory

16 February 2006


R&D Mission

Study of “principles, methods and principles, methods and technologies to improve and expand the technologies to improve and expand the Business opportunitiesBusiness opportunities” and transfer of the acquired know-how to production departments and controlled companies.

Concretely: Technical support to tenders and to

development of new businesses Participating to research project co-financed

by European and Italian funding bodies Disseminating and transferring of know-how

through course tuition, papers, reports, ecc.

16 February 2006


Research Areas and related Projects

Service-based

Semantic-aware

CCUBOFoodNet

BRICKSCALLASCASPAR

Grid technology

DILIGENTBelief

Trustworthiness

Discorso

SeCSESERENITYPEPERSSFORCE

ETICS

16 February 2006


Present:System Integration

Next Future:Distributed and heterogeneous

Services Federation

Past:Single Product Delivery

The ITC evolution – our vision

16 February 2006


Grid

The evolution of Enterprise ITC architecture

Hw

Mw

App …App App

App …App App

Mw

App…

App App

Mw …Mw Mw

Hw …Hw Hw

Mw

Hw Hw Hw…Centralisation

Disintegration

Integration

(Font: I.Foster, S.Tuecke – The different faces of IT as service, ACM Queue July/August 2005)

16 February 2006


Open Issues for Commercialisation

Lack Stable and proven version of grid middleware

Unclear evidence of standards (OGSA, WSRF,…) Concrete demonstrations for final user benefits

Reduction of HW costs by re-use and by optimisation Certainty of porting costs Usability of grids Infrastructure and related applications

Security and Trustiness on The infrastructure itself Confidentiality and privacy of data and contents Workload measures for accounting (for multi-domain

grids)

16 February 2006


GÉANT .

INFRASTRUCTURE

eIn

fras

tru

ctu

reGRID .

INFRASTRUCTURE

KNOWLEDGE .

INFRASTRUCTURE

3D processing

Speech recognition

Feature extraction

Supporting eScience

First step:Di l i gent

A DIgital Library Infrastructureon Grid ENabled Technology

16 February 2006


DILIGENT objectives

Develop a Digital Library Test-bed Infrastructure that will allow members of dynamic virtual research organizations to create on-demand transient digital libraries based on shared computing, storage, multimedia, multi-type content and application resources

“Digital libraries are not ends in themselves; rather they are enabling technologies for digital asset management, electronic commerce, electronic publishing, teaching and learning, and other activities.”

Fourth DELOS Workshop, Budapest, 2002

16 February 2006


DL definition

•The Digital Library is:•The collection of services

•And the collection of information objects

•That support users in dealing with information objects

•And the organization and presentation of those objects

•Available directly or indirectly

•Via electronic/digital means.

•(Dlib WG –1998)

16 February 2006


DL definition adopted by DILIGENT

•“A digital library is an institution which performs and/or supports (at least) the functions of a library in the context of distributed, networked collections of information objects in digital form.

•The functions meant are:

•selecting, collecting, preserving, organizing, representing, providing access to, ensuring knowledge of, and disseminating information objects,

•mediating and supporting interaction between information users and information objects.” By Nickolas Belkin

16 February 2006


DILIGENT Architecture

EGEE/ gLite Middleware

Information ServiceBroker

&MatchMaker

Keeper

DL Generator

Process Design & Verification

Process Execution & Reliability Metadata

Management

An

nota

tion

SearchIndex

Data Fusion P

ers

onal

iza

tion

Fea

ture

E

xtra

ctio

n

Content Source Description & Selection

Portal Generator

Co

lle

cti

ve

La

ye

rD

igi t

al

Lib

r ar y

La

ye

rA

pp

lic

ati

on

S

pe

ci f

i c L

ay

er

DL Creation & Management

Process Management

Content & Metadata Management

Index & Search Management

Dynamic Virtual Organization

Support

MetadataBroker

ContentSecurity

Visualization

Content Management

Sto

rage

Mo

nito

r

Con

ten

t W

rap

per

Process Optimization

Application Specific Functionality

16 February 2006


EGEE – DILIGENTresources

VDL

WEBdata sources

DLMS Interface

D-Portal

ImpECt Web Portal(public/private part)

DL-Portal

ImpECt community

DILIGENT Web portal (public/private part)

ImpECt Owner

LoginVDL creation

Contents identificationServices and Web Portal

default

configuration

Users identification

Access to VDL contents and services

ImpECt communitydata sources

DILIGENT Scenario

16 February 2006


• CERN, INFN, Engineering,4D Soft, University of Wisconsin

Using grid for Integration, testing and quality assurance

16 February 2006


ETICS in a Nutshell

ETICS stands fore-Infrastructure for Testing, Integration and Configuration ofSoftware

It has been allocated 1.4 M€ It has a duration of two years The starting date was January 1st, 2006

16 February 2006


The ETICS Consortium

Build system, software configuration, service

infrastructure, dissemination, EGEE,

gLite, project coord.

Software configuration, service infrastructure, dissemination

Web portals and tools, quality process, dissemination, DILIGENT

Test methods and metrics, unit testing tools, EBIT

The Condor batch system, distributed testing tools, service infrastructure, NMI

16 February 2006


The ETICS Principles

OperationsETICS will run a comprehensive software engineering service for other projects to use it. All services are accessible from a web portal and can run locally or remotely

InformationETICS will collect and share information about the software it hosts, its characteristics, configuration, requirements to help users and developers make informed, interoperable choices

CertificationETICS will conduct a feasibility study on a QA process for distributed software that will lead to a future Certification Process

16 February 2006


I - Operations

InfrastructureInfrastructure

Reporting

ServicesServicesSoftware Configuration

and Repository

Build System Distributed Test System

CLI / Web PortalCLI / Web Portal

16 February 2006


II - Information

Interoperability Benchmarks and test results

Package repositoryGuidelines, how-to’s

and best-practice recipes

Software configuration, requirements and dependencies

Standards compliance

Tools

Quality Assurance and metrics

Projects managers, integrators, testers

Application developers

Certification process

16 February 2006


III - Certification

Standards, QA, interoperability, …

In what sense software is “good”?

The software adheres to agreed standards, it does what it is supposed to do, satisfied a number of qualitative and quantitative requirements, etc, etc, etc

ETICS PABUser communities

ETICS

16 February 2006


EGEE2 and Other Collaborations

The ETICS services are intended to provide from the start the integration, testing and QA tools for EGEE2, Diligent and other projects

Part of the infrastructure and tools are the same already used by project like Condor and GT4. It’s the NMI service run by the UoW

Other projects developing software and in particular applications providers are more than welcome to use the services and tests their products with ETICS

ETICS has an explicit mandate to provide training and promote dissemination activities related to the ETICS services, but also to software processes and quality assurance in general

One of the major goals of ETICS is to strengthen the interoperability and quality of middleware and applications developed for the Grid and other complex distributed environments

16 February 2006


International Cooperation

Grids (Computational, Data, Resource,…) have Net Externality-based value

Italian, or European cannot see Emergent Economies such as India, China, Latin-America Countries

Engineering consider that new form of business, based on services could happen from the cooperation with Emergent Economies and want to ride this opportunity.

16 February 2006


Belief Support Action

To deliver brainstorming events on strategic multidisciplinary topics;

To deliver strategic networking workshops with major potential user communities;

To deliver two international conferences in India and Latin America

To develop, maintain and populate a multimedia Digital Library for any documentation produced by eInfrastructure projects and initiatives.

http://www.beliefproject.org

16 February 2006


I-Ching proposal (IST call 6th) To build upon existing Chinese and European

links for development of research and commercial opportunities;

To leverage and collaborate together EU & China teams both from industries and academies:

To define open-source and new licensing models strategies

To exploit Scientific Repositories and Audiovisual

Archives

To move forward to a Standard Certification Process

for Quality Assurance. To attract greater interest from Chinese

Industry & researchers to use European Grid technologies & allow Europeans for strategic partnerships with China

To execute on an adequate communication scheme that help the mutual understanding between two different culture.

16 February 2006


New fields of interest: Finance

Using Grid to boost Financial Applications and, hence, renew the Banks and Insurance markets GRIFIN [MIUR] proposal for secure and trustiness

of Grid infrastructure for Finance applications Univ. of Lecce

MONEY [IST-NEST] proposal for grid infrastructure to enable NLP analysis of market news for improving analysis on market values share

Univ of Roma “La Sapienza” DFKI CELI CCFEA

16 February 2006


New fields of interest: Media Grid infrastructure to store, curate and

delivere audiovisual and multimedia content DEMETRA [MIUR] proposal for using grids and

satellite communication for a secondary schools networks accessing RAI archives

DualTV RAI Educational Univ. of Trento

(name TbD) [IST call 6th] Use Grid technology and existing grid-based Infrastructure to support Interactive TV

Metaware Microsoft Other LAC partnerships

16 February 2006


Conclusions

There can be concrete commercial exploitation behind the grid “buzzword”, provide that: will be defined Open Standards (I.e. Web-

services) Will be created an “institution” at EU level to

ensure the operation of a grid-based Infrastructure (not only for eScience)

Will be achieved a widely accepted Quality Certification for grid applications

16 February 2006


Acknowledge Some slides have been kindly supplied by

Luigi Fusco from - ESA/ESRIN Donatella Castelli – CNR ISTI Alberto Di Meglio - CERN

Andrea Manieri ([email protected]) ENG grid initiative coordinator

Thanks for your attention

16 february 2006 ictp/infm workshop on porting scientific application on computational grids pag 1...

Documents