CGSP and Vega in ChinaCGSP and Vega in China

Zhiwei XuInstitute of Computing Technology

Chinese Academy of Scienceszxu@ict.ac.cn

OGSA-UK MeetingJanuary 31, 2005, London

National Grid Projects in China

Net-based Science Environment

Plan

Research

Develop

Construct Procure Deploy Operate Manage

E-Science Data Grid

Science and Technology R &D Assets Foundation Platform

Next-Generation Network Initiative

Edu. & Res. Grid

ChinaNational

Grid

StateCouncil

NSFC

CAS

MoE

MoST

NationalPlanningCommission

Semantic Grid

Digital China Grid (2006-2020)

ChinaGrid Structure

Campus Grids

大科防国

清华学大

大科华中 学大

山中 学大京北

大交海上

大交安西

学大北东

工理南华

航北

学大南东

学大 东山

Massive DataProcessing

CFD

DistanceEducation Bioinformatics

ImageProcessing

CGSP’s modules

Portal

Information Center

Uniform Management

Computing Nodes

Secu

rity Mod

ule

Grid Developing Environment

Portal:Grid entry for submitting & monitoring job, querying resources’ info, user management and accouting etc.

Grid Developing Environment: a set of toolkits including portal development tools, resource encapsulation tools, programming tools and job generation tools etc.

Information Center:the manager of resource & service information

Uniform Management:a set of managers including job manager, data center, domain manager and service container.

Security:Identity authentication and mapping, service and resource authorization, secure transferring etc.

GSI

WS-Security

CAS

SimpleCA

Data Managemen

tSecurity

WSCore

Resource Managemen

t

Information Services

Authz Framework

RFT

RLS

OGSI-DAI

New GridFTP

XIO

JAVAWS Core(WSRF)

C WS Core(WSRF)

MDS2

WS-Index

Pre-WSGRAM

WS-GRAM

CSF(contribution)

pyGlobus(contributed)

Python Bindings(contributed)

Data Center(CGSP)

Data Center(CGSP)

Portal SDK(CGSP)

Portal SDK(CGSP)

Programming Toolkits(CGSP)

Programming Toolkits(CGSP)

Resource-Index(CGSP)

Resource-Index(CGSP)

HyperService(CGSP)

HyperService(CGSP)

Proxy(CGSP)

Proxy(CGSP)

MetaData-Man(CGSP)

MetaData-Man(CGSP)

InterDomain(CGSP)

InterDomain(CGSP)

Topologic(CGSP)

Topologic(CGSP)

RemoteDeploy(CGSP)

RemoteDeploy(CGSP)

Job Manager(CGSP)

Job Manager(CGSP)

WorkFlow(CGSP)

WorkFlow(CGSP)

HotDeploy(CGSP)

HotDeploy(CGSP)

GT3.9 and CGSP

What Is Vega?• Grid related research thrust (brand) at ICT since 1999• Founded by MOST, CAS, NSFC, industry People

Grid system software (GOS) 40 Information Grid software (VIG) 10 Service Grid software (VINCA) 30 Basic research and semantic grid (Vega-KG) 30 Share common philosophy VEGA 110

– Versatile Services– Enabling Intelligence– Global Uniformity– Autonomous Control

• Vega Grid Inc. established in 2004• Software versions 2000 2003 2005

GOS (started in 1999) 0.5 1.0 2.0 VIG (started in 1999) 0.6 1.0 2.0 VINCA (started in 2002) 1.0 2.0

ResourcesGOS

VIGVINCA

Apps

Ad hoc GT3 WS-I

Vega Grid Software Suite

Distributed Resources and ServicesDistributed Resources and Services

Service GridVINCAInformation Grid

VIG

Vega System Software GOS

Vega Grid Targeted Users

• Universities

• Research institutes

• Manufacturing (Aviation, Space, Automobile)

• Weather, traffic, railways, supply chain

• Underground water, minerals, irrigation

• Petroleum

Vega Grid Software

Distributed Resources and Services

App Scope of Vega Grid Software

ScienceResearch

Manufacturing Resources and Environment

Services Sector

Vega Grid Architecture

GR

GSML PageClient

Effective

Virtual

Physical

Internet

GSML PageGSML Page

Grip1 Grip2 Grip3 Grip4

Grid Operating System （ GOS Kernel, Core, Libraries, Utilities）

Beijing Node

GSGR

Shanghai Node

GSGR

Xi’an Node

GS

Server PhysicalResource

GR Grid Router GS Grid Switch

Agora 1 Agora 2

MapperComposer

Composing Mapping

DawningDagger

EffectiveResource

VirtualResource

Vega GOS

Agora Service Engine

Java J2SE, J2EE/Microsoft Windows

GOS Hosting Environments

GOS Core Services

Service BUS

User Mgmt. EngineAgora

AccountVerification

Global UserAuthentication

Resource Mgmt. EngineService AddressTrans.

PT

Policy Engine

Resource Authority

Grip Engine

Grip Container

Grip Lifecycle Mgmt.

Core Libraries (Core API)

GOS System Services

File Services Database ServicesData BUS

Certificate/CA Mgmt.

System Mgmt. Services

Metadata Services

Information Integrator

Inforamtion BUS

TransformationStabilizer

Data Integrator

Computing Services

DDS

Batch Services

Legacy Resource

IntegratorMonitor

Logging Audit

Config

System Libraries (System API)

Portal Engine GSML Interpreter Abacus Compiler Workflow Engine

Grid PortalGSML

BrowserAbacus Studio

Vinca Workshop

Build-in Utilities

...

Tomcat(Apache)

WebSphere(IBM)

WebLogic(BEA)

.NET(Microsoft)

GT4(Globus)

User Def.Apps.

Service Router Service Registry Service Adapter

GOS Applications

ExtendedSystem

Services

Vega GOS and OGSA V1.0

• Vega is an implementation of (part of) OGSA• Vega would like to contribute to OGSA

After implementation and testing (running codes) Loose coupling Partner with other groups Focus on 4 key issues and aim at minimal common requirements

• Naming, Process/States, VO, Programming

• Vega complements existing grid projects Focus on implementation architecture, not protocols/services

• Use computer systems approach, not middleware or network Utilize existing software

• At Vega GOS kernel level– Apache; OMII, GT4; Commercial

• As services• At Vega GOS application level

Security in Vega GOS• End-to-End

From user log-on to physical resource execution Details are hidden from user/developer

• Based on WS-Security Cert based authentication; Token based authorization & AC; signature

Web uCert

Portal/Server

uid/pass

Grip Container

Agora pCertpCertpCert

Phy Svc Phy SVC Phy SVC Phy SVC

pCertuTK

pCertuTK

pCertuTK

pCertuTK

User Res AA

uTKuTKuTK

Other Client

pCert

uCert

Naming in OGSA and Vega GOS

• Vega matches OGSA 3-level naming convention OGSA Human-Oriented Abstract

Address Vega (EVP) Effective Virtual Physical

• OGSA Naming specification must include Precise definitions and axioms Syntax and semantics (rough consensus)

• Who provides, uses, and maintains such names• Scoping and name/address space• Full Lifecycle• Mapping, resolution, binding• Exception handling• Provision for resources

VO in OGSA and Vega GOS

• There is no precise definition of VO in OGSA

• Agora is a concrete example of VO (community)

• Agora has a precise definition, and it holds Subjects, objects, context/policies information Agora-related system services

• Agora is persistent and “static”

• Application programmer knows the agora concept, but agora does not appear in app codes

Process/States in OGSA and Vega GOS

• There is no process concept in OGSA 1.0• Grip is distributed process in grids environment

A runtime construct representing a subject (a grid user running a grid application) to access and utilize objects (grid resources and services)

• Classification of “states” Session related Application logic specific Grid system related Resource related Service specific

Grip

Core and Kernel

Put It Together

Web

GripUser, App Logic

Address Space, States

AgoraPolicies:

Security and Selection

Phy Svc Phy SVC Phy SVC Phy SVC

Other Client

System ServicesResource Services

UI and Utility Tools

Common Supports

not per-service or per-application codes120 KLOC

Follow the E2E and KISS principles Loose coupling; Hide details, reduce coding; Try to minimize abstractions

4 abstractions: User, (Effective) Service, Grip, Agora5 API “functions”

Vega GOS Roadmap in 2005

• 2004.11 2.0 preview Sample Apps

• 2005.2 2.0 alpha

• 2005.4 2.0 beta CNGrid Apps

• 2005.6 2.0 CNGrid Deploy

• 2005.7 2.0 on OMII Other Apps

• 2005.11.30-12.3 CI6016 & GCC 2005 Exhibit www.ict.ac.cn/ci6016

GOS mail-list ： gos@software.ict.ac.cn

CNGrid ： http://www.grid.org.cn/

Vega GOS ： http://vega.ict.ac.cn/

Summary

• Grid activities in China are still growing• CGSP started development in 2004

extends WSRF (GT 3.9), will release V1.0 this year

• Vega started in 1999 China apps driven, while learning from international community Will release V2.0 in June 2005 Based on WS-I and uses a computer systems approach

• Vega and OGSA Partner with OGSA-UK

• Use OMII as a kernel and system services• Naming (EVP), Grip, and Agora