optiputer and aist
DESCRIPTION
OptiPuter and AIST. Tomohiro Kudoh Grid Technology Research Center (GTRC), National Institute of Advanced Industrial Science and Technology (AIST). Who we are. - PowerPoint PPT PresentationTRANSCRIPT
OptiPuterand AIST
Tomohiro Kudoh
Grid Technology Research Center (GTRC), National Institute of
Advanced Industrial Science and Technology (AIST)
Who we are
• AIST (National Institute of Advanced Industrial Science and Technologies) is Japan's largest public research organization with more than 50 research units and 2,500 researchers.
• GTRC (Grid Technology Research Center) is a research unit of AIST, established in 2002. GTRC has more than 50 researchers.
• GTRC/AIST is a new partner of OptiPuter– Became a affiliate member this year
Grid Technology Research Center
3
GridMPI™
ED grid Software Architecture
Local Site Data
Local Site Data
E- Defense daq
Data AcquisitionHDTV image
E- Defense daq
Data AcquisitionHDTV image
ED pop @MikiCollaborationTelepresenceLocal Data Tools
ED pop @MikiCollaborationTelepresenceLocal Data Tools
Client ToolsWeb BrowserChef (EN)Simulation portal
Client ToolsWeb BrowserChef (EN)Simulation portal
Remote Researcher
E-Defense Facility
ED grid central
Facility SiteED pop @XX
Local Data ToolsComputing resources
ED pop @XXLocal Data ToolsComputing resources
Local Site Data
Local Site Data
Data AcquisitionData Acquisition
Simulation program
Simulation program
Sensor GridSensor Grid
ED pop @YYComputing resources
ED pop @YYComputing resources
IT service Site
AuthenticationAuthorizationData Repository
Coming Soon: (NEESit)Simulation/ Analysis & Visualization tools
AuthenticationAuthorizationData Repository
Coming Soon: (NEESit)Simulation/ Analysis & Visualization tools Data Cache
RepositoryData CacheRepository
GridAuthCA
Data Integration/FederationCommon formatPOP interoperabilitySimulation portal
EDlite/GT4
EDlite/GT4
EDlite/GT4
EDlite/GT4
NEW!!NEW!!
E-Defense Grid
Geo Grid Web service platform
Geo Grid Web service platform
AIST Geo Grid
GEONGEONInteroperable
ASTERMODIS
L1A
Geometric correction
DEM
East/SouthEast ASIA15m resolution
Possible collaboration
Application Simulation
Geo Grid Portal (GEON base)
Geo Grid Portal (GEON base) GEON PortalGEON Portal
Interoperable
AISTCA
GEONCA
Cross Trust
Inter-exchangeable Data FormatDistributed Data Storage
Visualizationservice
Tiled Wall DisplayApplication
•Have own DEM data of E/SE Asia at 15m resolution•Have common architecture so that
•Share data•Share Application
•Have own CA at each site to allow multi CA in future•Tele visualization on Tiled Display and its user I/F•More insight: (future)
•Exchange raw data between US/JP
AIST GEO Grid Grid ASPグリッド技術を用いてユーティリティサービスを実現する次世代IT基盤のフレームワークを開発するプロジェクト。経済産業省によるビジネスグリッドコンピューティングプロジェクトの一環として実施中。
■GridASPの技術的特徴
一般ユーザ
SP
AP
RP
ユーザ情報やデータの秘匿•匿名IDによるRPへのユーザ情報隠蔽•SPに対するユーザデータの暗号化
三種類のプロバイダによる連携•アプリケーションの自動配備•リソースに関する情報サービス
Users SP RP
Real ID AnonymousID
Real World Anonymous World
(1)Authentication (2) Trusted SP
Data Data DataData(3) Encryption (5) Decryption(4) Transfer
Shared key cryptosystemsecret key secret key
AP RPSP
Application Pool
Management node(Deployment Engine)
Resource nodeResource nodeResource node
Cluster
AppApp App.
Info.
App
ApplicationDB
DeploymentManager
App
AppApp
DeploymentDescription
App.Info.
DeploymentDescription
(5) Transfer
DeploymentDescription
(6) Installation
(2) RequestInstallation
(3) Searches DBs
(7) Register
(1) Upload
(4) Notice& Confirm
ResourceDB
Application Manager System Manager
Ex. Smith Ex. user12
Ex. Structures of candidate molecules
Ex. cd $userdir/app/rpm –r app.rpm ….
Users SP RP
Real ID AnonymousID
Real World Anonymous World
(1)Authentication (2) Trusted SP
Data DataData DataDataData(3) Encryption (5) Decryption(4) Transfer
Shared key cryptosystemsecret key secret key
AP RPSP
Application Pool
Management node(Deployment Engine)
Resource nodeResource nodeResource node
Cluster
AppApp App.
Info.
App
ApplicationDB
DeploymentManager
App
AppApp
DeploymentDescription
App.Info.
DeploymentDescription
(5) Transfer
DeploymentDescription
(6) Installation
(2) RequestInstallation
(3) Searches DBs
(7) Register
(1) Upload
(4) Notice& Confirm
ResourceDB
Application Manager System Manager
Ex. Smith Ex. user12
Ex. Structures of candidate molecules
Ex. cd $userdir/app/rpm –r app.rpm ….
図中の説明は日本語化
一般ユーザ GridASP
テクニカルアプリケーション実行サービス
一般ユーザ GridASP
テクニカルアプリケーション実行サービス
三つの組織の連携によるASPの実現
・SP (Service Provider)・AP (Application Provider)・RP (Resource Provider)
① Promoting Grid technology with real application experiments ② Developing Grid middle wares
③ International collaboration and standardization activities
Gfram 1.1.1 (5/17)Ninf-G 2.3 (12/21)Grid MPI 0.2 (11/07)
Some of main research themes at GTRC/AISTSome of main research themes at GTRC/AIST
What we (will) do (in terms of OptiPuter)
• Data-Intensive research and collaboration– Tiled display system and SAGE– AIST GEO Grid and GEON
• Optical network infrastructure– G-lambda project
Tiled Display at AIST
A tiled display system which uses the SAGE environment
AIST GEO Grid
GTRC and Institute of Geology and Geoinformation of AIST will collaborate with GEON project at UCSD
Geo Grid Web service platform
Geo Grid Web service platform
AIST Geo Grid
GEONGEONInteroperable
ASTERMODIS
L1A
Geometric correction
DEM
East/SouthEast ASIA15m resolution
Application Simulation
Geo Grid Portal (GEON base)
Geo Grid Portal (GEON base) GEON PortalGEON Portal
Interoperable
AISTCA
GEONCA
Cross Trust
Inter-exchangeable Data FormatDistributed Data Storage
Visualizationservice
Tiled Wall DisplayApplication
Optical network + Grid • OptiPuter is a textbook case
– We have a lot to learn from OptiPuter– In Japan, situation is a little bit different from that of US
• Joint project of network and computer science research is not common
• Network carriers have strong will and ability to create new services
– We are trying to find a way to realize lambda path service in cooperation with network carriers
• G- lambda project– Define an interface between users and GMPLS network
carriers– Advance co-reservation of computing and network reso
urces– Collaborative project of AIST, KDDI lab., NTT, NICT– Demo at RICE station, from 1:30pm
8
Overview of G-lambda project• To make lambda path service available for everyone
– Lambda path service should be a “commercial service”• Well defined standard interface between users and network operators is
required• Isolate detailed network control from users
• To realize inter-carrier service– A standard lambda path control protocol should be used
– One of the most viable protocols for lambda path control and management
• To realize stable and high quality service on Grid at low cost– Dynamic provisioning of stable wide-BW network
GNS-WSI: Grid Network Service / Web Services Interface
GMPLS (Generalized Multi-Protocol Label Switching)
Simultaneous advance reservation of both computing and lambda path resources
9
Demonstration Overview
① User requests service via GUI, specifying the required number of computers and thenetwork bandwidth needed
Grid Resource Scheduler (GRS)
Computing Resource Manager(CRM)
Network Resource Management System (NRM)
②The computing resourcesand GMPLS network resourcesare reserved as the result of
interworking between the GRS and NRM using GNS-WSI(Grid Network Service /Web Services Interface)
GNS-WSI
1 10
5
1Gbps0.
5Gbp
s
GUI
1 10
5
1Gbps0.
5Gbp
s
GUI
AISTAISTTsukubaTsukuba
JGN JGN ⅡⅡ Osaka Osaka Research CenterResearch Center
AISTAISTAkihabaraAkihabaraJGN Ⅱ
Gigabit Ether ( X n streams)
Cluster
GMPLS Router
Optical Cross-Connect
JGN IIJGN IIFukuokaFukuoka
JGN IIJGN IIKanazawaKanazawa
KDDIKDDI Labs.Labs.KamifukuokaKamifukuoka
AISTAISTTsukubaTsukuba
JGN JGN ⅡⅡ Osaka Osaka Research CenterResearch Center
AISTAISTAkihabaraAkihabaraJGN Ⅱ
Gigabit Ether ( X n streams)
Cluster
GMPLS Router
Optical Cross-Connect
JGN IIJGN IIFukuokaFukuoka
JGN IIJGN IIKanazawaKanazawa
KDDIKDDI Labs.Labs.KamifukuokaKamifukuoka
③ A molecular dynamics simulation is executed using the reserved computers and lambda paths. Ninf-G2 and GlobusToolkit 2 (GT2) are used at each cluster.
WS-RFWS-RF
GT4GT4
Web Services I/F
GMPLSGMPLS
10
Request computers and bandwidth
Required # of CPULocation can bespecified (optional)
Required path andbandwidth
A total of 37 CPUs at 4 locations and star shaped paths are requested
Duration of reservation
Deadline ofjob completion
11
Advance reservation status
CPUs reservation status Paths reservation status
# of CPU
The pathTKB-KMF
Reservation status of TKB cluster
time
Current time
12
Current CPU and paths
Paths are displayed based on the information from GMPLS routers
Summary
• AIST is a novice partner of OptiPuter• We have a lot of possible collaboration r
esearch themes– Tiled display– Geo science research– Lambda path services– Transport protocol…
• We are looking forward to future collaborations with OptiPuter partners.
14
Live demo of G-lambda
JA101
1:30pm-3:00pm at RICE station
Thank you!