jian gui wang new implementation of agriculture models apan19---jan. 25 2005. 1. new implementations...

Jian Gui WANG New Implementation of Agriculture Models APAN19---Jan. 25 2005 . 1.

New Implementations of Agriculture Models Using Mediate Architecture

J. G. Wanga A. Yamakawaa M. Laurensonb H. Y. Menga S. Ninomiyaa

a. National Agriculture Research Centre Tsukuba, Japanb. Horticulture and Food Research Institute of New Zealand, Auckland New Zealand


Introduction--AGmodel

MetBrokerPSE

Some Issues

New Implementations

Variant Access Method

MetBrokerEJB

Multiple Broker Server

Conclusion

Outline


Introduction -- AGmodelData Grid Virtual integration and coordination of heterogeneous databases and application programs

AGmodel project provides tools for speeding the development of portable AGriculture Models

AGmodel can be easily run in any country rather than being tied to a particular database

Agricultural software applications can access these hubs using distributed computing approaches

Open source Project, developing open source package and using open source third party software.


MetBrokerPSE - First Implementation

MetBrokerPSE MetBrokerPSE First implementation of Agmodel, First implementation of Agmodel, – based on mediator architecturebased on mediator architecture– provide applications with consistent access to remote weather provide applications with consistent access to remote weather

databasedatabase– Java language packageJava language package

Meta DB

AWeather

DB

C

WeatherDB

BWeather

DBMetBroker

Weather Browser

Pesticide

Farm Management

RMI

ApplicationsD

Weather DB

– Coverage of weather dataCoverage of weather dataJapan, New Zealand, a partJapan, New Zealand, a partarea of some counties,area of some counties,such as Korea, Norway,such as Korea, Norway,South Africa and USASouth Africa and USA

– Commercial databaseCommercial database PSEPro employed to PSEPro employed to store metadatastore metadata


Demonstration

Connected by Java RMI application

Access with region and weather station– provides element provides element

histogramhistogram– text and graphic formattext and graphic format

Access with spatial requiring


Some Issues with First Implementation

Global coverage is limitedGlobal coverage is limited– Number of weather database Number of weather database

Firewalls blocking direct Java RMI access Firewalls blocking direct Java RMI access

Java application access onlyJava application access only

Cannot have own copy due to PSEPro licenseCannot have own copy due to PSEPro license

Tight relation between MetBroker core and MetadataTight relation between MetBroker core and Metadata

Fixed elements of measurementFixed elements of measurement


Improvements

HTTP wrapper service– MetBroker can be accessed by Java RMI and HTTP– provide firewall friendly access

Developed the driver for NOAA/WMO– Metrological data archive– provide more 8000 weather stations– cover about 220 counties in the world wide

Mechanism of updating the meta-database– Automatically updating metadata

Adopt database connection pooling – Sharing server resources– Improved the access performance

Different versions of MetBroker to fix variant issues


Current Coverage of MetBrokerCurrent Coverage of MetBroker

~25 remote DB 16,000 weather stations


MetSOAP – Multiple Access Method

MetSOAP, A language-independent way of executing MetSOAP, A language-independent way of executing Remote Procedure Calls (RPCs).Remote Procedure Calls (RPCs).Directly access MetBrokerDirectly access MetBroker

from from Excel spreadsheets, Excel spreadsheets,

Visual Basic, Delphi, ASP,C++Visual Basic, Delphi, ASP,C++

SOAP-based webSOAP-based webservice service People can use People can use other language toother language todevelop their client develop their client application softwareapplication software


MetBrokerOzon -New Implementation

Employed an open source OODB—Ozone DB Matching our open source policy Server managed proxy connection Meta database can be run as a remote DB

Full compatibility with MetBrokerPSE applications, database drivers, and configuration files Java language package

Developed with open source or free to use third party software Metadata

Ozone DB

AWeather

DB

CWeather

DB

BWeather

DB

MetBrokerWeather Browser

Pesticide

ApplicationsD

Weather DB

Farm Management


MetBrokerlite – a lightweight implementation

Full compatibility with MetBrokerPSE applications, database drivers, and configuration files.

Keep metadata in the memory.

Offer raw data to client.Offer raw data to client.

All third party software are open source or All third party software are open source or

free to use.free to use.

Suitable for Remote Database

with small scale.

Easy to install in anywhere

or on any system.C

Weather DB

BWeather

DB

MetBrokerliteWeather Browser

Applications

AWeather

DB

Farm Management No Meta DB


MetBrokerEJB latest implementation

A new implementation based on J2EE architectureA new implementation based on J2EE architecture

Independent four modules: multiple protocols Independent four modules: multiple protocols connection, Client interface, MetBroker Core, connection, Client interface, MetBroker Core, Remote database driver beanRemote database driver bean

Integrate HTTP wrapper, SOAP interface and RMI Integrate HTTP wrapper, SOAP interface and RMI as one serviceas one service

Use RMI-IIOP protocol instead of RMI-JRMP Use RMI-IIOP protocol instead of RMI-JRMP protocolprotocol

Use Resource Description Framework (RDF) Use Resource Description Framework (RDF) and Web Ontology Language (OWL)and Web Ontology Language (OWL)


MetBrokerEJB (cont'd)

SOAP

HTTP

Access toremote DB

MetBroker Interface

Broker Driver farm

Access toremote DB

Access toremote DB

Metadatamanagement

Server

Flash Remoting

MetSOAPinterface

RMI

Protocols Client Interface MetBroker Core Driver bean

Delegate functions to the J2EE container Improve the extensibilityImprove the extensibility



Multiple protocols managementMultiple protocols management– Built with JBoss, much stronger function and easier Built with JBoss, much stronger function and easier

operationoperation– RMI, HTTP, SOAP, Flash Remoting, ...RMI, HTTP, SOAP, Flash Remoting, ...

Remote DB DriverRemote DB Driver– Independently– Managed by Driver bean – can be used as “plugcan be used as “plug”

Dynamical elements for measurement

Flexible metadata update and management

HTTP tunneling

HandlingSOAP message

Session Management

Driver Handling

MetadataManagement

Process client request

Calculation

Access to Remote database

Wrapper Servlet

MetSOAP



Integrate multiple protocolIntegrate multiple protocol

Build with JBoss, offers SOAP serviceBuild with JBoss, offers SOAP service

Install OpenAMF with JbossInstall OpenAMF with Jboss

system is able to support system is able to support

Flash RemotingFlash Remoting

System can be System can be

accessed by accessed by

Falsh clientFalsh client

MetBroker

Invoker Servlet

JBoss-net

XXX

OpenAMF

Easy to add new protocol

Java client

Java client

SOAP client

Flash client

J2EE makes things easy!

J2EE makes things easy!

RMI


Multiple Broker - Destributed Service

Remote DB

MetBroker Multiple Broker Server

Multiple Broker

Discovery ServerDiscovery Server

Web ServiceWeb Service

Semantic BrokerSemantic Broker

Grid:Grid:

Globus 4.0Globus 4.0

Grid ServiceGrid Service


Multiple Broker Server

Discovery Server– Build with Globus discovery serverBuild with Globus discovery server– Analyze user's data requestAnalyze user's data request– Collect MetBroker network informationCollect MetBroker network information– Return a suitable MetBroker to userReturn a suitable MetBroker to user– Local information serverLocal information server

Web ServiceWeb Service– Build with Globus Java web serviceBuild with Globus Java web service– Make connection with MetBroker networkMake connection with MetBroker network

Benefits:Benefits: – Offer intelligent broker serverOffer intelligent broker server– Maximumly use MetBroker resourcesMaximumly use MetBroker resources– Eliminate single point of failure as bottle neckEliminate single point of failure as bottle neck

Globus

Information Server

Discovery Server

MetBroker


Conclusion

Java technology makes our software package run Java technology makes our software package run on variance systemon variance system

Full open source projects carry much more Full open source projects carry much more benefits to usersbenefits to users

Multiple versions of MetBroker are availableMultiple versions of MetBroker are available

MetBrokerEJB can reach standardization.MetBrokerEJB can reach standardization.

Multiple Broker server will make MetBroker Multiple Broker server will make MetBroker working with high efficiencyworking with high efficiency


What is Grid?

jian gui wang new implementation of agriculture models apan19---jan. 25 2005. 1. new implementations...

Documents

database drivers

open source package

consistent access

open source oodbozone

usacommercial database

remote db

metbrokerpse applications

metbroker core