98 625-cd-520-001 aster scenario: backward chaining insertion retrieval production subscribe search...

1625-CD-520-001

ASTER Scenario: Backward ChainingIN

SE

RTI

ON

RE

TRIE

VA

L

PRODUCTION

Subscribe

Search& Order

Store

ExternalData Provider User

Deliver

Generate Plan

Ingest

Product SubscriptionOn-demand ProductionStanding Order DeliveryQA Update

2625-CD-520-001

Backward Chaining

RE

TRIE

VA

L

Subscribe

Store

LocateData

Deliver

Media

Search& Order

InventorySearch

ASTER Scientist searches fornewly ingested AST_L1BTgranules, verifying attributes

3625-CD-520-001

ASTER: Search Process

ASTER Scientist decides to check out the AST_L1BT (L1B TIR)granule that was received. First, the scientist searches for thegranule.

1. Search for AST_L1BT

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

CommunicationsSubsystem

SBSRV

2. Submit query via V0 Gateway

3. Submit translated query to SDSRV

4625-CD-520-001

Client (CLS)External/InternalUsers

Workbench(WKBCH) CSCI

User RegistrationTool (URT) Scripts

EcClWbUrEcClWbUrConfirmEcClWbUrSubmit

HDF ProductViewing Tool

EOSView

Java DARTool

EcClWbJdt

User ProfileGateway

EcClDtUserProfileGateway

Data MgmtSubsystem

(DMS)

Data Dictionary(DDICT) CSCI

Data DictionaryMaintenance Tool

EcDmMaintTool

Data DictionarySQL Server

Sybase Server (COTS)

Data DictionaryReplication Server

Sybase Replication Server (COTS)

Data DictionaryServer

EcDmDictServer

Version Zero Gateway(V0 GTWY) CSCI

V0 to ECSGateway Server

EcDmV0ToECSGateway

ECS to V0Gateway Server

EcDmECSToV0Gateway

Local Information Manager(LIMGR) CSCI

Local InformationManager

EcDmLimServer

ASTER: CSCI/Component Rolein Data Search

Submits query from EOS Data Gateway Web Client, via V0 Gateway, with search constraints provided by Science User

Provides ECS names for V0 terms

Translates search criteria

to a search object and

submits query

to SDSRV Search service

5625-CD-520-001

Backward Chaining (Cont.)

RE

TRIE

VA

L

Subscribe

Store

LocateData

Deliver

Media

Search& Order

InventorySearch

Locate AST_L1BT granules ofinterest

6625-CD-520-001

ASTER: Data Search Process

SDSRV queries Sybase/SQS database for AST_L1BT (L1B TIR)granules meeting search criteria.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


PlanningSubsystem

Planning

abc

def

ghi

jkl

mno


0110001011001011001011010111010110001011

1. Query Sybase

Client


SBSRV

2. Return query results

3. Return results to Client for display to User

7625-CD-520-001

Client (CLS)External/InternalUsers

Workbench(WKBCH) CSCI

User RegistrationTool (URT) Scripts

EcClWbUrEcClWbUrConfirmEcClWbUrSubmit

HDF ProductViewing Tool

EOSView

Java DARTool

EcClWbJdt

User ProfileGateway

EcClDtUserProfileGateway

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer


Data MgmtSubsystem

(DMS)

Data Dictionary(DDICT) CSCI

Data DictionaryMaintenance Tool

EcDmMaintTool

Data DictionarySQL Server


Data DictionaryReplication Server


Data DictionaryServer

EcDmDictServer

Version Zero Gateway(V0 GTWY) CSCI

V0 to ECSGateway Server

EcDmV0ToECSGateway

ECS to V0Gateway Server

EcDmECSToV0Gateway

Local Information Manager(LIMGR) CSCI

Local InformationManager

EcDmLimServer

ASTER: CSCI/Component Rolein Data Search

Breaks down Query and generates calls to inventory database; packages and returns results

Database; contains metadata for search and retrieval

Translates results and

returns them to

the User Profile

Gateway and

EOS Data Gateway Web

Client

Forwards query results to EOS Data Gateway Web Client for Display to the user

8625-CD-520-001


PRODUCTION

ProcessOn

Demand

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

ASTER Scientist calls DAAC requesting AST_08 to be produced from AST_L1BT using ETS algorithm

9625-CD-520-001

ASTER: On-Demand Production Request Process

Scientist calls DAAC requesting AST_L1BT (L1B TIR) be generatedinto an AST_08 (L2 Surface Temperature) product using ETSalgorithm.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


PlanningSubsystem

Planning

abc

def

ghi

jkl

mno


0110001011001011001011010111010110001011

Client

1. Scientist calls DAAC with production request


SBSRV

10625-CD-520-001

ASTER: CSCI/Component Rolein On-Demand Production Request

No CSCI/Components involved.

11625-CD-520-001


PRODUCTION

ProcessOn

Demand

Subscribe


Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

DAAC submits subscription on behalf of scientist for delivery of AST_08 via ftpPush

12625-CD-520-001

ASTER: User Subscription Registration Process

DAAC enters subscription, on behalf of scientist, for delivery ofAST_08 (L2 Surface Temperature) product, via ftpPush, whenproduct is generated.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


PlanningSubsystem

Planning

abc

def

ghi

jkl

mno


0110001011001011001011010111010110001011

Client


SBSRV

1. Subscribe (AST_08, ftpPush)

13625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

(a service of CSS,not a CSCI)

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

GUI used by User ServicesRepresentative to createsubscription for Science User

ASTER: CSCI/Component Rolein User Subscription Registration

Stores subscriptionin the Sybase Database

14625-CD-520-001


PRODUCTION

ProcessOn

Demand

Subscribe


Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Operator determines need to run ACT PGE before ETS. Submits production requests for ACT and ETS, and then initiates production

15625-CD-520-001

ASTER: PGE Chaining

Input: 1 AST_L1BT

Requested Output: 1 AST_08

ETS (PGE)

1 AST_05

1 AST_ANC1 AST_09T

ACT (PGE)

1 GDAS0ZFH 24 AST_ANC1 AST_L1BT

1 AST_08

16625-CD-520-001

ASTER: Production Request Process

Operator determines that, in order to run ETS algorithm on AST_L1BT (L1B TIR),ACT algorithm must be run first. Operator then creates productionrequests and a plan which includes a DPR for the ACT, with the AST_09 (L2 Surface Radiance TIR) output feeding the ETS algorithm.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


PlanningSubsystem

Planning

abc

def

ghi

jkl

mno


0110001011001011001011010111010110001011

Client


SBSRV

1. Create Production Requests

2. SearchAdvertising

3. Submit subscriptions

4. Submit search for input granules

5. Search database

6. Return results

7. Create Production Plan

17625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionServiceEcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocolFTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway


SDSRVDDIST

STMGT

Inven-toryDB


ScienceData Server


HDF EOSServer

EcDsHdfEosServer




DataDistribution



EcDsDdistGui









Pull MonitorProcess




Interoper-ability(IOS)

Advertising Service(ADSRV) CSCI

AdvertisingServer

EcIoAdServer

Advertising Server Component

Advertising ServiceSQL Server


Advertising ServiceReplication Server


PlanningSubsystem

(PLS) Planning

abcdef

ghi

jkl

mno

Production Planning(PLANG) CSCI

DataStore

Sybase Database (COTS)

Resource PlanningWorkbench

EcPlRpReEcPlRpSiEcPlRpTl

ProductionRequest Editor

EcPlPrEditor

ProductionPlanning Workbench

EcPlWbEcPlTl

PlanningSubscription Editor

EcPlSubsEditor

SubscriptionManagerEcPlSubMgr

ProductionStrategies GUI

EcPlProdStrat

ASTER: CSCI/Component Rolein Production Request

Planner creates Production Requests; Editor searches Advertising Server and submits subscriptions

Contains records of subscribable services

Stores subscriptionsin the Sybase Database

Searches SDSRV for input granules

Breaks down

Query and

generates calls

to inventory

database;

packages and

returns results


Stores ProductionRequests

18625-CD-520-001


PRODUCTION

Subscribe


Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Operator activates Plan which includes Data Processing Requests (DPRs) for ACT and ETS PGEs

ProcessOn

Demand

19625-CD-520-001

ASTER: Plan Activation Process

Production Planner interacts with the Planning Workbench GUI tocreate a plan with DPRs for the ACT and ETS PGEs and make it thecurrent processing plan.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV



0110001011001011001011010111010110001011

Client


SBSRV

1. Activate Production Plan Planning

SubsystemPlanning

abc

def

ghi

jkl

mno

2. Data Processing Request (ACT)

20625-CD-520-001

Data ProcessingSubsystem

(DPS) Data Proc

0110001011001011001011010111010110001011

Algorithm Integration and Test Tools(AITTL) CSCI

SSAP GUIEcDpAtSSAPGui

SSIT ManagerEcDpAtMgr

EcDpAtMgrLogDump

Define PGEEcDpAtCheckODL

EcDpAtCreateODLTemplateEcDpAtRegisterPGE

EcDpAtOpDbGui

View/CompareData ToolsEOSView, IDL

EcDpAtBinDiffGuiEcDpAtBinDiffPrepareFiles

EcDpAtCheckHdfFilehdiff, xdiff

Check SoftwareTools

EcDpAtCheckPCFEcDpAtBadFuncGui

EcDpAtBadFuncEcDpAtPrologs

EcDpAtReplaceString

Insert/AcquireTools

EcDpAtINSTALLEcDpAtInsertStaticFile

EcDpAtInsertExeTarFileEcDpAtInsertTestFile

EcDpAtStageDAPEcDpAtGetMCF

SDP ToolKit(SDPTK) CSCI

(Separatesoftware libraries

for SSI&T)

Processing(PRONG) CSCI

DataManagement

EcDpPrDM

ExecutionManagement

EcDpPrEMEcDpPrSMFLink

PGEManagement

EcDpPrRunPGEEcDpPrRusage

DeletionServer

EcDpPrDeletion

Job ManagementEcDpPrJobMgmt

EcDpPrJobMgmtClientEcDpPrViewJobStates

AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore


Ground EventProcessEcDpPrGE

Data PreprocessingEcDpPrAm1AncillaryDPREP

EcDpPrAm1EphemerisGapFillDPREPEcDpPrAm1FddAttitudeDPREP

EcDpPrAm1FddReplaceEphemerisDPREPEcDpPrAm1ToolkitToHdfDPREP

EcDpPrDumpAttitudeDPREPEcDpPrDumpEphemerisDPREP

PlanningSubsystem

(PLS) Planning

abcdef

ghi

jkl

mno

Production Planning(PLANG) CSCI

DataStore


Resource PlanningWorkbench

EcPlRpReEcPlRpSiEcPlRpTl

ProductionRequest Editor

EcPlPrEditor

ProductionPlanning Workbench

EcPlWbEcPlTl

PlanningSubscription Editor

EcPlSubsEditor

SubscriptionManagerEcPlSubMgr

ProductionStrategies GUI

EcPlProdStrat

ASTER: CSCI/Component Rolein Plan Activation

Submits the DPRs (one for ACTand a dependent one for ETS)to AutoSys for job processing

Production Planner

uses GUI to activate

plan

21625-CD-520-001


PRODUCTION

Subscribe


Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Job locates AST_L1B, AST_ANC (ASTER ancillary data set), and GDAS0ZFH (NCEP ancillary) data required for ACT algorithm

ProcessOn

Demand

22625-CD-520-001

ASTER: Input Data Location Process

ACT locates required AST_L1BT (L1B TIR), AST_ANC (ASTER ancillary data set), and GDAS_0ZF (NCEP ancillary) input data granule.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


Client


SBSRV

1. Search (AST_L1BT, AST_ANC, & GDAS0ZFH)

2. Query Sybase

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno


0110001011001011001011010111010110001011

23625-CD-520-001


(DPS) Data Proc

0110001011001011001011010111010110001011




EcDpAtMgrLogDump



EcDpAtOpDbGui

View/CompareData Tools

EOSView, IDLEcDpAtBinDiffGui

EcDpAtBinDiffPrepareFilesEcDpAtCheckHdfFile

hdiff, xdiff

Check SoftwareTools



EcDpAtReplaceString

Insert/AcquireTools






for SSI&T)


DataManagement

EcDpPrDM

ExecutionManagement


PGEManagement


DeletionServer

EcDpPrDeletion



AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore








SDSRVDDIST

STMGT

Inven-toryDB


ScienceData Server


HDF EOSServer

EcDsHdfEosServer




DataDistribution



EcDsDdistGui









Pull MonitorProcess




ASTER: CSCI/Component Rolein Input Data Location

Releases and sequencesDPRs (Jobs)

Controls staging andprocessing activities


Retrieves metadata for requested input granules from the Sybase/SQS database

24625-CD-520-001


PRODUCTION

Subscribe


Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Retrieve AST_L1B, AST_ANC (ASTER ancillary data set), and GDAS0ZFH granules as input to ACT; PGE execution begins

ProcessOn

Demand

25625-CD-520-001

ASTER: Job Staging Process

ACT production job retrieves required AST_L1BT (L1B TIR), AST_ANC (ASTER ancillary data set), and GDAS0ZFH (NCEP ancillary) input datagranules.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


Client


SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

1. Acquire (AST_L1BT, AST_ANC, & GDAS0ZFH, ftpPush)


0110001011001011001011010111010110001011

2. Distribution Request (AST_L1BT, AST_ANC, & GDAS0ZFH files, ftpPush)

3. Copy (AST_L1BT, AST_ANC, & GDAS0ZFH files, ftpPush)

4. ftpPush (AST_L1BT, AST_ANC, & GDAS0ZFH files)

26625-CD-520-001


(DPS) Data Proc

0110001011001011001011010111010110001011




EcDpAtMgrLogDump



EcDpAtOpDbGui




hdiff, xdiff

Check SoftwareTools



EcDpAtReplaceString

Insert/AcquireTools






for SSI&T)


DataManagement

EcDpPrDM

ExecutionManagement


PGEManagement


DeletionServer

EcDpPrDeletion



AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore








SDSRVDDIST

STMGT

Inven-toryDB


ScienceData Server


HDF EOSServer

EcDsHdfEosServer




DataDistribution



EcDsDdistGui









Pull MonitorProcess




ASTER: CSCI/Component Rolein Job Staging

Releases and

sequencesDPRs (Jobs)

Handles requests to the Archive for retrieving andinserting granules

Controls staging andprocessing activities


Retrieves metadata; creates metadata Staging Disks; creates and passes metadata files to DDIST

Creates staging disks for granule files; requests granule file retrieval by STMGT

Allocates space in response to Distribution Requests

Stages granule files to read-only cache disks

Provides Resource

Manager for

ftpPushes

27625-CD-520-001


PRODUCTION

Subscribe


Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Archive newly created AST_09T (L2 Surface Radiance TIR) granule after completion of ACT PGE;

ProcessOn

Demand

update catalogue with reference to AST_09T

28625-CD-520-001

ASTER: PGE Execution and Output Insertion Process

ACT PGE is successfully executed and newly created AST_09T(L2 Surface Radiance TIR) granule is archived; inventory is updated.


SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV


Client


SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno


0110001011001011001011010111010110001011

1. Get DSS UR

2. Insert (AST_09T)

3. Store (AST_09T files)

4. Add (AST_09T metadata)

29625-CD-520-001

Interoper-ability(IOS)

Advertising Service(ADSRV) CSCI

AdvertisingServer

EcIoAdServer

Advertising Server Component

Advertising ServiceSQL Server


Advertising ServiceReplication Server



(DPS) Data Proc

0110001011001011001011010111010110001011




EcDpAtMgrLogDump



EcDpAtOpDbGui




hdiff, xdiff

Check SoftwareTools



EcDpAtReplaceString

Insert/AcquireTools






for SSI&T)


DataManagement

EcDpPrDM

ExecutionManagement


PGEManagement


DeletionServer

EcDpPrDeletion



AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore








SDSRVDDIST

STMGT

Inven-toryDB


ScienceData Server


HDF EOSServer

EcDsHdfEosServer




DataDistribution



EcDsDdistGui









Pull MonitorProcess




ASTER: CSCI/Component Role in PGE Execution and Output Insertion

Executes PGE; places output files in output directory

Provides DSS Universal Reference (UR)

Gets DSS UR from Advertising Server; handles requests to the Archive for retrieving andinserting granules

Reads files from DPS

disks and stores

files in Archive

Database; receives and stores metadata

Provides Metadata Configuration File (MCF);requests STMGT to insert output granule files; adds metadata to inventory

98 625-cd-520-001 aster scenario: backward chaining insertion retrieval production subscribe search...

Documents

required ast

delivery of ast

ingested ast

productionretrieve ast

created ast

anc aster ancillary

aster scenario

gdas0zfh ncep ancillary