aeronet web data access and relational database david giles science systems and applications, inc....

28
AERONET Web Data AERONET Web Data Access and Relational Access and Relational Database Database David Giles David Giles Science Systems and Science Systems and Applications, Inc. Applications, Inc. NASA Goddard Space Flight NASA Goddard Space Flight Center Center

Upload: leonard-wheeler

Post on 28-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

AERONET Web Data AERONET Web Data Access and Relational Access and Relational

DatabaseDatabase

David GilesDavid Giles

Science Systems and Applications, Science Systems and Applications, Inc.Inc.

NASA Goddard Space Flight NASA Goddard Space Flight CenterCenter

Page 2: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

AERONET Web SiteAERONET Web Site Adheres to One Adheres to One

NASA Portal formatNASA Portal format Redesigned static Redesigned static

and dynamic web and dynamic web pagespages

Updated content Updated content and web linksand web links

Complies with US Complies with US accessibility accessibility standardsstandards

http://aeronet.gsfc.nasa.govhttp://aeronet.gsfc.nasa.gov

Page 3: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

OverviewOverview

AERONET Data AccessAERONET Data Access Relational DatabaseRelational Database

Page 4: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

OverviewOverview

AERONET Data AccessAERONET Data Access Database DesignDatabase Design Data Interface and Download ToolData Interface and Download Tool Level 2.0 ClimatologyLevel 2.0 Climatology

Relational DatabaseRelational Database

Page 5: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Database Design: Database Design: AcquisitionAcquisition

Measurements andTransmission

Relay Transmissionto Receiving Station

Transfer Data viaInternet

Download and TransferData via Internet

AERONETServer

Web Interface“Demonstrat”

Page 6: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Main Database “Demonstrat” Web Database

• Processed Hourly• Stored in binary format

(Raw and Processed)• Indexed Hourly

•Transferred hourly•Stored in text format(Raw and Processed)

•Indexed hourly

• Converts satellite data into raw data files• Calculates AOT and sky retrievals data using solar and radiance calibration data• Scans database files

Processing Software

• Converts binary files to text files• Combines sky retrieval data into single files• Scans database files

Processing Software

Database Design: Database Design: ProcessingProcessing

Page 7: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Display InterfaceDisplay Interface

Time SelectionTime Selection Site SelectionSite Selection

Map InterfaceMap Interface Text InterfaceText Interface

Additional Additional OptionsOptions Site TypeSite Type AOT LevelAOT Level

Page 8: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Display InterfaceDisplay Interface

Time Selection MenuTime Selection Menu Display Aerosol Optical Display Aerosol Optical

Depth PlotsDepth Plots Direct Data Download Direct Data Download

LinksLinks Additional Data Additional Data

ProductsProducts Almucantar Retrieval Almucantar Retrieval

Products (AERONET)Products (AERONET) Satellite Images Satellite Images

(AQUA/TERRA-MODIS, (AQUA/TERRA-MODIS, GOES)GOES)

MPLNETMPLNET Back Trajectory AnalysesBack Trajectory Analyses

Page 9: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Geographical Geographical Site SelectionSite Selection MapMap Region, Region,

Country/State, Country/State, and AERONET and AERONET SiteSite

Download ToolDownload Tool

Page 10: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Download ToolDownload Tool Time SelectionTime Selection AOT ProductsAOT Products

Levels 1.0, 1.5, 2.0Levels 1.0, 1.5, 2.0 Instrument number Instrument number

and wavelength and wavelength informationinformation

Raw Radiance Data Raw Radiance Data with calibration with calibration appliedapplied Almucantar, Principal Almucantar, Principal

Plane (Polar), BRDFPlane (Polar), BRDF Nakajima Almucantar Nakajima Almucantar

RetrievalsRetrievals SKYRAD.PAK CodeSKYRAD.PAK Code

Page 11: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Download ToolDownload Tool Almucantar Almucantar

Retrievals Retrievals (Dubovik)(Dubovik) Spherical, SpheroidSpherical, Spheroid Default OptionDefault Option Advanced Advanced

ParametersParameters Data Type FormatsData Type Formats

All PointsAll Points Daily and Monthly Daily and Monthly

AveragesAverages

Page 12: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Download ToolDownload Tool

Wait for Data Wait for Data ProcessingProcessing

Select “Accept” Select “Accept” to download to download “zip” file“zip” file

Page 13: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Level 2.0 ClimatologyLevel 2.0 Climatology

Daily Average Daily Average and Weighted and Weighted AverageAverage MonthlyMonthly Multi-Year Multi-Year

MonthlyMonthly YearlyYearly Multi-Year Multi-Year

YearlyYearly

Page 14: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Level 2.0 ClimatologyLevel 2.0 ClimatologyAOT 500nm 870-440nm Angstrom

Page 15: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Data Access: Data Access: SummarySummary

Update main database hourly; Update main database hourly; transfer full database weeklytransfer full database weekly

Provide visualization of AOT and Provide visualization of AOT and other related productsother related products

Access to download all available Access to download all available AERONET productsAERONET products

Page 16: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Data Access: Data Access: Future WorkFuture Work

Modify web database software to Modify web database software to accommodate new AERONET retrieval accommodate new AERONET retrieval productsproducts

Integrate AERONET web site into Integrate AERONET web site into BAMGOMASBAMGOMAS

Develop climatology of retrieval Develop climatology of retrieval productsproducts

Develop flux data web interfaceDevelop flux data web interface

Page 17: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Data Access: Data Access: Future WorkFuture Work

Possible multi-site download tool Possible multi-site download tool based on a geographic and text based on a geographic and text interfaceinterface

Possible radiative forcing AERONET Possible radiative forcing AERONET productproduct

Page 18: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

OverviewOverview

AERONET Data AccessAERONET Data Access Relational DatabaseRelational Database

BackgroundBackground DesignDesign ExampleExample

Page 19: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Filemaker Pro: Filemaker Pro: A Relational DatabaseA Relational Database

Filemaker Pro (FMPro) 6 UnlimitedFilemaker Pro (FMPro) 6 Unlimited Provides dependable data storageProvides dependable data storage Interlinks databases to allow Interlinks databases to allow

customizable data reports and formscustomizable data reports and forms Performs complex sort and search Performs complex sort and search

proceduresprocedures

Page 20: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Background:Background: User Interface User Interface

Supported PlatformsSupported Platforms PC (Preferred)PC (Preferred) MacMac UnixUnix

Web AccessibleWeb Accessible Internet Explorer Internet Explorer

(Preferred)(Preferred) NetscapeNetscape MozillaMozilla

FMPro 6 SoftwareFMPro 6 Software

Page 21: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Background:Background:User PrivilegesUser Privileges

Browse Browse RecordsRecords

Add/Add/Modify/Modify/Delete Delete RecordsRecords Password Password

ControlledControlled SearchSearch SortSort

Page 22: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

DesignDesignAeronet Server FileMaker Server

FTP

Updated hourly

PCUNIX

User Input

Updated instantly

HTTP

WEB

Page 23: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

DesignDesign

Database LinksDatabase Links InternalInternal ExternalExternal Multi-link (Internal and External)Multi-link (Internal and External)

Page 24: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

DesignDesign

External RelationalLinks from AERONET Database

InternalRelationalLinks

Master Database

Instrument Locations

Location Data

AERONETLocations

AERONETIntercalibration

Data

AERONETInventory

Instrument Status

Database

ContactData

Page 25: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Example:Example:Instrument Status DatabaseInstrument Status Database

Page 26: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Example:Example:Instrument Status DatabaseInstrument Status Database

Page 27: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Relational Database: Relational Database: SummarySummary

Provides reliable monitoring, storage, and Provides reliable monitoring, storage, and tracking of operational activities, tracking of operational activities, inventory, and contact informationinventory, and contact information

Improves accuracy and timeliness of Improves accuracy and timeliness of AERONET web site metadataAERONET web site metadata

Allows user interactivity from multiple Allows user interactivity from multiple platforms, web browsers, and locationsplatforms, web browsers, and locations

Page 28: AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center

Relational Database: Relational Database: Future WorkFuture Work

Continue to integrate FMPro with Continue to integrate FMPro with AERONET database and web siteAERONET database and web site

Transfer legacy Excel intercalibration Transfer legacy Excel intercalibration data to FMProdata to FMPro

Integrate additional calibration Integrate additional calibration facilities (e.g., Spain, Australia, facilities (e.g., Spain, Australia, Canada, China)Canada, China)