npoess data exploitation status update
DESCRIPTION
NPOESS Data Exploitation Status Update. COPC 13 Nov 2008 John Zapotocny. Approved for Public Release Distribution Unlimited. Overview. Risk Reduction Strategy Early centrals interface Use current advanced sensor data Collaboration via JCSDA Infrastructure Enhancements - PowerPoint PPT PresentationTRANSCRIPT
Air Force Weather AgencyFly - Fight - Win
NPOESS Data Exploitation
Status Update
COPC 13 Nov 2008John Zapotocny
Approved for Public Release Distribution Unlimited
F l y - F i g h t - W i n
Overview
Risk Reduction Strategy Early centrals interface Use current advanced sensor data Collaboration via JCSDA
Infrastructure Enhancements MetSat ingest and data storage redesign Weather Data Analysis (WDA) program
Data Applications Imagery products Model data assimilation High resolution cloud analysis & forecasts
F l y - F i g h t - W i n 3
IDPS Early Centrals Interface Supports testing for AFWA internal applications Improves the quality of the delivered IDPS by identifying issues
early-on IDPS development/test resources on-site to support AFWA’s
software development process IDPS software installed on AFWA equipment AFWA staff training completed nearly a year ago
Independent testing by AFWA on-going Canned test data (~2TB) transferred from replicated IDPS Datasets are roughly 100x legacy volume
IA process issues continue to be a challenge Interim Approval to Test (IATT) allowing connection to AFWA
operational network expected NLT Dec 08
Risk Reduction StrategyEarly Centrals Interface
F l y - F i g h t - W i n 4
MODIS Data comes in HDF EOS format (precursor to HDF 5) and is a
good proxy for NPP/NPOESS format Currently ingesting MODIS data via DREN (RDT&E only) Continuing challenges with data feed from NESDIS
Only partial data receipt via DATMS-U
METOP Planned to fill third orbit requirement during NPOESS era AFWA receiving 8-minute data granules via DATMS-U 120+ min latency of MetOp data does not meet AFWA
timeliness requirements for global cloud analysis
Risk Reduction StrategyUse of Current Advanced Sensor Data
F l y - F i g h t - W i n 5
JCSDA is AFWA’s primary vehicle for data assimilation capability development 6 AFWA-funded projects directly related to NPP/NPOESS
Impact assessment of AIRS (CrIS proxy) in WRF MODIS (VIIRS proxy) skin temperatures in Land Information System (LIS) Integration of CRTM into LIS (will support NPP sensors) Impact of AMSU and AIRs cloudy radiances in WRF Integrate MODIS/METOP cloud optical properties into WWMCA Impact of VIIRS cloudy/precipitating radiances on WRF using GSI
AFWA migrating to GSI data assimilation engine for WRF More effectively leverages community development NCAR is energized – provides transition path and synergy
Increased on-site presence at JCSDA Visiting Scientist positions increase to 3 beginning CY09
Risk Reduction StrategyCollaboration via JCSDA
F l y - F i g h t - W i n
Infrastructure EnhancementsIngest and Data Storage
AFWA has redesigned ingest sub-system in preparation for NPOESS era
Data placed directly on SAN landing zone prior to processing to allow virus scanning before promoting to a trusted location for product generation and dissemination
Redesign enables ingest of MODIS and METOP data from DATMS-U network emulating NPOESS IDPS connection
Systems Engineering, Management, and Sustainment (SEMS) team worked with IDPS staff to optimize connection and data flow between the IDPS and AFWA SAN Required to support NPP system tests planned for Jan – Mar
2009
F l y - F i g h t - W i n 7
DMZ
Landing
Zone
AFWA CentralStorage
WPMDS
Meteosat-8GOES-E/W
POES, DMSPMTSATMODIS data
MSG Dell front end
boxes
Sun V40zFront end
boxes
Shared
Data
Environment
DATMS-U
Meteosat-7Metop-A
NOAA-18 “blind”
CentralAPPSServer
Emulates IDPS
Emulates NPOESSSecurity Architecture
Infrastructure EnhancementsIngest and Data Storage
F l y - F i g h t - W i n
Infrastructure EnhancementsWeather Data Analysis Program
AFWA’s Weather Data Analysis (WDA) program will store, process, and disseminate NPOESS/NPP data Technical challenges
Massive volume of time critical data Integration with existing WDA capabilities Relay of NPP data to Navy Centrals Requirements to “slice & dice” incoming data sets, sampling
for spatial resolution, and subset extractions to meet users requests
Evaluating opportunities for NESDIS collaboration/reuse
AFWA’s internal applications will migrate to HDF5 format and adjust to granule based data of NPOESS/NPP
Vendor not yet on contract Projected award late Spring 09
F l y - F i g h t - W i n 9
Vis IR MSI
Data ApplicationsMultispectral Imagery Products
F l y - F i g h t - W i n 10
Fog
Data ApplicationsMulti-channel Fog Detection
F l y - F i g h t - W i n
WRF Data Assimilation System will ingest raw brightness temperature radiances—SDR’s Planned integration to operations as follows:
AMSU (NOAA/MetOp) — Nov 2008 COSMIC (FORMOSAT) — Spring 2009 AIRS (NASA EOS) — Spring 2009 SSMIS (DMSP) —Winter 2010 CrIS/ATMS (NPP) — Winter 2011* IASI (METOP) — Winter 2012* GRAS (METOP) — Winter 2013*
*May be operational sooner with AFWA transition to GSI in early 2011
11
Data ApplicationsTheater NWP Model
F l y - F i g h t - W i n
Land Information System (LIS) MODIS/NPP/NPOESS
Snow Cover (R&D ongoing, initial integration FY09/10) Vegetation cover/health (R&D ongoing, initial integration FY09/10) Land Surface temperature (R&D ongoing, integration FY09/10)
AMSR-E/NPOESS-MIS (mission C2) Snow Depth (R&D complete, integration AMSR-E capability FY09/10) Soil Moisture (planned FY09/10 R&D, integration FY11/12)
Cloud Analysis and Forecasting (CDFS-II) MODIS/NPP/NPOESS
VIIRS cloud mask integration FY09 Cloud Optical Properties (R&D Ongoing, integration FY10-11)
12
Data ApplicationsLand Surface and Cloud Modeling
F l y - F i g h t - W i n 13
6 km resolution global cloud analysis using MODIS Analysis generated hourly but data are 2-4 hours latent
Land surface backgrounds (e.g. snow/ice and highly reflective desert conditions) negatively affect products
Need to continue updating AFWA land surface characterization capabilities
5 km resolution regional cloud forecasts using Diagnostic Cloud Forecast (DCF) based on WRF
Hi-res global cloud analysis is used to tune the WRF DCF coefficients for optimal performance
Forecasts showing skill improvement over traditional WWMCA-based forecasts particularly beyond 9 hours
Data ApplicationsHigh Resolution Global Cloud Analysis & Forecast
F l y - F i g h t - W i n
LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html
Data ApplicationsHigh Resolution Global Cloud Analysis
F l y - F i g h t - W i n 15
https://weather.afwa.af.mil/cgi-bin/aneph_data.cgi
Data ApplicationsHigh Resolution Regional Cloud Forecasts
F l y - F i g h t - W i n 16
LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html
Data ApplicationsHigh Resolution Regional Cloud Forecasts
F l y - F i g h t - W i n
Summary
AFWA aggressively preparing for NPP/NPOESS Several Infrastructure, data processing, and application
projects underway and planned Leveraging collaborative development via JCSDA for
NPOESS model data assimilation Advanced sensor data assimilation showing favorable impact
in WRF based on NCAR studies Prototype high res cloud forecast showing skill improvement
AFWA will play important role in VIIRS Calibration & Validation (CalVal)
Goal is to achieve initial operational capability (IOC) for most NPP processing by end of respective CalVal periods
17
F l y - F i g h t - W i n 18
Questions?