noaa satellite products, data access and direct readout overvie · 2020. 5. 4. · • overview of...

Department of Commerce // National Oceanic and Atmospheric Administration // 1

Satellite and

Information

Service

NOAA Satellite Products, Data Access and Direct Readout Overview

Natalia Donoho, (Physical Scientist/Program Manager)

AOMSUC-10

Melbourne, Australia

4 December, 2019

http://www.noaa.gov/marine-aviation

http://www.noaa.gov/research

http://www.noaa.gov/satellites

http://www.noaa.gov/fisheries

http://www.noaa.gov/oceans-coasts

http://www.noaa.gov/weather

https://www.commerce.gov/

http://www.noaa.gov/










Smoke from Australian wildfires

GOES-17 GeoColor – 14 November, 2019Courtesy: CIRA

S-NPP VIIRS – 8 November, 2019











• Overview of OSPO and NOAA Satellites

• Data Access and Distribution

• Direct Broadcast Overview• GOES-R Series GOES Rebroadcast (GRB) and User Group

• High Rate Information Transmission/ Emergency Managers

Weather Information Network (HRIT/EMWIN) and User Group

• High Rate Data (HRD) Broadcast and User Group

• Product Distribution and Access (PDA)

• Data Archive - CLASS

• NOAA Big Data Project - Cloud

• Websites and Other resources

Outline











• NOAA NESDIS Office of Satellite and Product Operations

• Performs command and control of United States operational

weather satellites

• Operates ground sites for command and control; and for data

acquisition and retransmission

• Produces derived products from satellite observations and

distributes those products to authorized users in near real-

time or to the archive for use by the scientific community

Satellite and Product Operations (OSPO)











Operates the Nation’s 16 environmental satellites:

• 4 Geostationary (GOES) by NOAA

• 2 Joint Polar Satellite Systems by NOAA + NASA

(NOAA-20, Suomi-NPP)

• 3 Polar-Orbiting (POES) by NOAA

• 5 Defense Meteorological Satellite program (DMSP)

operated by NOAA

• 1 OSTM Jason-3 (Ocean Surface Topography Mission)

- Joint NOAA, NASA, CNES, EUMETSAT effort

• 1 DSCOVR (Deep Space Climate Observatory) by

NOAA

Office of Satellite and Product Operations











Current GOES Constellation

GOES-15 to continue tandem GOES-West operations through December, 2019 and then transition to

on-orbit storage

GOES-T (GOES-18) scheduled for launch on or before FY2022 and after post-launch checkout will

transition to on-orbit storage











• The entire portfolio of GOES-16 and

GOES-17 level 1b products from all

12 instruments are validated at

provisional

• All data are available via GRB, PDA &

CLASS (terrestrial subscription

access), except for EUV which awaits

bias and dark counts temperature

correction due no later than end of

Spring 2020

• Validation Artifacts & READMEs: https://noaasis.noaa.gov/GOES/product_quality.html

16 17

GOES-16 and GOES-17 L1b Products











Baseline ABI L2 Products

23 of 24 ABI level 2 products are

validated at provisional

1 remaining product (Snow Cover)

is due in February 2020

Full Validation dates are in 2021 for

GOES-16 and 2022 for GOES-17

Enterprise ABI L2 Products

“Delta” post-provisional validation

dates are for enterprise algorithm

promotions and will also include

ABI “hot period” analysis

Volcanic Ash is to-be-determined

GOES-16 and GOES-17 ABI L2 Products











Overview of GOES-R Series Data Access











GOES-R Series Products on GRB

Level 1b Products:

Radiances from the Advanced

Baseline Imager: 16 Bands; Full

Disk, CONUS, and Mesoscale

Solar imagery from the Solar

Ultraviolet Imager

Solar flux from the Extreme

Ultraviolet and X-ray Irradiance

Sensors

Energetic heavy ions from the

Space Environment In-Situ Suite

Space environment magnetic field

from the Magnetometer

Level 2 products:

Geostationary Lightning Mapper

Space Weather Products











ABI L1 Quicklooks

ABI true color

Community Satellite Processing Package

for Geostationary Data

Funded by NOAA GOES-R Program to create and distribute software to

process direct broadcast data from geostationary satellites, generating

products in real-time. Software is available at:

http://cimss.ssec.wisc.edu/csppgeo/

All software is free to download and use. Capabilities include:

– Process the GOES-16 and GOES-17 GRB data streams,

reconstructing the products that were generated on the ground

system

– Further process GOES-16/17 ABI data to generate Level 2 products

– Create high quality RGB and single band images in GeoTiff format










http://cimss.ssec.wisc.edu/csppgeo/


• 61 sites. Some sites have

more than 1 receive station

• 89 receive stations

(antennas)

GRB User Community











NOAA NWS

• Anchorage

• Ford Island, Honolulu, HI

Chilean Weather Service Easter Island

receives GOES-17

MeteoFrance generates

products from the GOES-

17 GRB in Tahiti

(Interregional

Meteorological Center)

for users in French

Polynesia

Fiji is planning to

install a GOES-17

GRB receive station

NOAA National Weather

Service (NWS) National

Centers receive GOES-16

and GOES-17

GOES-17 GRB sites

United States Navy

• FNMOC (Planned)

• JTWC (Planned)











The High Rate Information Transmission (HRIT) / Emergency Managers Weather

Information Service (EMWIN) broadcast is operational on GOES-16 and GOES-

17 with a data relay capacity of 400 Kbps

• The initial HRIT/EMWIN product offering includes:

• EMWIN products includes National Weather Service watches, warnings,

forecasts and graphics

• Copy of the GOES-DCS observations

• Environmental maritime products from National Hurricane Center

• Additional 4 km resolution GOES-15 & Himawari-8 IR/WV/Visual

Imagery (GOES-17 only)

• GOES-16 & 17 Imagery – ABI Cloud and Moisture Imagery (CMI)

converted to the 2013 CGMS Global LRIT/HRIT standard

• 2 kilometer spatial resolution ABI Full Disk Bands 2, 7, 8, 9, 13, 14

and 15 available every 30 minutes

• ABI mesoscale imagery in Bands 2, 7 and 13 available every 15

minutes (Band 2 is .5 km while Bands 7 and 13 are 2 km resolution)

HRIT/EMWIN











➢ All full disk imagery is in it’s native spatial resolution of 2 kilometers (km), in exception of

Band 2, which has been scaled down from 0.5 km to 2 km for bandwidth management.

➢ All seven full disk bands are currently available every 30 minutes, containing the :00 - :10

and :30 - :40 scan times.

➢ All meso imagery is in it’s native spatial resolution and distributed every 15 minutes.

CMI Band 2

0.86umCMI Band 7

3.9um

CMI Band 8

6.2umCMI Band 9

6.9um

CMI Band 13

10.3um

CMI Band 14

11.2um

CMI Band 15

12.3um

Scene 1 Meso

Scene 2 Meso

Scene 1 Meso

Scene 2 Meso

Scene 1 Meso

Scene 2 Meso

Visual BandIR Shortwave

Band

Mid-Upper Tropospheric

Water Vapor BandsIR Longwave Bands

Imagery Group Products











VCID

#Product Name

GOES-16

Availability

GOES-17

Availability

Frequency

(Minutes)

Priority on

Broadcast

Guaranteed

BandwidthFormat Resolution Product Status

0 Admin Text X X 60 1 72% Text Messages N/A Active and available

1 Mesoscale Imagery X X 15 1272%

HRIT/LRIT0.5km Band 2, 2km for

bands 7 and 13

Both Meso scenes active and

available

2 CMI Band 2 X X 30 7 72% HRIT/LRIT 2 km Active and available

5 GOES-15 WV Imagery X 30 - 180 13 72% LRIT 4 km Active and available until 2020

6 GOES-15 IR Imagery X 30 - 180 13 72% LRIT 4 km Active and available until 2020







16 G16 CMI Band 13 X 60 17 72% HRIT/LRIT 4 km Active and available

17 G17 CMI Band 13 X 60 17 72% HRIT/LRIT 4 km Active and available

20 EMWIN – High Priority X X Continuous 1 8% Text N/A Active and available

21 EMWIN - Graphics X X 15 - 60 3 8%Graphic (e.g. GIF,

JPEG)N/A Active and available

22 EMWIN – Low Priority X X Continuous 2 8% Text N/A Active and available

23 NWS Discussion Products X X Variable 14 72% Text N/A Active and available

24 NHC Maritime Graphics X X Variable 14 72%Graphic (e.g. GIF,

JPEG)N/A Active and available

25GOES-R/S Level II

Ancillary ProductsX X Variable 15 72% HRIT/LRIT 2 - 10 km Active and available

30 DCS Admin X X Continuous 4 5% DCS Formatted Text N/A Active and available

32 DCS Data X X Continuous 4 5% DCS Formatted Text N/A Active and available

60 Himawari-8 X 60 16 72% HRIT/LRIT 4 km Active and available

Virtual Channel Listing











Users are defined as a having a

complete receiving station capable of

obtaining the HRIT/EMWIN broadcast

downlink

Known HRIT/EMWIN User Community











GOES West HRIT/EMWIN User Community

RA-V HRIT/EMWIN Users

• Solomon Islands

• Tahiti

• Samoa (2)

• Tonga (2)

• Federated States of Micronesia

• Niue

• Papua New Guinea

• Kiribata

• Marshall Islands

• Fiji

• Cook Island

• Tuvalu

• Vanuatu

* 20+ receive stations are planned for the

future*











• The polar orbiting satellites in the Joint Polar Satellite System (JPSS)

constellation gather global measurements of atmospheric, terrestrial and

oceanic conditions, including sea and land surface temperatures,

vegetation, clouds, rainfall, snow and ice cover, fire locations and smoke

plumes, atmospheric temperature, water vapor and ozone

• The High Rate Data (HRD) is the S-NPP and JPSS direct broadcast.

NOAA has accounted for 47 X-band receive stations that are receiving

HRD

• The JPSS Program funded the University of Wisconsin-Madison to

install and operate a network of polar satellite receiving stations in North

America and the Pacific to deliver advanced sounder data, including

ATMS and CrIS data, to NWP centers with low latency for rapid refresh

data assimilation

• The NOAA network is part of the worldwide DBNet system coordinated

by the WMO Space Program

High Rate Data (HRD) Broadcast











HRD Sites











Production Distribution and Access (PDA)

• New subscriptions to Environmental Satellite Processing Center PDA are on hold

• PDA service is dedicated for authorized near real-time users. Other near real-time distribution services are being explored as PDA is a finite resource

• The PUSH services are available only to users with a 24x7 support desk

• Data access information is available at: http://www.ospo.noaa.gov/Organization/About/access.html

• Must be signed by the Government official responsible for the data flow on the subscriber’s end

• For existing users who contact ESPC about a problem:

▪ Make sure to say that you are a PDA user and provide our PDA user group name

▪ Provide PDA product names or exact files names for the data you are missing. The filename of the last data you received is most useful to help us pinpoint your problem quickly










http://www.ospo.noaa.gov/Organization/About/access.html


Comprehensive Large Array-data Stewardship System

(CLASS)

• CLASS is NOAA's Archive and delayed-mode distribution system for

distribution of NOAA and US Department of Defense (DoD) Polar-orbiting

Operational Environmental Satellite (POES) data, NOAA's Geostationary

Operational Environmental Satellite (GOES) data, and derived data.

• CLASS is not a near real-time system and data availability is not guaranteed

• CLASS stores an average of 180 Terabytes/month of data. The total amount

of data at CLASS is almost 14 Petabytes

• Register: https://www.bou.class.noaa.gov/saa/products/user_profile

• A demonstration is available at:

https://www.class.noaa.gov/notification/demo.htm

• A tutorial is available at:

https://www.avl.class.noaa.gov/notification/pdfs/CLASS%20Data%20Access

%20Tutorial_042015.pdf

• For questions regarding access in CLASS please contact:

[email protected]











NOAA Big Data Project

• NOAA’s Big Data Project (BDP) is designed to facilitate public use of key

environmental datasets by providing copies of NOAA’s information in the

Cloud, allowing users to do analyses of data and extract information

without having to transfer and store these massive datasets themselves

• http://www.noaa.gov/big-data-project

• CICS-NC is a partner in the BDP and acts as a broker between NOAA

and the public cloud providers

• Links to Public Cloud Information and Datasets

▪ GOES-16/17 Data:

― Amazon Web Services

― Google Cloud Platform

― Open Commons Consortium










http://www.noaa.gov/big-data-project

https://ncics.org/data/noaa-big-data-project/

https://registry.opendata.aws/noaa-goes/

https://console.cloud.google.com/launcher/details/noaa-public/goes-16?pli=1

http://edc.occ-data.org/goes16/getdata/


Big Data Program History (4/2015-5/2019)

• Cooperative Research and Development Agreements

▪ 5 separate but identical 4-year agreements (Google, IBM,

Microsoft, AWS, OCC)

• Industry provides access to NOAA’s open data to all

▪ Data storage and egress are free, are not to be sold

▪ Collaborators can monetize services based on data

▪ NOAA provides data and expertise

• Combines 3 powerful resources based on NOAA’s open data:

1. NOAA’s science and subject matter expertise

2. Industry’s data storage and access expertise

3. Cloud's scalable and on-demand processing capability











Websites\

NOAA STAR GOES Image Viewer

https://www.star.nesdis.noaa.gov/GOES/

NOAA/NESDIS Geostationary Satellite Server

https://www.goes.noaa.gov/

NOAASIS Website: https://noaasis.noaa.gov/

NOAA Centers for Environmental Information (NCEI) portal

CLASS

http://www.class.ngdc.noaa.gov/saa/products/welcome

NOAA does not control or guarantee the accuracy, relevance, timeliness, or completeness of information

contained in the non-NOAA sites. NOAA does not endorse the organizations or individuals maintaining these

sites, any views they express, or any products/services they offer











Notifications, Status, and Contacts

24/7 Help Desk [email protected]

ESPC Messages https://www.ospo.noaa.gov/Operations/messages.html

User Services [email protected]

Data Access [email protected]

Facebook https://www.facebook.com/NOAASatellites/

Twitter https://twitter.com/NOAASatellites

GOES Status https://www.ospo.noaa.gov/Operations/GOES/status.html

GOES User Information

and Documentshttps://www.ospo.noaa.gov/Operations/GOES/documents.html

Direct Services https://noaasis.noaa.gov/NOAASIS/

GRB/HRD User Group [email protected]

HRIT/EMWIN User

[email protected]

GNC-A User Group [email protected]











Contributors

• Jim McNitt

• Seth Clevenstine

• Matt Seybold

• Liz Kline

• Dan Lindsey

• Michelle Smith

• Mitch Goldberg











Thank you!








