powerpoint presentation · • overview of web site • searching for data • examples of...
TRANSCRIPT
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 1
-
NCAR is operated by UCAR under sponsorship of the NSF
Outline • Introduction to RDA • Overview of web site • Searching for data • Examples of available data • Dataset web pages
5/25/2012 2
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 3
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 4
-
NCAR is operated by UCAR under sponsorship of the NSF
Research Data Archive (RDA) at NCAR Data Support Section • Mission - support climate & weather
research by curating, organizing, documenting, and creating access to research datasets
• To extent possible, all data and services are
free and open
5/25/2012 5
-
NCAR is operated by UCAR under sponsorship of the NSF
Research Data Archive (RDA) at NCAR Research Data Archive (RDA) • Established in 1960s • 600+ datasets, 4M files, 600 TB
– Every dataset has a web page • Many datasets routinely updated
– daily, weekly, monthly
• 7000 unique users annually – ~2000 from US
• ~580TBs provided in 2011
5/25/2012 6
-
NCAR is operated by UCAR under sponsorship of the NSF
Core Data Categories Examples of Research Areas Supported Climate Synoptic Oceanographic Hydrologic Weather Prediction Numerical Modeling Renewable Energy (Wind/Solar)
5/25/2012 7
-
NCAR is operated by UCAR under sponsorship of the NSF
RDA web site : rda.ucar.edu
5/25/2012 8
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 9
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 10
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 11
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 12
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 13
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 14
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 15
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 16
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 17
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 18
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 19
-
NCAR is operated by UCAR under sponsorship of the NSF
Core Data Categories
Operational and Reanalysis model outputs
Meteorological and Oceanographic Observations
Remote Sensing Observations
Topography/Bathymetry, Vegetation, Land Use
5/25/2012 20
-
NCAR is operated by UCAR under sponsorship of the NSF
Meteorology/Oceanography Observations
5/25/2012 21
•141 Total Datasets •107 w/ Air Temp •77 w/ Wind •78 w/ Rainfall
Fixed Stations
•72 Total Datasets •10 w/ Water Temp •41 w/ Air Temp •8 w/ Rainfall
Ships
•Cyclone Tracks •Station Libraries •Visibility
Miscellaneous
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 22
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 23
-
NCAR is operated by UCAR under sponsorship of the NSF
Meteorology/Oceanography Observations
5/25/2012 24
•141 Total Datasets •107 w/ Air Temp •77 w/ Wind •78 w/ Rainfall
Fixed Stations
•72 Total Datasets •10 w/ Water Temp •41 w/ Air Temp •8 w/ Rainfall
Ships
•Cyclone Tracks •Station Libraries •Visibility
Miscellaneous
-
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
5/25/2012 25
-
NCAR is operated by UCAR under sponsorship of the NSF
ICOADS
5/25/2012 26
• Marine surface and subsurface data • Ships, buoys, coastal stations and others • rda.ucar.edu/datasets/ds540.0
Description • 1662 – 2007 (rel 2.5) • 2008 – 2010 (prelim extension) • -> 2012 available
Dates • Air Temperature • Water Temperature • Salinity • Winds
Variables
• 261 million obs • Hourly to daily observations • Monthly statistics at 1x1 degree boxes
Statistics
-
NCAR is operated by UCAR under sponsorship of the NSF
Evolution of the Marine Climate Data System
TOTAL
5/25/2012 27
-
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
5/25/2012 28
-
NCAR is operated by UCAR under sponsorship of the NSF
NCAR Upper Air Database
5/25/2012 29
• Meteorological land stations • 2x (4x) daily balloon launches • rda.ucar.edu/datasets/ds370.0
Description • 1920’s to 2011 (winds only) • 1940’s to 2011 (thermal ) • 1973 -> available via web
Dates • Temperature • Moisture • Wind • Height
Variables
• 15 Standard pressure levels • Significant levels • Height above surface
Levels
-
NCAR is operated by UCAR under sponsorship of the NSF
0
200
400
600
800
1000
1200
1920
1925
1930
1935
1940
1945
1950
1955
1960
1965
1970
1975
1980
1985
1990
1995
# S
tatio
ns
YEAR
Stations Reporting 30 Times/ Month or More
Content of Upper Air Archive
5/25/2012 30
-
NCAR is operated by UCAR under sponsorship of the NSF
Station Coverage Evolution in UADB
5/25/2012 31
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 32
-
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
5/25/2012 33
-
NCAR is operated by UCAR under sponsorship of the NSF
NCEP Operational Surface
5/25/2012 34
• Meteorological land stations • Observations taken 3x, 4x, 6x, 8x or 24x
daily • rda.ucar.edu/datasets/ds461.0
Description
• 1977 to 2012 Dates Range • Temperature • Moisture • Precipitation • Winds
Variables
• Global Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
Synoptic Stations in NCEP Surface
5/25/2012 35
~ 1000 stations in North America ~ 5 obs/day per station
-
NCAR is operated by UCAR under sponsorship of the NSF
Metar Stations in NCEP Surface
5/25/2012 36
~ 2700 stations in North America ~ 30 obs/day per station
-
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
5/25/2012 37
-
NCAR is operated by UCAR under sponsorship of the NSF
GHCN Summary of the Day/Month
5/25/2012 38
• Meteorological land stations • Summary of the day and month • Web : coming soon
Description
• 1800’s to 2011 • Most stations start in 1900’s Dates
• Minimum Temperature • Maximum Temperature • Precipitation
Variables
• Global Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 39
0
5000
10000
15000
20000
25000
1850
1855
1860
1865
1870
1875
1880
1885
1890
1895
1900
1905
1910
1915
1920
1925
1930
1935
1940
1945
1950
1955
1960
1965
1970
1975
1980
1985
1990
1995
2000
2005
2010
Num
ber o
f Sta
tions
Year
Total GHCN Daily Data in US
Precip
Tmin
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 40
Annual Precipitation Anomalies from GHCN
-
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
5/25/2012 41
-
NCAR is operated by UCAR under sponsorship of the NSF
U.S. and Canada Surface Hourly Data
5/25/2012 42
• Meteorological land stations • Observations 24x daily • rda.ucar.edu/datasets/ds472.0
Description
• 1977 thru 2011 Dates • Temperature • Moisture • Precipitation • Wind
Variables
• U.S. and Canada Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 43
0
500
1000
1500
2000
2500
3000 19
77
1978
1979
1980
1981
1982
1983
1984
1985
1986
1987
1988
1989
1990
1991
1992
1993
1994
1995
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
# of
Sta
tions
Year
Number of Stations in the U.S. and Canada Hour Data
-
NCAR is operated by UCAR under sponsorship of the NSF
Core Data Categories
Operational and Reanalysis model outputs
Meteorological and Oceanographic Observations
Remote Sensing Observations
Topography/Bathymetry, Vegetation, Land Use
5/25/2012 44
-
NCAR is operated by UCAR under sponsorship of the NSF
Operational and Reanalysis Model Output
5/25/2012 45
• Provide real time forecasts • 18 Total datasets • 2 Global Primary • 1 Regional
Operational
• 8 Projects currently archived • 6 global • 2 regional
Reanalysis
• Temperature • Moisture • Winds • Radiation • Usually well over 100/model
Variables
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
5/25/2012 46
-
NCAR is operated by UCAR under sponsorship of the NSF
TIGGE
5/25/2012 47
• Global Ensemble Forecast Data • Output from 10 different centers • Near real time (48 hours) • rda.ucar.edu/datasets/ds330.2
Description
• Oct, 2006 - > 2012 • Forecasts : 0 -> 15 days Dates Range • Temperature ~ 30 total variables • Moisture ~ 13 levels • Precipitation • Winds
Variables
• Global Domain
-
TIGGE data A phased approach was chosen beginning with mirrored data
collections of global medium-range ensemble forecasts from 10 NWP providers at three TIGGE Archive Centres: CMA, ECMWF, and NCAR.
TIGGE data is made available for research after a 48-hour delay. Near real-time access may be granted for specific projects through the THORPEX International Project Office.
-
NCAR is operated by UCAR under sponsorship of the NSF
TIGGE
5/25/2012 49
• Global Ensemble Forecast Data • Output from 10 different centers • Near real time (48 hours) • rda.ucar.edu/datasets/ds330.2
Description
• Oct, 2006 - > 2012 • Forecasts : 0 -> 15 days Dates Range • Temperature ~ 30 total variables • Moisture ~ 13 levels • Precipitation • Winds
Variables
• Global Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 50
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 51
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
5/25/2012 52
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily
5/25/2012 53
-
NCAR is operated by UCAR under sponsorship of the NSF
UNIDATA IDD
5/25/2012 54
• Collection of model output • NCEP and ECMWF • Global and regional models • rda.ucar.edu/datasets/ds335.0
Description
• Dec, 2002 - > 2012 • Forecasts : 0 -> 16 days • Updated daily (48 hourly delay)
Dates Range • Temperature ~ 52 total variables • Moisture ~ 25 levels • Precipitation • Winds
Variables
• Global • Regional Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
Model Analysis Forecasts # of Variables
Region
RUC2 CONUS Hourly 3 hourly -> 12 hours
16 Continental U.S. (20km)
NAM CONUS 00,06,12,18 UTC 3 hourly -> 84 hours
16 Continental U.S. (12km)
GFS 00,06,12,18 UTC 3 houlry -> 180 hours
16 Global (1 degree)
GFS 00,06,12,18 UTC 12 houlry 192 -> 384 hours
16 Global (2.5 degree)
GFS 00,06,12,18 UTC 16 Global (0.5 degree)
NCEP Regional Ensemble
00, 12 UTC 6 hourly -> 84 hours
8 North and Central America
(1.5 degree)
ECMWF 00, 12 UTC 24 hourly -> 168 hours
5 Global (2.5)
5/25/2012 55
Models in UNIDATA IDD Dataset
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily
NCEP ETA/NAM (40km) North America 1995 - Present Monthly
5/25/2012 56
-
NCAR is operated by UCAR under sponsorship of the NSF
NCEP NAM
5/25/2012 57
• North American regional model • Great for WRF input • rda.ucar.edu/datasets/ds609.2
Description
• 2002 - > 2012 • Forecasts : 0 -> 60 hours • Updated monthly
Dates Range • Temperature ~ 15 total variables • Moisture ~ 35 levels • Precipitation • Winds
Variables
• North America • 40km ??
Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily
NCEP ETA/NAM (40km) North America 1995 - Present Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg) Global 1985 - Present Bi-Yearly
5/25/2012 58
-
NCAR is operated by UCAR under sponsorship of the NSF
ECMWF
5/25/2012 59
• ECMWF Data assimilation system • Backbone for ECMWF forecast system • rda.ucar.edu/datasets/ds113.0
Description
• 1985 - > 2011 • Updated bi-monthly Dates Range • Temperature > 60 total variables • Moisture ~ 25 levels • Precipitation • Winds
Variables
• Global • ~1.125 degree -> 2010 • .14 degree 2011 ->
Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 60
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 61
-
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily
NCEP ETA/NAM (40km) North America 1995 - Present Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg) Global 1985 - Present Bi-Yearly
NCEP GDAS Final Analysis (1x1 Deg) Global 1999 - Present Daily
5/25/2012 62
-
NCAR is operated by UCAR under sponsorship of the NSF
NCEP GDAS
5/25/2012 63
• NCEP Global Data Assimilation system • Used to initialize the GFS • Backbone for NWS forecasts
Description
• 1985 - > 2012 • Updated daily Dates Range • Temperature > 60 total variables • Moisture ~ 25 levels • Precipitation • Winds
Variables
• Global • 1.0 degree Domain
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 64
KATRINA
-
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily
NCEP ETA/NAM (40km) North America 1995 - Present Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg) Global 1985 - Present Bi-Yearly
NCEP GDAS Final Analysis (1x1 Deg) Global 1999 - Present Daily
5/25/2012 65
-
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Data Dataset Title Coverage Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily
NCEP ETA/NAM (40km) North America 1995 - Present Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg) Global 1985 - Present Bi-Yearly
NCEP GDAS Final Analysis (1x1 Deg) Global 1999 - Present Daily
NCEP OI Global SST (1x1 Deg) Global 1981 - Present Weekly
NOAA OI Global SST (0.25 x 0.25 Deg) Global 1981 - Present Monthly
Hadley Centre Global Sea Ice and SST Global 1850 - Present Monthly
5/25/2012 66
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 67
-
NCAR is operated by UCAR under sponsorship of the NSF
Reanalysis Model Output
5/25/2012 68
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 69
Operational Model Evolution 1985 1990 1995 2000 2005 2010
Cycle R34L34
Cycle R35L34
Cycle R36L50
Cycle R37L50
Change Physics
Add Levels
New Radiation
Unknown if changes in time series caused by model discontinuities or change in climate
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 70
Operational Model Evolution 1985 1990 1995 2000 2005 2010
Cycle R34L34
Cycle R35L34
Cycle R36L50
Cycle R37L50
Change Physics
Add Levels
New Radiation
Reanalysis R37L50
Changes in time series caused by change in climate or other factors
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
High Resolution Re-Analysis Dataset Title Coverage Update
Frequency Resolution Dataset ID
ERA-40 (T159) Global 1957 - 2002 Static Set ~1.125 Ds117.0
ERA-Interim (N128 Gaussian) Global 1989 - Present Yearly ~.7023 Ds627.0
1870 2011 High Resolution Re-Analysis
5/25/2012 71
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
High Resolution Re-Analysis Dataset Title Coverage Update
Frequency Resolution Dataset ID
ERA-40 (T159) Global 1957 - 2002 Static Set ~1.125 Ds117.0
ERA-Interim (N128 Gaussian) Global 1989 - Present Yearly ~.7023 Ds627.0
1870 2011 High Resolution Re-Analysis
5/25/2012 72
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 73
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
5/25/2012 74
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
High Resolution Re-Analysis Dataset Title Coverage Update
Frequency Resolution Dataset ID
ERA-40 (T159) Global 1957 - 2002 Static Set ~1.125 Ds117.0
ERA-Interim (N128 Gaussian) Global 1989 - Present Yearly ~.7023 Ds627.0
1870 2011 High Resolution Re-Analysis
JRA-25 (1.125 Deg Gaussian) Global 1979 – Present Yearly ~1.125 Ds625.0
NCEP/DOE (T62) Global 1979 - Present Static Set ~ 2.0
NCEP/NCAR (T62) Global 1948 - Present Quarterly ~2.0 Ds090.0
NARR (32 x 32 km) North America 1979 - Present Quarterly 32km Ds608.0
CFSR (0.5 x 0.5 Deg) Global 1979 - Present Monthly .5 x .5 Ds093.0 Ds094.0
5/25/2012 75
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
5/25/2012 76
-
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
High Resolution Re-Analysis Dataset Title Coverage Update
Frequency Resolution Dataset ID
ERA-40 (T159) Global 1957 - 2002 Static Set ~1.125 Ds117.0
ERA-Interim (N128 Gaussian) Global 1989 - Present Yearly ~.7023 Ds627.0
1870 2011 High Resolution Re-Analysis
JRA-25 (1.125 Deg Gaussian) Global 1979 – Present Yearly ~1.125 Ds625.0
NCEP/DOE (T62) Global 1979 - Present Static Set ~ 2.0
NCEP/NCAR (T62) Global 1948 - Present Quarterly ~2.0 Ds090.0
NARR (32 x 32 km) North America 1979 - Present Quarterly 32km Ds608.0
CFSR (0.5 x 0.5 Deg) Global 1979 - Present Monthly .5 x .5 Ds093.0 Ds094.0
NOAA-CIRES 20th Century Global 1870 – 2008 Static Set 1.875 Ds131.1 5/25/2012 77
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 78
-
NCAR is operated by UCAR under sponsorship of the NSF
Dataset Web Pages
5/25/2012 79
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 80
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 81
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 82
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 83
-
NCAR is operated by UCAR under sponsorship of the NSF
5/25/2012 84
-
NCAR is operated by UCAR under sponsorship of the NSF
SUMMARY : RDA WEB SITE : rda.ucar.edu 641 datasets covering: Meteorology and oceanographic obs Numerical Weather Output Many other datasets Email : [email protected]
5/25/2012 85
Slide Number 1Slide Number 2Slide Number 3Slide Number 4Research Data Archive (RDA) at NCARResearch Data Archive (RDA) at NCARCore Data CategoriesSlide Number 8Slide Number 9Slide Number 10Slide Number 11Slide Number 12Slide Number 13Slide Number 14Slide Number 15Slide Number 16Slide Number 17Slide Number 18Slide Number 19Core Data CategoriesMeteorology/Oceanography �ObservationsSlide Number 22Slide Number 23Meteorology/Oceanography �ObservationsPlatform ObservationsICOADS Evolution of the Marine Climate Data SystemPlatform ObservationsNCAR Upper Air DatabaseSlide Number 30Slide Number 31Slide Number 32Platform ObservationsNCEP Operational SurfaceSynoptic Stations in NCEP SurfaceMetar Stations in NCEP SurfacePlatform ObservationsGHCN Summary of the Day/MonthSlide Number 39Slide Number 40Platform ObservationsU.S. and Canada Surface Hourly DataSlide Number 43Core Data CategoriesOperational and Reanalysis Model OutputFeatured DatasetsTIGGETIGGE dataTIGGESlide Number 50Slide Number 51Featured DatasetsFeatured DatasetsUNIDATA IDDSlide Number 55Featured DatasetsNCEP NAMFeatured DatasetsECMWF Slide Number 60Slide Number 61Slide Number 62NCEP GDAS KATRINASlide Number 65Slide Number 66Slide Number 67Reanalysis Model OutputSlide Number 69Slide Number 70Featured DatasetsFeatured DatasetsSlide Number 73Featured DatasetsFeatured DatasetsFeatured DatasetsFeatured DatasetsSlide Number 78Dataset Web PagesSlide Number 80Slide Number 81Slide Number 82Slide Number 83Slide Number 84Slide Number 85