![Page 1: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/1.jpg)
1
CF Unleashed:Introduction to Cf/Radial
Joe VanAndel
National Center for Atmospheric Research
2013/1/8
The National Center for Atmospheric Research is sponsored by the National Science Foundation
![Page 2: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/2.jpg)
2
CF -What is it?
• Climate and Forecast Metadata Convention• Locate data in space–time and as a function
of other independent variables, to facilitate processing and graphics
• for– model-generated data– observational datasets
• originally no support for radial data2
![Page 3: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/3.jpg)
3
Motivation
• Support radar/lidar community• Provide better interoperability for data
providers and tool creators• provide libraries and tools to
– read/write datasets – convert from legacy formats– display radial data
![Page 4: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/4.jpg)
4
What is Cf/Radial?
• CF extensions for radial radar/lidar data• CF compliant netCDF
– netCDF is familiar to many scientists– CF allows assimilating data into forecast
models
• Details: http://www.ral.ucar.edu/projects/titan/docs/radial_formats
4
![Page 5: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/5.jpg)
5
What Kind of Instruments?
• Scanning• Staring• Vertically Pointing• Mobile or Fixed
5
![Page 6: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/6.jpg)
6
Stationary Scanning
6
![Page 7: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/7.jpg)
7
Mobile/Scanning
7
![Page 8: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/8.jpg)
8
Airborne Scanning Radar
8
![Page 9: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/9.jpg)
9
Airborne Vertically Pointing
9
![Page 10: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/10.jpg)
10
Fixed, Staring Profilers
10
![Page 11: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/11.jpg)
11
Advantages• Readable on Linux, OS X, Windows• Supported by multiple languages:
– C/C++– Fortran– Python– IDL– Matlab
11
![Page 12: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/12.jpg)
12
Advantages (2)
• Byte order independent• Efficient storage:
– supports variable gates/beam– native compression
12
![Page 13: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/13.jpg)
13
Staggered 2-D Storage
13
![Page 14: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/14.jpg)
14
Transparent Compression
• NetCDF4 uses HDF5 as storage layer • NetCDF4/HDF5 supports transparent
compression• compressed files can be as small as 20% of
the original size (data dependent)
14
![Page 15: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/15.jpg)
15
Sample Surveillance Data
15
![Page 16: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/16.jpg)
16
Range Height Radar Data
16
![Page 17: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/17.jpg)
17
Lidar Data
17
![Page 18: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/18.jpg)
18
Data Content Overview
• data fields (moments)• each moment is a collection of “Rays”• each ray has range gates
18
![Page 19: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/19.jpg)
19
Metadata
• each ray has metadata:– range– elevation– latitude– longitude– altitude– time
19
![Page 20: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/20.jpg)
20
Metadata(2)
• Moving platforms:– heading– roll– pitch– rotation– tilt
20
![Page 21: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/21.jpg)
21
Coordinate Conventions
• Fixed location• Mobile ground-based (truck mounted
radars)• Airborne radars/lidars
21
![Page 22: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/22.jpg)
22
Current tools
• Radx C++ library• Conversions: Read/Write
• CfRadial• DORADE (legacy binary radar format)• Universal Format (UF) - very old binary format• NEXRAD level 2 archive• Foray1 (EOL netCDF)• SIGMET (writing is not supported)
22
![Page 23: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/23.jpg)
Future work (1)
• Incorporating metadata from NODC netCDF templates
• Incorporating metadata from NetCdf Attribute Convention for Data Discovery
23
![Page 24: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/24.jpg)
24
Future work (2)
• convert SOLO (display/editing tool) to read/write CfRadial
• Python libraries and tools• Matlab libraries• IDL libraries• Community archive of user contributed
libraries and tools.
24
![Page 25: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/25.jpg)
25
Who is using CfRadial?
• NCAR• UNIDATA• DOE/ARM• NOAA/NSSL• EEC (commercial radar vendor)• Pro Sensing (commercial radar vendor)• Various university users
25
![Page 26: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/26.jpg)
26
Conclusion
• Want to encourage more users to adopt CfRadial
• We welcome your ideas on how to publicize this format
NCAR is supported by the National Science Foundation.
![Page 27: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/27.jpg)
27
Acknowledgements
27
Co-Authors:
Mike Dixon Wen-Chau LeeBob RillingChris Burghart
![Page 28: 1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research vanandel@ucar.edu 2013/1/8 The National Center for Atmospheric](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649ddf5503460f94ad85e4/html5/thumbnails/28.jpg)
28
Questions?
28
??
?