unidata and some of its international cyberinfrastructure ...€¦ · unidata and some of its...
TRANSCRIPT
![Page 1: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/1.jpg)
Unidata and Some of its International
Cyberinfrastructure Activities
05 August 2011
NSF Workshop on Science and Cyberinfrastructure in Africa
Boulder, CO
Mohan Ramamurthy
Tom Yoksas
Unidata
UCAR Community Programs
![Page 2: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/2.jpg)
Global partnerships are essential to making advances in the geosciences.
Global Connections, Local
Observations
![Page 3: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/3.jpg)
We have so much to learn…Hurricane Catarina, 2004
Another “unusual” storm
Anita, 2010
![Page 4: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/4.jpg)
Unidata
It is a community driven program.
Unidata is an exemplar of what can be achieved through sustained investments in cyberinfrastructure.
Established in 1984, Unidata is an NSF-funded program that provides the data services and cyberinfrastructure leadership for advancing geoscience research and education.
![Page 5: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/5.jpg)
Mission
Facilitate data access
Develop and provide software for data management, analysis, and visualization
Provide comprehensive support, including training
Engage in community building and advocacy
![Page 6: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/6.jpg)
Community Evolution
• Developing interoperable software based on broadly applicable frameworks;
• Exploiting technological advances (e.g., Internet, Java, and GIS);
• Having a “free and open” philosophy;
• Workings closely with and engaging users;
• Leveraging partnerships at every opportunity;
Build it. Give it away. Support it. Engage your users.
From its modest beginning in meteorology, the Unidata community now includes users in more than1500 academic institutions and 7000 organizations in ~150 countries, spanning every sector and every geoscience discipline.
![Page 7: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/7.jpg)
A Snapshot of Services
User Support & Training:
Direct email support
Community mailing lists
Annual Training Workshops, Triennial Users Workshops, and Regional Workshops as needed.
Data:
Over 30 data streams provided
Data collection, cataloging, and distribution
Both push and pull technologies are used
Software:
Data Distribution: LDM
Remote Data Access: THREDDS, ADDE, and RAMADDA
Data Management: netCDF and UDUNITS
Analysis and Visualization: GEMPAK, McIDAS and IDV
GIS support via TDS (WCS, WMS) and KML and Shapefiles
Community:
Equipment Awards to universities; Seminars; Information Commons; Advocacy;
![Page 8: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/8.jpg)
Real-time Data Distribution
Source
LDM
Source
Source
LDM LDM
LDMLDM
LDM LDM
LDM
LDM
Internet
Radar
Model
Satellite
About 30 different streams of real-time weather data from diverse sources are provided to a global community.
Unidata systems move more data (~30 Terabyes/week) via Internet 2 than any other advanced application.
![Page 9: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/9.jpg)
Internet Data Distribution Network
The IDD has nearly 500 nodes in over 260 unique network domains. About 10% of those institutions are outside the U.S.
Unidata IDD: North American data delivery and sharing network
IDD-Brasil: South American peer of North American IDD
IDD-Caribe (a work in progress): Central American peer of North American IDD
Antarctic-IDD: Support of US Antarctic research community
![Page 10: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/10.jpg)
Remote Data Access
Complements the IDD/LDM push system
Made available via THREDDS Data Server, RAMADDA, and ADDE data servers that support several protocols
The Unidata Program Center operates an operational server at motherlode.ucar.edu that provides the above services.
![Page 11: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/11.jpg)
THREDDS Data Server
The TDS can be accessed from many clients, including the IDV, ArcGIS, IDL, and Matlab
![Page 12: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/12.jpg)
RAMADDARAMADDA is a web-based, content repository, a publishing platform, and a collaboration environment. Below is a RAMADDA server in operation.
![Page 13: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/13.jpg)
Workshops
We conduct training workshops both here in Boulder (annually) and in other locations (e.g., Sao Paolo, Cyprus, Iguassu Falls).
Participants come from many countries, including Asia, Africa, Europe, and Latin and Central America.
They bring fresh perspectives and an eagerness to participate, enriching our community.
![Page 14: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/14.jpg)
Unidata Visualization
Software
GEMPAK
McIDAS-X McIDAS-X
IDV
![Page 15: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/15.jpg)
New Insights
The IDV is a multiplatform visualization and analysis tool that brings a wide range of data within a unified interface. These images were created using GEON-IDV, a version of the IDV.
Source: Unavco
![Page 16: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/16.jpg)
Unidata CI Use
Unidata’s technologies are used by universities, government agencies, research institutions, and research and operational projects worldwide.
Most major data centers use netCDF and many have implemented THREDDS middleware.
Many weather services around the world, federal agencies and companies, including NWS, NOAA, NASA, The Weather Channel, Raytheon, use LDM to send/receive data.
![Page 17: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/17.jpg)
Team: UCAR/NCAR/Unidata
International Research Institute
North Carolina State University
Navrongo Health Research Center
Scientists in Africa
![Page 18: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/18.jpg)
Relative Humidity and
Meningitis
Meningitis cases have been observed to occur in the dry season and end with the onset of higher humidity that accompanies the rainy season
![Page 19: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/19.jpg)
Vision: An Information System
Open access* to current, historic, and
forecasted epidemiological, environmental, political, and socio-demographic data in a geo-referenced framework that enables research, supports decision, and facilitates collaboration.
*At least open to MERIT members and partners
Unidata-developed CI like netCDF, CDM,
RAMADDA, and the IDV, provide a framework for developing such an information system.
![Page 20: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/20.jpg)
Model-Observation Inter-
comparison
Example: View of West Africa looking from the northeast, with precipitable water in blue and meningitis reports by district -- no report (gray), alert (yellow), and epidemic (red).
IDV visualization
![Page 21: Unidata and Some of its International Cyberinfrastructure ...€¦ · Unidata and Some of its International Cyberinfrastructure Activities 05 August 2011 NSF Workshop on Science and](https://reader035.vdocuments.site/reader035/viewer/2022070809/5f07d48c7e708231d41ef714/html5/thumbnails/21.jpg)
Concluding Remarks
The increased globalization, enabled by global networks and a new generation of data and information services, is creating new partnerships that are accelerating scientific discoveries and creating new knowledge.
Unidata is keenly interested in enhancing its ties to the international community. We would welcome opportunities to leverage and enhance NSF’s investments in Unidata in order to help build capacity and partnerships.