sustained coordinated processing of environmental satellite data for climate monitoring sustained...
TRANSCRIPT
Sustained Coordinated Processing of Environmental Satellite Data for Climate Monitoring
Sustained Co-ordinated Processing Of Environmental Satellite Data For Climate Monitoring (SCOPE-CM)Overview and Next Steps
John Bates, Chair SCOPE-CM Executive Panel
WMO’s SCOPE-CM initiative: goals and structure
• Aim: to address the requirements of GCOS in a cost-effective, coordinated manner, capitalising upon the existing expertise and infrastructures.
• Objective: continuous and sustained provision of high-quality Essential Climate Variables satellite products (Climate Data Records) on a global scale
• Structure: The SCOPE-CM Network will be:» Based on activities of existing initiatives (GOS, GCOS and GSICS)» Build upon existing operational infrastructures» Serve users and other organisations (e.g. WMO Regional Climate
Centres RCC, National Weather Services)
Satellite & In Situ Observations
Sustained Climate Information FlowEmerging International Architecture
Satellite data
EnvironmentalData Records
Long-term Information Preservation
Interim Climate Data
Records(ICDRs)
Essential Climate Variables
Climate Information
Records
Short scale physical phenomena
monitoring
Operational Climate Monitoring supporting
Climate Services
Longer term climate variability& climate change analysis
Adaptation + mitigation planning
(decision making)
Sustained Applications
Major model-based
Reanalysis
Near Real Time
Re-calibrationInter-calibrationReprocessing
Observing system performanceMonitoring and automated corrections
Data conversion
User Services
Archives
Inter-calibration
Sustained Coordinated Processing
ThematicalClimate Data
Records(TCDRs)
FundamentalClimate Data
Records(FCDRs)
WMO’s SCOPE-CM initiative: goals and structure
• Phase 1 Participants of the SCOPE-CM Network
• Operational Satellite operators:
– NOAA– JMA– CMA– EUMETSAT (Central Facilities and CM
SAF)
• Stakeholder– WMO Space Programme– GCOS– CEOS– CGMS/GSICS
WMO’s SCOPE-CM initiative: Phasing
• establish initial network and structure
• agreement on principles and standards
• first pilot projects on selected subjects
• assessment of the current capabilities
• establishment of feedback mechanisms
2008 2009 2010 2011 2012 2013 2014
Phase I
• establishment of structures for sustainable generation of FCDRs and TCDRs
• generation of first SCOPE-CM products
• increased coverage of products in terms of ECVs, time and spatial dimension
• fostering extension of the network
• full deployment of the sustained system of product generation
• products review and quality control
• continuous product improvement
Phase II Phase III
SCOPE-CM Pilot Projects
Sensors Parameters and topics Lead Contributors
1 AVHRR Clouds and Aerosols
2 SSM/I Water vapour, clouds, precipitation
3 GEO Surface albedo, clouds and aerosols
4 GEO Winds and clear sky radiances
5 GEO Upper tropospheric humidity
Present status and future plan EUMETSAT
- MFG AMV and CSR reprocessing (end 2010)- MSG AMV and All Sky Radiance (ASR) reprocessing (end 2011)
NOAA- Make existing record (1982-present) of reprocessed AVHRR AMVs available to
SCOPE-CM community- Define plans for a pilot project aimed at demonstrating the utility and benefits of
reprocessed AMVs- GOES AMV reprocessing per pilot project (mid 2011)- Development of reprocessing capability (2011-2014)- GOES AMV and CSR reprocessing (2015)- MODIS AMV reprocessing (2015)
JMA- GMS/MTSAT AMV and CSR reprocessing is in progress to meet Japanese 55-year
Reanalysis project (JRA-55) schedule (end 2010)- Webpage showing the status of JMA’s reprocessing is available
CMA- CMA is interested in FY-2 AMV reprocessing- FY-2 archive intercalibration reprocessing has just started
GEWEX RADIATION PANELWORKING GROUP ON DATA MANAGEMENT AND ANALYSIS
• Formed in 2004 by combining existing GRP
Data Project Working Groups that date to 1980s
• Purpose: Coordinate next data product revision and
re-processing to increase physical consistency and to produce joint data product
• Original Working Groups Differed in Nature– ISCCP: Data Processing Center Representatives– GPCP: Science Team & Data Processing Group– GACP & SRB: Data Processing Team– SeaFlux & LandFlux: Science Study Group Representative
GEWEX RADIATION PANELWORKING GROUP ON DATA MANAGEMENT AND ANALYSIS
• Added Data Product Assessment WG Leaders for Precipitation, Radiation, Clouds (and Aerosols)
• Accumulated Functions– Monitor Data Exchanges and Resolve Problems– Radiance Calibration– Ancillary Data Acquisition & Evaluation– Review Scientific Developments for Retrieval Methods– Develop/Evaluate Analysis Methods & Revise Products– Assess Data Product Quality
Proposal to Transition Some GRP WGDM Functions to SCOPE-CM - Rationale
• SCOPE-CM is moving into Phase 2 – Ongoing pilot projects and new projects require sustained provision of data, calibration, and processing from operational environmental satellite
• SCOPE-CM is an appropriate mechanism for sustaining some important GRP WGDM functions
• Other GRP WGDM functions should remain within international research bodies and/or be part of shared responsibilities
SCOPE Presentation Template - SCOPE CM
10
• 1978-2012• 32 Satellites
– 2 SMS– 13 GOES– 8 Meteosat– 5 GMS– 2 MTS– 2 FY
Current Geostationary Quilt2 GOESs
GOES, Meteosat, GMS
2 GOES, Meteosat, GMS
2 GOES, 2 Meteosats,GMS, FY
ISCCP Data SharingHistorically
SatelliteProcessingCenters
ISCCPCentralArchive(NCDC)
GlobalProcessingCenter
JMACMAEUMETSATNOAAINP (Brazil)
GISS/CCNY
B3 (All satellites)Products (C/D Data)
B2
B2
GOES-11,12,13Meteosat-7,9MTS-1,2FY2
NOAA-7,8,9,10,11,12,14,15,16,17
B1
GOES-11,12,13Meteosat-7,9MTS-1,2FY2
ISCCP Data SharingAfter transition
SatelliteProcessingCenters
ISCCPCentralArchive(NCDC)
ISCCPDevelopment
JMAEUMETSATNOAACMAINP (Brazil)Others?
GISS/CCNY
B1
GOES-11,12,13Meteosat-7,9MTS-1,2FY-2E
ISCCP CloudProcessing @ NCDC
Code Improvements
B1 & AVHRR
New ISCCP ProductsHX – Pixel-level, not mapped,3-h (DX)HG – 0.1° global, remapped, 3-hH1 – 1° gridded global 3-h (D1)H2 – 1° gridded global monthly (3-h) (D2)H3 – 1° gridded global monthly mean (D3)
For Archive
ForAnalysis
Early Results from B1 processing
ISCCP B1 IR Radiance ISCCP Clear sky IR Radiance ISCCP Cloud Mask
B3 (32 km) B1 (10 km)
GRP WGDM Accumulated Functions
• Radiance Calibration– Who currently is involved?– Who should be involved going forward?– What major issues are involved?– What international bodies should be involved and
provide leadership?
SCOPE Presentation Template - SCOPE CM
15
SCOPE-CM initial structure
• Current Members: Operational Agencies: NOAA, EUMETSAT, JMA, CMA (USGS) = operators of operational (meteorological) satellites
• Executive Panel as the only established formal structure so far.
• Pilot Projects: groups at different level of integration and nature of cooperation.
• Some pilot projects grouped by sensors, some by targeted ECV CDR
SCOPE-CM transition towards Phase 2: Questions and issues
• Increasing interest from other organisations: Universities, ESA, GEWEX, ....
• University groups to join SCOPE-CM? How? • What are the conditions to become member?• What shall be the difference between a SCOPE-
CM activity and any other type of project?• What shall be the difference and the relation to
other initiatives, projects e.g. WMO GFCM, CEOS Climate Working Group, ESA CCI, GMES Climate, ....
A Proposal for the SCOPE-CM in its next phase
Two “spheres”:
SCOPE-CM Sustained Structures
SSS
SCOPE-CMProjects Sphere
(research, science)
A Proposal for the SCOPE-CM in its next phase
Two “spheres”:
SCOPE-CM Sustained Structures
SSS
SCOPE-CMProjects Sphere
(research, science)
– Teams from the operational agencies
– Working together on: FCDRs, standards, inter-calibration, reprocessing methodologies, archive issues, data distribution, documentation, ....
– Permanent groups and resources (e.g. sustained funding, staff, etc...)
– Group by sensor / sensor types
A Proposal for the SCOPE-CM in its next phase
Two “spheres”:
SCOPE-CM Sustained Structures
SSS
SCOPE-CMProjects Sphere
(research, science)
– Teams from universities, research labs, (space agencies)
– Working together on: algorithms, science, applications, initial CDR processing, ....
– Non-Permanent groups and resources (project funding)
SCOPE-CM Generic CDR life cycle
SCOPE-CMPilot Project
SCOPE-CMCDR generation
projectIndependent
CDR assessment(e.g. GEWEX RP)
Consolidated Retrievals/Methods
Feasibility for sustained generation
Pre-releasedCDRs
Accepted CDR
SCOPE-CM Generic CDR life cycle
SCOPE-CMPilot Project
SCOPE-CMCDR generation
project
IndependentCDR assessment
Consolidated Retrievals/Methods
Feasibility for sustained generation
Pre-releasedCDRs
Accepted CDR
• Identification of CDRs reaching maturity for R2O transition
• Initiated by external groups, SCOPE-CM, or GRP etc.
• Lead by PI, consortium consist of external groups and SCOPE-CM partners (from the relevant SSS)
• Criteria: e.g. CDR targeted, that need coordination of SCOPE-CM partners
• Proposals to be accepted by the Executive Panel
• Assessment of requirements, scientific relevance and feasibility
• Determination of processing requirements, schedules, dependencies
• Agreement of methods and principles (inter-calibration, validation, etc.)
• Main outcome: Pilot project report, ATBD (for TCDRs and FCDRs) for implementation
SCOPE-CM Generic CDR life cycle
SCOPE-CMPilot Project
SCOPE-CMCDR generation
project( transition step)≙
CDR assessment
Pre releasedCDRs
Accepted CDR
• Joint Lead by PI and SSS representative (=“transition manager”), consortium consist of external groups and SCOPE-CM partners (SSS)
• Proposals for a CDR project (pre-agreed with SSS) to be accepted by the Executive Panel
• CDR generation at SSS
• Validation
• Review Processes
• “Pre-”Release of a CDR with unique reference (DOI)
• Main outcome: CDR, Documentation (Validation Report, Product User Manual,..), Dissemination/Publication
Consolidated Retrievals/Methods
Feasibility for sustained generation
Consolidated Retrievals/Methods
Feasibility for sustained generation
SCOPE-CM Generic CDR life cycle
CDR assessment
CDRs Accepted CDR
• Independent assessment of Pre-released CDR (following internationally agreed assessment procedure supervised by GRP)
• Capturing user feedback and assessment of CDR impact in applications
• Main outcome: Assessment Report – (To be reviewed by e.g. GRP and/or GCOS panels AOPC, OOPC, TOPC)
• (Release) Endorsement ? Confirmation or Rejection
SCOPE-CMCDR generation
project( transition step)≙
SCOPE-CMPilot Project
Way forward
• General agreement on the concept for SCOPE-CM Phase 2 in the Executive Panel (including the stakeholders WMO Space Programme, GCOS, CGMS, CEOS, GEWEX)
• Draft Implementation proposal for SCOPE-CM Phase 2 – including the achievements and accomplishments of Phase 1– Takes into account developments e.g. WMO/COES Climate Space
Infrastructure, GCOS IP update, WMO GFCS,...
• Review by SEP• Review and approval by WMO
SCOPE-CM Phase 2 Proposed Organizational Chart
SCOPE-CM Executive Panel (SEP)
S-Center Project Development Partnerships
S-Center Continuous
Projects
Working Group on Data Management
Other International Coordination?
SCOPE Presentation Template - SCOPE CM
26
SCOPE-CM Executive Panel
GCOSWMOCEOS
Questions to Consider for SCOPE-CM and GRP
• (a) continued involvement of the science community to diagnose new problems as they arise
• (b) periodic assessments and procedures to make sure the data are still relevant
• (c) periodic research announcement for more formal product improvement efforts
• (d) Tracking of progress in a quantifiable manner.