mid-term review of 2007 cwb project p.i.: y-h. kuo 1,2 y.-r. guo 1 (wrf-var lead) h. liu 3 (wrf-enkf...

32
Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor: Y.-T Lin 1 NCAR/MMM, 2 UCAR/COSMIC, and 3 iMage 7 August 2007

Upload: tamsyn-boone

Post on 20-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Mid-Term review of 2007 CWB project

P.I.: Y-H. Kuo1,2

Y.-R. Guo1 (WRF-Var lead)H. Liu3 (WRF-EnKF lead)

J. Braun2 (Ground-based GPS lead)CWB Visitor: Y.-T Lin

1NCAR/MMM, 2UCAR/COSMIC, and 3iMage7 August 2007

Page 2: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

CWB Project Tasks:

• Task 1: Support and enhancement of the WRF-Var system for CWB operation

• Task 2: Exploration of the WRF-based Ensemble Kalman Filter (EnKF) data assimilation

• Task 3: Training on ground-based GPS PW data processing

• Task 4: Continued interaction on WRF data assimilation systems

Page 3: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 1: Support and enhancement of the WRF-Var system for CWB operation

Performance Period: a. develop the namelist files and shell scripts for pre-operational configuration

1/1/07 – 06/30/07

b. end-to-end tests on UCAR IBM for short period of time 04/01/07 - 06/30/07

c. post results of WRFVar/WRF tests for short period of time on web page

04/01/07 - 06/30/07

d. timely responses to solve WRFVar related problems 04/01/07 – 12/31/07

Deliverables: 1. namelist files and shell scripts for pre-operational configuration

06/30/07

2. Brief report on experiment results for short period of time in UCAR

12/31/07

Page 4: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 2: Exploration of the WRF-based Ensemble Kalman Filter (EnKF) data assimilation

Performance Period:a) perform WRF-based EnKF assimilation of COSMIC GPSRO data on Typhoon ShanShan

1/1/07 – 12/31/07

b) perform WRFVar assimilation of COSMIC GPSRO data on Typhoon ShanShan

1/1/07 – 12/31/07

c) conduct comparison of WRFVar and EnKF data assimilation

1/1/07 – 12/31/07

d) training of CWB staff on WRF-based EnKF system 1/1/07 – 12/31/07

Deliverables: 1. EnKF code and run shell scripts 12/31/07

2. Report of the comparison study between WRFVar and EnKF

12/31/07

Page 5: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 3: Training on ground-based GPS PW data processing

Performance Period:a) Training of GPS PW retrieval (not to exceed one week) 1/1/07 – 12/31/07

Deliverables:1. UCAR software on GPS PW retrieval 12/31/07

Fig. 1. (a) The distribution of the 57 GPS receiver stations over Taiwan, and (b) the eight GPS stations that are equipped with collocated surface meteorological observations.

Page 6: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 4: Continued interaction on WRF data assimilation systems

Performance Period:1. Updated CWB project web pages on both CWB and UCAR sides

1/1/07 – 12/31/07

2. Site visit to CWB4/1/07 - 12/31/07

Deliverables: 1. Updated web page for project 12/31/07

2. Site visits 12/31/07

http://www.mmm.ucar.edu/people/guo/individual_guo/CWB/CWB_Project_2007.html

NCAR CWB Web Page:

CWB Blog:

http://gfs3cwb.blogspot.com/

Page 7: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 1: Support and enhancement of the WRF-Var

system for CWB operation

Yong-Run Guo

Page 8: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task#1 Support and enhancement of the WRFVar system for CWB operation • Design the operational configuration

To answer the questions from Eric Chiang about WRFVara, wrf_io.F related things for WRFV2.2b, Stage0 in gen_be with WRFV2.2 datac, GPSRO wetPrf decoderd, obs error statistic tuning codee, …..

To update the WRFVar code (bug fix and development)a, introduce the TSK increment by using the lowest level T incrementb, corrected the sfc_assi_option=2 code: the height above the sea level

should be the height above the groundc, Relative humidity check: check_rh = 2d, WRFVar-based VERIFY: use U10, V10, T2, Q2 read from WRF model output

To deliver the namelist files and running shell script on web page on 8 May 2007 and updated on 26 July 2007.

Page 9: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Major problems encountered in operational testing by Dr. Hong (CWB) are:

1) WRFVar2.1/WRFV2.1 cycling runs blew up;2) Warm bias drift in late December 2006.

NCAR recommended:WRF model: a) use WPS and WRFV2.2; b) use 45 vertical levels with Ptop=3000Pa, and re-define levels; c) use Noah LSM to replace the thermal diffusion scheme. WRFVar: a) sfc_assi_options = 2; b) cv_option_hum = 1; c) current use cv_options = 3, but in future use cv_options = 5.

The suggested namelist files and running shell scripts are post on the web:

http://box.mmm.ucar.edu/individual/guo/individual_guo/CWB/CWB_Project_2007.html

Page 10: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

• WRFVar/WRF testing at NCAR

End-to-end 3 domains (45/15/5km) 6-h cycling run with CWB FGGE observation data and GFS intermediate data files from 0000 UTC 1 to 1800 UTC 31 December 2006.

End-to-end testing of the following programs: WPS (metgrid) real.exe FGGE decoder OBSPROC WRFVar Update_BC WRFV2.2Archive (to NCAR MSS)

Loop domains

Loop time

Page 11: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

a) Two Exps completed on PC Linux cluster (leea) with 6 CPUs:ExpA: cv_options = 3ExpB: cv_options = 5 with interpolate_stats=.TRUE. By use 41-

level BES from Eric Chiang (CWB) 200608-10

It takes about 1 day wall-clock time to advance 1 day (four 6-h cycles) initial times, i.e. it took one month to complete one Exp.

b) One Exp (cv_options =3) completed in NCAR IBM (blueice).

NCAR IBM has a queuing system to submit (bsub) the jobs. The maximum time limit for one job is 6 hours. Some of WRFVar/WRF system are single CPU code, some are

MPP code.

The shell script of running on NCAR IBM is more complicated than that on a local machine.

The job dependence “#bsub –w ${previous_job}” must be used.“Implicit” submitting the ${next job} need to be used to avoid a pile

of jobs (for a month,11<jobs/time>x4<times/day>x31<days>=1364 jobs) listed in the job list.

Page 12: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

On NCAR IBM blueice, normally 4 days (16 6-h cycles) took one-day wall-clock time.

According to Jim Bresch CWB HPC has the same queuing system as NCAR machine, this running shell may be implemented in CWB.

Results have the minor differences between PPPC Linux cluster and IBM. For example, for 2006123112Z domain1 (45km) WRFVar:

IBM (blueice):Diagnostics of OI for Sound

var u (m/s) n k v (m/s) n k t (K) n k q (kg/kg) n k

Number: 3323 3367 3784 2937

Minimum(n,k): -14.9377 5 6 -16.4897 3 28 -4.9816 26 16 -0.4762E-02 28 10

Maximum(n,k): 16.2593 16 35 16.4019 25 6 4.9787 24 30 0.8619E-02 29 1

Average : -0.0524 0.1376 -0.1163 0.1405E-03

RMSE : 4.5117 4.4488 1.8880 0.9857E-03

Linux (leea):Diagnostics of OI for Sound

var u (m/s) n k v (m/s) n k t (K) n k q (kg/kg) n k

Number: 3314 3374 3784 2934

Minimum(n,k): -14.9315 43 12 -16.2835 10 28 -4.9952 40 10 -0.4761E-02 26 10

Maximum(n,k): 15.9613 19 35 15.2500 28 8 4.9912 35 4 0.8619E-02 56 1

Average : -0.0272 0.1062 -0.1244 0.1319E-03

RMSE : 4.4627 4.4657 1.8840 0.9726E-03

Page 13: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

• CWB pre-operational testing

Yun-Tien Lin (CWB) arrived at NCAR in early July 2007.

a) The CV5 BES have been derived based on the ExpA (on leea) one month results for 3 domains: 45km, 15km, and 5km with 45-L.

Now check the correctness……

b) WRFVar-based VERIFY: generating the 6 hourly CWB QCed observation data by using NCEP AVN analysis……

c) When the new CV5 BES is ready, will conduct CV5 BES Exp on IBM for DEC2006 data;

d) Conduct the JUL2007 (summer time) Exps.

Page 14: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 2: Exploration of the WRF-based Ensemble Kalman Filter

(EnKF) data assimilation

Hui Liu and Yong-Run Guo

Page 15: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task#2 Exploration of the WRF-based Ensemble Kalman Filter (EnKF) data assimilation

• Conduct WRF-based EnKF assimilation of COSMIC GPSRO data on a typhoon case

- What have been done for WRF/ENKF

1. Impact of COSMIC data on forecast of Shanshan using WRFv2.1/EnKF. Positive impact was found in the presence of satellite winds and radiosondes.

2. Upgraded the system to WRFv2.2/EnKF.

3. Tested assimilation of CWB observations and COSMIC data in WRFv2.2/EnKF with CWB WRF options.

4. Initial results show that COSMIC data has positive impact on forecast of Shanshan in the presence of satellite winds and radiosondes.

Page 16: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

An assimilation experiment of Shanshan with WRF2.1/WRFSI with NCAR options

1 hour assimilation windowAssimilation continuously done for Sep 6-12

Control run: Assimilate radiosonde and satellite windsGPS run: Control run + COSMIC data

Forecast from 12Z Sep 12, 2006.

Page 17: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Best track – blackControl run – blueGPS run – red

Forecast from 12Z Sep 12 (dots for every 12 hour)

Page 18: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

-50

-30

-10

10

30

50

0 12 24 36 48 60 72 84 96 108

Time (hour)

Pressure Error (hPa)

CTL GPS

0

50

100

150

200

0 12 24 36 48 60 72 84 96 108

Time (hour)

Track Error (km)

CTL GPS

Page 19: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

An initial study with CWB configuration

1. Assimilation of CWB radisondes, satellite cloud winds, and COSMIC refractivity for 12 hour from Sep 13 12Z to Sep 14 00Z over CWB domain 1 (45km).

CNTL: radiosonde + satellite winds

GPS : CNTL + COSMIC refractivity

2. 3-day forecast from the analyses at Sep 14 00Z

3. No typhoon bogus

Page 20: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Track forecasts

Black: OBS

Green: NoDA

Blue: CNTL

Red: GPS

Page 21: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Track and intensity errors

Page 22: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

For 2008 of WRF/ENKF

1.Setup WRF/EnKF for CWB domain and tune observation errors, filter localization, ensemble sizes, ensemble inflations etc.

2. Develop QC of CWB observations for use in WRF/EnKF, especially surface observations

3. Performance 2-week assimilation of CWB data in operational setting. Validate the analyses and forecasts against observations. Compare with WRF/3dvar.

4. Evaluate impact of the local and non_local RO refractivity operators in WRF/EnKF on forecasts.

Page 23: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

• Comparison between WRFVar and WRF-based EnKF

Six experiments have been done with WRFVar for Typhoon Shanshan:

1, NODA --- Initiated at 2006091300Z with NCEP AVN analysis;

2, COLDNB --- FG at 2006091400Z is the 24-h forecast from NODA, OBS data are SOUND, SYNOP, SATOB, AIREP, PILOT, METAR, SHIPs, SATEM, QuikScat, and BUOY within 1 h time window from 2330 UTC 13 to 0030 UTC 14 September 2006.

3, COLDALL --- Same as COLDNBNG, but GPSREF and BOGUS (global and TC Bogus) included too.

4, CYCLNBNG --- 25 1-h cycles starting from 2006091300Z with WRFVar/WRF, but no GPSREF and BOGUS data assimilated.

5, CYCLNB --- Same as CYCLNBNG, but GPSREF assimilated.

6, CYCLALL --- Same as CYCLNB, but BOGUS data assimilated too.

All Exps were conducted over a domain of 222x128x45 with grid size of 45-km. The BES is interpolated from Eric Chiang’s (CWB) 41-L CV5 BES based on the 3 months forecast data from June to August 2006.

Page 24: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

1300Z 1400Z

1306Z 1312Z 1318Z

NODA 96h forecast

Cold start 72h forecast

COLDNBNG

COLDALL

Hourly Cycling:

CYCLNBNG

CYCNB

CYCLALL

72h forecast

Schematic diagram of experiments

NCEP AVN Analysis

CWB OBS data

Page 25: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Results

Track forecast Intensity forecast

Page 26: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Track forecast errors averaged over the different periods(km)

Exp 3-24h 27-48h 51-72h 3-72h

NODA 271.7 292.4 257.5 273.9

COLDNBNG 191.5 229.5 265.3 229.0

COLDALL 104.9 149.6 159.0 137.8

CYCLNBNG 144.3 137.6 113.2 131.8

CYCLNB 116.7 134.3 81.4 110.8

CYCLALL 54.7 121.9 200.5 125.7

Page 27: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

summary

• Assimilation of the CWB observation data, no matter Cold-start or cycling mode, improved the Typhoon Shanshan track forecast. However, only when the BOGUS data are assimilated the intensity forecast is improved.

• Assimilation with the cycling mode gave better track forecast than the cold-start runs because more observation information was injested into the initial condition at 2006091400Z.

• GPSREF data assimilation showed the positive impact on the track forecast (compare the CYCLNB with CYCLNBNG).

• BOGUS data assimilation improved both track and intensity forecast (COLDALL, CYCLALL).

Page 28: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task 3: Training on ground-based GPS PW data processing

John Braun

Page 29: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Task #3: Training of GPS PW Retrieval

• Visit to CWB scheduled last week of August (August 25 - September 1)

Goals of Trip:

• Install and test B50 processing scripts on CWB machines

• Teach class on using Bernese software for PW retrieval.

• Reprocess July 2005 data set for training and verification

• Process current data set for

• Give two public seminars

Page 30: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Scientific Seminars

• Tropical Cyclone Intensity and Precipitable Water Vapor Estimates from GPS

• Recent Improvements and Results in Water Vapor Estimates from GPS

Page 31: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Topics in Training Course

• Bernese Software Description Overview

• Bernese Processing Engine

• External data sources, orbits, reference stations, and ancillary information.

• Important components of PWV analysis strategy.

• GPS observation equation

Page 32: Mid-Term review of 2007 CWB project P.I.: Y-H. Kuo 1,2 Y.-R. Guo 1 (WRF-Var lead) H. Liu 3 (WRF-EnKF lead) J. Braun 2 (Ground-based GPS lead) CWB Visitor:

Topics for Discussions

• Date of project final review

• Deliverables check-off

• Contract payments (not yet been paid)

• Tasks to be performed for the remainder of 2007 both at NCAR and CWB