integration readiness review nexrad turbulence detection algorithm (ntda) gary blackburn, steven g....
TRANSCRIPT
Integration Readiness ReviewIntegration Readiness Review
NEXRAD Turbulence Detection Algorithm (NTDA)NEXRAD Turbulence Detection Algorithm (NTDA)
Gary Blackburn, Steven G. Carson, John K. WilliamsGary Blackburn, Steven G. Carson, John K. Williams
NCAR Research Applications LaboratoryNCAR Research Applications Laboratory
January 30, 2007January 30, 2007
Outline
• Action items from last DAR• Intellectual Property Issue/New CPC• Review of data flow and CCR• Review of documentation
– WSR-88D System Specification (SS)– Software Requirement Specification (SRS)– Product Specification– Interface Control Document (ICD) RPG to Class 1 User– Software Description Document
• Review of IRR matrices– Deliverables matrix– Infrastructure Details matrix– Test matrix
• Content of handoff
Action items from last DAR
• The ROC will provide NCAR with SZ-2 data for use in creating NTDA interest maps for VCPs 211, 212 and 221.
• NCAR will provide CodeView plots of the NTDA output at different range resolutions on the FTP site. (Done)
• NCAR will place the detailed size information for the VCP 12 case on the FTP site. (Done)– Note: Resource usage is higher than originally
reported, but still within the SREC targets.
DAR materials and minutes may be found at ftp://ftp.rap.ucar.edu/pub/jkwillia/NTDA/DAR_2/
Product size breakdown• Case: KINX 20060429_025230 (VCP 12, significant weather
coverage) • Resource usage summary:
– Timing: 9.70 sec/volume– Product: 99.86 kB/volume (total of lelb_mon lengths) – Tilt Lengths from lelb_mon:
No. (EDR)+(CONF) .1 2280 + 1820 = 4100 = 4.00 kB 2 2781 + 2199 = 4980 = 4.86 kB 3 3592 + 2624 = 6216 = 6.07 kB 4 6023 + 4275 = 10298 = 10.06 kB 5 7311 + 4587 = 11898 = 11.62 kB 6 7386 + 4684 = 12070 = 11.79 kB 7 6471 + 4270 = 10741 = 10.49 kB 8 5228 + 3689 = 8917 = 8.71 kB 9 4538 + 3221 = 7759 = 7.58 kB 10 3653 + 2727 = 6380 = 6.23 kB 11 3143 + 2470 = 5613 = 5.48 kB 12 2854 + 2223 = 5077 = 4.96 kB 13 2473 + 1934 = 4407 = 4.30 kB 14 2166 + 1638 = 3804 = 3.71 kB
Resolution comparison
0.25 km range resolution 2.0 km range resolution
Intellectual Property Issue
• UCAR’s legal office: NTDA should be licensed for government use under UCAR’s agreement with the FAA.– Who is the ROC point of contact to complete
license agreement?– See accomanying draft agreement
NTDA_FAA_ROC_license_1-29-07.doc
• Inclusion in the proposed separate CPC with MIT/LL software not for public distribution would be ideal.
298 RECCLGIDREFELEVATION_DATA
303 COMBBASE_ELEVELEVATION_DATA
NTDA_ALG
99/01
ELEVATION
162 NTDA_EDR_IPELEVATION_DATA
163 NTDA_CONF_IPELEVATION_DATA
NTDA_FP
99/01
ELEVATION
162 NTDA_EDR_IPELEVATION_DATA
163 NTDA_CONF_IPELEVATION_DATA
{See: P.NN} {See: P.NN}
High-Level NTDA Data Flow in ORPG
Data Flow Diagrams, Figure 1
CCR #NA06-09601, “IMPLEMENTATION OF THE NEXRAD TURBULENCE DETECTION ALGORITHM
(NTDA) IN THE NEXRAD OPEN RPG”
Review of documenation
• See accompanying file ROC_DOCS_NTDA_B10.doc
• See following slides for flow diagrams
NtdaMain.c
NtdaApp.c
NtdaAlgs.c
NtdaApp_Init()
nexrad_sw_to_edr_LmodInf.txt
NtdaParamData.h
NtdaApp_InitParams()
NtdaApp.h
NtdaAppStruct_t
ParamsmParams;
NtdaAlgsStruct_t mNtdaAlgs;
Data pathFunction call
NtdaApp_ReadSwMultTable()
int mSWMultVsDist_Size;float *mSWMultVsDist_Dist, *mSWMultVsDist_Mult;
NtdaAlgs_init()
NtdaApp_Run()
< site adaptation data >
Siteadp_adpt_t mSiteAdaptData;
NTDA_ALG Data Flow : Initialization (once at startup)
Data Description
ORPGlinear buffer
ORPGlinear buffer
NTDA parameterdata in header file
NTDA_ALGmain program
ORPG siteadaptation data
NTDA corealgorithm struct
NTDA_ALG Data Flow : Once Per Elevation - Overview
NtdaApp.h
NtdaAppStruct_t
Compact_basedata_elev*mCombbaseElev;
NtdaElevIntProd_tmIP_EDR;
ReccldigrefInputBuffer_t*mReccldigref;
NtdaElevIntProd_tmIP_CONF;
NtdaApp.c
NtdaApp_Run()
NtdaApp_GetPtr_COMBBASE_ELEV()
NtdaApp_GetPtr_RECCLDIGREF()
COMBBASE_ELEV
RECCLDIGREF
NtdaApp.c (cont’d)
NtdaApp_ProcessElevation()
{see p.NN}
NtdaApp_WriteProducts()
NTDA_CONF_IP
NTDA_EDR_IP
ORPGlinear buffer
ORPGlinear buffer
ORPGlinear buffer
ORPGlinear buffer
likelihoodof clutter
DZ,VE,SW
NTDA EDRintermediate product
NTDA CONFintermediate product
COMBBASE_ELEVDZ, VE, SW
RECCLDIGREFlikelihood of clutter
Data pathFunction call
Data Description
NTDA_ALG Data Flow : Once Per Elevation - Detail
NtdaApp.c
<inline code section 1>
NtdaApp.h
NtdaAppStruct_t
Compact_basedata_elev*mCombbaseElev;
ReccldigrefInputBuffer_t*mReccldigref;
COMBBASE_ELEVDZ, VE, SW
RECCLDIGREFlikelihood of clutter
NtdaApp.h
NtdaAppStruct_t
ae_pack mSunAzElStruct
NtdaElevIntProd_tmIP_EDR;
NtdaElevIntProd_tmIP_CONF;
NTDA EDRintermediate product
NTDA CONFintermediate product
Data needed forsunspike censoring
BaseDataHdrInfo_t mBaseDataHdrInfo;
From COMBBASE_ELEVBase_data_header
NtdaApp_ProcessElevation():
Variousscalar members
of NtdaAppStruct_t
Same header file: NtdaApp_ProcessElevation() reads from and writes to this struct
<inline code section 2>
Siteadp_adpt_t mSiteAdaptData;
ORPG siteadaptation data
NtdaApp_RadarData2Arrays()
NtdaAuxFields_t mAuxFields;
Working copies ofall UHCAR arrays
NtdaApp_NTDA_CalcInit()
NtdaApp_NTDA_CalcEDR()
NtdaIP_EncodeIP()
NtdaApp_WriteProducts()NtdaAuxFields_t mAuxFields;
Working copies ofall UHCAR arrays
ae_pack mSunAzElStruct
Data needed forsunspike censoring
NTDA_CONF_IP
NTDA_EDR_IP
ORPGlinear buffer
ORPGlinear buffer
Review of IRR Matrices
• See accompanying file NTDA_Build10_process_matrix.xls
Handoff Method and Contents
• Delivery via “hidden” NCAR FTP site– readme file– tar file containing C code and header files– stubs for
• product generation tables• product tables• task table
– ORPG manpages– draft documentation– sample output data and select screen shots– recommended CVG color tables for EDR and
confidence
Proposed Package Updates
• Modifications for porting to ORPG Build 9• Interest maps for SZ-2 VCPs• Additional Optimization
– Code changes that yield > 10% speedup but were too risky for this build
– New scaling of EDR that should reduce product size
• Additional testing• Address any issues identified by the ROC
Integration challenges and risks• Need to anticipate Build 10.0 changes that may
impact the NTDA where possible– NTDA interest maps and parameters must be
specified for each new VCP; the default interest map may not produce optimal results
• Any degradation in SW estimate accuracy or sampling volume in future ORDA changes could cause erroneous NTDA output– Recent simulation studies have suggested that the
pulse-pair method used in the ORDA produces significant positive bias for low SWs. If an improved estimator can be implemented, the NTDA’s ability to identify all levels of turbulence will be enhanced.
NCAR contact information• John Williams
• Steve [email protected]
• Gary [email protected]
• Greg [email protected]