1

E-2D Advanced HawkeyeLessons Learned from Integrated Test (IT)

Rick QuadeNavy T&E

10 March 2010

2

Agenda

• Program Overview

• IT Challenges

• Implementation of IT

• IT Self Assessment

• Keys to Success

3

E-2D Advanced Hawkeye Program

ACAT: IDM/S: MS B June 03, MS C May 09, IOT&E FY12, IOC FY15

Contractors: Northrop-Grumman as Total Weapon System PrimeLockheed-Martin as Radar Principal Subcontractor

Flight Test Program Phases• SDD – 2 SDD Aircraft, ~2000 Flt Hrs

• Apr 2007 • Pilot Production Verification – 3 Aircraft, ~800 Flt Hrs

• June 2010 • IOT&E – 4 Aircraft, ~1000 Flt Hrs

• FY12

E-2D Integrated Test Team (ITT)• 100+ engineers and project officers

4

E-2D Test Organization

Test Director

CFTD/GFTD

LTE

Air Vehicle

Test Engineering*

Aircrew (Pilots)

Aircraft Coordinators

Mission System

Test Engineering*

Data Reduction/ Management

Logistics/ Supply

Test Facilities

Aircrew (WSOs & NFOs)

Reliability & Maintainability

Engineering

Instrumentation Engineers &

Techs

FCRA Safety Officer

AHE T&E IPT PMA-231, NGC

Operational Test Coordinator

COTF

Operational Test Director

VX-1

Use of Test Site Specific Facilities or Services

LEGEND

* Including Aircrew Performing Test Planning and Data Reduction and Analysis Functions

ISEET/VX-20

A/C Maintenance & Quality Control

SAMC, VX-20

Safety Dept. DCMA, VX-20

Flight Operations SAMC,VX20

Integrated Test Team (ITT)

5

Test Environmental Factors

• E-2D complex weapon system with extensive amount of flight testing

– Mission Systems - ~225 successful flights (SDD)

– Air Vehicle - ~125 successful flights (SDD)

– 25+ Test Plans (SDD)

• Many moving parts (Staff, HW/SW, DRs, Management)

• Large and diverse test team comprised of NAVAIR (5.1.1, 5.1.2, 5.1.6, VX-20, 5.2, 5.4, CSS), Northrop Grumman, Lockheed Martin, VX-1, COTF and others

• Typical program and flight test challenges

6

E-2D IT Challenges

• DT, OT and Program Organizational Barriers• “I’ve got a secret”• Expectations Management• Staffing/Turnover• Spec Compliance vs Suitability • Legacy vs Program of Record• Weapon System Maturity • Leveraging/Integrating DT/OT efforts

IT touches all aspects of program execution.

7

E-2D IT Implementation

• PMA embraced T&E role in program execution– Multiple 5.0 T&E Deep Dives of test program– Conducted an Independent T&E Review to identify test risks– Program unilaterally added an Operational Assessment (OA)

• Focused on improving internal/external communications– Monthly meetings with VX-1 (OTA)– Weekly reports and metrics to stakeholders & leadership

• Embraced early and robust OT participation – OA Report mitigation plans pre-coordinated– OT concerns included in update to CDD– OT part of program management team

• E-2D ITT CONOPS implemented to document roles, responsibilities and procedures– Signed by NGC, PMA, DT (VX-20), OT(VX-1) and DCMA

8

E-2D IT Implementation (Continued)

• Early and continuous participation by all stakeholders (DT, Cont and OT) on test DT planning and execution– Test planning working groups– Discrepancy reporting/NTAB Yellow Sheet Reviews– Technical Reviews

• Integrated Test Planning & Execution– DT/OT Test Point Matrix for Pilot Production/IOT&E testing– OT Test Planning – coordinate with program, risk reduction– Integrated flight schedule w/OT crews

• Efficient use T&E Infrastructure/Capability– Telemetry Trailer, targets, labs – Data/data analysis personnel used by DT and OT

• Northrop-Grumman Support– Embraced early OT involvement and feedback– Willing to discuss and mitigate relevant OT issues

9

E-2D IT – Self Assessment

• Contractor data augmenting IOT&E data– OA Report leveraged significant amount of data collected

during DT

• DT and OT personnel recognize each other in airport• OT personnel influence DT scenarios

– OT part of planning process, common goal of leveraging “DT” flights to meet OT objectives

• DT system operated by OT users– Monthly flt hr goals for OT team, DR verification

• DT and OT sharing data in common format• OT confirms DT results

– OA Report did not identify any new issues

10

E-2D Awards and Recognitions• CY2007

– NAWCAD Commander's Award for 2007 – VX-20 Test Team Award 2007

• CY2008– NAWCAD Commander's Award for 2008 for Individual Effort for Mr. Pat

Svatek– Society of Flight Test Engineers' International Flight Test Team of the Year

2008 (James S McDonnell Award)– Daedalian Weapons Systems Award: Colonel Franklin C. Wolfe Memorial

Trophy– VX-20 Test Team Award 2008

• CY2009– NAWCAD Commander's Award 2009 – Society of Flight Test Engineers’ 40th International Symposium Best of

Symposium Award for E-2D ACAWS Team– European Flight Test Safety Award for 2009– E-2/C-2 Shore Pilot of the Year – LT Greg Machi– E-2/C-2 Shore NFO of the Year – LCDR Matthew Tharp

11

E-2D IT Keys to Success

• Set Expectations– Known roles & responsibilities, big picture awareness

• Open Communication– Create forums for discussion, education and decision making– No secrets or surprises, transparency expedites issues resolution

• Common Goals & Objectives– Deliver weapon system to war fighter with known performance

• Robust Conflict Resolution Process– No one has to agree, resolve conflicts at lowest level possible

• Demand Constructive-Tension/ Positive-Friction– Disagreements are expected, know when to move on

• Embrace value of robust T&E program– Program leadership values T&E and solicits input– T&E’s job is to inform the PM and decision makers