test & evaluation/science & technology (t&e/s&t) … & evaluation/science &...
TRANSCRIPT
Test & Evaluation/Science & Technology (T&E/S&T) Program
Ron Barrett Principal Engineer, T&E/S&T Program
Test Resource Management Center (TRMC)
Legend: Army, Navy, AF, Defense Agency
The STEWARD of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB): The “Critical Core”
24 Sites: Army-9; Navy-6; Air Force-7; Defense Agency-2
18,000 sq. mi. of land
180,000 sq. mi. of air space
( > ½ of all DoD land)
30,000 personnel
Military, Gov, Contractor
Replacement Value = $25B
Keyport
China Lake
30th Space Wing
Point Mugu
Air Force Flight Test Center
Yuma
Nevada Test and Training Range
Utah Test and Training Range
West Desert Test Center
White Sands Test Center
High Energy Laser Systems Test Facility
Electronic Proving Ground
PMRF
U.S Army Kwajalein Atoll
DISA,JITC 46th Test Wing (Includes 46th Test Group)
Atlantic Undersea Test
and Evaluation Center
45th Space Wing
Arnold Engineering Development Center
Naval Air Warfare Center-Aircraft Division
Aberdeen Test Center
DISA,NCR
Cold Region
Test Center, AK
Tropic Region Test
Center, HI & Puerto Rico
DoD Directive 3200.11
Established in FY2002
Develops technologies required to test future warfighting capabilities
BA 3 RDT&E funds
~$95M / year
8 Test Technology Areas Electronic Warfare
Cyberspace
High Speed/Hypersonics
Autonomous Systems
Net-Centric Systems
Directed Energy
Advanced Instrumentation
Spectrum Efficiencies
Established in FY2007
Provides infrastructure for distributed Joint and Cyberspace testing
BA 5 RDT&E funds
~$10M / year
68 current sites Expanding to 74 sites
Maintains Network connections
Security agreements
Integration software
Interface definitions
Distributed test tools
Reuse repository
Established in FY1991
Develops or improves test capabilities that have multi-Service utility
BA 4 RDT&E funds
~$150M / year
60 current projects
29 projects developing core Joint capabilities
– 3 projects improving interoperability test cap.
13 projects improving threat representations used in testing
18 projects addressing near-term OT shortfalls
T&E/S&T CTEIP JMETC
TRMC Investment Programs
Overview
T&E Capability Development Cycle
CTEIP and
Services I&M
Operations
and Support
C B A
Use T&E
Capabilities
IOT&E uses
capabilities
Articulate T&E
Requirements
Engineering and
Manufacturing
Development
Materiel
Solution
Analysis
Technology
Development
Production
and
Deployment
Begin
System
T&E
Planning
Cycle for Test Capability Development Must Begin Early
T&E/S&T
Program
Challenge: T&E Capabilities must be available in time to provide
useful insight to decision-makers and warfighters
T&E/S&T Test Technology Areas
•Technologies to Test Emerging Warfighting Capabilities
– Cyberspace Warfare
– Directed Energy Weapons
– Electronic Warfare
– High Speed Systems
– Net-Centric Systems
– Unmanned and Autonomous Systems
•Technologies to Enhance the Test Infrastructure
– Advanced Instrumentation Systems
– Spectrum Efficiency
Established in FY02
Joint DDR&E / DOT&E Initiative
Transitioned to TRMC in FY05
RDT&E Budget Activity 3 funds
Purpose
High Risk / High Payoff R&D for Testing
Foster technology transition to major DoD test ranges
Risk reduction for test capabilities developments
80 Active Projects
Annual Broad Agency Announcements (BAAs) Academia
Industry
Government Laboratories
Tri-Service working groups Validate requirements
Evaluate proposals
Facilitate technology transition
Central Oversight – Distributed Execution
High Speed
Systems
13 Active Projects
Eight Test Technology Areas
Directed Energy
17 Active Projects
Cyberspace
2 Active Projects
Net-Centric Systems
7 Active Projects
Electronic Warfare
16 Active Projects
Unmanned &
Autonomous Systems
3 Active Projects
Advanced
Instrumentation
8 Active Projects
Shaping Technology into Tomorrow’s T&E Capabilities
T&E/S&T Program Overview
FY 2011 FY 2012 FY 2013 FY 2014 FY 2015 FY 2016 FY 2017
$94.6M $96.6M $92.6M $94.0M $95.8M $98.4M $100.2M
Spectrum
Efficiency
14 Active Projects
Mission: Develop Technologies Required to Test Future Warfighting Capabilities
Arizona State University
Brigham Young University
Carnegie Mellon University
Case Western Reserve Univ.
Columbia University
Cornell University
Embry-Riddle Aeronautical Univ.
Fayetteville State University
Florida International University
George Washington University
Georgia Tech Research Institute
Harvey Mudd College
Johns Hopkins University
Lincoln University
Mass. Institute of Technology
Middle Tennessee State Univ.
University of Florida (Gainesville)
University of Hawaii at Manoa
University of Illinois (Urbana-
Champagne)
University of Iowa
University of Kansas
Univ. of Maryland (College Park)
Univ. of Minnesota
University of Missouri
University of Pittsburgh
University of Texas – El Paso
University of Virginia
University of Washington
Utah State University
Vanderbilt University
Virginia Tech
Morgan State University
Naval Post Graduate School
New Mexico State University
North Carolina A&T Univ.
North Carolina State Univ.
Ohio State University
Oklahoma State University
Purdue University
University of Alabama, Huntsville
University of Arizona
University of California Irvine
Univ. of California Los Angeles
Univ. of California San Diego
University of Central Florida
University of Delaware
Universities Supporting
Test Technology Development
Since FY03, University Efforts Total > $65M
7
Technology Readiness Levels
TRL 9 Actual system 'flight proven' through successful mission
operations
TRL 8 Actual system completed and 'flight qualified' through test
and demonstration
TRL 7 System prototype demonstration in an operational
environment
TRL 6 System/subsystem model or prototype demonstration in a relevant environment
TRL 5 Component and/or breadboard validation in relevant environment
TRL 4 Component and/or breadboard validation in laboratory environment
TRL 3 Analytical and experimental critical function and/or characteristic proof of concept
TRL 2 Technology concept and/or application formulated
TRL 1 Basic principles observed and reported
T&
E/S
&T
Pro
gra
m
CT
EIP
TRL 3: Analytical and Experimental Critical Function and/or Characteristic Proof of Concept
• Active R&D initiated
• Includes analytical and
laboratory studies
• Validation of analytical
predictions of separate
elements of the technology
• Example: Components that
are not yet integrated or
representative
Analytical Studies of
Spectrum Environment
Telemetry Network
Modeling
Evaluation of
Components
Example: Linear Power Amplifier for Telemetry
TRL 4: Component and/or Breadboard Validation in Laboratory Environment
• Integration of basic
technology components to
establish that they will
work together
• Relatively “low fidelity”
representation of eventual
technology
• Example: Integration of ad
hoc hardware; testing of
laboratory breadboard—
estimate of how
breadboard test results
differ from the expected
system goals
Example: Linear Power Amplifier for Telemetry
TRL 5: Component and/or Breadboard Validation in Relevant Environment
• Fidelity of breadboard
technology increases
significantly
• Basic technology
components are integrated
with reasonably realistic
supporting elements so they
can be tested in a simulated
environment
• Example: Integration of
components for testing at Air
Force Flight Test Center,
Edwards AFB; Naval Air
Station, Patuxent River or
White Sands Missile Range
Example: Linear Power Amplifier for Telemetry
TRL 6: System/Subsystem Model or Prototype Demonstration in a Relevant Environment
• Prototype tested in a relevant
environment
• Represents a major step up in
the technology’s demonstrated
readiness
• Near the desired configuration
in terms of performance,
weight, and volume
• Example: Testing a prototype at
Air Force Flight Test Center,
Edwards AFB; Naval Air Station,
Patuxent River or White Sands
Missile Range
Example: Linear Power Amplifier for Telemetry
T&E/S&T Project Progression
• Project Initiation (Decision Point) – Multi Track Awards – competing approaches for the same test
technology
– Advance technology from TRL 3 to 4
– Materials/Component Investigation (e.g., M&S analysis)
– Cost driver – Labor
• Technology Milestone (Decision Point) – Advance technology from TRL 4 to 5
– Fabricated investigative part/sub-assembly build-up
– Demonstrate in laboratory/simulation
– Cost driver – Transitioning from labor to material and testing
• Technology Milestone (Decision Point) – Advance Technology from TRL 5 to 6
– System Integration
– Demonstrate in representative environment
– Cost driver – brassboard to prototype development
T&E/S&T Program Broad Agency Announcements
• Topics for Industry, Academia, and Government Laboratories to propose test technology solutions
• In-cycle Process – Declared schedule for white paper submissions (deadline)
– Requires an allocation of available funding
– Priority over out-cycle white papers (must be processed first)
• Out-of-cycle Process – White papers submitted anytime after "in-cycle" deadline
– Offerors "highly encouraged" to contact Executing Agent before submitting white paper Ensures interest
Can address whether a 'chance' exists for funding
• All BAAs include an “Other Test Technologies” topic to enable offerors to propose test technology developments that were not previously identified by the Government
All T&E/S&T BAAs are always open for new white papers
Executing Agent Action Program Manager Action Offeror Action Contracting Officer Action
BAA Pre-FY Cycle
Draft BAA Topic Areas
Industry/Academia Days
BAA Topics Finalized
BAA Topics Announced
White Paper Submissions
Proposals Requested from
Selected Offerors
Proposal Submissions
Proposal Review &
Clarifications
Executing Agents
Recommendations to PM
Contract Awards Initiated
White Paper Reviews
Activity T&E/S&T New Project Selection Schedule
OCT NOV DEC JAN FEB MAR APR MAY JUN JUL AUG SEP
PM New Start Decisions
T&E/S&T New Project
Selection Schedule
Refine BAA Topics
18-20 October in Atlanta
Call for White Papers
White Papers were due 20 March
T&E/S&T Program
Test Technology Needs Structure • T&E/S&T Program
– Program Manager & Deputy Program Manager
• Test Technology Area (TTA) – Executing Agent in field organization within a Service
– Each TTA has a separate BAA announcement at http://www.fbo.gov
– There are currently 8 TTAs in the T&E/S&T Program
• Domains – Sub-division of TTA for categorization
– TTAs are currently divided into 2 to 6 domains each
– There are currently 27 domains across the T&E/S&T Program
• Topics – Test Technology Need for an offeror to propose a development
– There are currently 99 test technology topics across the 8 BAAs
• Enabling Technologies – Some test technology topics could be addressed by a multitude of different
technologies that could enable an aspect of the overall solution
– In some domains, we also identify enabling technologies to clarify different technology approaches to a test technology need
Location of T&E/S&T BAAs
www.fbo.gov
Keyword: TRMC
Note: Posted in January so may need to change search
for “Posted Date” to beyond “Last 90 Days”
T&E/S&T Test Technology Area Executing Agent Organizations
Spectrum Efficiency Edwards AFB
High Speed Systems Test Arnold Engineering
Development Center
Electronic Warfare Test PEO for Simulation, Training
and Instrumentation
Program Office TRMC HQ
Cyberspace Test TRMC HQ (Interim)
Advanced Instrumentation Systems Naval Undersea Warfare Center
Net-Centric
Systems Test Naval Air Systems
Command
TRMC HQ
Air Force
Army
Navy
Central Oversight – Distributed Execution
Unmanned & Autonomous Systems Test
Naval Air Systems
Command
Directed Energy Test PEO for Simulation, Training
and Instrumentation
Cyberspace Test Eglin AFB (Future)
Cyberspace Test T&E/S&T Test Technology Area
• Current Portfolio: 2 Projects
• FY12 Budget: $2.6M
• 3 Domains with 8 Current Topics
Cyberspace Test Planning: 3 Topics
Cyberspace Threats: 2 Topics
Cyberspace Test Execution/Analysis: 3 Topics
• Significant Technology Needs
Cyberspace test visualization
Defining cyberspace test measurements
Improved, scalable cyberspace threat
representations
Advanced cyberspace instrumentation
Improved cyberspace analysis
Interim Executing Agent
Arjuna “AJ” Pathmanathan
Test Resource Management
Center
571-372-2702 [email protected]
Improving Cyberspace Testing
Application Layer Attack: Virus Epidemics,…
Defense: Secure web, Access control, …
Transport Layer Attack: Flood Attacks, Denial of service
Defense: Cryptographic Protocol Security
Network Layer Attack: Wormhole, Rushing attackers…
Defense: Internet Protocol Security
Link Layer Attack: Tracking, Link disruption
Defense: Link encryption
Physical Layer Attack: Jamming, battery exhaustion,…
Defense: Spread spectrum…
Cyber Threat
Threat Test Team
Operational Tester
System Under Test (SUT)
StealthNet – Developing tools for T&E of mission assurance under
full-spectrum cyberspace operations
Realistic Cyberspace threat stimulation of single systems or networks of many systems,
scalable by incorporating simulated representations of unavailable components
Directed Energy Test T&E/S&T Test Technology Area
• Current Portfolio: 17 Projects
• FY12 Budget: $13.8M
• 3 Domains with 10 Current Topics
High Power Microwave: 6 Topics
High Energy Laser: 3 Topics
Special Interest Area: 1 Topic
• Significant Technology Needs
Neutron Environment Simulator to replicate
required nuclear effects test environments
In Chamber HPM Source
HPM Electronic Failure Analysis
Characterizing beam propagation through
atmosphere & maximizing laser test windows
Executing Agent
Minh Vuong
U.S. Army PEO-STRI
407-384-5238
Providing High Power Microwave (HPM) Sensors for
CHAMP Joint Capability Technology Demonstration
Developed prototype 12-node system to collect data during CHAMP flight test
Field Strength Sensor Network (FSSN) -
Developed prototype wireless mesh
network of sensor nodes for capturing and
reporting the pulsed amplitude of radiated
HPM fields in a geographically dispersed
test configuration.
.
Ideally suited for new HPM
systems coming to the range
that may illuminate large areas
where standard diagnostics
approaches are ill suited.
Counter Electronics HPM
Advanced Munitions Project (CHAMP)
22
Electronic Warfare Test T&E/S&T Test Technology Area
• Current Portfolio: 16 Projects
• FY12 Budget: $19.9M
• 2 Domains with 15 Current Topics
Electro Optics: 8 Topics
Radio Frequency: 7 Topics
• Significant Technology Needs
Full-Range Surrogate Missile Technology
High-Speed EO/IR Scene Generation
Missile Body & Plume Attitude Measurement
Real-time, High-Fidelity, High-Density
RF Signal Generation
Multi-Beam Characterization
Radar Clutter Simulation
Executing Agent
Minh Vuong
U.S. Army PEO-STRI
407-384-5238
High Speed Systems Test T&E/S&T Test Technology Area
• Current Portfolio: 13 Projects
• FY12 Budget: $19.3M
• 5 Domains with 16 Current Topics
Advanced Propulsion: 6 Topics
Aerodynamics & Aerothermal: 2 Topics
Flight Test and Evaluation: 3 Topics
Computational Tools for Flow Fields: 1 Topic
Instrumentation for Flow Fields: 4 Topics
• Significant Technology Needs
Propulsion Scaling Test Techniques
Combined Cycle Propulsion Test Methods
Hypersonic Flight Erosion Test Methods
Thermal Protection System Ablation Testing
Executing Agent
Ed Tucker
Arnold Engineering
Development Center
931-454-7469
Hypersonic Aero-propulsion
Clean Air Test Bed (HAPCAT)
Air Storage
(Banks A/B)
PBAH Pressure Control
PBAH Isolation /
Flow Control
Valve
Test
Cabin
(Existing)
Diffuser
(Existing)
PBAH –
Pebble Bed
Air Heater
(Existing)
RSH – YsZ Regenerative
Storage Heater
Start
Valve
VMN – Variable Mach NozzleADS Mixer
ADS
Stilling
Chamber
RSH Flow Control
Air Storage
(Bank C)
Ejector Motive
Air Control
Bay VI
Vacuum
Valve
(Existing)
Ejector
Exh
au
st
Sile
nce
r
Exhaust
Manifold
(Existing)
Vacuum Sphere
(Existing)
Ejector
Isolation
Cold Air Injection
Ring
ADS Liner Cooling
Pressure Control
Cold Air
Flow Control Liner Cooling
Reinjection Flow
Exhaust
Liner Cooling
Exhaust Flow
ADS Liner Cooling
Flow Control
First-of-a-kind clean air, variable Mach test
capability
• Advanced storage heater with near-Mach 8
temperatures (4800 °R) and pressures
• Wide range of temperatures and pressures
from fixed-temperature sources
• Variable Mach nozzle (4.5 – 7.5)
• Integrated into ATK-GASL Test Bay VI
Net-Centric Systems Test T&E/S&T Test Technology Area
• Current Portfolio: 7 Projects
• FY12 Budget: $17.4M
• 3 Domains with 11 Current Topics
System of System Testing: 3 Topics
Improved Test Automation: 3 Topics
Modeling & Simulation for Test: 5 Topics
• Significant Technology Needs
Flexible Test Harness Generator
Automated, Rapid, Agile Test Planning
Removing biases in Distributed Testing
Rapid Analysis of Voluminous Unstructured
Data (“Test Data to Decision”)
Determining Required M&S Fidelity in Tests
Executing Agent
Gil Torres
NAVAIR (Pt. Mugu)
805-989-9521
Unmanned & Autonomous Systems Test T&E/S&T Test Technology Area
• Current Portfolio: 3 Projects
• FY12 Budget: $3.3M
• 2 Domains with 7 Current Topics
Autonomous System Test Planning: 3 Topics
Autonomous System Performance
Assessment: 4 Topics
• Significant Technology Needs
Predicting Autonomous Behavior for Testing
Enhancing Safety of Autonomous Testing
Testing of Autonomy Functional
Components
Measure Autonomous System Reliability and
Performance
Executing Agent
Bill Hamel
NAVAIR (Pax River)
301-342-6373
Advanced Instrumentation Systems T&E/S&T Test Technology Area
• Current Portfolio: 8 Projects
• FY12 Budget: $10.6M
• 6 Domains with 24 Current Topics
Time Space Position Info: 7 Topics
Advanced Sensors: 9 Topics
Advanced Energy & Power: 4 Topics
Non-Intrusive Instrumentation: 2 Topics
Range Environment Encroachment: 1 Topic
Human Systems: 1 Topic
• Significant Technology Needs
TSPI without GPS (or with limited GPS)
Measuring body armor / helmet effectiveness
Measuring cognitive workload
Executing Agent
Dr. George Shoemaker
NUWC-Newport
401-832-5304 [email protected]
UHDGPS Breadboard
(203 X 305 mm)
Achievements
• GPS signals continually buffered and processed
• Unprecedented number of simultaneous search windows: 3
million windows performing 350 million searches/second
• Time-to-first-fix less than half a second
• First GPS receiver acquiring and tracking L2C to provide
ultra high dynamics capability up to 1,000g and 9km/s
• First GPS receiver acquiring and tracking L5
Improving Time-Space-Position (TSPI)
System Dynamics, Accuracy and Anti-Jam Capability
Current TSPI systems use only L1 frequency GPS receivers with limited dynamics
and accuracy. Ultra-High Dynamics GPS (UHDGPS) is developing a three-frequency
hybrid (L1, L2, L5) GPS receiver to support ultra-high dynamics, high-accuracy
GPS, and operation under GPS jamming.
Existing
Q20 HD GPS
Receiver Module
shown for
comparison
(22 X 26 mm)
Will provide ability to accurately track high-dynamic
Systems-Under-Test and incorporate GPS jamming into test scenarios
Path Forward
• Trade study to address application-specific
integrated circuit (ASIC) architecture designs
• Architecture of the existing receiver is being
reconfigured to increase the maximum
velocity capability to address extended range
hypersonic requirements
F-22 Launching AIM-120 AMRAAM HMMWV Launched AIM-120
29
Spectrum Efficient Technology T&E/S&T Test Technology Area
• Current Portfolio: 14 Projects
• FY12 Budget: $9.6M
• 3 Domains with 8 Current Topics
Wireless Technologies: 5 Topics
Telemetry Networking: 2 Topics
Spectrum Management: 1 Topics
• Significant Technology Needs
Multiple Access Schemes for Serial
Streaming Telemetry
Modulation Agile Radio for Test Applications
Channel Estimation and Equalization
Steerable Multiband Antenna (L-band,
S-band, & C-band) for Airborne Test Articles
Executing Agent
Tom Young
Air Force Flight Test Center
(661) 277-1611
Developed new test technology to improve test data quality by reducing data errors;
investigating telemetry performance in C-Band spectrum to support test operations
M4A antenna
mounting on test
platform
Telemetry ground
antenna at
Edwards AFB
Multipath Modeling and Mitigation Using
Multiple Antennas (M4A) - Developing
technology to determine radio frequency
channel models for fixed-wing aircraft and
helicopters. The models will be used to
investigate ways to mitigate telemetry
multipath effects.
Improving Telemetry Data Quality and
Expanding Testing in C-band Spectrum
31
• Meets a T&E Need
• Requires S&T work
• High Payoff
• Broad application (more than one DoD test activity)
• High potential for transition to development of
a test capability
The Proposal — Key Criteria
33
T&E/S&T Program Summary
• T&E/S&T Program initiated to address critical T&E needs tied to S&T drivers
– Advancing the state of the art in T&E technologies
• The only DoD S&T program dedicated to T&E
• Annual Call to Industry, Academia, and Government
Laboratories to address test capability needs
• Competitive technology developments to get the best
technologies possible to the test community
• Focused on transition into needed test capabilities
Looking Ahead, Responsive, Agile