![Page 1: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/1.jpg)
Test & Evaluation Office 1
Testing in a Joint Environment Value Added and Considerations
Janet GarberDirector
Test and Evaluation OfficeOffice of the
Deputy Under Secretary of the Army
June 2008
UNCLASSIFIED
![Page 2: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/2.jpg)
Why do we test?
Unclassified
Unclassified
![Page 3: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/3.jpg)
33
Support the Warfighter to accomplish mission!Support the Warfighter to accomplish mission!Unclassified
Unclassified
![Page 4: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/4.jpg)
Test & Evaluation Office4
Unclassified
Unclassified
Agenda
• Why do we test?
• Introduce Test & Evaluation Office (TEO), Deputy Under Secretary of the Army (DUSA)
• Provide insight on Chemical and Biological Defense Program (CBDP) testing challenges
![Page 5: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/5.jpg)
Test & Evaluation Office5
Unclassified
Unclassified
Determine/verify performance envelope (capabilities & limitations)Evaluate Systems’ Effectiveness, Suitability, & Survivability
Assess mission accomplishment
Identify and Assess Acquisition & Operational RisksCertify attainment of:
Technical Performance SpecificationsOperational RequirementsSafety
Verify Correction of DeficienciesAddress Compatibility/Interoperability/Net ReadinessAssist in Determining DOTMLPF Requirements
Why Do We Test ?
DOTMLPF - Doctrine, Organization, Training, Materiel, Leadership & education, Personnel, & Facilities
Support the Warfighter!Support the Warfighter!
![Page 6: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/6.jpg)
Test & Evaluation Office6
Unclassified
Unclassified
T&E Critical to the Warfighter
Biological Warfare Agent (BWA) and Chemical Warfare Agent (CWA) performance data provides:
Performance envelope
System limitations
Insight on how to employ system in the field
Does the System support mission success?
![Page 7: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/7.jpg)
Test & Evaluation Office7
Unclassified
Unclassified
What is Data?a. A fact or body of factsb. Information that could save your lifec. An android from a TV seriesd. All the above
Answer: d
Pop Quiz
![Page 8: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/8.jpg)
Test & Evaluation Office8
Unclassified
Unclassified
Importance of Testing
• Collecting Data: measure test environment and system under test
• To answer questions: – Is the system safe for use?– Does system meet performance specifications?
• Where it works• Where it doesn’t work
• Reliability and Logistic Supportability• Human Factors, MANPRINT• Others
![Page 9: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/9.jpg)
Test & Evaluation Office9
Unclassified
Unclassified
Importance of Testing (cont.)
Provides Data Needed for Evaluation
Evaluation:• Integration of data and analysis from many sources • To answer questions:
– Was mission accomplished?– Was the system effective, suitable, survivable?– How well were requirements met?
![Page 10: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/10.jpg)
Test & Evaluation Office10
Unclassified
Unclassified
Types of Tests: Chemical and Biological Defense
• Developmental/Operational Testing: – Data are critical for operational evaluation– Surety chamber tests with
• BWA and CWA• BWA and CWA simulants
– Field tests with BWA/CWA simulants• Operational Testing
– Military test participants performing unit missions/tasks– Operationally realistic environment
Threat and Environmental Realism Is Key To All Testing
![Page 11: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/11.jpg)
Test & Evaluation Office11
Unclassified
Unclassified
T&E Executive VisionT&E Executive Vision
Ensure world class combat and support systems for our nation's Warfighters by providing programs with sound analyses, adequate testing, and credible evaluation procedures supported by robust, efficient and versatile T&E resources, and infrastructure
![Page 12: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/12.jpg)
Test & Evaluation Office12
Unclassified
Unclassified
• Ensure Adequate and Credible Testing
• Establish T&E Policy for CBDP
• Plan T&E Infrastructure Investment
• Advocate for T&E Funding
• Promote early T&E community involvement in planning
Mission of the CBDP T&E Executive
![Page 13: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/13.jpg)
Test & Evaluation Office13
Unclassified
Unclassified
TEO Structure for CBDP
Assistant Secretary for Acquisition, Logistics and Technology
Secretary ofDefense
Director, Operational
Test & Evaluation
Under Secretary of Defense (Acquisition,
Technology, & Logistics), Director,
Defense Systems/DDDevelopmental T&E
Secretary of the Army
Chief of Staff
Vice Chief of Staff
Director of the Army StaffDUSA
Coordination
CBDP T&E Executive
TEO
USA
Asst to The SEC DEF (NCB)
Special Asst For CBD&CDP
CBDP only
Navy Operational Test and
Evaluation Force
Air Force Operational Test and Evaluation
Center
Marine Corps Operational Test and Evaluation
Agency
Army Test and Evaluation Command
Special Operations Command
![Page 14: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/14.jpg)
Test & Evaluation Office14
Unclassified
Unclassified
Assessment and Projection of T&E Infrastructure Capabilities
(Incremental Improvements)
UnitMission Testing
System TestingAgent Simulant
Subsystem Testing
Materials/Component Testing
PerformanceModeling
Operationally RelevantModeling
UnitMission Testing
System TestingAgent Simulant
Subsystem Testing
Materials/Component Testing
PerformanceModeling
Operationally RelevantModeling Unit
Mission Testing
System TestingAgent Simulant
Subsystem Testing
Materials/Component Testing
PerformanceModeling
Operationally RelevantModeling
Note: After FY 12, most infrastructure should be in place.
Ongoing improvements will be primarily to address new technologies, new threats and emerging capability gaps
Continuous
Assessment
FY 06 FY 08 FY 10
FY 12 FY 15
![Page 15: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/15.jpg)
Test & Evaluation Office15
Unclassified
Unclassified
Joint, Multi-national, and Interagency CBDP T&E Partners
Joint, Multi-national, and Interagency CBDP T&E Partners
United Kingdom• Porton DownCanada• DRESAustralia
New Mexico• AFOTEC Det 1
Utah• Dugway Proving Ground• University of Utah
Florida• PEO STRI•NAVSEA NCSC•Eglin AFB•AFRL
Maryland• ECBC• AEC• DTC• NAVAIR• JHU-APL
Massachusetts• Natick Soldier Ctr
Texas• OTC Virginia/DC
• ATEC•EPA•DHS•OPTEVFOR•DOT&E•MCOTEA•NAVSEA Dahlgren
Alabama• Army Safety Ctr
North Carolina• Research Triangle Institute
Investment Sites19
Unclassified
Unclassified
![Page 16: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/16.jpg)
Test & Evaluation Office16
Unclassified
Unclassified
Key Dugway T&E Facilities
Life Sciences Test Facility
Materiel Test Facility
Combined Chemical Test Facility
Test Grid Defensive Test Chamber
West Desert Test Center
![Page 17: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/17.jpg)
Test & Evaluation Office17
Unclassified
Unclassified
CBDP T&E Infrastructure
• Hardware– Chambers, instrumentation, equipment, fixtures
• Software– Documentation, methodology, source data, M&S– Written procedures, validation trial data
• Personnel resources– intellectual capital
![Page 18: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/18.jpg)
Test & Evaluation Office18
Unclassified
Unclassified
Multi-Service Testing Considerations
• Common set of standards and processes– Each Service has its own policy and procedures– MOA for MOT&E– CBDP T&E Policy
• Evaluation Reports– Combined with inputs from all Services, Lead OTA coordinates– Dissenting evaluations must be included
• Test Design– Must accommodate missions of each Service– Lead OTA coordinates
• Staffing TEMPs and Test Plans– Concurrence from each participating OTA
![Page 19: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/19.jpg)
Test & Evaluation Office19
Unclassified
Unclassified
Ensuring Test Adequacy
• Provide test environment with realistic threat portrayal– Get the assets for a realistic force laydown
• Chamber DT/OT critical to Operational Evaluation– Key performance aspects identified using BWA/CWA in chamber– Field performance verified using simulants– Accurate correlation between simulant and agent critical to credible
evaluation
• Environmental Diversity– Simulant dissemination is strictly controlled by EPA restricting test
locations– M&S is critical to expanding test envelope
Operational Testing Under Battlefield Type Conditions Using Warfighters Critical to Evaluation
![Page 20: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/20.jpg)
Test & Evaluation Office20
Unclassified
Unclassified
My Focus as the CBDP T&E Executive
• Ensure Developmental and Operational testing is robust– Systems under test satisfy requirements– System supports mission success– Provide Decision Makers with the information they need to
make Milestone and Fielding Decisions
• Ensure Warfighter gets right information to accomplish mission
– Evaluation report should clearly state limitations and impact to employment in the field
Value of testing to Warfighter = Demonstrated Mission Success in Operationally Realistic Setting
Support Program Development and Fielding
![Page 21: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/21.jpg)
Test & Evaluation Office21
Unclassified
Unclassified
Backup
![Page 22: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/22.jpg)
Test & Evaluation Office22
Unclassified
Unclassified
Active Standoff Chamber (ASC) and Joint Ambient Breeze Tunnel (JABT)
Unclassified
![Page 23: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/23.jpg)
Test & Evaluation Office23
Unclassified
Unclassified
JABT Exterior
Unclassified
![Page 24: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/24.jpg)
Test & Evaluation Office24
Unclassified
Unclassified
JABT Interior
Unclassified
![Page 25: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/25.jpg)
Test & Evaluation Office25
Unclassified
Unclassified
ASC Exterior
Unclassified
![Page 26: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/26.jpg)
Test & Evaluation Office26
Unclassified
Unclassified
ASC Interior26
Unclassified
Unclassified
![Page 27: Testing in a Joint Environment...An android from a TV series d. All the above Answer: d Pop Quiz Test & Evaluation Office 8 Unclassified Unclassified Importance of Testing • Collecting](https://reader034.vdocuments.site/reader034/viewer/2022042105/5e8407cecc3aac010d471653/html5/thumbnails/27.jpg)
27
Unclassified
Unclassified
JBAIDS Test Support Trailers BSL3 Lab JBAIDS BLS2 Lab
Offices for 45 personnel Field Support Trailer
LSTF
Office complex
BSL3 Lab
Work load is expanding faster than facilities