no doubt – the lras3/fs3 story of mission assurance · no doubt – the lras3/fs3 story of...
TRANSCRIPT
No Doubt – The LRAS3/FS3 Story of Mission Assurance
Jill BrooksSheleen JohnsonNetwork Centric Systems
11/15/2006 Page 2
Agenda• Introduction to Raytheon• LRAS3/FS3 Overview• Sound Engineering Processes• Partnership With The Customer• Results Speak For Themselves• Summary
11/15/2006 Page 3
Introduction to Raytheon• Raytheon is an industry leader in defense and government electronics,
space, information technology, technical services, and business aviation and special mission aircraft
• Network Centric Systems (NCS) develops and produces mission solutions for networking, command and control, battlespace awareness, and air traffic management
11/15/2006 Page 4
Introduction to Raytheon – continued
IPI CMM-based Internal Process Improvement AssessmentRTIS Raytheon/TI SystemsCMMI CMM Integrated
10x Fault DensityImprovementLevel 3
Level 2
BaldridgeAward
Level 3BaselineValidation
Level 2Repeatable
Level 3Defined
198919911990
1992 1993 1994
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 2003
Level 410x Fault DensityImprovement
10x Fault DensityImprovementLevel 3Level 3
Level 2Level 2
BaldridgeAward
BaldridgeAward
Level 3BaselineValidation
Level 3BaselineValidation
Level 2Repeatable
Level 3Defined
198919911990
1992 1993 1994
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 2003
Level 2Repeatable
Level 3Defined
198919911990
1992 1993 1994
Level 2Repeatable
Level 2Repeatable
Level 3DefinedLevel 3Defined
198919911990
1992 1993 1994
198919891991199119901990
19921992 19931993 19941994
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 2003
Level 4/5Managed/Optimizing
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 200320002000
19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003
Level 4Level 410x Fault DensityImprovement
10x Fault DensityImprovementLevel 3Level 3
Level 2Level 2
BaldridgeAward
BaldridgeAward
Level 3BaselineValidation
Level 3BaselineValidation
Level 2Repeatable
Level 3Defined
198919911990
1992 1993 1994
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 2003
Level 2Repeatable
Level 3Defined
198919911990
1992 1993 1994
Level 2Repeatable
Level 2Repeatable
Level 3DefinedLevel 3Defined
198919911990
1992 1993 1994
198919891991199119901990
19921992 19931993 19941994
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 2003
Level 4/5Managed/Optimizing
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 200320002000
19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003
Level 4Level 4
RTIS Integrated Product
Development Process
Software Sigma& Cycle Time
RTIS Policies & Procedures
RTIS Software Operating Instructions
10x Fault DensityImprovement
10x Fault DensityImprovementLevel 3Level 3
Level 2Level 2
BaldridgeAward
BaldridgeAward
Self-assessmentSoftware ImprovementTeam Formed
Level 3BaselineValidation
Level 3BaselineValidation
Level 2Repeatable
Level 3Defined
198919911990
1992 1993 1994
Level 2Repeatable
Level 2Repeatable
Level 3DefinedLevel 3Defined
198919911990
1992 1993 1994
198919891991199119901990
19921992 19931993 19941994
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 2003
Level 4/5Managed/Optimizing
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 200320002000
19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003
Level 2Repeatable
Level 2Repeatable
Level 3DefinedLevel 3Defined
198919911990
1992 1993 1994
198919891991199119901990
19921992 19931993 19941994
Level 2Repeatable
Level 2Repeatable
Level 3DefinedLevel 3Defined
198919891991199119901990
19921992 19931993 19941994
198919891991199119901990
19921992 19931993 19941994
Level 4/5Managed/Optimizing
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
RaytheonAcquisition & Transition
20001995 1996 1997 1999-
2001 2002 200320002000
19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003
Level 4/5Managed/Optimizing
Level 4/5Managed/Optimizing
RaytheonAcquisition & Transition
RaytheonAcquisition & Transition
2000200019951995 19961996 1997 1999-1997 1999-
20012001 20022002 2003200320002000
19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003
Level 4Level 4
Level 4IPI
SW Level 5SE Level 3
2003200320032003200320032003200320032003200320032003200320032004 2003200320032003200320032003200320032003200320032003200320032005 2003200320032003200320032003200320032003200320032003200320032006 2003200320032003200320032003200320032003200320032003200320032007
SW, SE & HWMulti-site
Level 5CMMI
CMMI
11/15/2006 Page 5
LRAS3/FS3 Overview• The LRAS3/FS3 is a long range reconnaissance and
surveillance multi-sensor suite system with the capability to determine far target location (FTL) coordinates, and to provide real-time target detection, recognition, and identification capability to the scout while permitting 24-hour adverse weather operations. In addition, the FS3 variant provides laser designation of a target for laser guided weapons.
LRAS3/FS3 Product supports scout and fire support missions
11/15/2006 Page 6
LRAS3/FS3 Overview – continued• FS3 product supports Knight fire support missions. The
LRAS3 product supports scout operations and is operable in both a stationary vehicle mounted configuration and in an autonomous dismounted configuration The host vehicle for the system is the High Mobility Multi-purpose Wheeled Vehicle (HMMWV) and Stryker Armored Vehicle.
LRAS3/FS3 Product supports scout and fire support missions
11/15/2006 Page 7
• SW engineering processes assessed as CMMI Level 5, in 2003
• Rigorous approach to engineering practices, key examples include:– Requirements Management
• Used DOORs tool to support bi-directional traceability• Ensures that the impact of changes to requirements is understood and
addressed through out the system– Configuration Management
• Used through out the life-cycle of the product from Requirements Definition, through design, implementation, test and maintenance
• A multi-tiered approach that has different requirements for different artifacts and for different points in an artifact’s lifecycle
Engineering process supports Mission Assurance
Sound Engineering Processes
11/15/2006 Page 8
Sound Engineering Processes –continued• Additional engineering practices that played a key role in the
mission assurance success of LRAS3/FS3: – Peer Reviews
• Not the “glamorous” part of the process, but rigorous application pays off• Verification by Quality Engineering
– Verification, Validation• An iterative approach• Back to basics, back to the requirements
– Quality Engineering• Maintained independence, but an integral part of the program• Ensured adherence to defined processes• Worked with program to find solutions
Engineering process supports Mission Assurance
11/15/2006 Page 9
Partnership with the Customer
• A series of demonstrations and user juries were conducted to refine the Raytheon understanding of the customer requirements:
– User Jury #1• Combined with PDR (Preliminary Design Review) to ensure requirements
are understood
– User Jury #2• Paper copies of the display screens• End user participation requested (several different ranks)
Demonstrations and User Juries were key tactics
11/15/2006 Page 10
Partnership with the Customer –continued
Demonstrations and User Juries were key tactics
11/15/2006 Page 11
Partnership with the Customer –continued
• Demonstrations and user juries (continued):
– Engineering Confidence Test: Demonstration #1• Fire LDM (Laser Designator Module) from external run box• External mounted camera - alleviate delays for packaging/fabrication• Insert filters in front of camera to simulate end system performance
– Program Gate: Demonstration #2• Interim demonstration of more integrated system at longer ranges
– Tactical Demonstration• After completion of the Vehicle Sensor Mount and end system development
Demonstrations and User Juries were key tactics
11/15/2006 Page 12
Partnership with the Customer –continued
• Customer participation in major reviews
– PDR – Preliminary Design Review– CDR – Critical Design Review – TRR – Test Readiness Review– IPR – Interim Progress Review
– All of these reviews involved customer participation and an agreement regarding actions and authorization to proceed
Formal Reviews were a key tactic
11/15/2006 Page 13
Partnership with the Customer –continued
• Field Service Representative in place to facilitate maintenance issues for deployed systems.
Maintaining systems assumes high priority.
11/15/2006 Page 14
Results Speak for Themselves
• Software CPI has consistently stayed within organizational limits for several years
Achieved Budget as well as Mission Assurance
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar
CPI FS3 Dev (2002-2003)CPI BB1 Insert (2004-2005)Org Norm 1Org Norm High
11/15/2006 Page 15
Results Speak for Themselves –continued
• Software SPI has consistently stayed within organizational limits for several years
Achieved Schedule as well as Mission Assurance
0
0.2
0.4
0.6
0.8
1
1.2
1.4
Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar
SPI FS3 Dev (2002-2003)SPI BB1 Insert (2004-2005)Org Norm LowOrg Norm High
11/15/2006 Page 16
Results Speak for Themselves –continued
• Defect containment metrics for software remained within organizational limits over multiple development efforts
No Doubt – A Mission Assurance Success Story
0
20
40
60
80
100
120
Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar
FS3 Dev (2002-2003)BB1 Insert (2004-2005)Org Norm LowOrg Norm High
11/15/2006 Page 17
Results Speak for Themselves –continued
• To date, there have been two follow-on software maintenance contracts in addition to development effort to enhance software and hardware
No Doubt – A Mission Assurance Success Story
11/15/2006 Page 18
Results Speak for Themselves –continued
• Positive feedback from in-theatre user community– Highly positive feedback in multiple
applications– Not originally designed for mounting on
buildings, but modified and used on rooftops to monitor borders / surveillance
No Doubt – A Mission Assurance Success Story
11/15/2006 Page 19
Results Speak for Themselves –continued
No Doubt – A Mission Assurance Success Story
"Best damn investment the Army ever made" ..Army Scout
11/15/2006 Page 20
Summary
• Sound Engineering Processes coupled with a partnership with the Customer have led to success for the LRAS3/FS3 program, Raytheon, and the Army:
– A program that is within budget and on time
– A product that performs – with no doubt
No Doubt – LRAS3/FS3: A Mission Assurance Success Story
11/15/2006 Page 22
Questions