learn. perform. succeed. log 203 (r&m) - log 103 (ram) migration prepared for the life cycle...

Learn. Perform. Succeed.

LOG 203 (R&M) - LOG 103 (RAM) Migration

Prepared for the

Life Cycle Logistics (LCL) Functional Integrated Product Team (FIPT)

Presented by

Patrick M. Dallosta, CPLPerformance Learning Director

LMI Government ServicesMcLean VA

15 January, 2010

1


Agenda

• Change Drivers

• LOG 203 Status

• LOG 103 Content

• Migration Plan

2


Change Drivers

• Recent Legislation/updated DoD Policy has significantly strengthened DOD Reliability, Availability and Maintainability (RAM) Policy, Systems Engineering/Reliability/Test & Evaluation processes and organizations.

• Life Cycle Logistics DAWIA certification path reflects new course requirements in the area of RAM and Supportability– LOG 103, “Reliability, Availability and Maintainability”

• Upgrading of existing LOG 203– LOG 211, “Supportability Analysis”

• New curriculum development

• Expect great cross-functional interest as RAM / Supportability is reconstituted in program offices – a “pendulum swing” back to government resulting from the aftermath of Acquisition Reform

3


• Application/case based• GS 9-12 & E7-O4

Level II Certification

LOG 201LOG 201Intermediate Intermediate Acquisition Acquisition LogisticsLogistics


35 hours, online



LOG 235LOG 235Performance Performance Based Life Based Life

Cycle Product Cycle Product SupportSupport

LOG 235LOG 235Performance Performance Based Life Based Life

Cycle Product Cycle Product SupportSupport

35 hours on-line

4.5 days classroom

P

LOG 211LOG 211Supportability Supportability

AnalysisAnalysis

LOG 211LOG 211Supportability Supportability

AnalysisAnalysis

4.5 days classroom

ACQ 202ACQ 202Intermediate Intermediate

SystemsSystemsAcquisition Acquisition



PACQ 203ACQ 203Intermediate Intermediate




4.5 days classroom

LOG 206LOG 206Intermediate Intermediate

Systems Systems SustainmentSustainment

LOG 206LOG 206Intermediate Intermediate

Systems Systems SustainmentSustainment

40 hours, online

NOTE: There would still be NO

prerequisites for LOG235

xx hours on-line

P

• Case/scenario based• GS 13-14 & E7-O5

Level IIICertification

P

PLOG 350LOG 350

Enterprise Life Enterprise Life Cycle Logistics Cycle Logistics Management Management

LOG 350LOG 350Enterprise Life Enterprise Life Cycle Logistics Cycle Logistics Management Management

LOG 340LOG 340Performance Based Performance Based

Life Cycle Life Cycle SustainmentSustainment

LOG 340LOG 340Performance Based Performance Based

Life Cycle Life Cycle SustainmentSustainment

8.5 days classroom

8.5 days classroom

Level II “Core Plus”Courses & CL Modules

(Includes LOG 204 CM Course& new LOG 2xx Tech Data Mgt Course)

Level II “Core Plus”Courses & CL Modules

(Includes LOG 204 CM Course& new LOG 2xx Tech Data Mgt Course)

P

25 hrs, on-line

Level I Certification

ACQ 101ACQ 101FundamentalsFundamentals of Systems of Systems Acquisition Acquisition

ManagementManagement

ACQ 101ACQ 101FundamentalsFundamentals of Systems of Systems Acquisition Acquisition

ManagementManagement

• Knowledge based• GS 5-9 & E7-O3

26 hrs, on-line

30 hrs, on-line

P

2 Continuous 2 Continuous Learning Learning Modules:Modules:

PBL & PBL & Designing for Designing for SupportabilitySupportability

2 Continuous 2 Continuous Learning Learning Modules:Modules:

PBL & PBL & Designing for Designing for SupportabilitySupportability

LOG 103LOG 103Reliability, Reliability,

Availability & Availability & MaintainabilityMaintainability

LOG 103LOG 103Reliability, Reliability,

Availability & Availability & MaintainabilityMaintainability

LOG 102LOG 102Systems Systems

SustainmentSustainmentManagementManagement

LOG 102LOG 102Systems Systems

SustainmentSustainmentManagementManagement

1-3 hrs ea, on-line

LOG 101LOG 101Acquisition Acquisition LogisticsLogistics

FundamentalsFundamentals

LOG 101LOG 101Acquisition Acquisition LogisticsLogistics

FundamentalsFundamentals

28 hrs, on-line

P = Prerequisite

Level I “Core Plus”Courses & CL Modules

(See DAU catalog for details)

Level I “Core Plus”Courses & CL Modules


Level III “Core Plus”Courses & CL Modules


Level III “Core Plus”Courses & CL Modules


FY13 LCL Certification Construct

P

New Cert Courses

4


LOG 203 Course Objective

• Understand the relationship between Acquisition Logistics and Reliability & Maintainability (R&M)

• Evaluate the impact of R&M decisions

• Knowledge of basic R&M concepts, terminology engineering practices and math

• Discussion of Practical applications

5


Crosswalk to LCL Competencies

• Logistics Design InfluenceLOG 101, LOG 103 (203), LOG 200, LOG 201, LOG 350

• Integrated Logistics Support (ILS) PlanningLOG 101, LOG 200, LOG 201, LOG 210, LOG 350

• Product Support & SustainmentLOG 102, LOG 206, LOG 235, LOG 236, LOG 350

• Configuration ManagementLOG 204, LOG 206

• Reliability & Maintainability AnalysisLOG 103 (203), LOG 200, LOG 201

• Technical/Product Data ManagementLOG 204, LOG 206

• Supportability AnalysisLOG 103(203), LOG 200, LOG 201, LOG 210

6


LOG 203 Overview

• Assignment specific course for Reliability & Maintainability

• No prerequisites

• Distance learning format / Only 1 Section of LOG 203

• LOG 203 metrics consistently meets performance expectations:

• 3-fold increase in student throughput since 2006

• Key Personnel:– Performance Learning Director: Tom Simcik, LCIC-LOG– Course Manager: Richard DiLorenzo, Mid-West– Course Manager Regional Reps : Hal Ernest, South

Phil Littrell, Mid-Atlantic

Great Job, Tom and Team!!7


Question/ Categories FY06 FY07 FY08 FY09

Courseware n=310 n=577 n=730 n=382

Online Delivery

n=310 n=578 n=731 n=382

Learning Effectiveness

n=304 n=571 n=729 n=380

Job Impact n=309 n=577 n=731 n=384

5.95

6.02

5.85

5.74

6.00

6.08

5.89

5.64

0 5.24 5.25 5.59 5.6 7.0 Other0 5.24 5.25 5.99 6.0 7.0 Inst0 5.24 5.25 5.59 5.6 7.0 Other0 5.24 5.25 5.99 6.0 7.0 Inst

* Data (from Data Mart) as of 31 Dec 2010

6.12

6.18

5.99

5.91

5.89

5.98

5.82

5.74

LOG 203 Metrics & Demographics

No

FY 10Data

8


LOG 203 Metrics & Demographics (cont.)

LOG 203 FY 06 FY 07 FY 08 FY 09 FY 10*(Actual/Projected)

Graduates 439 724 926 1140 306 / 1244

Army 114 235 410 440 97 / 338

Air Force 79 131 154 213 58 / 232

DoN 123 135 175 212 61 / 244

Industry 91 185 137 184 62 / 248

Other DoD 19 30 32 60 19 / 76

All Others 13 8 18 31 9 / 36

* as of 14 Jan 2010

9


1. Introduction to LOG 103, Reliability, Availability & Maintainability2. Historical Roots of Reliability, Availability & Maintainability3. Impact of Acquisition Reform on Reliability, Availability & Maintainability4. Mandatory Sustainment Metrics KPP/KSAs5. Legislative/Policy Reliability, Availability & Maintainability Initiatives6. The Systems Design Operational Model (SDOE)7. The Systems Engineering – Design Interface8. Software Reliability, Availability & Maintainability9. Designing and Enabling Reliability, Availability & Maintainability10. Modeling & Simulation of Reliability, Availability & Maintainability11. Supportability Elements, Practices and Outputs12. Impact of RAM on Mission Success and Logistics13. Translating Operational Requirements to RAM Requirements14. RAM Growth Programs, Test and Evaluation and Risk Reduction15. Impact of R&M on Manufacturing

Current and Proposed LOG 103 Lessons

10


Migration Path Ahead

• On-going LOG 201-Log 103 Conversion Actions– Convert current LOG 203 to DAU standard application software– Update basic course information, e.g., re-title LOG 103– Deployment of LG 103 Certification Level Course 15 Mar 10

• Additional LOG 103 Development– New LOG 103 competencies/proficiencies identified 30 Apr

10– Draft curriculum developed 31 Jul 10– Draft curriculum review 31 Aug 10– Curriculum finalized 30 Sep 10– Programming /Test 31 Dec 10– Instructor Pilot/Student Validation (Jan 11) 31 Jan 11– Deployment 15 Mar 11

11


Questions & AnswersQuestions & AnswersLOG 203 – LOG 103 MigrationLOG 203 – LOG 103 Migration

Thank you Thank you for the Opportunity to Serve the for the Opportunity to Serve the

Life Cycle Logistics (LCL) Life Cycle Logistics (LCL) Functional Integrated Product Team (FIPT) Functional Integrated Product Team (FIPT)

12


Back-up!!!


Proposed LOG 103 Learning Objectives/Outcomes

• Lesson 1: Impacts of R&M on Logistics– Recognize how R&M affects support costs– Recognize how R&M affects Total Ownership Costs– List 4 key elements in the definition of reliability– List 2 MTB_s that are logistics reliability parameters

• Lesson 2: Impacts of R&M on Missions– Distinguish between latent failures, random failures and wearout– Identify 3 measures of combat capability that are enhanced by R&M– Distinguish between reliability and maintainability

• Lesson 3: Operational & Contractual R&M Requirements– List 3 methods for converting operational R&M requirements into

contractual R&M requirements– List 3 approaches for assessing R&M of Commercial and Non-

Developmental Items


Current Learning Objectives (Continued)

• Lesson 4: Providing Insight into Designing for Reliability– Identify the reason that failure rates are easier to deal with than MTBFs– Distinguish between mission reliability and logistics reliability– Identify the aim of Reliability Centered Maintenance Analysis

• Lesson 5: R&M and Risk Reduction– Recognize the Test-Analyze-and Fix process of achieving reliability

growth– Recognize the concept of decision risk in reliability qualification test

(RQT)• Lesson 6: Impacts of R&M on Manufacturing

– Identify the effect that latent defects can have on missions and logistics– How to recognize a manufacturing defect from field data– 3 lines of defense to keep manufacturing from producing latent defects


Proposed New Learning Objectives

• Lesson 4: Providing Insight into Designing for Reliability– Identify the reason that failure rates are easier to deal with than MTBFs– Distinguish between mission reliability and logistics reliability– Identify the aim of Reliability Centered Maintenance Analysis

• Lesson 5: R&M and Risk Reduction– Recognize the Test-Analyze-and Fix process of achieving reliability

growth– Recognize the concept of decision risk in reliability qualification test

(RQT)• Lesson 6: Impacts of R&M on Manufacturing

– Identify the effect that latent defects can have on missions and logistics– How to recognize a manufacturing defect from field data– 3 lines of defense to keep manufacturing from producing latent defects


Proposed LOG 103 Learning Objectives/Outcomes

Lesson 5: Impact of Legislation and DoD Policy on Reliability, Availability and Maintainability

Discuss USD(AT&L) RAM Policy Memorandum of July 08 and its impact on systems engineering, reliability/logistics and test & evaluation, with emphasis on reliability growth programs

Discuss impact of the Weapons System Acquisition Reform Act of 2009 and updates to DoDI 5000.02 on the Defense Acquisition Management System, systems engineering processes, sustainment and governance

Lesson 6/1: Impacts of RAM on Logistics– Recognize how RAM affects support costs– Recognize how RAM affects Total

Ownership Costs– List 4 key elements in the definition of

reliability– List 2 MTB_s that are logistics reliability

parameters– Discuss the definitions of availability

Lesson 7/2: Impacts of RAM on Missions– Distinguish between latent failures, random

failures and wear out– Identify 3 measures of combat capability

that are enhanced by RAM– Distinguish between reliability and

maintainability

Lesson 1: Introduction to LOG 203 Reliability, Availability and Maintainability (RAM)

Identify the role of LOG 103 within the LCL and other DAWIA Certification Paths

Identify the relationships between LOG 103 and other certification courses

Identify the role of Reliability, Availability and Maintainability(RAM)as a key part of the systems engineering process

Identify the role of Reliability, Availability and Maintainability(RAM) in minimizing the need for logistics

Lesson 2: Historical Roots of Reliability, Availability and Maintainability (RAM)

Recognize Early Commercial/DoD Reliability Analyses, Tools and Outcomes

Recognize development and use of DoD Reliability, Availability and Maintainability processes, specifications and documentation

Recognize the impact of RAM on DoD Systems performance, sustainment and costs

Lesson 3: The Impact of Acquisition Reform on Reliability, Availability and Maintainability

Discuss the scope and impact of the Perry Memorandum

Discuss the Loss of workforce and skilled RAM personnel

Discuss the Discontinuance of Military Standards and Specifications and its impact

Discuss the Impact of the use of Commercial-Off-The-Shelf on system reliability and performance

Discuss the decrease in effectiveness and suitability as determined by operational Test and Evaluation

Lesson 4: Mandatory Sustainment Materiel Availability Key Performance Parameter and Supporting Key System Attributes of Materiel Reliability and Ownership costs

Discuss the origins of the Material Availability KPP, the Material Reliability KSA and the Ownership Cost KSA

Identify the impact of the KPP/KSA on the requirements management process

Discuss the development of the KPP/KSAs within the JCIDS process

Discuss the enablers to materiel readiness that impact RAM, e.g., RCM, CBM, diagnostics/prognostics


Current Learning Objectives (Continued)

Lesson 8/3: Operational & Contractual RAM Requirements

– List 3 methods for converting operational RAM requirements into contractual RAM requirements

– List 3 approaches for assessing RAM of Commercial and Non-Developmental Items

Lesson 7: The Systems Design and Operational Effectiveness (SDOE) Model

– Discuss the SDOE model and domains– Discuss specific SDOE engineering

outputs and their impact on performance, RAM, and sustainment

Lesson 8/4: Providing Insight into Designing for RAM

– Discuss the concept of design interface– Discuss the elements of supportability– Discuss specific Reliability Availability &

Maintainability trade space considerations

– Discuss common methodologies and analytic tools

– Identify the specific analyses to be conducts, e.g., block diagram development, allocation and prediction, failure modes and effects analysis, maintenance task analysis

– Identify the reason that failure rates are easier to deal with than MTBFs

– Distinguish between mission reliability and logistics reliability

– Identify the aim of Reliability Centered Maintenance

– Identify the aim of Condition Based Maintenance

– Identify the aim of diagnostics and prognostics

Lesson 9/5: RAM Growth Programs and Risk Reduction

– Discuss requirements for reliability management programs

– Discuss requirements for reliability growth test programs

– Discuss best practices– Recognize the Test-Analyze-and Fix

process of achieving reliability growth– Recognize the concept of decision riskLesson 10/6: Impacts of RAM on

Manufacturing– Identify the effect that latent defects can

have on missions and logistics– How to recognize a manufacturing

defect from field data– 3 lines of defense to keep manufacturing

from producing latent defects

Lesson 6/3: Operational & Contractual RAM Requirements

– List 3 methods for converting operational RAM requirements into contractual RAM requirements

– List 3 approaches for assessing RAM of Commercial and Non-Developmental Items

Lesson 7/4: Providing Insight into Designing for Reliability

– Identify the reason that failure rates are easier to deal with than MTBFs

– Distinguish between mission reliability and logistics reliability

– Identify the aim of Reliability Centered Maintenance Analysis

– Identify the aim of Condition Based Maintenance

– Identify the aim of diagnostics and prognostics

in reliability qualification test (RQT)Lesson 9/6: Impacts of RAM on

Manufacturing– Identify the effect that latent defects can

have on missions and logistics– How to recognize a manufacturing defect

from field data– 3 lines of defense to keep manufacturing

from producing latent defects


Defense Science Board

Principal Findings and Recommendations


Systems Failing Reliability During Operational Testing (OT)

Demonstrated Reliability vs Requirements for All Operational Tests

0

100

200

300

400

500

600

700

800

900

1000

0 200 400 600 800 1000

Requirement MTB_

Dem

on

stra

ted

MT

B_


Impact of Low Reliability on Life Cycle Cost (LCC)

• Recent Logistics Management Institute (LMI) and Army studies investigated relationship between reliability and Life Cycle Cost (LCC). Both studies concluded that reliability investment during design and development reduces support cost– LMI study concludes that:

• 30-60% reduction in support cost is achievable• Reacting to lower reliability after IOC (vice during development) results in

significant support cost increases • OSD CAIG study shows that support costs are two-thirds or more of total

system cost– DoD should address acquisition and LCC strategies concurrently

• Support cost bill payers should participate in requirements definition and trade studies during development

Upfront Investment in Robust RAM Effort EmphasizingUpfront Investment in Robust RAM Effort EmphasizingReliability Growth Reduces Life Cycle CostsReliability Growth Reduces Life Cycle Costs

Upfront Investment in Robust RAM Effort EmphasizingUpfront Investment in Robust RAM Effort EmphasizingReliability Growth Reduces Life Cycle CostsReliability Growth Reduces Life Cycle Costs


Reliability Availability & Maintainability (RAM) Findings

• Acquisition Reform implementation had a detrimental impact on RAM practices– With some exceptions, the practice of reliability growth methodologies

was discontinued during System Design and Development (SDD) and deferred until production

– Relevant military specifications and standards were cancelled and not, in all cases, replaced with industry standards

– The technical/managerial workforce was reduced in most government program offices and test organizations

• RAM shortfalls are frequently identified during DT, but program constraints (schedule and funding) often preclude incorporating fixes and delaying IOT&E

• In some instances, programs had such serious RAM concerns that they were precluded from proceeding to production until the problems could be corrected. Improved RAM decreases life cycle costs and reduces demand on the logistics system


USD(AT&L) Memo “RAM Policy” July 08

“…the single most important step necessary to correct high suitability failure rates is to ensure programs are formulated to execute a viable systems engineering strategy from the beginning, including a robust RAM program, as an integral part of design and development. No amount of testing will compensate for deficiencies in RAM program formulation. To this end, the following RAM-related actions are required as a minimum:”•Identify and define RAM requirements during the Joint Capabilities Integration Development System (JCIDS) process and incorporate them into the Request for Proposal (RFP) and as a mandatory contractual requirement•During source selection, evaluate the bidders’ approaches to satisfying RAM requirements•Ensure flow-down of RAM requirements to subcontractors•Make RAM, to include a robust reliability growth program, a mandatory contractual requirement and document progress as a part of every major program review •Develop a military standard for consistent RAM development and testing that can be readily referenced in future DoD contracts•Ensure an adequate cadre of experienced RAM personnel are part of the Service acquisition and engineering office staffs


Roles and Responsibilities of Government Test & Evaluation (T&E) Organizations

“…the aggregate lack of process guidance due to the elimination of specifications and standards, massive workforce reductions in acquisition and test personnel, and the high retirement rate of the most experienced technical and managerial personnel in government and industry has a major negative impact on DoD‘s ability to successfully execute increasingly complex acquisition programs.•Major personnel reductions have strained the pool of experienced government test personnel•A significant amount of developmental testing is currently performed without the needed degree of government involvement or oversight and in some cases, with limited government access to contractor data•The current trend away from governmental involvement in DT makes operationally oriented testing in some areas during development even more difficult to accomplish


LCL Course Development & Revision RoadmapLCL Course Development & Revision Roadmap

Course Title Delivery PLD & CMDAWIA Cert

Course?Funding

Development/ Revision Year

Planned to Deploy

LOG 103Reliability, Availability &

Maintainability (RAM)Distance Learning

PLD: Pat DallostaCM: Rich DiLorenzo (MW)

Yes, Level I

Sec 852 $695,817

FY10 FY11

LOG 206Intermediate Systems

Sustainment Management

Distance Learning

PLD: Pat Dallosta (Doug Killey)

CM: Al Barnes (S)

Yes, Level II

Sec 852 $719,037

FY10 FY11

LOG 340Performance Based Life

Cycle SustainmentClassroom

PLD: Dave FloydCM: Jack Cain (S)

Yes, Level III

Sec 852 $531,732

FY10-11 FY12

LOG 204Configuration Management

(Revision)

Distance Learning

PLD: Pat Dallosta (Doug Killey)

CM: Tom Edison (W)No, Core Plus

DAUTBD

FY11 FY12

LOG 211 Supportability Analysis ClassroomPLD: Tom Simcik (Pat

Dallosta)CM: Jim Curry (CNE)

Yes, Level II

Sec 852 TBD FY11 FY12

LOG 215Technical Data/Product

Data MgtDistance Learning

PLD: Pat DallostaCM: TBD

No, Core Plus

Sec 852 TBD FY12 FY13

LOG 235Performance Based Life Cycle Product Support

(Revision)

Distance Learning

PLD: Dave FloydCM: Kevin Wedmark (CNE)

Yes, Level IIDAUTBD

FY12 FY13

Note: FY10 Deployment of LOG 103 & LOG 206 are a DAU Performance Plan Target under Task 1.1.1 (Develop and deliver high-quality learning assets and services to our customers).

learn. perform. succeed. log 203 (r&m) - log 103 (ram) migration prepared for the life cycle...

Documents