ndia systems engineering division mission analysis committee meeting 20 april 2010
DESCRIPTION
NDIA Systems Engineering Division Mission Analysis Committee Meeting 20 April 2010. Agenda. Mission Analysis Committee Overview Early SE Development Planning DP Working Group Discussion Cost and Affordability in DP SoS Committee Collaboration DT&E Committee Collaboration. - PowerPoint PPT PresentationTRANSCRIPT
April 20, 2010
1
NDIA Systems Engineering Division
Mission Analysis CommitteeMeeting
20 April 2010
April 20, 2010
2
Agenda
• Mission Analysis Committee Overview
• Early SE Development Planning
• DP Working Group Discussion
• Cost and Affordability in DP
• SoS Committee Collaboration
• DT&E Committee Collaboration
April 20, 2010
3
Mission Analysis Committee Overview
April 20, 2010
4
Mission Analysis Committee
• http://www.ndia.org/Divisions/Divisions/SystemsEngineering/Pages/Mission.aspx
April 20, 2010
5
Mission Analysis Committee
Charter
To provide a forum where government, industry, and academia can share lessons learned, promote best
practices, address issues, and advocate the role of Pre-Milestone A Mission Analysis in the Systems Engineering process. The primary purpose is
determining successful strategies for incorporating mission analysis principles and their relationships to CONOPS, Mission Architecture, M&S, etc. to provide
better Warfighter solutions.
April 20, 2010
6
MA Committee - 2010 Initiatives
• Institutionalize early Development Planning– Study Industry specific Early SE processes and
identify best practices (Feb – Aug ‘10)– Create Early SE implementation framework (Oct ‘10)– Initial Outbrief at SE Conference (Oct ‘10)– Conduct Early SE Workshop (1st Qtr ‘11)– Issue Report on Best Practices (1st Qtr ‘11)
• Support SoS Committee to identify tools and practices to support architecture level assessment of emerging capabilities in SoS initiatives
• Maintain close collaboration with DT&E, SOS, and other committees
April 20, 2010
7
MA Committee Website
• http://www.ndia.org/Divisions/Divisions/SystemsEngineering/Pages/Mission.aspx
April 20, 2010
8
2010 Meeting Schedule
• Meetings in conjunction with SE Division Meetings – Monday, April 19th
• General Dynamics, 1201 M St. SE
– Wednesday, June 16th• Lockheed Martin, 2121 Crystal Drive
– Wednesday, August 18th
• General Dynamics, 1201 M St. SE
– NDIA SE Conference, October 2010– NDIA SE Division Planning Meeting, December 2010
April 20, 2010
9
Early SE Development Planning
April 20, 2010
10
MA Committee Support to OSD DDR&E/SE
April 20, 2010
11
MA Committee Support to OSD DDR&E/SE
April 20, 2010
12
MA Committee Support to OSD DDR&E/SE
April 20, 2010
13
WSARA Impact
April 20, 2010
14
Development Planning
April 20, 2010
15
April 20, 2010
16
Development Planning
April 20, 2010
17
Development Planning
April 20, 2010
18
Development Planning Working Group
sponsored by the
NDIA Systems Engineering Division(In conjunction with Aerospace Industries Association)
19 April 2010
April 20, 2010
19
DP Working Group Objectives
• Identify specific areas, activities and knowledge in the pre-milestone “A“ timeframe where industry engagement could inform early technical analysis and engineering for DoD Acquisition Programs.
• Understand the available and potential mechanisms necessary to facilitate industry involvement in that early technical analysis and engineering.
• Recognize the issues, limitations, and questions and formulate recommendations to foster industry involvement in early technical analysis and engineering.
Gain practical input from industry leaders to help shape Development Planning policy & guidance.
April 20, 2010
20
DP Working Group Output
• A report will be provided to OSD DDR&E/SE identifying industry’s potential role to engage in early technical analysis and engineering for DoD Acquisition Programs, specifically addressing the following:– Identify how the government can engage with industry in early
technical analysis and engineering – Identify the constraints the government and industry could face
during engagements involving early technical analysis and engineering and suggested recommendations
– Identify the mechanisms Government could use to engage with industry during early technical analysis and engineering
– Identify the appropriate key characteristics of DoD Policy & Guidance needed to enable industry’s successful engagement in early technical analysis and engineering
April 20, 2010
21
DP Working Group Specifics
• Expected to be 6 months in duration• Members will appointed and notified• Comprised of 60 – 75 individuals representing:
– Industry– Government– Military
• The NDIA SE Division will be soliciting broad advance input and will incorporate this data into the detailed discussions of the Working Group.– Allows all members of the SE Division (Government,
Military, Industry, and Academia) to provide their perspectives
April 20, 2010
22
DP Working Group Specifics
• Potential candidates for the Working Group are asked to submit their name and qualifications to one of the points of contact listed on the last slide– Candidates should be knowledgeable in one or
more of the objective areas previously listed– Other specific areas of interest include:
• Military Development Planners/Development Labs• IRAD/S&T• T&E Communities• Legal/Contracting
April 20, 2010
23
Points of Contact
• For further information on the Working Group, please contact the following:– Mr. Bob Rassa, NDIA Systems Engineering Division
(SED) Chair ([email protected])– Mr. Mike Duffey, OUSD(DDR&E)SE, DP Working
Group Government Co-chair ([email protected])
– Mr. John Lohse, NDIA SED Mission Analysis Committee Chair, DP Working Group Industry Co-chair ([email protected])
April 20, 2010
24
Working Groups
• Three working groups with freedom to comment across the DP phase, but each asked to focus in a certain area– WG1 focus – Industry Support to Concept Development and
Engineering (Pre-MDD) – Current and Desired– WG2 focus – Industry Support to Concept Evaluation and
Refinement (Post-MDD) – Current and Desired– WG3 focus – Government mechanisms for industry engagement
• WG1 and WG2 to be conducted simultaneously via breakout groups
• WG3 will be conducted with the entire team following WG1 and WG2 debrief
April 20, 2010
25
Working Group 1- Draft Content
• Focus – Industry Support to Concept Development and Engineering (Pre-MDD) – Current and Desired
– Requirements development• Understand operational needs• Anticipate future needs• Correlation with CBA• Correlation with Analytic Agenda• Correlation with CAPE• Mission Architecture development
– Understand Strategic Risk• Prioritization of gaps (CAPE)
– Technology awareness/readiness• Technology driven by advanced concepts• Maintain critical technology TRL assessments• Collaborative experimentation and development
– MDD quality attributes (care-abouts)• TRL assessment• Critical KPPs• MOEs/MOPs/COIs• Budgeting
– Etc.• What are the available tools, processes, and
methodologies?– Mission Analysis– CONOPS/MUAs– Etc.
Source: Mr. Michael DuffeyDeputy Director, Development PlanningOffice of the Director for Systems AnalysisSystems Engineering DirectorateOffice of Director, Defense Research and Engineering
Development PlanningNDIA SE Division MeetingFebruary 17, 2010
April 20, 2010
26
Working Group 2 - Draft Content
• Focus – Industry Support to Concept Evaluation and Refinement (Post-MDD) – Current and Desired
– AoA quality attributes• Critical KPPs• MOEs/MOPs/COIs• TRLs/MRLs - Technical risk• T&E input• “ilities”
– Etc.• What are the available tools, processes, and
methodologies?– Mission Analysis– CONOPS/MUAs– Mission Architecture– M&S– Etc.
Source: Mr. Michael DuffeyDeputy Director, Development PlanningOffice of the Director for Systems AnalysisSystems Engineering DirectorateOffice of Director, Defense Research and Engineering
Development PlanningNDIA SE Division MeetingFebruary 17, 2010
April 20, 2010
27
Working Group 3 - Draft Content
• Focus – Government mechanisms for industry engagement– RFIs– Pre-bidders Conferences– Study contracts– Etc.
April 20, 2010
2828
Considerations for WG1 and WG2
Source: Mr. Michael DuffeyDeputy Director, Development PlanningOffice of the Director for Systems AnalysisSystems Engineering DirectorateOffice of Director, Defense Research and Engineering
Development PlanningNDIA SE Division MeetingFebruary 17, 2010
- Need to ensure the workshop addresses these challenges- Need to ensure the workshop identifies other challenges
April 20, 2010
2929
Considerations for WG1 and WG2
Source: Mr. Michael DuffeyDeputy Director, Development PlanningOffice of the Director for Systems AnalysisSystems Engineering DirectorateOffice of Director, Defense Research and Engineering
Development PlanningNDIA SE Division MeetingFebruary 17, 2010
Make sure we get these questions answered. These could go into the questions we ask industry to brief on.
April 20, 2010
30
Cost and Affordability in DP
Kishore Gragani Presentation
April 20, 2010
31
SoS Committee Collaboration
Discussion
April 20, 2010
32
DT&E Committee Collaboration
Discussion
April 20, 2010
33
Back-up
April 20, 2010
34
Mission Analysis Committee
Committee Objectives• Understand the impact of the new DoD 5000.02, DAG, and CJCS 3170 on Pre-Milestone A (Early) SE• Understand the relationship of Mission Analysis, CONOPS, Mission Architecture, M&S, etc. in Early SE.• Define ways Industry can better support Early SE Development Planning• Evaluate and provide recommendations on Early SE policy and guidelines • Provide best practices for Early SE activities.• Strengthen the SE skill set for dealing with high level of abstraction in Early SE.
Related SE Committee and DOD Interfaces• Identify cross SE Committee Participation
• DT&E Committee - Develop T&E Early SE Thread• SoS Committee - Elevate Early SE framework to Early SoS framework• HSI Committee – Develop process to ensure HSI operational relevance is properly identified
• Identify linkage to other OSD Initiatives• DDR&E Imperatives
• Prepare for Uncertain Future• Reduce MDAP cost, acquisition time, and risk
2009 Accomplishments• Stood up Mission Analysis Committee (Apr ’09)• Decomposed JCIDS exit criteria and AoA entrance criteria, and identified initial set of gaps. (Jun/Aug ’09)• Reviewed USAF Early SE process (Oct ’09)
2010 Initiatives• Study Service and Industry specific Early SE processes and identify best practices (Feb – Jun ‘10)• Create Early SE implementation framework (Aug ‘10)• Initial Outbrief at SE Conference (Oct ‘10)• Conduct Early SE Workshop (1st Qtr ‘11)• Issue Report on Best Practices (1st Qtr ‘11)
Budgeting
Assessm
entRequirements Acquisition
Early SEDevelopment
Planning
• PPB&E• POM Formulation• FYDP• Appropriations
JCIDS Process• CJCSI 3170.01G• CBA
- DCR- ICD
Defense Acquisition System• DoDI 5000.02
- Policy & Guidance- MDAP Decision Authority- AoA
• Formulation of MOEs and MOPs
• Warfighter Requirements• Prioritization of Gaps
Budgeting
Assessm
entRequirements Acquisition
Early SEDevelopment
Planning
Budgeting
Budgeting
Assessm
entA
ssessment
RequirementsRequirements AcquisitionAcquisitionEarly SE
DevelopmentPlanning
Early SEDevelopment
Planning
• PPB&E• POM Formulation• FYDP• Appropriations
JCIDS Process• CJCSI 3170.01G• CBA
- DCR- ICD
Defense Acquisition System• DoDI 5000.02
- Policy & Guidance- MDAP Decision Authority- AoA
• Formulation of MOEs and MOPs
• Warfighter Requirements• Prioritization of Gaps
April 20, 2010
35
Requirements to Acquisition Study
Recent JCIDS Evolution
May 2007
Feb 2009
• Feb 2009 JCIDS eliminates references to FAA, FNA, FSA
• Is FSA-like work truly eliminated and, if so, to what extent?
• Feb 2009 JCIDS eliminates references to FAA, FNA, FSA
• Is FSA-like work truly eliminated and, if so, to what extent?
CJCSI 3170.01G
April 20, 2010
36
Initial Capabilities Document (ICD).• A document that describes the need for a materiel approach to a specific capability gap derived from an initial analysis of materiel approaches. The ICD defines the capability gap in terms of the functional area, the relevant range of military operations, desired effects, and time. It summarizes the results of the Doctrine, Organization, Training, Materiel, Leadership and Education, Personnel, and Facilities (DOTMLPF) analysis and describes why non-materiel changes alone are not adequate to fully provide the capability. The ICD supports the Materiel Development Decision and Milestone A.
Integrated Defense Acquisition, Technology, and Logistics Life Cycle Management System
Transition From ICD to the AoA
April 20, 2010
37
APPENDIX A TO ENCLOSURE F
INITIAL CAPABILITIES DOCUMENT FORMAT
CLASSIFICATION OR UNCLASSIFIED INITIAL CAPABILITIES DOCUMENT
FOR TITLE
Validation Authority: _________
Approval Authority: ________
Milestone Decision Authority: _________
Designation: J ROC Interest/ J CB Interest/ J oint Integration/ J oint Information/ Independent
Prepared for Materiel Development Decision (or specify other acquisition decision point)
Date
•ICD format and detailed content identified in the JCIDS Manual (Appendix A to Enclosure F)
• No mention of MOEs, MOPs, COIs, etc.
The ICD format and detailed content instructions:
1. Concept of Operations Summary.
2. J oint Capability Area.
3. Required Capability.
4. Capability Gaps and Overlaps or Redundancies
a. Describe, in operational terms, the missions, tasks, and functions that cannot be performed ….
b. Describe the attributes of the desired capabilities in terms of desired outcomes….
f. Definitions of the identified capabilities should satisfy two rules:
(1) Rule 1. Capability definitions must contain the required operational attributes with appropriate qualitative parameters and metrics, e.g., outcomes, time, distance, effect (including scale), obstacles to be overcome, and supportability….
5. Threat and Operational Environment
6. Ideas for Non-Materiel Approaches (DOTMLPF Analysis). 7. Final Recommendations
Mandatory Appendices
Appendix A. Integrated Architecture Products.
Appendix B. References
Appendix C. Acronym List
Other Appendices or Annexes.
ICD Format Listed in JCIDS Manual
Transition From ICD to the AoA
April 20, 2010
38
Materiel Solution Analysis Phase
AoA SE “V”
Integrated Defense Acquisition, Technology, and Logistics Life Cycle Management System
Transition From ICD to the AoA
April 20, 2010
39
Interim DAG 3.3.2….At the Materiel Development Decision review, the Director, Program Analysis & Evaluation (DPA&E), or DoD Component equivalent, proposes study guidance for the AoA. The AoA study guidance is approved by the Milestone Decision Authority (MDA), and is provided to the lead DoD Component. Following approval of the AoA study guidance, the lead DoD Component prepares an AoA study plan that describes the technical approach and management of the AoA. A suggested template for the AoA study plan is provided in section 3.3.3. The study plan is coordinated with the MDA, and approved by the DPA&E, prior to the start of the AoA….
Interim DAG AoA Guidance
Transition From ICD to the AoA
April 20, 2010
40
Transition From ICD to the AoA
Interim Defense Acquisition Guidebook, 3.3.3….A recommended outline for the AoA plan would resemble the following: • Introduction <GB section 3.3.3.1>
Background Purpose Scope
• Ground Rules <GB section 3.3.3.2> Scenarios Threats Environment Constraints and Assumptions Timeframe Excursions
• Alternatives <GB section 3.3.3.3> Description of Alternatives Nonviable Alternatives Operations Concepts Sustainment Concepts
• Determination of Effectiveness Measures <GB section 3.3.3.4> Mission Tasks Measures of Effectiveness Measures of Performance
• Effectiveness Analysis <GB section 3.3.3.5> Effectiveness Methodology Models, Simulations, and Data Effectiveness Sensitivity Analysis
• Cost Analysis <GB section 3.3.3.6> Life-Cycle Cost Methodology Additional Total Ownership Cost Considerations (if applicable) Fully Burdened Cost of Delivered Energy (if applicable) Models and Data Cost Sensitivity and/or Risk Analysis
• Cost-Effectiveness Comparisons <GB section 3.3.3.7> Cost-Effectiveness Methodology Displays or Presentation Formats Criteria for Screening Alternatives
• Organization and Management <GB section 3.3.3.8> Study Team/Organization AoA Review Process Schedule
Need to map the ICD content to the AoA Plan content.(Capability Requirements to MOEs/MOPs)
April 20, 2010
41
Summary
• MA Committee will support OSD DDR&E/SE– Industry Development Planning best practices– Identify emerging challenges in “uncertain future”
• Identify Industry role in Development Planning
• Meeting Schedule identified for remainder of 2010
April 20, 2010
42
Early SE Development Planning
Budgeting
Assessm
ent
Requirements AcquisitionEarly SE
DevelopmentPlanning
• PPB&E• POM Formulation• FYDP• Appropriations
JCIDS Process• CJCSI 3170.01G• CBA - DCR - ICD
Defense Acquisition System• DoDI 5000.02
- Policy & Guidance - MDAP Decision Authority - AoA
• Formulation of MOEs and MOPs
• Warfighter Requirements• Prioritization of Gaps