presentation from june 12, 2006 dinner meeting
TRANSCRIPT
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
1/29
Strategy For the Composition and
Development of the Authoritative SystemRepresentation (ASR)
Robert Clayton
Booz Allen Hamilton
June 12, 2006
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
2/29
2
Strategy For the Composition and
Development of the Authoritative
System Representation (ASR)
Necessity of Representation
Representation
Authoritative System Representation
ASR Structural Alternatives
ASR Evolution
Boundaries & Definitions
System Requirements
Categorize & Correlate
Analysis, Engineering, Test
Details
Ancillary Considerations
Refinement
Conclusion
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
3/29
3
Famous Quote
Insanity is doing the same thing, in
the same way, under the same
conditions, and expecting the
results to be different.
Paraphrased from
Albert Einstein
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
4/29
4
Not-So Famous Quotes
In My 25+ years of Combat Development, MaterielAcquisition, Systems Engineering, and Modeling &Simulation The Same Issues/(Mis)Statements
Reappear Test My System Using M&S
Model My System So I Can Solve My EngineeringProblems
Your Model Says The System Cant Achieve This Level, But
We Are Sure It Can So Your Model Must Be Wrong Change It (The Model) Until The System Succeeds
We Do Not Consider Communications As Part Of TheSystem So You Dont Have To Model It
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
5/29
5
Simple Example: GIG
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
6/29
6
Challenge Parallels
ID Scope Of The System
Integrate Parts Of The System
Emphasis On The System
Engineer For System Success
ID Parts Of The System
ID Parts Not Of The System
ID Affecting Entities To The System
ID Effects Of The System
SE
M&S
Respond to (Model & Data,
System) Requirements
Build and Deliver
(System or M&S)
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
7/29
7
DA PAM 512
Simulation Support Planning and Plans
dated 2 March 2005
69. Authoritative system representation
a. Authority and distribution.An authoritative system representation (ASR) is the description of a
systems performance and behavior and its interaction with the environment. This section will alsoprovide information and procedures for obtaining ASR data. The PM approves the ASR and is
responsible for maintaining and updating it. Upon request, the PM will provide the ASR to other
organizations that represent the system in models or simulations. These organizations will use theASR as a specification for building composable models of the system. How the organizations
implement the ASR will not be constrained.
b. Description and documentation. The ASR will describe the system requirements and capabilities in
a standard manner to facilitate model and simulation reuse. The ASR can be described in a text
document, spreadsheet, or distributed product descriptions (DPD) as appropriate to the system. The
ASR should address certain areas to ensure that a complete and consistent system specification is
identified for the modeler. These common areas are critical to accurately model the systems
performance and behavior and its interaction with the environment. The following areas should bedescribed for the system, as appropriate: physical characteristics; reliability, availability, and
maintainability; survivability; lethality; behavior; and expected interaction with the threat, terrain and
weather. The PM will ensure that the ASR is based on data and products provided by the responsible
authoritative data source agency in accordance with applicable DOD and Army regulations. Estimated
data in the ASR will be replaced with actual data as the system matures. As this occurs, the PM will
maintain complete documentation of the sources and methods of acquiring the actual system data, to
support accreditation of the ASR for use. For a more detailed description of the ASR, refer to the SPG.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
8/29
8
DA PAM 512
Simulation Support Planning and Plans
dated 2 March 2005
69. Authoritative system representation
a. Authority and distribution.An authoritative system representation (ASR) is the description of a
systems performance and behavior and its interaction with the environment. This section will alsoprovide information and procedures for obtaining ASR data. The PM approves the ASR and is
responsible for maintaining and updating it. Upon request, the PM will provide the ASR to other
organizations that represent the system in models or simulations. These organizations will use theASR as a specification for building composable models of the system. How the organizations
implement the ASR will not be constrained.
b. Description and documentation. The ASR will describe the system requirements and capabilities in
a standard manner to facilitate model and simulation reuse. The ASR can be described in a text
document, spreadsheet, or distributed product descriptions (DPD) as appropriate to the system. The
ASR should address certain areas to ensure that a complete and consistent system specification is
identified for the modeler. These common areas are critical to accurately model the systems
performance and behavior and its interaction with the environment. The following areas should bedescribed for the system, as appropriate: physical characteristics; reliability, availability, and
maintainability; survivability; lethality; behavior; and expected interaction with the threat, terrain and
weather. The PM will ensure that the ASR is based on data and products provided by the responsible
authoritative data source agency in accordance with applicable DOD and Army regulations. Estimated
data in the ASR will be replaced with actual data as the system matures. As this occurs, the PM will
maintain complete documentation of the sources and methods of acquiring the actual system data, to
support accreditation of the ASR for use. For a more detailed description of the ASR, refer to the SPG.
An authoritative system representation (ASR) is the
description of a systems performance and behavior
and its interaction with the environment.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
9/29
9
DA PAM 512
Simulation Support Planning and Plans
dated 2 March 2005
69. Authoritative system representation
a. Authority and distribution.An authoritative system representation (ASR) is the description of a
systems performance and behavior and its interaction with the environment. This section will alsoprovide information and procedures for obtaining ASR data. The PM approves the ASR and is
responsible for maintaining and updating it. Upon request, the PM will provide the ASR to other
organizations that represent the system in models or simulations. These organizations will use theASR as a specification for building composable models of the system. How the organizations
implement the ASR will not be constrained.
b. Description and documentation. The ASR will describe the system requirements and capabilities in
a standard manner to facilitate model and simulation reuse. The ASR can be described in a text
document, spreadsheet, or distributed product descriptions (DPD) as appropriate to the system. The
ASR should address certain areas to ensure that a complete and consistent system specification is
identified for the modeler. These common areas are critical to accurately model the systems
performance and behavior and its interaction with the environment. The following areas should bedescribed for the system, as appropriate: physical characteristics; reliability, availability, and
maintainability; survivability; lethality; behavior; and expected interaction with the threat, terrain and
weather. The PM will ensure that the ASR is based on data and products provided by the responsible
authoritative data source agency in accordance with applicable DOD and Army regulations. Estimated
data in the ASR will be replaced with actual data as the system matures. As this occurs, the PM will
maintain complete documentation of the sources and methods of acquiring the actual system data, to
support accreditation of the ASR for use. For a more detailed description of the ASR, refer to the SPG.
The ASR is a PM Data Product
PM is responsible for approval, update, provision of
ASR to other organizations.
These organizations will use the ASR as a
specification for building composable models of the[ir]
system [of interest].
How the organizations implement the ASR will not be
constrained.
Use of the ASR by others is equivalent to our own.
The ASR must be multi-echelon, multi-fidelity, and
have a spectrum of abstraction.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
10/29
10
DA PAM 512
Simulation Support Planning and Plans
dated 2 March 2005
69. Authoritative system representation
a. Authority and distribution.An authoritative system representation (ASR) is the description of a
systems performance and behavior and its interaction with the environment. This section will alsoprovide information and procedures for obtaining ASR data. The PM approves the ASR and is
responsible for maintaining and updating it. Upon request, the PM will provide the ASR to other
organizations that represent the system in models or simulations. These organizations will use theASR as a specification for building composable models of the system. How the organizations
implement the ASR will not be constrained.
b. Description and documentation. The ASR will describe the system requirements and capabilities in
a standard manner to facilitate model and simulation reuse. The ASR can be described in a text
document, spreadsheet, or distributed product descriptions (DPD) as appropriate to the system. The
ASR should address certain areas to ensure that a complete and consistent system specification is
identified for the modeler. These common areas are critical to accurately model the systems
performance and behavior and its interaction with the environment. The following areas should bedescribed for the system, as appropriate: physical characteristics; reliability, availability, and
maintainability; survivability; lethality; behavior; and expected interaction with the threat, terrain and
weather. The PM will ensure that the ASR is based on data and products provided by the responsible
authoritative data source agency in accordance with applicable DOD and Army regulations. Estimated
data in the ASR will be replaced with actual data as the system matures. As this occurs, the PM will
maintain complete documentation of the sources and methods of acquiring the actual system data, to
support accreditation of the ASR for use. For a more detailed description of the ASR, refer to the SPG.
On the one hand, the ASR is a compilation of
requirements for the system.
The following areas should be described for the
system, as appropriate: physical characteristics;
reliability, availability, and maintainability; survivability;
lethality; behavior; and expected interaction with the
threat, terrain and weather.
On the other hand, the ASR goes beyond
requirements by specifying objects/conditions outside
the system which affect/are affected by the system.
Together, these reflect what is required for portrayal
within the M&S.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
11/29
11
ASR Policy vs. Need
The ASR When Fleshed Out With System Requirements AndInteraction Information
Suffices To Describe The System And Hints To Its Operational Concept
Fails To Provide Ready-to-use Or Ready-to-implement Capabilities
Good Representation Of A Given System
Provides Consistency In Implementation and Portrayal of System
Provides Visibility In Verification & Validation
Requires Following Standardized Techniques Reflecting Best Practices
In M&S
Current Policies Regarding ASRs, Dissuade Achievement of
Desirable Benefits of Good Representation
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
12/29
12
DA PAM 512
Simulation Support Planning and Plans
dated 2 March 2005
69. Authoritative system representation
a. Authority and distribution.An authoritative system representation (ASR) is the description of a
systems performance and behavior and its interaction with the environment. This section will alsoprovide information and procedures for obtaining ASR data. The PM approves the ASR and is
responsible for maintaining and updating it. Upon request, the PM will provide the ASR to other
organizations that represent the system in models or simulations. These organizations will use theASR as a specification for building composable models of the system. How the organizations
implement the ASR will not be constrained.
b. Description and documentation. The ASR will describe the system requirements and capabilities in
a standard manner to facilitate model and simulation reuse. The ASR can be described in a text
document, spreadsheet, or distributed product descriptions (DPD) as appropriate to the system. The
ASR should address certain areas to ensure that a complete and consistent system specification is
identified for the modeler. These common areas are critical to accurately model the systems
performance and behavior and its interaction with the environment. The following areas should bedescribed for the system, as appropriate: physical characteristics; reliability, availability, and
maintainability; survivability; lethality; behavior; and expected interaction with the threat, terrain and
weather. The PM will ensure that the ASR is based on data and products provided by the responsible
authoritative data source agency in accordance with applicable DOD and Army regulations. Estimated
data in the ASR will be replaced with actual data as the system matures. As this occurs, the PM will
maintain complete documentation of the sources and methods of acquiring the actual system data, to
support accreditation of the ASR for use. For a more detailed description of the ASR, refer to the SPG.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
13/29
13
Decomposing The Definition of An Authoritative System
Representation
Authoritative
Having or arising from authority; official
Of acknowledged accuracy or excellence; highly reliable
Wielding authority; commanding System
A group of interacting, interrelated, or interdependent elementsforming a complex whole
A set of objects or phenomena grouped together for classificationor analysis
Representation Vehicle To Manifest or To Convey Technical, Practical, and
Conceptual Notions For The Better Understanding, ImprovedPortrayal of A Concept, Phenomenon, Condition, Object, orProcess
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
14/29
14
Four General Forms of Presenting ASR
Information
Descriptive Format
Graphics, Spreadsheet, Distributed Product Description
(DPD), Narrative
Identification of Model-Ready Informational Packages
Code/Algorithm Descriptions*
Module-Level Conceptual Models
Prescribed Algorithms
Plug-n-Play APIs, Widgets, etc.
* Some Consider Synonymous or Related To DPD
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
15/29
15
ASR Evolution Scheme
Give Overarching Definitions and Terms
Define System Boundaries
Configuration
Hardware/Software
Capabilities/Services
Processes
Decomposition of System
By Design Echelon (Enterprise, System, Component, Module/Algorithm)
By Partition (External, Innate, Transitional)
Associate System Requirements
Identify Categories, Correlate To Design Echelons/Partitions Flesh Out Details
Recurring Refinement
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
16/29
16
ASR Matrix: Example Entries
Define System Boundaries Configuration
Hardware/Software
Capabilities/Services
Processes
Site Hardware: Server 1, Server 2, Server3, Workstation(x3), Router 1, Router 2,
Cat 5E cabling, WAN PoP, 30m UHF Dish
Site Software: Windows XP Server, MS Internet Explorer, Oracle DBMS
Site Capabilities: Image Database, COP Fusion, Local System Management
Site Processes: Image Storage, Image Archive, Sub Image Interpolation
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
17/29
17
ASR Matrix: Example Entries
Decomposition of System
By Design Echelon (Enterprise, System, Component, Module/Algorithm)
By Partition (External, Innate, Transitional)
1. Enterprise: The Enterprise representation portrays the capabilities and
performance of the System in the context of its role vis--vis other C2 and C4I
Community Operations. On a broader scale, the context would include theremainder of the Global Information Grid (GIG).
2. System: The most-likely to be scrutinized will be the System representation
portraying System capabilities as it relates to other parts of itself, often on a location
by location basis.
3. Component: Engineering level portrayal of Gozintas and Gozoutas from the
individual physical/functional entities that comprise any System location.Components include displays, keyboard, databases, memory,
routers/hubs/switches, etc.
4. Module/Algorithm: Pseudocode or actual code; this will likely remain the least
populated portion of the ASR most often listing only the most significant functions
or procedures.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
18/29
18
ASR Matrix: Example Entries
Decomposition of System By Design Echelon (Enterprise, System, Component, Module/Algorithm)
By Partition (External, Innate, Transitional)
Enterprise: The Enterprise representation of the SYSTEM portrays the
capabilities and performance of the SYSTEM in the context of its
role vis--vis other C4 and ISR Community Operations. On a
broader scale, the context would include the remainder of the
Global Information Grid (GIG).
Enterprise:Innate: the SYSTEM SystemTransitional: All Communications
External: Other Systems
System: The most-likely to be scrutinized representation of the SYSTEM, the
System representation will be used to portray the SYSTEM as it
relates to other parts of itself, often on a location by location basis.
System:Innate: Site Hardware, UserTransitional: All Comms (Incl Within the SYSTEM)
External: All Other ISR Assets
Component: Engineering level portrayal of Gozintas and Gozoutas from
the individual physical/functional entities that comprise any the
SYSTEM location. Components include displays, keyboard,databases, memory, routers/hubs/switches, etc.
Component:Innate: Server, CPU, or Keyboard
Transitional: All I/O Between ComponentsExternal: Any Agent outside the Component
Module/Algorithm: Pseudocode or actual code; this will likely remain the
least populated portion of the ASR most often listing only the
most significant functions or procedures.
Module/Algorithm:Innate: The CodeTransitional: Input and Output DataExternal: Any Component or Datapath
External
Transition Innate
Universe
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
19/29
19
ASR Matrix: Example Entries
Associate System Requirements
Requirement 1: The System shall enable
Requirement 2: The System shall monitor
Requirement 3: The System shall display
Requirement N: The System shall
Each System Requirement Will be associated with appropriate
Design Echelon and partitions.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
20/29
20
ASR Matrix: Example Entries
Identify Categories, Correlate To Design Echelons/Partitions
Each System Requirement Will be Categorized and listed in a
comprehensive, structured fashion.
Requirement: The System shall
Category: Volumetric, Threat Situational Awareness (Within Area of
Interest)
Applicable Design Echelon/Partition: System/Transition;
Enterprise/Innate
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
21/29
21
ASR Matrix: Example Entries
Elaborate on Analysis/Test Issue
Map Requirement to Evaluation Scheme
Requirement: The System shall
Metric: Demand/Response Ratio (DRR)
Prediction/Hypothesis: DRR will be >45%, Error +/- 2%
Evaluation Scheme: Demand will be recorded at Component X input as
quantity of Type A messages. Response will be recorded at
Component Y output as quantity of Type B messages having values
within +/- 3 of corresponding Type A message.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
22/29
22
Graphically Depicted Hypothesis
Prediction
2
3
4
2 3 4 7 8
Demand
Response
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
23/29
23
Prediction-vs-Results
0
10
20
30
0
50
60
0 1 2 3 5 6
Demand
Response
response = .9 demand + 1 .65
error of +/- 2.59
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
24/29
24
ASR Matrix: Example Entries
Flesh Out Details
Descriptive text, specific parameters, methodological description, or
specified code/process is provided
Modeling Issues:
External: Generation of Demand.
Transitional: Adequately Reflecting Degradation By Weather.
Innate: Representing system response to demand, composing Type Bmessage.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
25/29
25
ASR Purpose
The ASR Matrix is designed to allow distribution of
multi-fidelity definitization of expressions of systems
capability
Sufficient detail to adequately portray the system within a
simulations environment
Allows the model developer the maximum flexibility in
constructing their tool
Reminder: The ASR is designed to convey how to portray the
system. It is not a detailed description of the system and the
resulting models developed from its contents are not the system but
an abstraction.
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
26/29
26
Challenge of Representation Beyond Hardware and
Software
Many Net-Centric Systems Embody A SOA Basis
Overlayed On Hardware & Comm Infrastructure
Hardware Representation Is Most Straight-forwardlyImplemented by Physical Prototype or Empirical
Methods
Software Representation Requires Actual Code or A
Fidelity-Appropriate Abstraction
Representing the Soft Portions (Services,
Processes, etc.) Requires More Elaboration
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
27/29
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
28/29
28
ASR Matrix (Workbook) to Database Transition
Workbook Configuration Will
Migrate To Database
Configuration Over Time
Long-term Objective Would Be
To Become A Service Offering
In A SOA Both Within And
External To The System
-
8/9/2019 Presentation from June 12, 2006 Dinner Meeting
29/29
29
Conclusion
The ASR Is Fundamentally An Extension Of The
System Requirements
Conveyed In Terms Of M&S Requirements
Augmented With Modeling Needs Reflecting Entities,
Processes, And Conditions That Affect Or Are Affected By
The System
The Selection Of One Or More Of The Modeling
Strategies Is Dependent On The Specific Needs OfThe System Developer Over The Long Term
(Program Requirements)