human readiness levels: linking s&t to acquisition · pdf filehuman readiness levels:...
TRANSCRIPT
![Page 1: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/1.jpg)
Human Readiness Levels: Linking S&T to Acquisition… …and beyond
![Page 2: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/2.jpg)
13 February 2015 2
![Page 3: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/3.jpg)
Human Systems Operational Capability Scope
• Acquire
• Train
• Equip
• Enhance
• Protect
13 February 2015 3
Mason et al., 2013
How do we ensure that complex systems developed
today are ready and optimized for human
interaction?
![Page 4: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/4.jpg)
Human Readiness Levels
User-centered Requirements
System-centered
Requirements
Human Systems Community Developers Decision Makers
Transformation to overcome
communication barrier
![Page 5: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/5.jpg)
Human Readiness Levels • NDIA HSC and DoD HFE TAG have driven
awareness and progress in quantifying human readiness
• Support transfer from R&D to system acquisition and deployment
![Page 6: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/6.jpg)
Human Readiness… of Systems: designed, developed, deployed
• Tool at the ‘human factors practitioner’ level that can be shared with decision makers – Minimize HS/HF related risks to project schedule and
costs – Measure R&D outcomes
• Support enforcement of HSI standards through development and validation of HF anchors to measure and model maturity
• Decision makers can use anchors to assess and track HSI maturity in the acquisition, project management, or implementation phases
![Page 7: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/7.jpg)
One approach to Quantifying Human Readiness of Systems
Input of Human Factors Evaluation Data, emphasis on Issues
• Conditions under which the issue was identified
• Related human factors anchors (FAA)
• Risk level of the issue
• Progress made toward resolving the issue
![Page 8: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/8.jpg)
One approach to Quantifying Human Readiness of Systems
Analyze Human Factors Issues
• Calculate human factors readiness level based on 2 components: – Number of HF issues, prioritized by risk severity and probability
– Degree issue has been addressed – solution conceptualized, implemented, validated?
Track and Predict
• Track each identified issue and its associated resolution recommendations over time (i.e., across multiple evaluations)
• Predict impact of adopting a recommendation on the system HFRL
![Page 9: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/9.jpg)
Challenges remain
• Relationship between practitioner tool at detailed level to high level decision maker summary brief – Communication language and understanding
• Merger of strategic HRL and detailed approaches to quantify
• Baseline metrics/methods to set ‘thresholds’ for level achievement – Completing process is not enough –outcome of the
process must be considered and tracked
User-centered Requirements
System-centered
Requirements
![Page 10: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/10.jpg)
Beyond System Evaluation…
10
![Page 11: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/11.jpg)
Human Readiness… of training solutions
• Training Effectiveness Readiness Levels – How effective is the training system? – What parameters make it most effective? – Need for objective, consistent scale to
compare across systems
• Again, not tracking process of evaluation, but outcome – has training demonstrated xx in training effectiveness
Baseline measurement needed!!!
What is threshold??
![Page 12: Human Readiness Levels: Linking S&T to Acquisition · PDF fileHuman Readiness Levels: Linking S&T to Acquisition ... • NDIA HSC and DoD HFE TAG have driven ... project management,](https://reader034.vdocuments.site/reader034/viewer/2022051523/5a7935227f8b9ad3658b6f87/html5/thumbnails/12.jpg)
Human Readiness… Personnel
What are metrics? What are baselines? Thresholds?