technology readiness level assessments for research program
TRANSCRIPT
![Page 1: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/1.jpg)
Technology Readiness Level Assessments for Research Program
Managers and Customers Transportation Research Board Webinar
April 28, 2016
![Page 2: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/2.jpg)
Agenda
• Introductions • About Technology Readiness Levels • Conducting Technology Readiness Assessments • TRAs in Practice/Lessons Learned • Q&A
2
![Page 3: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/3.jpg)
Presenters
3
David Kuehn, Federal Highway Administration
Elizabeth Machek, Volpe Center Stephen Lane, VTRC
Andrew Berthaume, Volpe
Center
![Page 4: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/4.jpg)
Technology Readiness Levels Overview
4
![Page 5: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/5.jpg)
Understanding Technology Maturity
• Tunnel Boring Machine: In the 19th century, repeatedly a colossal failure
• In the 1950s, engineers re-adapted technology developed for mining coal, which is soft, for tunneling harder rock.
5
![Page 6: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/6.jpg)
TRL History
• Developed by NASA in the 1980s • Adopted by DoD in the late 1990s • Adapted by many industries since
6
![Page 7: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/7.jpg)
Technology Readiness Levels
• Assess technology maturity on a 1-9 scale
• Ask two key questions • How complete was the technology
when it was tested? • How representative was the test
environment?
7
Phase TRL Description Basic Research 1 Basic principles and research
2 Application formulated
3 Proof of concept
Applied Research
4 Components validated in laboratory environment
5 Integrated components demonstrated in a laboratory environment
Development 6 Prototype demonstrated in relevant environment
7 Prototype demonstrated in operational environment
8 Technology proven in operational environment
Implementation 9 Technology refined and adopted
![Page 8: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/8.jpg)
FHWA Interest
• Improve communication • Is your “market-ready” the same as mine?
• Improve outcomes • What’s the next step?
• Improve internal assessment • Is the research portfolio balanced appropriately? • Is this project the right fit?
8
![Page 9: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/9.jpg)
State DOT Interest
• Provide structured framework for assessing research needs and research products
• Review panels often quite diverse in skill set and function
• Readiness level assessment provides common focus allowing proper scoping of the needed effort
• The scope and scale of the assessment will be different at state DOT
• Adjust to fit your needs
9
VDOT Pavement Preservation Treatment
![Page 10: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/10.jpg)
State DOT Interest
• Broad application • New products • New processes • Technology transfer • State Transportation Innovation
Council (STIC) efforts
• Questions at various levels can be fine-tuned to fit the issue at hand
10
VDOT Rapid Placement
![Page 11: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/11.jpg)
TRL Scale Development and Deployment
11
Foundation • Literature Review • SME Interview • Engagement with
GAO
Scale Development • Language
simplification • Desktop testing for
software, hardware, and processes
Piloting and Refinement • EAR • SBIR • SHRP2 • Pooled Funds
Implementation • Post-event debrief • Process
improvement
![Page 12: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/12.jpg)
Benefits of TRLs
1. Improved communication 2. Improved outcomes 3. Improved research program management
12
![Page 13: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/13.jpg)
Benefits of TRLs
1. Improved communication • Clearly convey research maturity • Identify audiences
13
![Page 14: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/14.jpg)
Benefits of TRLs
1. Improved communication • Clearly convey research maturity • Identify audiences
2. Improved outcomes • Ask key questions in a structured framework • Inform research in progress with expert assessment • Identify steps to advance maturity • Transition results to stakeholders
14
![Page 15: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/15.jpg)
Benefits of TRLs
1. Improved communication • Clearly convey research maturity • Identify audiences
2. Improved outcomes • Ask key questions in a structured framework • Inform research in progress with expert assessment • Identify steps to advance maturity • Transition results to stakeholders
3. Improved research program management • Establish expectations for research progress • Review the alignment of projects with program objectives
15
![Page 16: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/16.jpg)
Limitations of TRLs
• Provide a measure of technology maturity only. • Do not assess the risk, cost and feasibility of advancing to the next level. • Should be used in concert with other assessment tools. • Poor fit for measuring success of outreach or training, or adoption
• Risk of oversimplification • Project value cannot be reduced to a single number.
16
![Page 17: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/17.jpg)
TRL Example: Electronic Toll Collection
17
TRL 1-3: Basic Research
TRL 4-5: Applied
Research
TRL 6-8: Development
TRL 9: Implementation
![Page 18: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/18.jpg)
TRL 1-3: Basic Research
TRL 4-5: Applied Research
TRL 6-8: Development
TRL 9: Implementation
TRL 1-3: Basic Research
18
• Radio transponders, the basic precursors to RFID technology, developed (1940s)
• Post-war patents identify ETC as a potential application of radio transponders (1950s-60s)
• Development of passive radio transponder with memory (1970s)
Automated tolling patent (1968).
WWII radar beacon technology for plane navigation (1940s).
![Page 19: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/19.jpg)
TRL 1-3: Basic Research
TRL 4-5: Applied Research
TRL 6-8: Development
TRL 9: Implementation
TRL 4-5: Applied Research
19
• RFID tags were validated at Los Alamos National Laboratory (1970s)
• Laboratory research continued on RFID systems (1970s-80s)
![Page 20: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/20.jpg)
TRL 1-3: Basic Research
TRL 4-5: Applied Research
TRL 6-8: Development
TRL 9: Implementation
TRL 6-8: Development • Early prototypes were tested on
closed courses and public roads (1980s)
• Temporary installations were replaced by larger deployments with more readers and transponders
• Initial pilots were open to limited users but eventually, many open the system up to more users
20
![Page 21: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/21.jpg)
TRL 1-3: Basic Research
TRL 4-5: Applied Research
TRL 6-8: Development
TRL 9: Implementation
TRL 9: Implementation
• Early adopters implemented ETC solutions (late 1980s)
• More states tested and adopted ETC and developed new concepts (1990s)
• As of 2009, FHWA requires all new toll facilities with Federal funding to use ETC
21
![Page 22: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/22.jpg)
Technology Readiness Assessments Process
22
![Page 23: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/23.jpg)
Conducting a Technology Readiness Assessment
• Pre-Meeting • Goals • Timing and Location • Panelists • Materials
• At the Panel Meeting • Roles
• Post-Meeting • Documentation • Follow-up
23
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 24: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/24.jpg)
Determine your goals
• What is the critical technology to be assessed? • What application, or applications will the panel assess? • What is the intended operating environment for each application?
24
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 25: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/25.jpg)
Set a Date and Location
• Timing • To inform decision point • ~4-6 months in advance of conclusion
• Location • Virtual • In-Person
• At research site • Coordinated with relevant workshop/conference • Neutral location
• Length
25
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 26: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/26.jpg)
Invite Panelists
• 4-6 panelists (including chair) • Panel composition suggestions
• Academic • Practitioner • Stakeholder • End User • Sponsoring Agency Representative
26
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 27: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/27.jpg)
Prepare Materials
• Process Documents • TRL Scale • Goal of the TRA • Key Technology, Application(s), Operating Environment(s)
• Project Documentation • PI Questionnaire • Presentations • Research Reports • Published Papers
• Coordination • Pre-Meeting Conference Call
27
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 28: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/28.jpg)
Determine Roles
• Panel Chair • Panelists • Research Team Representative • Staff Support
• Facilitation • Documentation • Remote Participation Support
28
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 29: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/29.jpg)
Decide What’s Next
• TRA Report • Real-time feedback to research team • Recommendations for immediate next steps
• draft work scopes for next research • logic models
• Debrief and identify process improvements
29
Post-Meeting
At the Panel Meeting
Pre-Meeting
![Page 30: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/30.jpg)
TRAs in Practice Lessons Learned
30
![Page 31: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/31.jpg)
Example: New Structural Materials
• Location • At PI’s lab • Laboratory tour • Grad student/postdoc participation
• Panel Composition • State DOT (2) • Industry (2) • U.S. DOT SME (2) • U.S. Army Corps of Engineers (1) • Project Lead
• Results • Seismic column TRL 4 • Bridge deck TRL 2 • Railroad tie TRL 2
• Outcomes • Commissioned economic study on materials costs • Developed Statements of Work by application type
31
![Page 32: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/32.jpg)
Example: Energy in the Right-of-Way
• Location • Two virtual meetings
• Panel Composition • State DOT (2) • Industry (3) • U.S. DOT SME (5) • DOE SME(1) • Project Lead
• Results • TRL 2-3 • TRL 5-6
• Outcomes • Identified next steps to advance maturity
• Traffic safety performance (collision) • Testing is less than ideal weather conditions
32
![Page 33: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/33.jpg)
Example: Portfolio Assessment
• 3 projects • TRL 2 • TRL 2/3 • TRL 4-6
• Some panelist overlap • Results informed
development of a topical logic model
33
Increased ability to investigate cutting edge topics and make better
transportation decisions
Raised awareness and interest
• Increased knowledge and awareness of agent-based modeling methods and results, including their potential to improve the modeling of elements of the transportation system
ActivitiesDirect
OutcomesIntermediate
OutcomesLonger Term
Outcomes ImpactsInputs Outputs (less than 1 year) (1-5 years) (over 5 years)
Handoff Support
Project Outreach
Research Gaps• Ability to model and
understand traveler behavior • Literature on characterizing
driver behavior• Non-site specific research
Resources• Research support from
academic institutions and State and local governments
• Federal Staff• FHWA and matching funding
Research Products• Technical reports• Agent-based
modeling software
• Driver behavior data
Handoff Workshop
Conduct research project
Assess project on an interim basis
TRL-H Assessment Report
Screen portfoliofor transition potential
Organize targeted transition activities
Assess transition support needs
Internal (USDOT) and External
Communication Materials
Document project results
Presentations, Demonstrations, and
TRB InvolvementConduct outreach
Improved industry research capacity through agent-
based modeling results that more accurately represent and predict user behavior
Better transportation planning and
programming based on improved accuracy of
modeling leads to better transportation projects and facilities
Cutting edge research leads to the
implementation of new technologies and
processes
Broad Agency Announcement
Project Execution
Foundational Research
Development of informal and formal strategic
partnerships and networks between researchers
Access to new ideas and research methods from
cooperative work, partnerships, fellowships
Increased investment in follow-on research
from external sources
Increased program engagement across USDOT
Support national research priorities and strategic goals
• Increased safety
• Enhanced reliability
• Increased mobility
• Enhanced economic competitiveness
• Increased environmental sustainability
• Improved national leadership
• Enhanced program delivery
• Improved movement of goods
Strengthened relationships and cross-sector collaboration• Increased collaboration
among stakeholders• Expanded professional
knowledge base for constructing and testing agent-based models
• Engagement of new and traditional stakeholders in new ways
• Identification of potential future research champions
• Introduction of agent-based simulation into TRB subcommittees
Relationships formed among researchers
and project stakeholders
Agent-Based Modeling Logic Model
IT Product Assessment
Knowledge
Outreach
Improved research tools and processes
• Better calibration of agents
• Improved modeling of elements of the transportation system
• Incorporation of agent-based modeling methods into planning models
Usage
Support national research priorities and strategic goals
Enhance transportation modeling so agencies can better plan,
design, build and operate transportation systems
2008 2009 2010 2011 2012 2013 2014 2015 2016 | Future
Identified Needs• Better understand how the
transportation system adapts to actions taken by drivers, commercial vehicles, TMCs, and policy agents
• Enhance data analysis and visualization capabilities beyond existing models’ capabilities
External Factors: Institutional Issues, etc.
![Page 34: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/34.jpg)
Possible Next Steps
• Program-Level Logic Map • Market Analysis • Barrier, Level of Effort Analysis • Stakeholder Meetings • Data Documentation
34
![Page 35: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/35.jpg)
Lessons Learned
• Use assessments strategically • Is there interest in moving forward with the project? • Is the project outcome very clear?
• Set expectations early • With the research team • With the panelists
• The value is in the discussion, not the number • Panelists may identify additional research needs or ambiguities for clarification
35
![Page 36: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/36.jpg)
Discussion
Thank you! Questions?
36
For More Information: http://www.fhwa.dot.gov/advancedresearch/trl_h.cfm
![Page 37: Technology Readiness Level Assessments for Research Program](https://reader033.vdocuments.site/reader033/viewer/2022042600/588dc8041a28abee208bf087/html5/thumbnails/37.jpg)
Photo Credits Slides 1 and 31
• University of California, Berkeley
Slide 5
• Henri-Joseph Maus
Slide 6
• NASA • http://www.nasa.gov/audience/forstudents/k-4/stories/nasa-
knows/what-is-mars-k4.html
Slides 9 and 10
• Virginia DOT (Stephen Lane)
Slide 13
• halfpoint / 123RF Stock Photo
Slide 14
• Volpe Center, Fecht
Slide 15
• nexusplexus / 123RF Stock Photo
37
Slides 17-21
• National Institute of Standards and Technology • http://www.antd.nist.gov/wctg/RFID/RFIDassist.htm • http://www.antd.nist.gov/wctg/RFID/ISART06-Assisted-LocCom.pdf
• Department of Defense • http://www.history.navy.mil/research/library/online-reading-room/title-list-
alphabetically/u/operational-characteristics-of-radar-classified-by-tactical-application.html
• Patent and Trademark Office • https://www.google.com/patents/US3602881
• Department of Transportation • Volpe Center • https://www.environment.fhwa.dot.gov/strmlng/newsletters/jul13nl.asp • https://www.fhwa.dot.gov/publications/publicroads/05jul/01.cfm • https://www.fhwa.dot.gov/publications/publicroads/93fall/alongroad.cfm • https://www.fhwa.dot.gov/publications/publicroads/96spring/p96sp23.cfm • http://www.ops.fhwa.dot.gov/plan4ops/focus_areas/organizing_for_op.htm • https://www.pcb.its.dot.gov/eprimer/module8.aspx
Slide 32
• University of Nebraska, Lincoln
• Virginia Tech Transportation Institute