scaling up open innovation programs
TRANSCRIPT
SCALING UP OPEN INNOVATION PROGRAMSLEARNING FROM NASA’S OPEN INNOVATION PROGRAM
NASA’S CENTER OF EXCELLENCE FOR COLLABORATIVE INNOVATION (COECI)
STEVE RADER [email protected]
@NASA_NTLPublic Release NoticeThis document has been reviewed for technical accuracy, business/management sensitivity, and export control compliance. It is suitable for public release without restrictions per NF1676 TN57221.
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
D · ,j·txcellence jiu-Center o ., .
~. \ Colloborot1ve ~: Innovation
""-.
NASA’s Center of Excellence for Collaborative Innovation
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
HQ
GRC
GSFC
KSC
LaRCMSFC
JPL
JSC
SSC
AFRC
Educates NASA engineers & scientists on the value of crowdsourcing & challenges.
Makes crowdsourcing & challenges easy to use by removing/reducing barriers.
Across NASA CentersPublic Facing - Worldwide
ARC
Across US Federal Agencies
() Center of Excellence for
Innovation
T NASA ournament Lab
NASA Programs & ProjectsU.S. Federal Agencies
USE
TO RUN CHALLENGES AND PERFORM WORK USING CONTRACTS WITH CURATED CROWDS
AND
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
ARCGRC
LaRCMSFC
AFRCNASACitizen Science
As a part of NASA’s
Network of 2M Technical
Problem Solvers working across
Industry, Academia &Government
Crowd of 400K Crowd oGfS1F.C4M software
developers andHQ data scieKnStCists
focusing on algorithms and
software
Crowd of100K filmmakers and
creatives that
challenges
Network of 13K companies, researchers,
and individuals
technology searches
500K+ worker that can be
inexpensivelymobilized for
training machine learning
Crowd of 27M freelance
workers that provide
tasks and contests
Crowd of 4.7M mechanical engineers &
designers
CAD/Design Challenges
Community of10K+ softwaredevelopers/teams that can
TO ENfoGcuAsGonEvTidHeEoPUBLICproAvidSinPg ARTNEmRiScroIN-tasMksAlikKeING PpRrOoduGctRsEviSaS IN THcoEmEpXetPinLgOinRATIObuNild OsofFtwSaPreA. CE
INNOCENTIVE'
ye"tf;com
-•· LUMINARY ~ CommonPool LABS "'»' kaggle·
amazon~
mechanical turk ""
GR,ABCAD
Steve RaderDeputy Manager CoECI Human Health and Performance NASA Johnson Space Center
Allison WolffInnovation StrategistHuman Health and Performance NASA Johnson Space Center
Christine JenkinsTechnical and Business Integration Human Health and Performance Wyle/Stellar - Johnson Space Center
Carol GalicaTechnical IntegrationAdvanced Exploration Systems, HEOMD Stellar Solutions – NASA Headquarters
5
The Center of Excellence for Collaborative InnovationJason Crusan
Director CoECI Director, Advanced Exploration Systems
HEOMD, NASA Headquarters
Lynn BuquoManager CoECI
Human Health and Performance NASA Johnson Space Center
Carolyn WoolvertonCustomer Relationships Manager
Human Health and Performance NASA Johnson Space Center
Carissa CalliniNASA@work Lead
Human Health and Performance Wyle - Johnson Space Center
Jeff DoiInformation Management Specialist
Human Health and Performance Wyle - Johnson Space Center
NASA Solve: www.nasa.gov/solve
NASACitizen Science
6
NASA’s Open Innovation Landscape
All of NASA’s Crowd-Based Efforts
CENTENNIAL CMAllENGES
1._,1
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
Innovation & Problem Solving
Algorithms & Software
Micro-Purchase Design &
Multimedia
Global Technology
Search
Internal
The CoECI ToolkitCurated Crowds Available for NASA Challenges & Tasks
INNOCENTIVE .,
V1 herox. E L
~ -1-J flJ
kaggle· ~- NASA t % Tournament Lab ~&
',-0 ~ v_,., <',1
GRABCAD ~s~c-17 •• )cOutsource d/fenges --
LUMINARY LA BS
N l ~E SIGMA?
0
open:r:oEo freelancer.com
0 tongal' •
Crowd-Based Challenge
Research with Laboratory for
Innovation Science at
Harvard
NASA WORK
NASA’s Center of Excellence for Collaborative InnovationOpen Innovation Challenge Toolkit
Enterprise Knowledge Sharing ChallengesChallenges that tap into the expertise, knowledge, and projects around NASA.
Low-Cost Creative Design ChallengesGraphic, CAD design, idea, design, animation, video, or software.
Technology SearchesWorldwide search for tech. beyond what is publically visible.
Ideation ChallengesInnovative ideas on how to approach or solve a problem.
Technical Problem Solving ChallengesInnovative concepts or designs to solve a problem.
Data Science/Algorithm/Software ChallengesDevelopment of a software app or high performance algorithm.
Video/Animation ChallengeDevelopment of a creative promotional or instructional video.
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
NA
SA O
pen
Inno
vatio
nSe
rvic
esC
ontra
ct N v wpcooe,
~ · kaggle Ta NASA 1:1 hero"
INNOCENTIVE•
N I N F s I G M_;;..)
~ tonga1·
~ Common Pool
A LUMINARY w LABS
~~ J:OEO
Patexia. ""11~k~ t«m>be\lo ...... ftl ....
LISH ~bu1oto,y ,.or lruh.>vot10P
c 1<'..., C of f- Jr.,·ord
nasa.gov\solve
t--·--, .... --,:•· . , '., .. ~ . .!.-,-. . ~-·-~ · .,. · .. -... ·.
- - - - I ;; 7;, a·: .. ~- .. •;;,;;,:,;. ....... -
The CoECI Toolkit
NASA’s Internal Crowd
10
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
7%NO
Advance
55%Incremental
Advance
24%Significant Advance
14%Solved
140Challenges
Effective in Enterprise Knowledge Sharing
20,000NASA
employees/contractorsparticipating
Results from 8
93%Success
Rate
Outlet for Employees who want to be innovative
and make a difference!11
95%Would Use Challenge
Again
Challenge
Determining Urine Volume
in Microgravity
Found an existing prototype saving$1.3M & 3-5 years of development.
Solution already existed in a lab 300m from challenge owner.
The CoECI Toolkit
A Collection of Crowds on Contract
13
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
NOIS: NASA Open Innovation Services@ Common Pool kaggle· ~ tongar· INNOCENTIVE•
• LUMINARY
LABS topcod er ~J:DEO Patexia.
14
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
THE SPAl:E POOP CHAIL.EHBE
fi $30"000 C()MPETJTION TC S<>U{lCE A SYS1EM TfJ.AT flOIJTES ./tHD CC..t.$..~CTS 1:U)MAN W~STE AWAY FROM TFIE BODY, IMNDS-FREE, POR FU,LL Y SUITED ~STRONAUTS.
faoNSORED 8v NASA Johnson Space Center
Secure Key Exchange Challenge
Mission iMpossibleSolution:
Byzantine Generals
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
Strain Measurement of Kevlar Challenge
Challenge to find ways to measure strain in kevlar and vectran webbing
used for inflatable space habitats.
$40K Challenge resulting in 3 solutions
“So simple, so elegant how could we NOT have thought of this ourselves” – Challenge Owner
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
Challenge:Improve the object detection algorithm for TSA’s mm-Wave Scanners using machine learning.
Result:Winning algorithm performance is estimated 98% detection rate
$1.5M in Prize Money
• 1st Place: $500,000
• 2nd Place: $300,000
• 3rd Place: $200,000
• 4th-8th Place:$100,000 each
DHS Challenge Owner:"This will be the best $2.5M we've (DHS) spent in a long time."
17
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
Il l "'E1.S, . ... ~~ . .._
Robonaut Vision Algorithm Challenges
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
--)
ISS Astronaut Food Intake Tracker (FIT) iPad App
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
The CoECI Toolkit
Challenges on a Government Credit Card (< $10,000)
21
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
Micro-Purchase Challengestreelanc~"':t:am
herox GRABCAD
$2000 in Prizes to 5 Winners
492 Designs Received
Clamp 3D PrintDesign
Challenge
3.2M MechanicalEngineers and
ti n. , .• I ...__ ____ ....
Micro-Purchase Challenge Case Studies
Robonaut Sim Tools 3D ModelingDeveloped 14 photorealistic CAD models for $1100 (est.$12,000 savings). 300submissions across 14 10 day challenges.
Experiment Attachment System$3500 challenge resulted in 50 submissions. 5 winning designs provided novel and innovative approaches to meeting design constraints.
Astronaut SmartwatchApp
$1500 User Interface challenge resulted in 245 UI submissions. $3000 SW
Development Task implemented functional
prototype.
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
REALM Project Video$1500 storyboard
challenge followed by a$3000 video production
challenge developed a 3minute fully CGI
explanation of REALM.
The CoECI Toolkit
Network Technology Search Contract
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
24
Technology Search Case Studies
Intracranial Pressure MonitorFound 3 solutions
(1 resulting in a partnership). “Very pleasantly surprised that this process exposed so many
potential solutions with such wide breadth and depth.”
Radiation Tolerant Graphics Processing Identified 50 targets and resulted in 5 high interest targets. Expanded new/ relevant info about vendors that were already known.
Monitoring Water and BiocidesIdentified 61 leads (over 2000 hits) – Resulted in 8 active leads. Owner found this method more affordable than SBIR effort and as valuable.
Lander LIDAR TerrainMapping
Identified 50+ leads Provided both a more complete
understanding of the technology landscape and 8
high interest targets that may beleveraged.
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
CoECI’s Challenge Experience304 Challenges Total Completed or in Progress (with 15 more in formulation)
44 Software/Apps317321
20 Algorithms161111
26 Graphics/Designs1394
63 Technical Solutions401341111 1
57 Ideation4075311 20 CAD Modeling/
Mechanical Design1721
15 Videos65211
27 Technology Survey234
2 Consulting Services11
30 Other292
Trade names, trademarks, and logos are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
[\J.ASA@VvORK ~ INNOCENTIVI:
NINE s I G MA.~
@ Common Pool
herox i& LUMINARY V LAIS
' t opoocte r herox A LUMI NARY V LABS
----
Y,reelanceroom
N IN ES IGM~ ,
@ Common Pool
. ' · 0 APP LAU SE"
t_op ood er [\JASA@V,/ORK
~ elancer_,,, ••• ~ cOutsource
top aotte r
kaggle ~ INNOCENTIVE'
NA.SA@VVORK A LUM I NARY w LAB$
GRABCAD NASA.@VV()Rr<
ve~cqm [\A,SA.@VVORK
~ elancer.com
~~ASA.@VV()R-< ' t op oocte(
0 tongar f\.ASA@VVORK
l-f re e I a nce rm m
~.. NNOCENTIVI:
herox
~JASA@VVORr< ~ elancer.com
NASATournament
Lab Challenges
by the90+% Successful
300+ Challenges
Numbers
80+% Result in CostSavings
Scaling Up an Open Innovation Program
~ • -..\..
,!--,. ( 'f'
\ ' f
•
.,/
•• • L, t:,
- 'J ,
• ~ , __ t--,.
':-.,_ ,'~---- ~
"""'-
....
A Brief History of Program Creation
NASA Prize Authority
signed into law
OMB M-10-11Memo
NASA Human Health and Performance
Conducts Pilot Challenges
NTL Contract with
Harvard Begins
COMPETESAct signed
into law
NASA CoECICreated at
OSTPRequest
First Space Apps
Challenge
OCT hires Prize and Challenge
Program Executive
NASA SubmitsFirst AmericaCOMPETES
Report to OSTP
NASA SOLVEGoes Live
NASA Prizes and Challenges Policy
Directive Published
NASA Prizes and Challenges Program Overview
Administration issues Open
Gov initiative
America Innovation and
Competitiveness Act
30
2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018
Scaling Up CoECI’s NASA Tournament Lab (NTL)
31
2008 NASA Human Health and Performance IndustryBenchmarking
2009 NASA Human Health and Performance Conducts Pilot Challenges (Innocentive & Yet2 Contracts)
2009 NASA@work launched (Innocentive contract)
2010 NTL Contract with Harvard Begins (Subcontract to Topcoder)
2011 Contract with Yet2 for Tech Search
2011 NASA CoECI Launched
2014 NASA SOLVE Launched
2014 Re-Brand of NTL to include all of CoECI toolkit
2015 NOIS Contract Awarded to 10 Vendors
2015 Micro-Purchase Challenges Pilot
2017 OITS contract to Yet2 for Tech Search
2018 NIICE Contract for NASA@work (TBD)
2020 NOIS2 Contract Planned
CoECI Challenges for Each Year n p ogres - u~ 'S',ar< C'
• In Progress (includes pr~endor assignment) • Complete
Get and Maintain a Senior Leadership Champions
Agree on Specific Goals with Leadership
Solve problems and bring innovative solutions that are valuable to the organization
Make workforce more innovative
Find incremental improvements
Find new products, markets, or opportunities
Understand and Focus the Goals for Open Innovation
Problem owner vs solution owner vs innovator
Consider their world
Heads down, no time for disruption, limited resources
Is external innovation a threat?
Know the Customer
Knowledge & Passion for OI
Customer Domain Expertise
Broadly Connected
Specific Skills
facilitation contracting legal/IP marketing/salesmetrics/data analytics
Build an OI Team with the Right Skills
Make using Open Innovation as easy as possible for the workforce
Reduce Barrierscontracts
legal processes mentoring
hand holding examples
challenge extraction/definition
“Be a Sherpa” – Steve Domeck, GE
Marketing is NOT SalesMarketing is important message out and raise
Sales is required to getShow them how it apProvide affordable o funding
Let them “Test Drive” i
to get the awareness
teams to use OI plies to them
ptions or starter
t
You Have to Sell ItTeams must be shown how OI applies to their work
Facilitate challenge identification
f-- '' ' ....
( -=--:,, ',It. ·• :J L 1
11 I I I I
• •• ·.1.J " . .
Hold Workshops to Facilitate Problem Identification & Decomposition
Strategic goal setting to create bold gaps
Decompose problems to find most valuable challenges suited for OI.
“If I were given one hour to save the world, I would spend 59 minutes defining the problem and one minute solving it.”
Encourage Teams to Own the Problem
Manage the Challenge Pipeline
Minimize Effort Required
Make Repeatable
Develop Lightweight Processes
Invest in Tools and Templates
Track and MeasureTrack
Organizational Infusion Leads/Engagements
Challenge Lifecycle
Measure Value and ImpactSavings Over Est. Cost Using Traditional Methods
Calculated Lifecycle Cost Savings
Value of Work Performed in Challenge
ROIReturn on Investment
-,,u1,flf'fl111
.. ;. ....
-----6 ...........
Invest in Curating an Internal Community
Provides a bulkhead for innovation culture change
Signals organization is open to new ideas
Leverage the passion already in the organization
Provides a framework for the innovation process
Beware of “suggestion box” ask for new ideas
• , •
• •
• • • •
C - . •
• ,; . ., ~ -....., ~
' - '
• ' ' ·-' '
,
-I---r ._
~
... • •
• -,.-/ ·J
••
" •• ' . •
I 1-- • L' e I
• • •
• •
• .. •
- ' •
w ,
' --:. J •
-~
'. :;.., ' . -.
Keep Up with What is Possible
Open Innovation landscape is still evolving
Lots of emerging lessons and best practices
New communities, tools, and vendors
Experiment or Pilot New Offerings
Discussion & Collaboration