![Page 1: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/1.jpg)
Integrating Previously Uninvolved Stakeholdersin an Online Public Participation Program
The Next Stop Design Case
Daren C. Brabhamwith
Thomas W. SanchezKeith Bartholomew
![Page 2: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/2.jpg)
Outline• The origins of crowdsourcing• Toward a typology of crowdsourcing• Crowdsourcing public participation in planning• A tour of Next Stop Design• Outcomes• Future Plans• Q & A
Me.
![Page 3: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/3.jpg)
A Boy and His Shirts
![Page 4: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/4.jpg)
A Struggle Over the Term• Challenges “in the form of an open call”• “An online, distributed problem solving and
production model”• Like anything in Wired, “crowdsourcing” was
an instant buzzword• Old wine in new bottles?• A bloated concept makes for unclear research
![Page 5: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/5.jpg)
Toward a Typology• Toward a typology of crowdsourcing
approaches– Knowledge Discovery– Broadcast Search– Peer-Vetted Creative Production– Distributed Human Intelligence Tasking
• And what about open source, commons-based peer production, distributed computing, etc.?
![Page 6: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/6.jpg)
Knowledge Discovery• Online communities challenged to uncover
existing knowledge in the network• Amplify discovery capabilities of an
organization with limited resources• Example: Peer-to-Patent
![Page 7: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/7.jpg)
Knowledge Discovery
![Page 8: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/8.jpg)
Knowledge Discovery• Similar in spirit to what Yochai Benkler calls
“commons-based peer production,” but not the same– Commons-based peer production (e.g., Wikipedia)
lacks a centralized set of tasks– A knowledge management and coordination
process
![Page 9: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/9.jpg)
Broadcast Search• Online communities challenged to find
solutions to difficult problems• Casting a wide net finds the “lone gunman” –
the genius able to solve the problem• Examples: InnoCentive, Goldcorp Challenge
![Page 10: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/10.jpg)
Broadcast Search
![Page 11: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/11.jpg)
Peer-Vetted Creative Production• Online communities challenged to develop
and choose solutions to ideation problems• Inviting a lot of input—diverse input—brings
in many (different) ideas. And people “find the best stuff”
• Best idea is the one the market will support• Examples: Threadless, user-generated ads
![Page 12: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/12.jpg)
Peer-Vetted Creative Production
![Page 13: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/13.jpg)
Peer-Vetted Creative Production
![Page 14: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/14.jpg)
Distributed Human Intelligence Tasking
• Online communities tasked to perform simple tasks that computers cannot do well
• Decomposing a problem/task requiring human intelligence into smaller pieces and distributing it is faster, better
• Examples: Amazon Mechanical Turk, Subvert & Profit
![Page 15: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/15.jpg)
Distributed Human Intelligence Tasking
![Page 16: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/16.jpg)
Distributed Human Intelligence Tasking
• Similar to distributed computing projects like SETI@Home, Rosetta@Home, etc.– Distributed computing lacks human intelligence– Use of “spare cycles” is similar, though• Bored at work? Make $0.03 clicking on things• Complicates the idea of separate work, play, and
“down” time
![Page 17: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/17.jpg)
Why Does All of This Work?• Collective intelligence: we are smarter than me• Crowd wisdom– Aggregating individual input is sometimes better
than averaging ideas
• The Web coordinates effort– Speed, reach, asynchrony, anonymity, convergence
• Crowds are motivated– money, reputation, portfolio building, enjoyment, friends
![Page 18: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/18.jpg)
Review: 4 Types, 4 Features• 4 types: knowledge discovery, broadcast search, peer-
vetted creative production, distributed human intelligence tasking
• 4 core features:– Hierarchical task management by an organization
(the “crowdsourcer”)– Crowdsourcer understands motivations of “crowds”– Crowdsourcing leverages human intelligence– Depends on the Web
![Page 19: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/19.jpg)
Urban Planning & Public Participation• Urban planning central to many of today’s
biggest social and environmental problems• Urban planning uses public participation programs• Traditional public participation methods have
limitations– Interpersonal dynamics, special interest groups,
logistics, skewed demographics, one-way comm.
• Purpose is similar to peer-vetted creative production (ideation, market support)
![Page 20: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/20.jpg)
Next Stop Design• Federal Transit Administration grant for
“Innovations in Public Participation”– In cooperation with the Utah Transit Authority
• Peer-vetted creative production approach• Bus stop design contest– Why bus stops? Common, complex, contained
![Page 21: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/21.jpg)
Next Stop Design
![Page 22: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/22.jpg)
![Page 23: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/23.jpg)
![Page 24: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/24.jpg)
![Page 25: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/25.jpg)
![Page 26: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/26.jpg)
![Page 27: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/27.jpg)
Variety of Designs
![Page 28: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/28.jpg)
Winners• 1st – “Folding Bus Stop” – 3.30– Thessaloniki, Greece
• 2nd – “Stop to Move” – 3.05– Mumbai, India
• 3rd – “Smart Stop” – 2.89– Sioux Falls, South Dakota
![Page 29: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/29.jpg)
Final Breakdown• 29,855 visits• 316,141 page views (10.6 pages/visit)• 3,187 registered users• 260 bus stop designs• 11,058 votes cast
![Page 30: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/30.jpg)
Final Breakdown• Countries/territories
visiting: 127– Top: US, UK, India,
Greece, Canada
• U.S. states visiting: 50, plus D.C.– Top: NY, CA, UT, TX,
LA
![Page 31: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/31.jpg)
Final Breakdown• Users were riders– 48% rode bus “more than once a week” or “every day”– 57% rode bus at least once a week
• Users were new to the process– 68.5% had never attended a public meeting
• Diverse ages– 13-85 years old– 9% teens, 49% 20s, 21% 30s, 21% 40+
![Page 32: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/32.jpg)
Outcomes• Crowdsourcing has potential for public
participation in urban planning. Model needs refinement.
• Replicated some of the limitations of traditional public participation methods
• Cheaters – 20 cheaters, 27.6% of votes– Accountability– Keep current score unknown
![Page 33: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/33.jpg)
Findings So Far• Building online community is challenging
• Motivations are complex• Amateur – Professional Tension• Global – Local Tension
![Page 34: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/34.jpg)
Future Plans• Continued interviews with participants– Motivations for participation– Perceptions of the project as effective for government– How they found out about the site
• “Expert” panel review of the winners• Code common themes in designs• Phase 2 – design a plan, not a structure• Publish source code, create toolkit
![Page 35: Daren Brabham Stakeholder Engagement Conference 2010](https://reader036.vdocuments.site/reader036/viewer/2022062703/554d9fbab4c905fa7a8b45f7/html5/thumbnails/35.jpg)
Thank You• Questions?