![Page 1: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/1.jpg)
Citizen Science: Building REALLY Large Teams to Get Research Done
Richard J. Bookman, [email protected]
@rbookman
Oct 8, 2014UM CTSI Seminar Series
or<…with apologies to Pirandello…>
8 short stories in search of authority
![Page 2: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/2.jpg)
<talk>
![Page 3: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/3.jpg)
<intro>
![Page 4: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/4.jpg)
ATLAS team at the LHC/CERN
http://particularphysics.tumblr.com/day/2012/08/31
![Page 5: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/5.jpg)
in the beginning…
…there was nothing but citizen science.
![Page 6: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/6.jpg)
http://www.theshirtdudes.com/trust-scientist.html
![Page 7: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/7.jpg)
Science is the belief in the ignorance of experts.
Richard Feynman,“What is Science?”, address to science teachers, 1966
http://img.youtube.com/vi/_ah7f-1M2Sg/hqdefault.jpg
![Page 8: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/8.jpg)
Crowdsourcing is not new
“The greatest improvements…have been the effects of the division of labor.”Adam Smith, Wealth of Nations, 1776
![Page 9: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/9.jpg)
Cognitive surplus
![Page 10: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/10.jpg)
</intro>
![Page 11: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/11.jpg)
<stories>
![Page 12: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/12.jpg)
<1>
![Page 13: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/13.jpg)
![Page 14: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/14.jpg)
</1><2>
![Page 15: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/15.jpg)
![Page 16: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/16.jpg)
![Page 17: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/17.jpg)
http://blog.galaxyzoo.org/2013/02/22/green-valley-the-town-too-good-to-di/
![Page 18: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/18.jpg)
http://spaceinfo.com.au/2010/09/16/puzzle-of-the-green-pea-galaxies/
![Page 19: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/19.jpg)
![Page 20: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/20.jpg)
</2><3>
![Page 21: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/21.jpg)
• Is it citizen science?
![Page 22: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/22.jpg)
</3><4>
![Page 23: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/23.jpg)
![Page 24: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/24.jpg)
</4><5>
![Page 25: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/25.jpg)
![Page 26: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/26.jpg)
![Page 27: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/27.jpg)
![Page 28: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/28.jpg)
![Page 29: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/29.jpg)
</5><6>
![Page 30: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/30.jpg)
![Page 32: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/32.jpg)
</6><7>
![Page 33: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/33.jpg)
And what if the science is about citizen health?
![Page 34: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/34.jpg)
![Page 35: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/35.jpg)
http://www.patientslikeme.com/about
![Page 36: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/36.jpg)
http://www.pnas.org/content/105/6/2052
![Page 37: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/37.jpg)
Methods
http://www.pnas.org/content/105/6/2052
![Page 38: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/38.jpg)
Wicks et al., Nat Biotech, 29(5);p411.
![Page 39: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/39.jpg)
http://www.nature.com/nbt/journal/v29/n5/full/nbt.1837.html
![Page 40: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/40.jpg)
Abstract
Patients with serious diseases may experiment with drugsthat have not received regulatory approval. Online patient communities structured around quantitative outcome datahave the potential to provide an observational environmentto monitor such drug usage and its consequences. Herewe describe an analysis of data reported on the website PatientsLikeMe by patients with amyotrophic lateral sclerosis (ALS) who experimented with lithium carbonate treatment.To reduce potential bias owing to lack of randomization, we developed an algorithm to match 149 treated patients to multiple controls (447 total) based on the progression of their disease course. At 12 months after treatment, we found no effect of lithium on disease progression. Although observational studies using unblinded data are not a substitute for double- blind randomized control trials, this study reached the same conclusion as subsequent randomized trials,
http://www.nature.com/nbt/journal/v29/n5/pdf/nbt.1837.pdf
![Page 41: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/41.jpg)
And what if the science is about citizen health?
“What I’ve found to be most amazing about these forums thus far is the ability of patients to identify common side effects, formulate solutions, test them, and confirm their general efficacy all in a matter of days, when it would take researchers weeks or even months to generate the same knowledge.”—Patient with ALS discussing potential treatments on the forum of the ALS Therapy Development Institute
![Page 42: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/42.jpg)
</7><8>
![Page 43: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/43.jpg)
![Page 44: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/44.jpg)
</8></stories>
![Page 45: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/45.jpg)
<show $>
![Page 46: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/46.jpg)
NIH’s View
https://imagebank.nih.gov/details.cfm?imageid=1335
![Page 47: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/47.jpg)
![Page 48: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/48.jpg)
http://dpcpsi.nih.gov/sites/default/files/Citizen_Science_presentation_to_CoC_Jan31.pdf
![Page 49: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/49.jpg)
http://dpcpsi.nih.gov/sites/default/files/Citizen_Science_presentation_to_CoC_Jan31.pdf
![Page 50: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/50.jpg)
</show $>
![Page 51: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/51.jpg)
<issues>
![Page 52: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/52.jpg)
what is citizen science?
![Page 53: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/53.jpg)
What do citizen scientists do?
Collect dataDonate samples (dna, µbiome)Analyze dataSolve puzzlesAsk questionsFormulate hypothesesBuild toolsWriteSocialize
![Page 54: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/54.jpg)
How does citizen science work?
Standalone appPlatform-basedGamingChallenges/competitionsSolo &/or teamsSocial networks/build community
![Page 55: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/55.jpg)
![Page 56: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/56.jpg)
Quality
Reproducibility
Credit/Attribution
Identity/Privacy
Retention
Capacity
Emerging Issues in Citizen Science
![Page 57: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/57.jpg)
…and then there’s this:
![Page 58: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/58.jpg)
http://www.csmonitor.com/Business/The-Adam-Smith-Institute-Blog/2011/0131/Forget-fair-trade-buy-from-sweatshops
![Page 59: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/59.jpg)
Ethical, Legal and Social Implications
• Virtual sweatshop
• IP
• Misrepresentation of task
• Repression 2.0
• Disruptive participants
![Page 60: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/60.jpg)
Ethical, Legal and Social Implications
Some solutions
• Trusted platforms
• Open algorithms
• Consent to play/participate
• Identity Verification
• Credit or badge system
![Page 61: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/61.jpg)
</issues>
![Page 62: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/62.jpg)
How can you use citizen science and
human/machine computation in your
research?
![Page 63: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/63.jpg)
</talk>
![Page 64: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/64.jpg)
![Page 65: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/65.jpg)
extras
![Page 66: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/66.jpg)
https://www.mturk.com/mturk/welcome
![Page 67: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/67.jpg)
![Page 68: Univ of Miami CTSI: Citizen science seminar; Oct 2014](https://reader035.vdocuments.site/reader035/viewer/2022062514/558e2df11a28ab94468b4604/html5/thumbnails/68.jpg)