seti@home and citizen cyber-science david p. anderson space sciences laboratory u.c. berkeley
TRANSCRIPT
![Page 1: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/1.jpg)
SETI@homeand Citizen Cyber-Science
David P. Anderson
Space Sciences LaboratoryU.C. Berkeley
![Page 2: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/2.jpg)
Citizen Cyber-Science
The use of Internet and computer technology to involve the public in scientific research
Volunteer computing Volunteer thinking
Stardust@home, GalaxyZoo, FoldIt!
![Page 3: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/3.jpg)
SETI@home Classic
Volunteer PC SETI@home serverInternet
SETI@homeclient
download,install
![Page 4: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/4.jpg)
SETI@home Classic
Volunteer PC SETI@home serverInternet
SETI@homeclient
serverrequest a job
![Page 5: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/5.jpg)
SETI@home Classic
Volunteer PC SETI@home serverInternet
SETI@homeclient
serversend data
database
get job
![Page 6: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/6.jpg)
SETI@home Classic
Volunteer PC SETI@home serverInternet
SETI@homeclient
(process data)
![Page 7: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/7.jpg)
SETI@home Classic
Volunteer PC SETI@home serverInternet
server
return results,request new job
database
store resultsget jobSETI@home
client
![Page 8: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/8.jpg)
Problems with S@h Classic
• Hard to deploy new applications or versions
• Wasteful replication
– “Always have work” policy
• No result validation
• Monolithic, inflexible server
![Page 9: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/9.jpg)
Problems with S@h Classic
• Client only downloads 1 job at a time
• Client uses only 1 CPU
• Unit of credit is “job”
• Hard to participate in >1 project (e.g. Folding@home and SETI@home)
![Page 10: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/10.jpg)
BOINC
• General-purpose “middleware” for volunteer computing
• Funded by NSF, 2002 - present
• Open-source (LGPL)
![Page 11: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/11.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client download,install
![Page 12: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/12.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
“attach” to project
SETI@home server
![Page 13: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/13.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
request jobs type of computer RAM, CPU speed connection interval
SETI@home server
scheduler
BOINCDB
get jobs
![Page 14: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/14.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
job descriptions list of application files list of input files list of output files
SETI@home server
scheduler
![Page 15: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/15.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
download program,input files
SETI@home server
data servers
![Page 16: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/16.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
SETI@home server
programprogram
(run applications)
![Page 17: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/17.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
upload outputfiles
SETI@home server
data servers
![Page 18: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/18.jpg)
SETI@home/BOINC
Volunteer PCInternet
BOINC client
report completed jobs
SETI@home server
scheduler
BOINCDB
ScienceDB
assimilate
validate
![Page 19: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/19.jpg)
Problems solved
• Easy to deploy new apps
• Efficient replication
– 2-fold, adaptive
• Errors, cheating are detected immediately
• Server is scalable, fail-soft
• Credit is based on FLOPS, not jobs
• Client can queue lots of jobs, use >1 CPU
![Page 20: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/20.jpg)
Painful transition to BOINC (2005)
• Awkward registration process
• “techie” GUI
• Classic credit didn’t carry over
• User base: 500K -> 200K
![Page 21: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/21.jpg)
The volunteer computing ecosystem
projects
CPDN
LHC@home
WCGattachments
volunteers
![Page 22: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/22.jpg)
Climateprediction.net
![Page 23: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/23.jpg)
Einstein@home
• Gravitational waves
![Page 24: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/24.jpg)
Other projects
• LHC@home
• Rosetta@home
• IBM World Community Grid
• Etc.
– epidemiology, plant ecology, genetic linkage, phylogenetics, graph theory, number theory, cognitive modeling, fluid dynamics, galactic structure, quantum chemistry, nanotechnology, quantum computing, cosmology
![Page 25: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/25.jpg)
History of volunteer computing
Applications
Middleware
1995 2005distributed.net, GIMPS
SETI@home, Folding@home
Commercial: Entropia, United Devices, ...
BOINC
Climateprediction.netPredictor@homeIBM World Community GridEinstein@homeRosetta@home ...
20052000 now
Academic: Bayanihan, Javelin, ...
Applications
![Page 26: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/26.jpg)
Performance
• Current
– 500K people, 1M computers
– 6.5 PetaFLOPS (3 from GPUs, 1.4 from PS3s)
• Potential
– 1 billion PCs today, 2 billion in 2015
– GPU: approaching 1 TFLOPS
– 1 ExaFLOPS: 4M GPUs * 0.25 availability
– Freescale i.MX51: 2 GFLOPS, 200mw
![Page 27: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/27.jpg)
Organizational models
Umbrella projects
• Institutional
– Lattice, VTU@home
• Corporate
– IBM World Community Grid
• Community
– AlmereGrid
• Research community
– MindModeling.org
Project
publicityweb developmentsysadmin
![Page 28: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/28.jpg)
Stardust@home
• The Stardust mission
• Where’s the dust?
• Stardust@home
– 23K volunteers
– 43M viewings
– 64 tracks found
![Page 29: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/29.jpg)
![Page 30: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/30.jpg)
jobs
middleware
people orcomputers
identityaccounting
queuingassignmentvalidation
![Page 31: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/31.jpg)
What’s different?
• People vary
• Jobs may not be well-defined
aptitudetraining
![Page 32: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/32.jpg)
Bossa
• Open-source PHP-based middleware for volunteer thinking
– http://bossa.berkeley.edu
• Policies
– replication, volunteer assessment, job assignment
– Bossa doesn’t provide policies, but makes it easy to implement a wide range of policies
![Page 33: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/33.jpg)
Projects in development
• Hominids@home
– Collect photos of Middle Awash (Ethiopia)
– Look for hominid and other fossils
• AfricaMap
![Page 34: SETI@home and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley](https://reader030.vdocuments.site/reader030/viewer/2022032722/56649f3e5503460f94c5f6c8/html5/thumbnails/34.jpg)
Conclusion
• Citizen Cyber-Science
– volunteer computing
– volunteer thinking
• Benefits to science
• Benefits to society