biol2050 - big data lab
TRANSCRIPT
![Page 1: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/1.jpg)
Big data labBIOL2050
![Page 2: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/2.jpg)
![Page 3: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/3.jpg)
Challenges of Big Data
• Overwhelming
• Difficult to sort through to find something meaningful
• Hard to manage
![Page 4: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/4.jpg)
Examples of Big data
• http://www.coopercenter.org/demographics/Racial-Dot-Map
• http://internet-map.net/
![Page 5: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/5.jpg)
Examples of Big data
www.google.com/trends/
- FIFA world cup- Beyonce- Potatoes- VHS
![Page 6: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/6.jpg)
Big Data: What is the Big deal?
Google grew from processing 100 TB of data a day in 2004 to 20 PB a day in 2008
We are producing more data than we are able to store or analyze
Economist, 2010
![Page 7: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/7.jpg)
Big Data: What is the Big deal?
Far out software
![Page 8: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/8.jpg)
Big Data: What is the Big deal?
“Focusing on one individual at a time, we can provide better reminders, search results, and advertisements by considering all the locations the person is likely to be close to in the future (e.g., “Need a haircut? In 4 days, you will be within 100 meters of a salon that will have a $5 special at that time.”)”
![Page 9: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/9.jpg)
Big Data: What is the Big deal?
Enable scientific breakthroughs
- Large Hadron Collider- Sloan Sky Survey- Genomics- Climate data
![Page 10: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/10.jpg)
![Page 11: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/11.jpg)
Hampton et al, 2013
![Page 12: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/12.jpg)
Big data for ecology
• Ecologists produce large amount of data, but needs to be compiled
• Ecologists must treat data as products, just like publications
• Archive & share -> data repositories
![Page 13: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/13.jpg)
Big data modelingexercise
![Page 14: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/14.jpg)
Big Data for climate
Many different climate projects- WorldClim- CalClimate Commons- NOAA- European Climate Data - Climate Data WMO
![Page 15: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/15.jpg)
Climate data and rasters
Point < Line < Raster
![Page 16: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/16.jpg)
Climate data and rasters
Weather station 1 Weather station 2
![Page 17: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/17.jpg)
Climate data and rasters
Weather station 1 Weather station 2
Interpolated values
![Page 18: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/18.jpg)
![Page 19: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/19.jpg)
Climate data and rasters
![Page 20: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/20.jpg)
Climate data and rasters
![Page 21: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/21.jpg)
Big data & species distributions
Desert nativeChaenactis fremontii
Invasive thistleCentaurea solstitalis
![Page 22: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/22.jpg)
Climate & species distributions
![Page 23: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/23.jpg)
Example
Consortium of California herbaria – plant databasehttp://ucjeps.berkeley.edu/consortium/
CalAdapt – Climate commonshttp://cal-adapt.org/data/tabular/
![Page 24: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/24.jpg)
![Page 25: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/25.jpg)
Plantago insularis
![Page 26: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/26.jpg)
![Page 27: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/27.jpg)
![Page 28: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/28.jpg)
- Copy from internet- Paste special, “as text”- Delete everything except GPS and ID- Re-label specimen to “id”- Re-label “lat” and “lng”
![Page 29: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/29.jpg)
![Page 30: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/30.jpg)
![Page 31: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/31.jpg)
![Page 32: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/32.jpg)
- Copy and paste- Click away from data area- Check settings to match below
![Page 33: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/33.jpg)
- Copy and paste- Click away from data area- Check settings to match below
![Page 34: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/34.jpg)
![Page 35: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/35.jpg)
![Page 36: BIOL2050 - Big data lab](https://reader035.vdocuments.site/reader035/viewer/2022070513/588873901a28ab34788b5089/html5/thumbnails/36.jpg)
Model climate change
• Pick one GPS point, remove all the others• Set time interval for daily, CCSM3• Download data• Plot temperatures from 1950 – 2099• Will your species go extinct? • Try other points