gsapp xcities gorman_upload

61
My Life Inside Big Data Power Struggles in Information Security, Open Government, and the Real Time Milieu

Upload: seagor

Post on 27-Jun-2015

292 views

Category:

Business


0 download

TRANSCRIPT

Page 1: Gsapp xcities gorman_upload

My Life Inside Big DataPower Struggles in Information Security, Open

Government, and the Real Time Milieu

Page 2: Gsapp xcities gorman_upload
Page 3: Gsapp xcities gorman_upload
Page 4: Gsapp xcities gorman_upload
Page 5: Gsapp xcities gorman_upload

Young Hyun (Cooperative Association for Internet Data Analysis - CAIDA)

Page 6: Gsapp xcities gorman_upload
Page 7: Gsapp xcities gorman_upload

Donna Cox and Robert Patterson (National Center for Supercomputing Applications, University of Illinois Urbana-Champaign, USA).

Page 8: Gsapp xcities gorman_upload

Gregory C. Staple and colleagues (TeleGeography, Inc.)

Page 9: Gsapp xcities gorman_upload

Matt Zook (University of Kentucky – Dept. of Geography)

Page 10: Gsapp xcities gorman_upload
Page 11: Gsapp xcities gorman_upload
Page 12: Gsapp xcities gorman_upload

bits vs. atoms

Page 13: Gsapp xcities gorman_upload
Page 14: Gsapp xcities gorman_upload
Page 15: Gsapp xcities gorman_upload
Page 16: Gsapp xcities gorman_upload

Ben Mendelsohn – Bundled, Buried and Behind Closed Doors

Page 17: Gsapp xcities gorman_upload
Page 18: Gsapp xcities gorman_upload
Page 19: Gsapp xcities gorman_upload

WTC

Holland Tunnel

Columbus Circle

Page 20: Gsapp xcities gorman_upload
Page 21: Gsapp xcities gorman_upload
Page 22: Gsapp xcities gorman_upload
Page 23: Gsapp xcities gorman_upload

Gas Pipeline

I 85 & Hwy 2540

Hwy 29

I 85 & Hwy 16

Woodlawn Rd. & Hwy 49

Charlotte Physical Infrastructure Interdependency

Page 24: Gsapp xcities gorman_upload

Aggregate Charlotte connectivity based on density, capacity, and routing for all six infrastructures

Blue dots are Charlotte based financial institutions

Page 25: Gsapp xcities gorman_upload

Areas that lost aggregate connectivity after a gas pipeline incident downtown

Green dots are Charlotte based financial institutions

Page 26: Gsapp xcities gorman_upload

Federal Reserve Bank

Page 27: Gsapp xcities gorman_upload
Page 28: Gsapp xcities gorman_upload
Page 29: Gsapp xcities gorman_upload
Page 30: Gsapp xcities gorman_upload
Page 31: Gsapp xcities gorman_upload
Page 32: Gsapp xcities gorman_upload
Page 33: Gsapp xcities gorman_upload
Page 34: Gsapp xcities gorman_upload
Page 35: Gsapp xcities gorman_upload
Page 36: Gsapp xcities gorman_upload
Page 37: Gsapp xcities gorman_upload
Page 38: Gsapp xcities gorman_upload
Page 39: Gsapp xcities gorman_upload

• 42,000+ contributors• 106,000+ datasets• 600,000+ mapable layers• 15+ million maps served• 4+ million datasets downloaded• 80,000+ monthly unique visitors

Page 40: Gsapp xcities gorman_upload
Page 41: Gsapp xcities gorman_upload
Page 42: Gsapp xcities gorman_upload

Jess3 2011

Page 43: Gsapp xcities gorman_upload

Meeker 2011

Page 44: Gsapp xcities gorman_upload

In Kenya the hottest selling new phone is Huawei’s $80 GPS enabled Android phone,

which has already sold 350,000+ units

MIT 2011

Page 45: Gsapp xcities gorman_upload

By 2014 18% of laptops and 42% of portable video games will be GPS enabled

iSuppli 2010

Page 46: Gsapp xcities gorman_upload

In the United States 72.2% of users accessed social media sites and blogs through their

mobile devices – up 37% from 2010

ComScore 2011

Page 47: Gsapp xcities gorman_upload

Over 40% of content on Twitter came from mobile devices in 2011

GigaOm 2011

Page 48: Gsapp xcities gorman_upload

Substance and Authority

Page 49: Gsapp xcities gorman_upload

Location as a filter for substance and authority

Page 50: Gsapp xcities gorman_upload

Filter by the location and time of the event

Page 51: Gsapp xcities gorman_upload

Bias and Error

Page 52: Gsapp xcities gorman_upload

Identify demographic bias by geography

Page 53: Gsapp xcities gorman_upload
Page 54: Gsapp xcities gorman_upload
Page 55: Gsapp xcities gorman_upload

Real Time Analytics

Page 56: Gsapp xcities gorman_upload

The NYC Marathon’s Human Sensor Network

Page 57: Gsapp xcities gorman_upload
Page 58: Gsapp xcities gorman_upload
Page 59: Gsapp xcities gorman_upload
Page 60: Gsapp xcities gorman_upload

Common thread to interconnect data

Page 61: Gsapp xcities gorman_upload

61

The Future

Real time data streaming from billions of interconnected devices

Scalable Infrastructure

Real Time Visualization

Real Time Analysis & Alerting