hack the census, unleash the power of data

19
Powering New Orleans Economic Benchmarks Alicia Brown April 13, 2016 hacking the Census API via FME

Upload: safe-software

Post on 14-Apr-2017

206 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Hack The Census, Unleash the Power of Data

Powering New Orleans Economic BenchmarksAlicia BrownApril 13, 2016hacking the Census API via FME

Page 2: Hack The Census, Unleash the Power of Data

The Team

Data AnalystSocrata

Data AnalystSocrata

Program ManagerSocrata

Alicia Brown Daniella Kuttner Chris Rieth

Page 3: Hack The Census, Unleash the Power of Data

New Orleans Mission● Develop & Track performance goals● Benchmark Progress against comparable

cities● Validate findings using federal and 3rd party

data● Use FME to automate indicator data retrieval

Page 4: Hack The Census, Unleash the Power of Data

Census API● Census publishes American Community Survey

yearly● API provides data from 2011 - 2014● Example for Travel Time to work:

http://api.census.gov/data/2014/acs1?get=NAME,B08303_001E,B08303_002E,B08303_003E,B08303_004E&for=place:55000&in=state:22&key=YOUR_API_KEY

Page 5: Hack The Census, Unleash the Power of Data

Let’s look at the Workflow

Page 6: Hack The Census, Unleash the Power of Data
Page 7: Hack The Census, Unleash the Power of Data

Python Caller Transformer

Page 8: Hack The Census, Unleash the Power of Data
Page 9: Hack The Census, Unleash the Power of Data

Attribute Renamer

Page 10: Hack The Census, Unleash the Power of Data
Page 11: Hack The Census, Unleash the Power of Data

Calculate & Aggregate

Page 12: Hack The Census, Unleash the Power of Data
Page 13: Hack The Census, Unleash the Power of Data

Socrata Writer → data.nola.gov

Page 15: Hack The Census, Unleash the Power of Data

Parameters to handle future years

Page 16: Hack The Census, Unleash the Power of Data
Page 17: Hack The Census, Unleash the Power of Data

Lessons Learned● There is a limit of 50 variables for single call● Need to handle missing data for some

variables & geographies● The type of ACS year (1,3,5) is dependent on

the population size of a geographical area so that sample is representative of it

● Categorical measurements may change over years

Page 18: Hack The Census, Unleash the Power of Data

Thanks to Melissa with the City of New Orleans for giving us this amazing task!

Resources● ResultsNOLA● github.com/socrata/connectors/cen

sus● ACS 1 YR API documentation● census.gov/developers

Page 19: Hack The Census, Unleash the Power of Data

Open Data Superhero?

We’re hiring!careers.socrata.com/jobs

Want to become an