working demo

31
NeutralOpinion Visualizing how people really feel about net neutrality. Geneviève Smith | Insight Data Science NYC | August 2014

Upload: smithgk

Post on 17-Jul-2015

474 views

Category:

Data & Analytics


0 download

TRANSCRIPT

Page 1: Working demo

NeutralOpinionVisualizing how people really feel about net neutrality.

!!!!

Geneviève Smith | Insight Data Science NYC | August 2014

Page 2: Working demo
Page 3: Working demo
Page 4: Working demo
Page 5: Working demo
Page 6: Working demo

Number of comments/complaints

The FCC doesn’t usually get this massive a response

Page 7: Working demo

Number of comments/complaints

The FCC doesn’t usually get this massive a response

Page 8: Working demo

neutralopinion.com

Page 9: Working demo

Raw comments (~250,000 out of 1 million)

Page 10: Working demo

Census tallies of houses with internet access

Raw comments (~250,000 out of 1 million)

Page 11: Working demo

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Census tallies of houses with internet access

Raw comments (~250,000 out of 1 million)

Page 12: Working demo

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Census tallies of houses with internet access

Found template comments by identifying identical rows

Raw comments (~250,000 out of 1 million)

Page 13: Working demo

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Scored sentiment using AFINN-111 2,477 English words rated between -5 and +5

Census tallies of houses with internet access

Found template comments by identifying identical rows

Raw comments (~250,000 out of 1 million)

Page 14: Working demo

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Scored sentiment using AFINN-111 2,477 English words rated between -5 and +5

Census tallies of houses with internet access

Found template comments by identifying identical rows

Front end built using Twitter Bootstrap, AWS, and D3

Raw comments (~250,000 out of 1 million)

Page 15: Working demo

Why might we care about template responses?

Page 16: Working demo
Page 17: Working demo
Page 18: Working demo

Lower engagement More positive language

Higher engagement More negative language

Page 19: Working demo

Lower engagement More positive language

Higher engagement More negative language

Page 20: Working demo

Geneviève Smith | Insight Data Science NYC | August 2014

Page 21: Working demo

Geneviève Smith | Insight Data Science NYC | August 2014

Page 22: Working demo

Geneviève Smith | Insight Data Science NYC | August 2014

Page 23: Working demo

Geneviève Smith | Insight Data Science NYC | August 2014

Page 24: Working demo
Page 25: Working demo
Page 26: Working demo
Page 27: Working demo
Page 28: Working demo
Page 29: Working demo
Page 30: Working demo
Page 31: Working demo