working demo

Post on 17-Jul-2015

474 Views

Category:

Data & Analytics

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

NeutralOpinionVisualizing how people really feel about net neutrality.

!!!!

Geneviève Smith | Insight Data Science NYC | August 2014

Number of comments/complaints

The FCC doesn’t usually get this massive a response

Number of comments/complaints

The FCC doesn’t usually get this massive a response

neutralopinion.com

Raw comments (~250,000 out of 1 million)

Census tallies of houses with internet access

Raw comments (~250,000 out of 1 million)

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Census tallies of houses with internet access

Raw comments (~250,000 out of 1 million)

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Census tallies of houses with internet access

Found template comments by identifying identical rows

Raw comments (~250,000 out of 1 million)

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Scored sentiment using AFINN-111 2,477 English words rated between -5 and +5

Census tallies of houses with internet access

Found template comments by identifying identical rows

Raw comments (~250,000 out of 1 million)

NLTK (natural language processing toolkit) to build term-document matrix and used tf-idf to normalize

Scored sentiment using AFINN-111 2,477 English words rated between -5 and +5

Census tallies of houses with internet access

Found template comments by identifying identical rows

Front end built using Twitter Bootstrap, AWS, and D3

Raw comments (~250,000 out of 1 million)

Why might we care about template responses?

Lower engagement More positive language

Higher engagement More negative language

Lower engagement More positive language

Higher engagement More negative language

Geneviève Smith | Insight Data Science NYC | August 2014

Geneviève Smith | Insight Data Science NYC | August 2014

Geneviève Smith | Insight Data Science NYC | August 2014

Geneviève Smith | Insight Data Science NYC | August 2014

top related