twitter, myfitnesspal and #foodporn: using social media ...€¦ · twitter, myfitnesspal and...

58
Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing Research Institute

Upload: others

Post on 17-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy

Lifestyle Tracking

Ingmar Weber

Qatar Computing Research Institute

Page 2: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 3: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 4: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 5: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Desert

Forrest

Page 6: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

24% Indian

16% Nepali

15% Qatari

11% Filipino

Page 7: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 8: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 9: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 10: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 11: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 12: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 13: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 14: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 15: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 16: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 17: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 18: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing
Page 19: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Social Computing Areas Understanding multi-cultural societies through social media - Cross-lingual communication, political violence, …

Computing for human development and crisis management

- Crisis mapping, international migration, …

Analytics for journalism, online news, and social media

- Forecasting news interest, creating personal relevance, …

Urban mobility and smart cities [starting]

- Understanding traffic abnormalities, studying spatial segregation, …

Page 20: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Selected Demos

http://tinyurl.com/SGP-Twitter (ICWSM ’14 Demo Paper)

http://fast.qcri.org/ (CSCW ‘14 Demo Paper)

http://aidr.qcri.org/ (WWW ‘14 Demo Paper)

Page 21: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Motivation: Obesity in Qatar

• >75% of Qatari adults are overweight

• ~50% of Qatari adults are obese (BMI >= 30)

• 16% diabetes

Page 22: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

You Tweet What You Eat: Studying Food Consumption

Through Twitter

Joint work with S. Abbar and Y. Mejova

CHI 2015

Page 23: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

“Pointless Babble” == Great Data! “Twitter Study Reveals Interesting Results - About Usage 40%

is Pointless Babble” (Pear Analytics, 2009)

Page 24: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Research Questions

• Can we use social media to study food consumption and obesity at the macro level?

• Can we identify markers that are associated with healthy lifestyles of individuals?

• Does the social network play a role in obesity?

Page 25: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Data Acquisition • Start with a streaming API filter for terms such as

“eat”, “cook”, “lunch”, “breakfast”, …

• Collect 50M tweets during Nov 2013

• 892K geo-tagged tweets from 400K users

– Use (lat, long) to map to ZIP and census data

• Get data for 210K random subset

• 3,200 public tweets, profile, friends, followers

• 503M tweets, 32M distinct friends

Page 26: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Food Dictionary & Calories Mapping • Start with “small” initial word list, eat, lunch, dinner, …

• Look at co-occurring terms to extend list

• Use CrowdFlower to label tweets

• Get 811 positive, 1,636 negative tweets

• Build a NB classifier, get common terms – 460 labeled as “food” (available online)

• Look up food mentioned and map to calories – Pizza 478, fruit salad 99, … *link]

• Compute per-person average value

Page 27: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Calories vs. Obesity

Page 28: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Zooming-In to Counties

• Try to predict county-level obesity

– avCal

– Food names

– LIWC categories (re Culotta’14)

– Demographic

• Ridge regression with 5-fold cross validation

Page 29: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Prediction Performance

Page 30: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Markers in Profiles/Tweets

Page 31: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Good and Bad Interests

[link]

Page 32: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Social Network Effects

• Call a user in predicted top 10% “active”

Page 33: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Conclusions

• Macro-level food consumption and obesity trends are traceable through social media

• Sedentary interests largely bad

• Difference between spectator and participatory sports

• Social assortativity of obesity

Page 34: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

#FoodPorn: Obesity Patterns in Culinary Interactions

Joint work with Y. Mejova, H. Haddadi and A. Noulas

Under review

Page 35: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Food on Instagram

Page 36: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Research Questions

• Is there a link between (the presence of) fast food restaurants and obesity?

• Can we understand perceptions of food, e.g. what is healthy?

• What is the effect of “social approval” on posting (un-)healthy photos?

Page 37: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Data Collection

• 194k food places on FourSquare

• 164k found on Instagram

• Queried from Sep’04 to Nov’04

– 21M photos, 3.3M users, 316 US counties

• Obesity and other variables

– County Health Rankings (CHR)

Page 38: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Additional Data Labeling

• Fast food or not

– Combining 4sq categories with names of chains

• Labeled #Hashtags

– Healthy, unhealthy, social, emotion

Page 39: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Fast Food Density vs. Obesity

r = .267 r = .424

Page 40: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Food, Emotions and Perceptions

Page 41: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

“Sensual” Food

[link]

Page 42: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Obesity and Hashtags

Page 43: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Obesity and Image Popularity

Page 44: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Food Category and Popularity

Page 45: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Conclusions

• Presence of fast food linked with obesity

• Though #healthy photos attract more likes than #unhealthy ones, the opposite holds for categories

– “pat on the back” for healthy

• Some (more) evidence for the social dimension of food and obesity

Page 46: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Determinants of Persistent Social Sharing of Fitness Apps in Twitter

Joint work with K. Park, M. Cha and C. Lee

Under review

Page 47: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

MyFitnessPal and Twitter

[link]

Page 48: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Research Questions

• What determines long-term fitness app usage?

• How important are social network features?

Page 49: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Data Collection

• Used a combination of Decahose and Twitter Streaming API to identify 7.5k Twitter users for #myfitnesspal

– 6 months later crawled their data

• Then subset further to English, <10k followers and long-term temporal coverage

– 3.2k users, 4.8M tweets

Page 50: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

#MyFitnessPal Tweets Examples

Page 51: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

“Persistent” vs. “Dormant”

• 2.6k persistent

• 0.5k dormant

Page 52: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Gradual “Churning”

Page 53: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Indicators of Persistence

Page 54: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Good vs. Bad Friends

Page 55: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

When a Fitness-Network Helps

Page 56: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Conclusions

• Fitness-network helps, but general feedback potentially hurts

• Early adoption linked to persistence

• Celebrity/TV interests are (again) a bad sign

• Fitness networks give biggest persistence boost to less-exercising users

Page 57: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

So What About Qatar?

• Currently collecting Instagram data for Qatar

– Twitter turned out to be too limited

• The “social” dimension will be crucial

– Food is consumed communally

– Refusing food can be offensive

• Working with medical doctors

• Developing culturally-aware interventions

Page 58: Twitter, MyFitnessPal and #FoodPorn: Using Social Media ...€¦ · Twitter, MyFitnessPal and #FoodPorn: Using Social Media for Healthy Lifestyle Tracking Ingmar Weber Qatar Computing

Come Talk to Me

• Health, Food, Mobile Sensing

– Work presented today

• Multi-Cultural Societies

– Links across languages, nationalities, ethnicities

• Polarization and Online Conflicts

– ISIS, Egypt, IL-PA

• Mobility and Smart Cities