university of california at santa barbara christo wilson, bryce boe, alessandra sala, krishna p. n....
TRANSCRIPT
University of California at Santa Barbara
Christo Wilson, Bryce Boe, Alessandra Sala, Krishna P. N. Puttaswamy, and Ben Zhao
Social Networks
4/2/2009University of California at Santa Barbara 2
Social Applications
4/2/2009University of California at Santa Barbara
Enables new ways to solve problems for distributed systems Social web search Social bookmarking Social marketplaces Collaborative spam filtering (RE: Reliable
Email) How popular are social applications?
Facebook Platform – 50,000 applications Popular ones have >10 million users
each3
4/2/2009
Social Graphs and User Interactions Social applications rely on
1. Social graph topology2. User interactions
Currently, social applications evaluated just using social graph Assume all social links are equally
important/interactive Is this true in reality? Milgram’s familiar stranger Connections for ‘status’ rather than ‘friendship’
Incorrect assumptions lead to faulty application design and evaluation
University of California at Santa Barbara 4
Goals
4/2/2009University of California at Santa Barbara 5
Question: Are social links valid indicators of real user interaction? First large scale study of Facebook
10 million users (15% of total users) / 24 million interactions
Use data to show highly skewed distribution of interactions <1% of people on Facebook talk to >50% of their friends
Propose new model for social graphs that includes interaction information Interaction Graph Reevaluate existing social application using new
model In some cases, break entirely
• Characterizing Facebook• Analyzing User Interactions• Interaction Graphs• Effects on Social Applications
Outline
4/2/2009University of California at Santa Barbara 6
Crawling Facebook for Data
4/2/2009University of California at Santa Barbara 7
Facebook is the most popular social network Crawling social networks is difficult
Too large to crawl completely, must be sampled Privacy settings may prevent crawling
Thankfully, Facebook is divided into ‘networks’ Represent geographic regions, schools,
companies Regional networks are not authenticated
Crawling for Data, cont.
Crawled Facebook regional networks 22 largest networks: London, Australia, New York, etc Timeframe: March – May 2008 Start with 50 random ‘seed’ users, perform BFS search
Data recorded for each user: Friends list History of wall posts and photo comments
Collectively referred to as interactions Most popular publicly accessible Facebook
applications
4/2/2009University of California at Santa Barbara 8
Facebook Orkut1
Number of Users Crawled 10,697,000 1,846,000
Percentage of Total Users 15% 26.9%
Number of Social Links Crawled
408,265,000 22,613,000
Radius 9.8 6
Diameter 13.4 9
Average Path Length 4.8 4.25
Clustering Coefficient 0.164 0.171
Power-law Coefficient α=1.5, D=0.55
α=1.5, D=0.6
High Level Graph Statistics
4/2/2009University of California at Santa Barbara 9
1. A. Mislove, M. Marcon, K. P. Gummadi, P. Druschel, and B. Bhattacharjee. Measurement and analysis of online social networks. In Proc. of IMC, October 2007.
•Based on Facebook’s total size of 66 million users in early 2008
•Represents ~50% of all users in the crawled regions
•~49% of links were crawlable
•This provides a lower bound on the average number of in-network friends
•Avg. social degree = ~77
•Low average path length and high clustering coefficient indicate Facebook is small-world
• Characterizing Facebook• Analyzing User Interactions• Interaction Graphs• Effects on Social Applications
Outline
4/2/2009University of California at Santa Barbara 10
Analyzing User Interactions
Having established that Facebook has the expected social graph properties…
Question: Are social links valid indicators of real user interaction?
Examine distribution of interactions among friends
4/2/2009University of California at Santa Barbara 11
Distribution Among Friends
4/2/2009University of California at Santa Barbara 12
For 50% of users, 70% of interaction comes from 7% of
friends.
Almost nobody interacts with more than 50% of their friends!
For 50% of users, 100% of interaction comes from 20% of
friends.
•Social degree does not accurately predict human behavior
•Initial Question: Are social links valid indicators of real user interaction?
Answer: NO
•Social degree does not accurately predict human behavior
•Initial Question: Are social links valid indicators of real user interaction?
Answer: NO
• Characterizing Facebook• Analyzing User Interactions• Interaction Graphs• Effects on Social Applications
Outline
4/2/2009University of California at Santa Barbara 13
A Better Model of Social Graphs
4/2/2009University of California at Santa Barbara 14
Answer to our initial question: Not all social links are created equal Implication: can not be used to evaluate
social applications What is the right way to model social
networks? More accurately approximate reality by
taking user interactivity into account Interaction Graphs
Chun et. al. IMC 2008
Interaction Graphs
Definition: a social graph parameterized by… n : minimum number of interactions per
edge t : some window of time for interactions
n = 1 and t = {2004 to the present}
4/2/2009University of California at Santa Barbara 15
Social vs. Interaction Degree
4/2/2009University of California at Santa Barbara 16
1:1 Degree Ratio
Dunbar’s Number (150)
99% of Facebook Users
•Interaction graph prunes useless edges
•Results agree with theoretical limits on human social cognition
•Interaction graph prunes useless edges
•Results agree with theoretical limits on human social cognition
Interaction Graph Analysis
4/2/2009University of California at Santa Barbara 17
Do Interaction Graphs maintain expected social network graph properties?
Social Graph Interaction Graph
Number of Vertices 10,697,000 8,403,000
Number of Edges 408,265,000 94,665,000
Radius 9.8 12.4
Diameter 13.4 19.8
Average Path Length 4.8 7.3
Clustering Coefficient 0.164 0.078
Power-law Coefficient α=1.5, D=0.55 α=1.5, D=0.24
•Interaction Graphs still have
Power-law scaling
Scale-free behavior
Small-world clustering
•… But, exhibit less of these characteristics than the full social network
•Interaction Graphs still have
Power-law scaling
Scale-free behavior
Small-world clustering
•… But, exhibit less of these characteristics than the full social network
• Characterizing Facebook• Analyzing User Interactions• Interaction Graphs• Effects on Social
Applications
Outline
4/2/2009University of California at Santa Barbara 18
Social Applications, Revisited
4/2/2009University of California at Santa Barbara 19
Recap: Need a better model to evaluate social
applications Interaction Graphs augment social graphs
with interaction information How do these changes effect social
applications? Sybilguard Analysis of Reliable Email in the paper
Sybilguard
4/2/2009University of California at Santa Barbara 20
Sybilguard is a system for detecting Sybil nodes in social graphs
Why do we care about detecting Sybils? Social network based games:
Social marketplaces:
How Sybilguard works Key insight: few edges between Sybils and
legitimate users (attack edges) Use persistent routing tables and random walks
to detect attack edges
Sybilguard Algorithm
4/2/2009University of California at Santa Barbara 21
Step 1:
Bootstrap the network.
All users exchange signed keys.
Key exchange implies that both parties are human and trustworthy.
Step 2:
Choose a verifier (A) and a suspect (B).
A and B send out random walks of a certain length (2).
Look for intersections.
A knows B is not a Sybil because multiple paths intersect and they do so at different nodes.
A
B
Sybilguard Algorithm, cont.
4/2/2009University of California at Santa Barbara 22
A
B
Sybilguard Caveats
4/2/2009University of California at Santa Barbara 23
Bootstrapping requires human interaction Evaluating Sybilguard on the social graph is
overly optimistic because most friends never interact!
Better to evaluate using Interaction Graphs
Expected Impact
4/2/2009University of California at Santa Barbara 24
Fewer of edges, lower clustering lead to reduced performance
Why? Self-loops
A
B
Sybilguard on Interaction Graphs
4/2/2009University of California at Santa Barbara 25
•When evaluated under real world conditions, performance of social applications changes dramatically
•When evaluated under real world conditions, performance of social applications changes dramatically
Conclusion
4/2/2009University of California at Santa Barbara 26
First large scale analysis of Facebook Answer the question: Are social links
valid indicators of real user interaction? Formulate new model of social networks:
Interaction Graphs Demonstrate the effect of Interaction
Graphs on social applications Final takeaway: when building social
applications, use interaction graphs!
Anonymized Facebook data (social graphs and interaction graphs) will be available for download soon at the Current Lab website!
http://current.cs.ucsb.edu/facebook
Questions?
4/2/2009 27University of California at Santa Barbara
4/2/2009
Social Networks
Social Networks are popular platforms for interaction, communication and collaboration > 110 million users
9th most trafficked site on the Internet
> 170 million users #1 photo sharing site 4th most trafficked site on the Internet 114% user growth in 2008
> 800 thousand users 1,689% user growth in 2008
University of California at Santa Barbara 28
Facebook Orkut1
Number of Users Crawled 10,697,000 1,846,000
Percentage of Total Users 15% 26.9%
Number of Social Links Crawled
408,265,000 22,613,000
Radius 9.8 6
Diameter 13.4 9
Average Path Length 4.8 4.25
Clustering Coefficient 0.164 0.171
Power-law Coefficient α=1.5, D=0.55
α=1.5, D=0.6
High Level Graph Statistics
4/2/2009University of California at Santa Barbara 29
1. A. Mislove, M. Marcon, K. P. Gummadi, P. Druschel, and B. Bhattacharjee. Measurement and analysis of online social networks. In Proc. of IMC, October 2007.
•Based on Facebook’s total size of 66 million users in early 2008
•Represents ~50% of all users in the crawled regions
•~49% of links were crawlable
•This provides a lower bound on the average number of in-network friends
•Avg. social degree = ~77
•Clustering Coefficient measures strength of local cliques
•Measured between zero (random graphs) and one (complete connectivity)
•Social networks display power law degree distribution
•Alpha is the curve of the power law
•D is the fitting error
Social Degree CDF
4/2/2009University of California at Santa Barbara 30
Nodes vs. Total Interactions
4/2/2009University of California at Santa Barbara 31
Top 10% of most well connected users are
responsible for 60% of total interactions
Top 10% of most interactive users are responsible for 85%
of total interactions•Social degree does not accurately predict human behavior
•Interactions are highly skewed towards a small percent of the Facebook population
•Social degree does not accurately predict human behavior
•Interactions are highly skewed towards a small percent of the Facebook population