icpsr - complex systems models in the social sciences - lecture 3 - professor daniel martin katz

51
Daniel Martin Katz Michigan State University College of Law Complex Systems Models in the Social Sciences (Lecture 3)

Upload: daniel-martin-katz

Post on 21-Jan-2015

506 views

Category:

Education


2 download

DESCRIPTION

 

TRANSCRIPT

Page 1: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Daniel Martin KatzMichigan State University

College of Law

Complex Systems Models in the Social Sciences

(Lecture 3)

Page 2: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Back to Where We Ended Our Last Class

Page 3: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Stanley Milgram’s Other Experiment

Milgram was interested in the structure of society

Including the social distance between individuals

While the term “six degrees” is often attributed to milgram it can be traced to ideas from hungarian author Frigyes Karinthy

What is the average distance between two individuals in society?

Page 4: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Stanley Milgram’s Other Experiment

NE

MA

Page 5: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Six Degrees of Separation?

NE

MA

Target person worked in Boston as a stockbroker

296 senders from Boston and Omaha.

20% of senders reached target.

Average chain length = 6.5.

And So the term ... “Six degrees of Separation”

Page 6: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Six Degrees

Six Degrees is a claim that “average path length” between two individuals in society is ~ 6

The idea of ‘Six Degrees’ Popularized through plays/movies and the kevin bacon game

http://oracleofbacon.org/

Page 7: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Six Degrees of Kevin Bacon

Page 8: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Visualization Source: Duncan J. Watts, Six Degrees

Six Degrees of Kevin Bacon

Page 9: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

But What is Wrong with Milgram’s Logic?

150(150) = 22,500

150 3 = 3,375,000

150 4 = 506,250,000

150 5= 75,937,500,000

Page 10: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

The Strength of ‘Weak’ Ties

Does Milgram get it right? (Mark Granovetter)

Visualization Source: Early Friendster – MIT Network

www.visualcomplexity.com

Strong and Weak Ties (Clustered

v. Spanning)

Clustering ---- My Friends’ Friends are also likely to be friends

Page 11: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

So Was Milgram Correct?

Small Worlds (i.e. Six Degrees) was a theoretical and an empirical Claim

The Theoretical Account Was Incorrect

The Empirical Claim was still intact

Query as to how could real social networks display both small worlds and clustering?

At the Same time, the Strength of Weak Ties was also an Theoretical and Empirical proposition

Page 12: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Watts and Strogatz (1998)

A few random links in an otherwise clustered graph yields the types of small world properties found by Milgram

“Randomness” is key bridge between the small world result and the clustering that is commonly observed in real social networks

Page 13: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Watts and Strogatz (1998)

A Small Amount of Random Rewiring or Something akin to Weak Ties—Allows for Clustering and Small Worlds

Random Graphlocally Clustered

Page 14: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Different Form of Network Representation

1 mode

2 mode

Page 15: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

2 mode

Actors and

Movies

Different Forms of Network Representation

Page 16: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

1 mode

Actor to Actor

Could be Binary (0,1)

Did they Co-Appear?

Different Forms of Network Representation

Page 17: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Different Forms of Network Representation

1 mode

Actor to Actor

Could also beWeighted

(I.E. Edge Weights by Number of

Co-Appearences)

Page 18: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Features of Networks

Mesoscopic Community StructuresWe will discuss these next week

Macroscopic Graph Level PropertiesWe will discuss these today

Microscopic Node Level Properties We will discuss these Next week

Page 19: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Macroscopic Graph Level Properties

Degree Distributions (Outdegree & Indegree)

Clustering Coefficients

Connected Components

Shortest Paths

Density

Page 20: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Shortest Paths

Shortest Paths

The shortest set of links connecting two nodes

Also, known as the geodesic path

In many graphs, there are multiple shortest paths

Page 21: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Shortest Paths

Shortest Paths

A and C are connected by 2 shortest paths

A – E – B - C

A – E – D - C

Diameter: the largest geodesic distance in the graph

The distance between A and C is the maximum for the graph: 3

Page 22: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Shortest Paths

In the Watts -Strogatz Model Shortest Paths are reduced by increasing levels of random rewiring

Page 23: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Clustering Coefficients

Clustering Coefficients

Measure of the tendency of nodes in a graph to cluster

Both a graph level average for clustering

Also, a local version which is interested in cliqueness of a graph

Page 24: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Density

Density = Of the connections that could exist between n nodes

directed graph: emax = n*(n-1)!(each of the n nodes can connect to (n-1) other nodes)

undirected graph emax = n*(n-1)/2(since edges are undirected, count each one only once)

What Fraction are Present?

Page 25: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

DensityWhat fraction are present?density = e / emax

For example, out of 12possible connections.. this graph

this graph has 7, giving it a density of 7/12 = 0.58

A “fully connected graph has a density =1

Page 26: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Connected Components

We are often interested in whether the graph has a single or multiple connected components

Strong Components

Giant Component

Weak Components

Page 27: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

“Largest Weakly Connected Component” in the SCOTUS Citation Network

There exist cases that are not in this visual as they are disconnected as of the year 1830

However, by 2009, 99% of SCOTUS Decisions are in the Largest Weakly Connected Component

Page 28: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Connected Components

Open “Giant Component” from the netlogo models Library

Page 29: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Connected Components

Notice the fraction of nodes in the

giant component

Notice the Size of the “Giant

Component”

Model has been

advanced 25+ Ticks

Page 30: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Connected Components

Model has been

advanced 80+ Ticks

Notice the fraction of nodes in the

giant component

Notice the Size of the “Giant

Component”

Page 31: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Connected Components

Model has been

advanced 120+ Ticks

Notice the fraction of nodes in the

giant component

Notice the Size of the “Giant Component”now = “num-nodes”

in the slider

Page 32: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Degree Distributions

outdegreehow many directed edges (arcs) originate at a node

indegreehow many directed edges (arcs) are incident on a node

degree (in or out)number of edges incident on a node

Indegree=3

Outdegree=2

Degree=5

Page 33: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Node Degree from

Matrix Values

Outdegree:

outdegree for node 3 = 2, which we obtain by summing the number of non-zero entries in the 3rd row

Indegree:

indegree for node 3 = 1, which we obtain by summing the number of non-zero entries in the 3rd column

Page 34: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Degree Distributions

These are Degree Count for particular nodes but we are also interested in the distribution of arcs (or edges) across all nodes

These Distributions are called “degree distributions”

Degree distribution: A frequency count of the occurrence of each degree

Page 35: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Degree Distributions

Imagine we have this 8 node network:

In-degree sequence:[2, 2, 2, 1, 1, 1, 1, 0]

Out-degree sequence:[2, 2, 2, 2, 1, 1, 1, 0]

(undirected) degree sequence:[3, 3, 3, 2, 2, 1, 1, 1]

Page 36: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Degree Distributions

Imagine we have this 8 node network:

In-degree distribution:[(2,3) (1,4) (0,1)]

Out-degree distribution:[(2,4) (1,3) (0,1)]

(undirected) distribution:[(3,3) (2,2) (1,3)]

Page 37: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Why are Degree Distributions Useful?

They are the signature of a dynamic process

We will discuss in greater detail tomorrow

Consider several canonical network models

Page 38: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Canonical Network Models

Erdős-Renyi Random Network

Highly Clustered Network

Watts-Strogatz Small World Network

Highly Clustered Highly Clustered

Barabási-Albert Preferential

Attachment Network

Page 39: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Why are Degree Distributions Useful?

Barabási-Albert Preferential

Attachment Network

Page 40: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Barabási-Albert Preferential Attachment

Netlogo Models Library --> Networks --> Preferential Attachment

Watch the Changing Degree Distribution

Page 41: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Barabási-Albert Preferential Attachment

Netlogo Models Library --> Networks --> Preferential Attachment

Page 42: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Barabási-Albert Preferential Attachment

Netlogo Models Library --> Networks --> Preferential Attachment

Page 43: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Barabási-Albert Preferential Attachment

Netlogo Models Library --> Networks --> Preferential Attachment

Page 44: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Barabási-Albert Preferential Attachment

Netlogo Models Library --> Networks --> Preferential Attachment

Page 45: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Barabási-Albert Preferential Attachment

Netlogo Models Library --> Networks --> Preferential Attachment

Page 46: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz
Page 47: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Back to the Milgram

Experiment

Page 48: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

The Milgram Experiment

How did the successful subjects actually succeed?

How did they manage to get the envelope from nebraska to boston?

this is a question regarding how individuals conduct searches in their networks

Given most individuals do not know the path to distantly linked individuals

Page 49: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Search in Networks

Most individuals do not know the path to an individual who is many hops away

Must rely on some sort of heuristic rules to determine the possible path

Page 50: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Search in Networks

What information about the problem might the individual attempt to leverage?

visual by duncan watts

dimensional data:

send it to a stockbrokersend it to closet possible city to boston

Page 51: ICPSR - Complex Systems Models in the Social Sciences - Lecture 3 - Professor Daniel Martin Katz

Follow up to the original Experiment

available at: http://research.yahoo.com/pub/2397

Published in Science in 2003