equitability and dominance in online forums: an ecological approach

76
Equitability and dominance in online forums: an ecological approach Jon Rosewell EATING, 13 th November 2008 Dept of Communications and Systems Faculty of Mathematics, Computing and Technology

Upload: katen

Post on 13-Jan-2016

26 views

Category:

Documents


0 download

DESCRIPTION

Equitability and dominance in online forums: an ecological approach. Dept of Communications and Systems Faculty of Mathematics, Computing and Technology. Jon Rosewell. EATING, 13 th November 2008. The few and the many…. Participation in forums is very variable - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Equitability and dominance in online forums: an ecological approach

Equitability and dominance in online forums:an ecological approach

Jon Rosewell

EATING, 13th November 2008

Dept of Communications and SystemsFaculty of Mathematics, Computing and Technology

Page 2: Equitability and dominance in online forums: an ecological approach

The few and the many…• Participation in forums is very variable

–a few students post many messages–many students post a few messages

Page 3: Equitability and dominance in online forums: an ecological approach

It seemed a good idea at the time…• A relatively painless way of analysing FirstClass forums• Looking at patterns of messages, not content

– quantitative, not qualitative• Postings only, not ‘readings’

Page 4: Equitability and dominance in online forums: an ecological approach

What is the point?• Analyse past forums

–make sense of what went on• Relate to structural features

–how to design the perfect forum• Dashboard approach

–monitor the health of forums

Page 5: Equitability and dominance in online forums: an ecological approach

Forums included in study• Course-based: moderated, not tutors• Large: 100-800 students• Mainly 10 pt, 10 week intensive courses• Peer support• Varying purpose: chat, discussion, help, …• Only some presentations analysed• 4 courses, 36 forums, 3000 posters, 27000 posts

Page 6: Equitability and dominance in online forums: an ecological approach

The few and the many (again)• Robin Mason: ‘Rule of thirds’

–1/3 post many, 1/3 post few, 1/3 lurk read• Or should it be:

–posters, readers, phantoms?• Or for posters:

–post many, post some, post one or two• Actually a bit more subtle…

Page 7: Equitability and dominance in online forums: an ecological approach

T180 2004J Forum

0

20

40

60

80

100

120

140

Individuals

No

of

po

sts

Page 8: Equitability and dominance in online forums: an ecological approach

All the data you want

Page 9: Equitability and dominance in online forums: an ecological approach

T180 2004E Blog Announce

0

10

20

30

40

50

60

70

80

Individuals

No

of

po

sts

Page 10: Equitability and dominance in online forums: an ecological approach

T180 2004E Cafe

0

5

10

15

20

25

30

35

40

Individuals

No

of

po

sts

Page 11: Equitability and dominance in online forums: an ecological approach

T180 2004E Forum

0

5

10

15

20

25

30

35

Individuals

No

of

po

sts

Page 12: Equitability and dominance in online forums: an ecological approach

T180 2004E IM Announce

0

1

2

3

4

5

6

Individuals

No

of

po

sts

Page 13: Equitability and dominance in online forums: an ecological approach

T180 2004E Your Questions

0

20

40

60

80

100

120

140

Individuals

No

of

po

sts

Page 14: Equitability and dominance in online forums: an ecological approach

T180 04J Blog Announce

0

10

20

30

40

50

60

70

80

90

100

Individuals

No

of

po

sts

Page 15: Equitability and dominance in online forums: an ecological approach

T180 2004J Cafe

0

20

40

60

80

100

120

Individuals

No

of

Po

sts

Page 16: Equitability and dominance in online forums: an ecological approach

T180 2004J Forum

0

20

40

60

80

100

120

140

Individuals

No

of

po

sts

Page 17: Equitability and dominance in online forums: an ecological approach

T180 2004J IM Announce

0

5

10

15

20

25

30

35

40

45

50

Individuals

No

of

po

sts

Page 18: Equitability and dominance in online forums: an ecological approach

T180 2004J Your Questions

0

10

20

30

40

50

60

70

80

Individuals

No

of

po

sts

Page 19: Equitability and dominance in online forums: an ecological approach

T184 2007E Cafe

0

2

4

6

8

10

12

Individuals

No

of

po

sts

Page 20: Equitability and dominance in online forums: an ecological approach

T184 2007E Forum

0

10

20

30

40

50

60

Individuals

No

of

po

sts

Page 21: Equitability and dominance in online forums: an ecological approach

T184 2007E Help

0

1

2

3

4

5

6

Individuals

No

of

po

sts

Page 22: Equitability and dominance in online forums: an ecological approach

T184 2007E Mindstorm

0

2

4

6

8

10

12

Individuals

No

of

po

sts

Page 23: Equitability and dominance in online forums: an ecological approach

T184 2007E Robotlab

0

2

4

6

8

10

12

Individuals

No

of

po

sts

Page 24: Equitability and dominance in online forums: an ecological approach

T184 2007J Cafe

0

1

2

3

4

5

6

7

8

Individuals

No

of

po

sts

Page 25: Equitability and dominance in online forums: an ecological approach

T184 2007J Forum

0

10

20

30

40

50

60

70

Individuals

No

of

po

sts

Page 26: Equitability and dominance in online forums: an ecological approach

T184 2007J Help

0

5

10

15

20

25

30

Individuals

No

of

po

sts

Page 27: Equitability and dominance in online forums: an ecological approach

T184 2007J Mindstorm

0

1

2

3

4

5

6

Individuals

No

of

po

sts

Page 28: Equitability and dominance in online forums: an ecological approach

T184 2007J RobotLab

0

1

2

3

4

5

6

7

8

9

Individuals

No

of

po

sts

Page 29: Equitability and dominance in online forums: an ecological approach

T189 2007E Cafe

0

50

100

150

200

250

300

350

Individuals

No

of

po

sts

Page 30: Equitability and dominance in online forums: an ecological approach

T189 2007E Blue Digital Photography

0

20

40

60

80

100

120

140

160

Individuals

No

of

po

sts

Page 31: Equitability and dominance in online forums: an ecological approach

T189 2007E Blue Elements Forum

0

20

40

60

80

100

120

140

Individuals

No

of

po

sts

Page 32: Equitability and dominance in online forums: an ecological approach

T189 2007 Blue Feedback

0

10

20

30

40

50

60

70

80

Individuals

No

of

po

sts

Page 33: Equitability and dominance in online forums: an ecological approach

T189 2007E Blue Study Queries

0

50

100

150

200

250

300

Individuals

No

of

po

sts

Page 34: Equitability and dominance in online forums: an ecological approach

T189 2007E Red Cafe

0

20

40

60

80

100

120

140

160

180

200

Individual

No

of

po

sts

Page 35: Equitability and dominance in online forums: an ecological approach

T189 2007E Red Digital Photography

0

20

40

60

80

100

120

140

160

Individuals

No

of

po

sts

Page 36: Equitability and dominance in online forums: an ecological approach

T189 2007E Red Elements Forum

0

50

100

150

200

250

300

Individuals

No

of

po

sts

Page 37: Equitability and dominance in online forums: an ecological approach

T189 2007E Red Feedback

0

10

20

30

40

50

60

70

80

90

100

Individuals

No

of

po

sts

Page 38: Equitability and dominance in online forums: an ecological approach

T189 2007E Red Study Queries

0

50

100

150

200

250

300

Individuals

No

of

po

sts

Page 39: Equitability and dominance in online forums: an ecological approach

T224 2007 Block 1

0

10

20

30

40

50

60

70

80

90

Individuals

No

of

po

sts

Page 40: Equitability and dominance in online forums: an ecological approach

T224 2007 Block 2

0

20

40

60

80

100

120

140

160

180

Individuals

No

of

po

sts

Page 41: Equitability and dominance in online forums: an ecological approach

T224 2007 Block 3

0

20

40

60

80

100

120

Individuals

No

of

po

sts

Page 42: Equitability and dominance in online forums: an ecological approach

T224 2007 Block 4

0

10

20

30

40

50

60

Individuals

No

of

po

sts

Page 43: Equitability and dominance in online forums: an ecological approach

T224 2007 Block 5

0

10

20

30

40

50

60

70

80

90

Individuals

No

of

po

sts

Page 44: Equitability and dominance in online forums: an ecological approach

T224 2007 Chat

0

10

20

30

40

50

60

70

80

90

100

Individuals

No

of

po

sts

Page 45: Equitability and dominance in online forums: an ecological approach

Do you want to see it again?

Page 46: Equitability and dominance in online forums: an ecological approach

T189 2007E Red Elements Forum

0

50

100

150

200

250

300

Individuals

No

of

po

sts

T189 2007E Red Feedback

0

10

20

30

40

50

60

70

80

90

100

Individuals

No

of

po

sts

Do patterns vary?

Page 47: Equitability and dominance in online forums: an ecological approach

Ecological analogy• Communities often composed of dominant species plus

a long tail of rare species

• Biodiversity–a statistic of academic and practical interest

Page 48: Equitability and dominance in online forums: an ecological approach

Diversity indices• How to measure diversity?

–simple species count risky because of long tail–dominance should count against diversity

• Diversity indices try to capture both:–richness (species count)–equitability (relative abundance of species)

Page 49: Equitability and dominance in online forums: an ecological approach

Shannon’s index

where:

S total number of species (participants)

pi proportion of ith species (proportion of total postings)

S

iii ppH

1

ln

Page 50: Equitability and dominance in online forums: an ecological approach

Ecological stories

Geometric model

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

0 10 20 30 40 50

Rank

Pro

po

rtio

n 0.9

0.8

0.5

0.2

Geometric model

0.00001

0.0001

0.001

0.01

0.1

1

0 10 20 30 40 50

Rank

Pro

po

rtio

n 0.9

0.8

0.5

0.2

Page 51: Equitability and dominance in online forums: an ecological approach

From May (1975) Patterns of species abundance and diversity, pp 81-120 in Cody & Diamond Ecology and Evolution of Communities, Harvard University Press

Page 52: Equitability and dominance in online forums: an ecological approach

Shorrocks Genesis of Diversity after Lack (1947) Darwin’s Finches

Pianka (1981) ‘Competition and niche theory’ in May Theoretical Ecology

Page 53: Equitability and dominance in online forums: an ecological approach

From Whittaker (1972) Evolution and Measurement of Species Diversity, Taxon, 21, pp. 213-251

Page 54: Equitability and dominance in online forums: an ecological approach

T189 2007E Blue

0.0001

0.001

0.01

0.1

1

0 50 100 150 200 250

Rank

Pro

po

rtio

n

Café

Digital photography

Elements forum

Feedback

Study queries

Page 55: Equitability and dominance in online forums: an ecological approach

Mark Newman Power laws, Pareto distributions and Zipf’s lawContemporary Physics, 46, 323-351http://www-personal.umich.edu/~mejn/courses/2006/cmplxsys899/powerlaws.pdf

Page 56: Equitability and dominance in online forums: an ecological approach

T189 2007E Blue

0.0001

0.001

0.01

0.1

1

1 10 100 1000

Rank

Pro

po

rtio

n

Café

Digital photography

Elements forum

Feedback

Study queries

Page 57: Equitability and dominance in online forums: an ecological approach

State of play• No simple underlying model

– Not geometric: not straight on log-linear plot– Not broken stick or log-normal: not sigmoid– Not power law: not straight on log-log plot

• So use diversity index as summary

Page 58: Equitability and dominance in online forums: an ecological approach

Diversity Indices

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

5

0 50 100 150 200 250 300

Richness S

Sh

ann

on

H

S

iii ppH

1

ln

Page 59: Equitability and dominance in online forums: an ecological approach

Diversity Indices

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 50 100 150 200 250 300

Richness S

Eq

uit

abili

ty

Page 60: Equitability and dominance in online forums: an ecological approach

Diversity indices

0

5

10

15

20

25

30

35

40

45

50

2 2.5 3 3.5 4 4.5 5

Shannon H

Sim

pso

n 1

/D

Page 61: Equitability and dominance in online forums: an ecological approach

All conferences

y = 10.813x - 126.04R2 = 0.9225

-500

0

500

1000

1500

2000

2500

3000

3500

0 50 100 150 200 250 300

No. of posters

No

. of

po

sts

Page 62: Equitability and dominance in online forums: an ecological approach

All conferences

y = 0.0853x + 17.18R2 = 0.9225

0

50

100

150

200

250

300

0 500 1000 1500 2000 2500 3000 3500

No. of posts

No

. of

po

ster

s

Page 63: Equitability and dominance in online forums: an ecological approach

T189 2007E Blue

0.0001

0.001

0.01

0.1

1

0 50 100 150 200 250

Rank

Pro

po

rtio

n

Café

Digital photography

Elements forum

Feedback

Study queries

Page 64: Equitability and dominance in online forums: an ecological approach

All conferences

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 500 1000 1500 2000 2500 3000 3500

No. of posts

"Geo

met

ric"

rat

io

Page 65: Equitability and dominance in online forums: an ecological approach

All conferences

0

50

100

150

200

250

300

350

0 500 1000 1500 2000 2500 3000 3500

No. of posts

Do

min

ant

ind

ivid

ual

's c

on

trib

uti

on

Page 66: Equitability and dominance in online forums: an ecological approach

All conferences

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0 500 1000 1500 2000 2500 3000 3500

No. of posts

Do

min

ant

ind

ivid

ual

's c

on

trib

uti

on

Page 67: Equitability and dominance in online forums: an ecological approach

Other possible analyses• Thread lengths• Starters & finishers• Groups• Readers• etc…

Page 68: Equitability and dominance in online forums: an ecological approach

Is it useful?• At least in subset here, patterns of participation seem remarkably

consistent, so:– doesn’t seem to tell us much about existing forums– no clues as to what to do differently next time

• Dashboard not likely to be much help– although simple measures might (rate of posting…)

• Moderators– offer quicker route into feel of conference– can intervene more rapidly– skilled moderation more useful than statistics!

Page 69: Equitability and dominance in online forums: an ecological approach

www.open.ac.uk

Jon RosewellThe Open UniversityWalton HallMilton KeynesMK7 6AA

[email protected]

Page 70: Equitability and dominance in online forums: an ecological approach

All courses

y = 2.1055x + 7.8001R2 = 0.5012

0

500

1000

1500

2000

2500

3000

3500

0 100 200 300 400 500 600 700 800 900

Registered students

No

of

po

sts

Page 71: Equitability and dominance in online forums: an ecological approach

All courses

y = 0.208x + 7.5689R2 = 0.6198

0

50

100

150

200

250

300

0 100 200 300 400 500 600 700 800 900

Registered s tudents

No

of

po

sts

Page 72: Equitability and dominance in online forums: an ecological approach

Messages / week

0

200

400

600

800

1000

1200

1 2 3 4 5 6 7

T180

T184

T189 Group 1

T189 Group 2

T224

Page 73: Equitability and dominance in online forums: an ecological approach

M essages / student

0.00

5.00

10.00

15.00

20.00

25.00

30.00

1 2 3 4 5 6 7

T180

T184

T189 Group 1

T189 Group 2

T224

Page 74: Equitability and dominance in online forums: an ecological approach

The fruitees

Page 75: Equitability and dominance in online forums: an ecological approach

The fruitees – how many readers

0 2000 4000 6000 8000 10000 12000 14000 16000 18000 20000

Page 76: Equitability and dominance in online forums: an ecological approach