equitability and dominance in online forums: an ecological approach
DESCRIPTION
Equitability and dominance in online forums: an ecological approach. Dept of Communications and Systems Faculty of Mathematics, Computing and Technology. Jon Rosewell. EATING, 13 th November 2008. The few and the many…. Participation in forums is very variable - PowerPoint PPT PresentationTRANSCRIPT
Equitability and dominance in online forums:an ecological approach
Jon Rosewell
EATING, 13th November 2008
Dept of Communications and SystemsFaculty of Mathematics, Computing and Technology
The few and the many…• Participation in forums is very variable
–a few students post many messages–many students post a few messages
It seemed a good idea at the time…• A relatively painless way of analysing FirstClass forums• Looking at patterns of messages, not content
– quantitative, not qualitative• Postings only, not ‘readings’
What is the point?• Analyse past forums
–make sense of what went on• Relate to structural features
–how to design the perfect forum• Dashboard approach
–monitor the health of forums
Forums included in study• Course-based: moderated, not tutors• Large: 100-800 students• Mainly 10 pt, 10 week intensive courses• Peer support• Varying purpose: chat, discussion, help, …• Only some presentations analysed• 4 courses, 36 forums, 3000 posters, 27000 posts
The few and the many (again)• Robin Mason: ‘Rule of thirds’
–1/3 post many, 1/3 post few, 1/3 lurk read• Or should it be:
–posters, readers, phantoms?• Or for posters:
–post many, post some, post one or two• Actually a bit more subtle…
T180 2004J Forum
0
20
40
60
80
100
120
140
Individuals
No
of
po
sts
All the data you want
T180 2004E Blog Announce
0
10
20
30
40
50
60
70
80
Individuals
No
of
po
sts
T180 2004E Cafe
0
5
10
15
20
25
30
35
40
Individuals
No
of
po
sts
T180 2004E Forum
0
5
10
15
20
25
30
35
Individuals
No
of
po
sts
T180 2004E IM Announce
0
1
2
3
4
5
6
Individuals
No
of
po
sts
T180 2004E Your Questions
0
20
40
60
80
100
120
140
Individuals
No
of
po
sts
T180 04J Blog Announce
0
10
20
30
40
50
60
70
80
90
100
Individuals
No
of
po
sts
T180 2004J Cafe
0
20
40
60
80
100
120
Individuals
No
of
Po
sts
T180 2004J Forum
0
20
40
60
80
100
120
140
Individuals
No
of
po
sts
T180 2004J IM Announce
0
5
10
15
20
25
30
35
40
45
50
Individuals
No
of
po
sts
T180 2004J Your Questions
0
10
20
30
40
50
60
70
80
Individuals
No
of
po
sts
T184 2007E Cafe
0
2
4
6
8
10
12
Individuals
No
of
po
sts
T184 2007E Forum
0
10
20
30
40
50
60
Individuals
No
of
po
sts
T184 2007E Help
0
1
2
3
4
5
6
Individuals
No
of
po
sts
T184 2007E Mindstorm
0
2
4
6
8
10
12
Individuals
No
of
po
sts
T184 2007E Robotlab
0
2
4
6
8
10
12
Individuals
No
of
po
sts
T184 2007J Cafe
0
1
2
3
4
5
6
7
8
Individuals
No
of
po
sts
T184 2007J Forum
0
10
20
30
40
50
60
70
Individuals
No
of
po
sts
T184 2007J Help
0
5
10
15
20
25
30
Individuals
No
of
po
sts
T184 2007J Mindstorm
0
1
2
3
4
5
6
Individuals
No
of
po
sts
T184 2007J RobotLab
0
1
2
3
4
5
6
7
8
9
Individuals
No
of
po
sts
T189 2007E Cafe
0
50
100
150
200
250
300
350
Individuals
No
of
po
sts
T189 2007E Blue Digital Photography
0
20
40
60
80
100
120
140
160
Individuals
No
of
po
sts
T189 2007E Blue Elements Forum
0
20
40
60
80
100
120
140
Individuals
No
of
po
sts
T189 2007 Blue Feedback
0
10
20
30
40
50
60
70
80
Individuals
No
of
po
sts
T189 2007E Blue Study Queries
0
50
100
150
200
250
300
Individuals
No
of
po
sts
T189 2007E Red Cafe
0
20
40
60
80
100
120
140
160
180
200
Individual
No
of
po
sts
T189 2007E Red Digital Photography
0
20
40
60
80
100
120
140
160
Individuals
No
of
po
sts
T189 2007E Red Elements Forum
0
50
100
150
200
250
300
Individuals
No
of
po
sts
T189 2007E Red Feedback
0
10
20
30
40
50
60
70
80
90
100
Individuals
No
of
po
sts
T189 2007E Red Study Queries
0
50
100
150
200
250
300
Individuals
No
of
po
sts
T224 2007 Block 1
0
10
20
30
40
50
60
70
80
90
Individuals
No
of
po
sts
T224 2007 Block 2
0
20
40
60
80
100
120
140
160
180
Individuals
No
of
po
sts
T224 2007 Block 3
0
20
40
60
80
100
120
Individuals
No
of
po
sts
T224 2007 Block 4
0
10
20
30
40
50
60
Individuals
No
of
po
sts
T224 2007 Block 5
0
10
20
30
40
50
60
70
80
90
Individuals
No
of
po
sts
T224 2007 Chat
0
10
20
30
40
50
60
70
80
90
100
Individuals
No
of
po
sts
Do you want to see it again?
T189 2007E Red Elements Forum
0
50
100
150
200
250
300
Individuals
No
of
po
sts
T189 2007E Red Feedback
0
10
20
30
40
50
60
70
80
90
100
Individuals
No
of
po
sts
Do patterns vary?
Ecological analogy• Communities often composed of dominant species plus
a long tail of rare species
• Biodiversity–a statistic of academic and practical interest
Diversity indices• How to measure diversity?
–simple species count risky because of long tail–dominance should count against diversity
• Diversity indices try to capture both:–richness (species count)–equitability (relative abundance of species)
Shannon’s index
where:
S total number of species (participants)
pi proportion of ith species (proportion of total postings)
S
iii ppH
1
ln
Ecological stories
Geometric model
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 10 20 30 40 50
Rank
Pro
po
rtio
n 0.9
0.8
0.5
0.2
Geometric model
0.00001
0.0001
0.001
0.01
0.1
1
0 10 20 30 40 50
Rank
Pro
po
rtio
n 0.9
0.8
0.5
0.2
From May (1975) Patterns of species abundance and diversity, pp 81-120 in Cody & Diamond Ecology and Evolution of Communities, Harvard University Press
Shorrocks Genesis of Diversity after Lack (1947) Darwin’s Finches
Pianka (1981) ‘Competition and niche theory’ in May Theoretical Ecology
From Whittaker (1972) Evolution and Measurement of Species Diversity, Taxon, 21, pp. 213-251
T189 2007E Blue
0.0001
0.001
0.01
0.1
1
0 50 100 150 200 250
Rank
Pro
po
rtio
n
Café
Digital photography
Elements forum
Feedback
Study queries
Mark Newman Power laws, Pareto distributions and Zipf’s lawContemporary Physics, 46, 323-351http://www-personal.umich.edu/~mejn/courses/2006/cmplxsys899/powerlaws.pdf
T189 2007E Blue
0.0001
0.001
0.01
0.1
1
1 10 100 1000
Rank
Pro
po
rtio
n
Café
Digital photography
Elements forum
Feedback
Study queries
State of play• No simple underlying model
– Not geometric: not straight on log-linear plot– Not broken stick or log-normal: not sigmoid– Not power law: not straight on log-log plot
• So use diversity index as summary
Diversity Indices
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
5
0 50 100 150 200 250 300
Richness S
Sh
ann
on
H
S
iii ppH
1
ln
Diversity Indices
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0 50 100 150 200 250 300
Richness S
Eq
uit
abili
ty
Diversity indices
0
5
10
15
20
25
30
35
40
45
50
2 2.5 3 3.5 4 4.5 5
Shannon H
Sim
pso
n 1
/D
All conferences
y = 10.813x - 126.04R2 = 0.9225
-500
0
500
1000
1500
2000
2500
3000
3500
0 50 100 150 200 250 300
No. of posters
No
. of
po
sts
All conferences
y = 0.0853x + 17.18R2 = 0.9225
0
50
100
150
200
250
300
0 500 1000 1500 2000 2500 3000 3500
No. of posts
No
. of
po
ster
s
T189 2007E Blue
0.0001
0.001
0.01
0.1
1
0 50 100 150 200 250
Rank
Pro
po
rtio
n
Café
Digital photography
Elements forum
Feedback
Study queries
All conferences
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0 500 1000 1500 2000 2500 3000 3500
No. of posts
"Geo
met
ric"
rat
io
All conferences
0
50
100
150
200
250
300
350
0 500 1000 1500 2000 2500 3000 3500
No. of posts
Do
min
ant
ind
ivid
ual
's c
on
trib
uti
on
All conferences
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0 500 1000 1500 2000 2500 3000 3500
No. of posts
Do
min
ant
ind
ivid
ual
's c
on
trib
uti
on
Other possible analyses• Thread lengths• Starters & finishers• Groups• Readers• etc…
Is it useful?• At least in subset here, patterns of participation seem remarkably
consistent, so:– doesn’t seem to tell us much about existing forums– no clues as to what to do differently next time
• Dashboard not likely to be much help– although simple measures might (rate of posting…)
• Moderators– offer quicker route into feel of conference– can intervene more rapidly– skilled moderation more useful than statistics!
www.open.ac.uk
Jon RosewellThe Open UniversityWalton HallMilton KeynesMK7 6AA
All courses
y = 2.1055x + 7.8001R2 = 0.5012
0
500
1000
1500
2000
2500
3000
3500
0 100 200 300 400 500 600 700 800 900
Registered students
No
of
po
sts
All courses
y = 0.208x + 7.5689R2 = 0.6198
0
50
100
150
200
250
300
0 100 200 300 400 500 600 700 800 900
Registered s tudents
No
of
po
sts
Messages / week
0
200
400
600
800
1000
1200
1 2 3 4 5 6 7
T180
T184
T189 Group 1
T189 Group 2
T224
M essages / student
0.00
5.00
10.00
15.00
20.00
25.00
30.00
1 2 3 4 5 6 7
T180
T184
T189 Group 1
T189 Group 2
T224
The fruitees
The fruitees – how many readers
0 2000 4000 6000 8000 10000 12000 14000 16000 18000 20000