Download - Provocations for CLA Dashboard
![Page 1: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/1.jpg)
Making social learning visible: some provocations for Connected Learning Analytics dashboard concepts
Simon Buckingham Shum Professor of Learning Informatics Director, Connected Intelligence Centre @sbuckshum
cic.uts.edu.au
![Page 2: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/2.jpg)
To nurture skillful social learners (prev talk)…
…invisible + ephemeral social processes need to be made visible + persistent
…for which we need analytics to aggregate + visualise data meaningfully
as proxies for social + personal learning 2
![Page 3: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/3.jpg)
Bridging the data—meaning gulf
3
logs of user actions (xAPI triples)
meaningful, timely representations
how students and educators think about learning (not necessarily the same thing)
![Page 4: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/4.jpg)
Bridging the data—meaning gulf
4
logs of user actions (xAPI triples)
meaningful, timely representations
how students and educators think about learning (not necessarily the same thing)
sensem
aking
ac+o
n/interven
+on
![Page 5: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/5.jpg)
Bridging the data—meaning gulf
5 logs of user actions (xAPI triples)
meaningful, timely representations
how students and educators think about learning (not necessarily the same thing)
Bloo
m’s ta
xono
my, etc
Ope
ra&o
n ... W
ayfin
ding … Sen
semaking … Inno
va&o
n
![Page 6: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/6.jpg)
All of the following are possible in closed learning platforms
‘Technically straightforward’ to apply to an xAPI LRS?
But which are of most interest? 6
![Page 7: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/7.jpg)
textchat + videoconf replay + analytics
7
![Page 8: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/8.jpg)
FlashMeeting (Open University’s Knowledge Media Institute)
8 http://flashmeeting.open.ac.uk
![Page 9: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/9.jpg)
FlashMeeting (Open University’s Knowledge Media Institute)
9 http://flashmeeting.open.ac.uk
![Page 10: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/10.jpg)
social network analytics
10
![Page 11: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/11.jpg)
Learning Technology
KMi, OU
AI & Argumenta&on
Learning Disposi&ons
Human-‐Centred Informa&cs
Learning Analy&cs
Seman&c Scien&fic Publishing
Dialogue / Issue / Argument Mapping
Social learning analytics — quantifying “professional identity”
![Page 12: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/12.jpg)
Schreurs B, Teplovs C, Ferguson R, De Laat M and Buckingham Shum S. (2013) Visualizing Social Learning Ties by Type and Topic: Rationale and Concept Demonstrator. Proc. 3rd International Conference on Learning Analytics & Knowledge. Leuven, BE: ACM, 33-37. Open Access Eprint: http://oro.open.ac.uk/36891
Adding topic and type of social tie to filter SN
![Page 13: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/13.jpg)
Adding topic and type of social tie to filter SN
Schreurs B, Teplovs C, Ferguson R, De Laat M and Buckingham Shum S. (2013) Visualizing Social Learning Ties by Type and Topic: Rationale and Concept Demonstrator. Proc. 3rd International Conference on Learning Analytics & Knowledge. Leuven, BE: ACM, 33-37. Open Access Eprint: http://oro.open.ac.uk/36891
![Page 14: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/14.jpg)
discourse analytics
14
![Page 15: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/15.jpg)
analytics that look beneath the surface, and quantify linguistic proxies for ‘deeper learning’
Beyond number / size / frequency of posts; ‘hottest thread’
http://ww
w.glennsasscer.com
/wordpress/w
p-content/uploads/2011/10/iceberg.jpg
![Page 16: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/16.jpg)
Discourse analytics on webinar textchat
Ferguson, R. and Buckingham Shum, S., Learning analytics to identify exploratory dialogue within synchronous text chat. In: 1st International Conference on Learning Analytics and Knowledge (Banff, Canada, 2011). ACM
Can we spot the quality learning conversations in a 2.5 hr webinar?
![Page 17: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/17.jpg)
-60
-40
-20
0
20
40
60
80
9:2
8 9
:32
9:3
6
9:4
0
9:4
1
9:4
6
9:5
0
9:5
3
9:5
6
10:
00
10:
05
10:
07
10:
07
10:
09
10:
13
10:
17
10:
23
10:
27
10:
31
10:
35
10:
40
10:
45
10:
52
10:
55
11:
04
11:
08
11:
11
11:
17
11:
20
11:
24
11:
26
11:
28
11:
31
11:
32
11:
35
11:
36
11:
38
11:
39
11:
41
11:
44
11:
46
11:
48
11:
52
11:
54
12:
00
12:
03
12:
04
12:
05
Average Exploratory
Discourse analytics on webinar textchat
Sheffield, UK not as sunny as yesterday - still warm
Greetings from Hong Kong
Morning from Wiltshire, sunny here!
See you!
bye for now!
bye, and thank you
Bye all for now
Given a 2.5 hour webinar, where in the live textchat were the most effective learning conversations? Not at the start and end of a webinar…
Ferguson, R., Wei, Z., He, Y. and Buckingham Shum, S., An Evaluation of Learning Analytics to Identify Exploratory Dialogue in Online Discussions. In: Proc. 3rd International Conference on Learning Analytics & Knowledge (Leuven, BE, 8-12 April, 2013). ACM. http://oro.open.ac.uk/36664
![Page 18: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/18.jpg)
-60
-40
-20
0
20
40
60
80
9:2
8 9
:32
9:3
6
9:4
0
9:4
1
9:4
6
9:5
0
9:5
3
9:5
6
10:
00
10:
05
10:
07
10:
07
10:
09
10:
13
10:
17
10:
23
10:
27
10:
31
10:
35
10:
40
10:
45
10:
52
10:
55
11:
04
11:
08
11:
11
11:
17
11:
20
11:
24
11:
26
11:
28
11:
31
11:
32
11:
35
11:
36
11:
38
11:
39
11:
41
11:
44
11:
46
11:
48
11:
52
11:
54
12:
00
12:
03
12:
04
12:
05
Average Exploratory
Discourse analytics on webinar textchat
Given a 2.5 hour webinar, where in the live textchat were the most effective learning conversations? Not at the start and end of a webinar but if we zoom in on a peak…
Ferguson, R., Wei, Z., He, Y. and Buckingham Shum, S., An Evaluation of Learning Analytics to Identify Exploratory Dialogue in Online Discussions. In: Proc. 3rd International Conference on Learning Analytics & Knowledge (Leuven, BE, 8-12 April, 2013). ACM. http://oro.open.ac.uk/36664
![Page 19: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/19.jpg)
Discourse analytics on webinar textchat
-100
0
100
9:2
8 9
:40
9
:50
1
0:00
1
0:07
1
0:17
1
0:31
1
0:45
1
1:04
1
1:17
1
1:26
1
1:32
1
1:38
1
1:44
1
1:52
1
2:03
Averag
Classified as “exploratory
talk”
(more substantive for learning)
“non-exploratory”
Given a 2.5 hour webinar, where in the live textchat were the most effective learning conversations? Not at the start and end of a webinar but if we zoom in on a peak…
Ferguson, R., Wei, Z., He, Y. and Buckingham Shum, S., An Evaluation of Learning Analytics to Identify Exploratory Dialogue in Online Discussions. In: Proc. 3rd International Conference on Learning Analytics & Knowledge (Leuven, BE, 8-12 April, 2013). ACM. http://oro.open.ac.uk/36664
![Page 20: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/20.jpg)
writing analytics
20
![Page 21: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/21.jpg)
Visualizations of writing cohesion
21 Whitelock, D., D. Field, J. T. E. Richardson, N. V. Labeke and S. Pulman (2014). Designing and Testing Visual Representations of Draft Essays for Higher Education Students. 2nd International Workshop on Discourse-Centric Learning Analytics, Fourth International Conference on Learning Analytics and Knowledge, Indianapolis, Indiana, USA. https://dcla14.files.wordpress.com/2014/03/dcla14_whitelock_etal.pdf
![Page 22: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/22.jpg)
Rhetorical functions of metadiscourse identified by the Xerox Incremental Parser (XIP)
BACKGROUND KNOWLEDGE
Recent studies indicate …
… the previously proposed …
… is universally accepted ...
NOVELTY
... new insights provide direct evidence ...
... we suggest a new ... approach ...
... results define a novel role ...
OPEN QUESTION … little is known … … role … has been elusive
Current data is insufficient …
GENERALIZING ... emerging as a promising approach Our understanding ... has grown exponentially ... ... growing recognition of the importance ...
CONTRASTING IDEAS … unorthodox view resolves … paradoxes …
In contrast with previous hypotheses ...
... inconsistent with past findings ...
SIGNIFICANCE studies ... have provided important advances
Knowledge ... is crucial for ... understanding valuable information ... from studies
SURPRISE We have recently observed ... surprisingly We have identified ... unusual
The recent discovery ... suggests intriguing roles
SUMMARIZING The goal of this study ... Here, we show ...
Altogether, our results ... indicate
22
![Page 23: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/23.jpg)
AWA: Academic Writing Analytics tool
23
![Page 24: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/24.jpg)
AWA: Academic Writing Analytics tool
24
![Page 25: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/25.jpg)
AWA: Academic Writing Analytics tool
25
![Page 26: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/26.jpg)
dispositional analytics
making dispositions visible, quantifiable, and improvable
26
![Page 27: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/27.jpg)
“It’s more than knowledge and skills. For the innovation economy, dispositions come into play: readiness to collaborate; attention to multiple perspectives; initiative; persistence; curiosity.”
Larry Rosenstock High Tech High
San Diego hightechhigh.org
LearningREimagined project: http://learning-reimagined.com Larry Rosenstock: http://audioboo.fm/boos/1669375-50-seconds-of-larry-rosenstock-ceo-of-hightechhigh-on-how-he-would-re-imagine-learning
Knowledge, Skills & Dispositions
27
![Page 28: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/28.jpg)
“It’s vital to know that … focusing on learning is not smoke and mirrors. It’s not just some clever idea among the intelligentsia. It’s really important.
And it’s really, really important that we can measure it, demonstrate it, and develop a language for it.”
Mark Moorhouse Matthew Moss High School,
Rochdale, UK
http://youtu.be/kayzkma1TIM — Learning Futures channel: http://bit.ly/lfmovies MMHS website: http://www.mmhs.co.uk/learning
Measuring learning to learn
28
![Page 29: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/29.jpg)
Deakin Crick, R., S. Huang, A. Ahmed Shafi and C. Goldspink (2015). Developing Resilient Agency in Learning: The Internal Structure of Learning Power. British Journal of Educational Studies: Published online: 24 Mar 2015. http://dx.doi.org/10.1080/00071005.2015.1006574 29
Evidencing learning dispositions: CLARA survey (Ruth Deakin Crick, UTS)
![Page 30: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/30.jpg)
30
Structural Equation Model underpinning CLARA
Deakin Crick, R., S. Huang, A. Ahmed Shafi and C. Goldspink (2015). Developing Resilient Agency in Learning: The Internal Structure of Learning Power. British Journal of Educational Studies: Published online: 24 Mar 2015. http://dx.doi.org/10.1080/00071005.2015.1006574
![Page 31: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/31.jpg)
Mindful Agency
Sense making
Creativity
Curiosity Belonging
Collaboration
Hope and optimism
Immediate visual analytic generated by CLARA (Individual and cohort profiles + detailed reports + spreadsheets enabling further analysis)
Rapid Visual Feedback to Stimulate Self-Directed Change
A framework for a coaching conversation
+
![Page 32: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/32.jpg)
Mindful Agency
Sense making
Creativity
Curiosity Belonging
Collaboration
Hope and optimism
Behavioural analytics for learning dispositions?
Social network patterns, teamwork effectiveness and
initiation of relationships?
Questioning, arguing and search behaviours reveal
intrinsic curiosity and epistemic commitments?
Tagging/sharing/blogging/social patterns reveal how you see connections between ideas?
32
![Page 33: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/33.jpg)
From blog feeds (to xAPI?)
![Page 34: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/34.jpg)
Mood View widget
![Page 35: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/35.jpg)
Dashboard view
![Page 36: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/36.jpg)
Teacher’s dashboard for EnquiryBlogger
![Page 37: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/37.jpg)
a learning design patterns tool?
37
![Page 38: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/38.jpg)
CompendiumLD: for OU Learning Design
OU LDI Project led by Grainne Conole: http://compendiumld.open.ac.uk
![Page 39: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/39.jpg)
(screenshots from CLAtoolkit demo)
39
![Page 40: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/40.jpg)
Harvesting social media activity as xAPI triples
40
![Page 41: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/41.jpg)
Harvesting social media activity as xAPI triples
41
TwiOer
Integrated data stream
![Page 42: Provocations for CLA Dashboard](https://reader030.vdocuments.site/reader030/viewer/2022032620/55ce4421bb61eb8d418b4665/html5/thumbnails/42.jpg)
Harvesting social media activity as xAPI triples
42