Download - Learning Analytics as Interpretive Practice
Learning Analytics as Interpretive Practice
Michael Atkisson and David WileyAllen Communications and Brigham Young University
Download These Slides
http://slideshare.net/opencontent/
http://woknowing.wordpress.com/
Interpretation ≠ ScienceJust the facts, ma’am.
Confusion
Science with positivism
Quantitative > Qualitative
Numbers are objective
Educational Measurement
What does s/he know?
Not Directly Observable
So we create behavioral proxies and look for evidence
Online Learning Is Even Worse
Proxies not available for direct observation
Impoverished Vocabulary
“Observable” behavior = clicks and key presses
Westerman’s Argument
Quantitative inquiry is interpretive
Operational Definitions
Fundamental to social science research,including educational measurement
First, Define Constructs
Then you can measure them
User ID Page Time78 /lecture1.html 10:4378 /lecture2.html 10:4978 /lecture3.html 10:5078 /lecture4.html 11:1278 /quiz.html 11:23
“Time on Task”
Are different definitions possible?Are different results possible?
If yes subjectivity
Philipp Frank
“The uncritical acceptance of empirical data without sophisticated study of assumptions.”
Vic Bunderson“Letting the data tail wag the theory dog”
Learning Analytics Success?
If we can predict, but don’t understand why
If Not Positivism…
Then what?
Hermeneutics
All about meaning and interpretation
Problems with Metaphor
e.g., the information processing model
Problems with Reductionism
“There is really nothing more to be said when neurophysiology has had its say”
Meaning in Concreteness
Behavior in context
How Could We Do This?
Given abstractness of online behaviors
User ID Page Time78 /lecture1.html 10:4378 /lecture2.html 10:4978 /lecture3.html 10:5078 /lecture4.html 11:1278 /quiz.html 11:23
These observations need to be clustered by practice
Cluster Behavior Observations by Practice
Readings, discussion forum participation, simulation use, homework assignments,
taking exams, etc.
How? A combination of…
Structural Equation Modeling (Latent Factors)Multilevel data structures
Continuous, longitudinal measures
Bw Within tasks
Between Tasks Bb
Bt Total Practice Regression
Task 1
Task 2
Task 3
Tasks nested within within practice
Almost Certainly Better Ways
Hopefully you will think of them!
LA Interventions with People
Learning analytics is an ethical activity
Let’s Be Good Stewards
And not regress to Behaviorism 2.0
