learning analytics as interpretive practice

Learning Analytics as Interpretive Practice

Michael Atkisson and David WileyAllen Communications and Brigham Young University

Download These Slides

http://slideshare.net/opencontent/

http://woknowing.wordpress.com/

Interpretation ≠ ScienceJust the facts, ma’am.

Confusion

Science with positivism

Quantitative > Qualitative

Numbers are objective

Educational Measurement

What does s/he know?

Not Directly Observable

So we create behavioral proxies and look for evidence

Online Learning Is Even Worse

Proxies not available for direct observation

Impoverished Vocabulary

“Observable” behavior = clicks and key presses

Westerman’s Argument

Quantitative inquiry is interpretive

Operational Definitions

Fundamental to social science research,including educational measurement

First, Define Constructs

Then you can measure them

User ID Page Time78 /lecture1.html 10:4378 /lecture2.html 10:4978 /lecture3.html 10:5078 /lecture4.html 11:1278 /quiz.html 11:23

“Time on Task”

Are different definitions possible?Are different results possible?

If yes subjectivity

Philipp Frank

“The uncritical acceptance of empirical data without sophisticated study of assumptions.”

Vic Bunderson“Letting the data tail wag the theory dog”

Learning Analytics Success?

If we can predict, but don’t understand why

If Not Positivism…

Then what?

Hermeneutics

All about meaning and interpretation

Problems with Metaphor

e.g., the information processing model

Problems with Reductionism

“There is really nothing more to be said when neurophysiology has had its say”

Meaning in Concreteness

Behavior in context

How Could We Do This?

Given abstractness of online behaviors

User ID Page Time78 /lecture1.html 10:4378 /lecture2.html 10:4978 /lecture3.html 10:5078 /lecture4.html 11:1278 /quiz.html 11:23

These observations need to be clustered by practice

Cluster Behavior Observations by Practice

Readings, discussion forum participation, simulation use, homework assignments,

taking exams, etc.

How? A combination of…

Structural Equation Modeling (Latent Factors)Multilevel data structures

Continuous, longitudinal measures

Bw Within tasks

Between Tasks Bb

Bt Total Practice Regression

Task 1

Task 2

Task 3

Tasks nested within within practice

Almost Certainly Better Ways

Hopefully you will think of them!

LA Interventions with People

Learning analytics is an ethical activity

Let’s Be Good Stewards

And not regress to Behaviorism 2.0

Thank You

michael.atkisson@gmail.com http://woknowing.wordpress.com/

david.wiley@byu.eduhttp://davidwiley.org/