introducing the indicators project
DESCRIPTION
Presentation introducing the Indicators project (http://indicatorsproject.wordpress.com/) and the associated ASCILITE'09 paper. More presentation resources here http://indicatorsproject.wordpress.com/2009/11/12/introducing-the-indicators-project-identifying-effective-learning/TRANSCRIPT
![Page 1: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/1.jpg)
The Indicators ProjectIdentifying effective learning: adoption, activity, grades and external factors
Colin BeerDavid JonesKen Clarkhttp://tr.im/FvRQ
![Page 2: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/2.jpg)
Overview
http://www.flickr.com/photos/atbaker/1577665185/
Context
Feature usage
Participation, grades
and other factors
Future work and Reflections
![Page 3: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/3.jpg)
Overview
http://www.flickr.com/photos/atbaker/1577665185/
Context
Feature usage
Participation, grades
and other factors
Future work and Reflections
![Page 4: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/4.jpg)
http://www.flickr.com/photos/dnorman/251646154/
The data that we, educators gatherand utilize is all but garbage.(Wiley,
2009)
![Page 5: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/5.jpg)
http://www.flickr.com/photos/riverap1/3875718119/
almost every university is planning to make use of an LMS (Salmon,
2005)
They are becoming ubiquitous at
universities around the world(Coates et al, 2005)
![Page 6: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/6.jpg)
http://www.flickr.com/photos/dsifry/2452527887/
Are sites ready for start of term?
Are students using the site?How?
With what impact?
What makes “good” LMS use?
Are thereproblems?
If I do “x” what happens?
Is it worth it?
![Page 7: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/7.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
What’s going on within your LMS/course site?a) Asking staff and/or
studentsb) Manual checking of LMSc) LMS reporting facilitiesd) Data mining + other analyticse) Opinion/self-reportingf) Otherg) None
![Page 8: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/8.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
Peer review?
![Page 9: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/9.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
![Page 10: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/10.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
Only what is in the LMS
Limited views
![Page 11: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/11.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
Only what is in the LMS
Human recollection
Limited views
![Page 12: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/12.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
Only what is in the LMS
Human recollection
Time-consuming & error prone
Limited views
![Page 13: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/13.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
Only what is in the LMS
Human recollection
Time-consuming & error prone
No lognitudinal examination
Limited views
![Page 14: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/14.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
Only what is in the LMS
Human recollection
Time-consuming & error prone
No lognitudinal examinationNo cross LMS comparison
Limited views
![Page 15: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/15.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
Mostly ad hoc
Some surveys
Mostly LMS reporting
One manual check (Gonch,
2007)
No widespread view
Only what is in the LMS
Human recollection
Time-consuming & error prone
No lognitudinal examinationNo cross LMS comparison
No cross institutional comparison
Limited views
![Page 16: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/16.jpg)
http://www.flickr.com/photos/80417459@N00/2471314610/
“LMS”
Webfuse – 1997-2009
Pre-2010
2010-
WebCT – 1999-2003/4Blackboard – 2004-2009
Moodle
![Page 17: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/17.jpg)
http://www.flickr.com/photos/anders-vindegg/3408838186/
We have lots of data
Examining it might reveal interesting patterns
Useful for L&T practice, management and research
![Page 18: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/18.jpg)
http://indicatorsproject.wordpress.com
Enabling comparisons of LMS usageacross institutions, platforms and
time
![Page 19: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/19.jpg)
http://www.flickr.com/photos/david_jones/36379215/
![Page 20: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/20.jpg)
http://www.flickr.com/photos/atbaker/1577665185/
Institution A
LMS 1 LMS 2
Institution B
LMS
Institution C
LMS
LMS Independent
Data
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
T&L Practice Research
![Page 21: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/21.jpg)
http://www.flickr.com/photos/atbaker/1577665185/
Institution A
LMS 1 LMS 2
Institution B
LMS
Institution C
LMS
LMS Independent
Data
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
T&L Practice Research
Enabling
![Page 22: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/22.jpg)
http://www.flickr.com/photos/atbaker/1577665185/
Institution A
LMS 1 LMS 2
Institution B
LMS
Institution C
LMS
LMS Independent
Data
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
T&L Practice Research
Enabling
What
![Page 23: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/23.jpg)
http://www.flickr.com/photos/atbaker/1577665185/
Institution A
LMS 1 LMS 2
Institution B
LMS
Institution C
LMS
LMS Independent
Data
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
T&L Practice Research
Enabling
What
Why
![Page 24: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/24.jpg)
http://www.flickr.com/photos/atbaker/1577665185/
Institution A
LMS 1 LMS 2
Institution B
LMS
Institution C
LMS
LMS Independent
Data
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
T&L Practice Research
Enabling
What
WhyHow
![Page 25: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/25.jpg)
Overview
http://www.flickr.com/photos/atbaker/1577665185/
Context
Feature usage
Participation, grades
and other factors
Future work
![Page 26: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/26.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
There are more similarities than differences among LMS (Black et al,
2007)
![Page 27: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/27.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
TransmittingContent
CreatingClass
Interactions
ComputerBased
Instruction
Move to features in unexplored categories, until each category is considered for different learning needs
Level 1: Most used Level 2: Moderately used Level 3: Rarely used
• Content/files• Announcements• Gradebook
More than 50% of courses More than 20% of courses (much) less than 20% of courses
EvaluatingStudents• Quizzes• Drop box
Evaluatingcourse and instructors
• Surveys• Chat• Discussion forum• Email
• Some quizzes• Adaptive release
(Malikowski et al, 2007)
![Page 28: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/28.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
What we did
CQU
Wf BbLMS logs
![Page 29: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/29.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
CQU
Wf BbLMS logs
LMS Independent
Data
What we did
![Page 30: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/30.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
CQU
Wf BbLMS logs
LMS Independent
Data
What we did
(Malikowski et al, 2007)
Feature usage
![Page 31: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/31.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
Malikowskitop & bottomrange
![Page 32: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/32.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
Blackboard
![Page 33: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/33.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
Webfuse
![Page 34: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/34.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
![Page 35: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/35.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
![Page 36: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/36.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
![Page 37: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/37.jpg)
http://www.flickr.com/photos/wadem/2730257498/
![Page 38: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/38.jpg)
http://www.flickr.com/photos/wadem/2730257498/
The particular trajectory of emergence is not wholly
determined either by the intentions of the human actors or by the material properties of technology, but rather by the interplay of the two(Jones,
1999)
![Page 39: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/39.jpg)
http://www.flickr.com/photos/nedrichards/3234490934/
Future Work
Will Moodle be different?
Why?
What about other institutions?
Are Malikowski ranges out of date?
When is a feature adopted?
How
…….
![Page 40: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/40.jpg)
Overview
http://www.flickr.com/photos/atbaker/1577665185/
Context
Feature usage
Participation, grades
and other factors
Future work and Reflections
![Page 41: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/41.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
The results indicated a significant difference between low and high performing students in terms of the quantity of online session times attended during the course (Dawson et al,
2008)
Discussion forum activity has been demonstrated to be a sound indicator of future student academic performance. (Dawson, 2009; Morris et al,
2005)
![Page 42: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/42.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
CQU
Wf BbLMS logs
LMS Independent
Data
What we did
(Malikowski et al, 2007)
Feature usage
![Page 43: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/43.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
CQU
Wf BbLMS logs
LMS Independent
Data
What we did
(Malikowski et al, 2007)
Feature usage
Student records
![Page 44: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/44.jpg)
http://www.flickr.com/photos/chokingsun/3495110670/
CQU
Wf BbLMS logs
LMS Independent
Data
What we did
(Malikowski et al, 2007)
Feature usage
Participation, grades,external factors
Student records
![Page 45: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/45.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
Hits on course site
Hits on course forum
Distance education students
![Page 46: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/46.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
CQ on-campus students
![Page 47: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/47.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
AIC students
![Page 48: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/48.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
Distance education students
# of replies
# of posts
![Page 49: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/49.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
CQ on-campus students
![Page 50: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/50.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
AIC students
![Page 51: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/51.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
The results indicated a significant difference between low and high performing students in terms of the quantity of online session times attended during the course (Dawson et al,
2008)
Discussion forum activity has been demonstrated to be a sound indicator of future student academic performance. (Dawson, 2009; Morris et al,
2005)
![Page 52: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/52.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
Mixed design ANOVA
All reported effects are significant
Significant interaction effectbetween grades and participation
![Page 53: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/53.jpg)
http://www.flickr.com/photos/wadem/2730257498/
![Page 54: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/54.jpg)
http://www.flickr.com/photos/wadem/2730257498/
AIC = emphasis on face-to-face
NESB?
FLEX/DE = no face-to-face
CQ = Quite a bit emphasis face-to-face
Course site designedby CQ-based staff(usually)
![Page 55: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/55.jpg)
Taxonomy of critical success factorsfor quality web-supported learning(Fresen,
2007)
Lecturer interaction/facilitationAcademic background of lecturer/instructional design
http://www.flickr.com/photos/orinrobertjohn/3321067724/
![Page 56: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/56.jpg)
Taxonomy of critical success factorsfor quality web-supported learning(Fresen,
2007)
Lecturer interaction/facilitationAcademic background of lecturer/instructional design
http://www.flickr.com/photos/orinrobertjohn/3321067724/
![Page 57: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/57.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Course groups based on staff hits
Group Courses Student-courses
Students/course
Definition
High 678(17%)
156,770 231 x>3000 hits
Medium 980(25%)
143,314 146 3000>x>1000
Low 1474(37%)
102,214 69 1000>x>100
Super low 849(21%)
68,354 80 100>x>0
![Page 58: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/58.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Hits
High staff participation courses
![Page 59: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/59.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Replies & posts
High staff participation courses
![Page 60: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/60.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Hits
Super low staff participation courses
![Page 61: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/61.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Replies & posts
Super low staff participation courses
![Page 62: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/62.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
High
Posts comparisons
Superlow
![Page 63: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/63.jpg)
http://www.flickr.com/photos/wolfgangstaudt/2279651479/
The results indicated a significant difference between low and high performing students in terms of the quantity of online session times attended during the course (Dawson et al,
2008)
Discussion forum activity has been demonstrated to be a sound indicator of future student academic performance. (Dawson, 2009; Morris et al,
2005)
![Page 64: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/64.jpg)
http://www.flickr.com/photos/wadem/2730257498/
![Page 65: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/65.jpg)
http://www.flickr.com/photos/nedrichards/3234490934/
Future Work
- Course size
Examination of super-low
Networks of interaction (Bakharia et al, 2009; Dawson,
2009)
Forum content
![Page 66: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/66.jpg)
![Page 67: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/67.jpg)
Taxonomy of critical success factorsfor quality web-supported learning(Fresen,
2007)
Lecturer interaction/facilitationAcademic background of lecturer
and instructional design
http://www.flickr.com/photos/orinrobertjohn/3321067724/
![Page 68: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/68.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Course offerings with
Staff with grad certs in L&TSignificant input from instructional designerStaff who have received teaching awards
Staff teaching education coursesNone of the above
n=167
n=4
n=196
n=3288
N=362
![Page 69: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/69.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
None of the above
![Page 70: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/70.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Grad cert in L&T
![Page 71: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/71.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Teaching awards
![Page 72: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/72.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Education discipline
![Page 73: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/73.jpg)
http://www.flickr.com/photos/orinrobertjohn/3321067724/
Instructional design
![Page 74: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/74.jpg)
Overview
http://www.flickr.com/photos/atbaker/1577665185/
Context
Feature usage
Participation, grades
and other factors
Future work & Reflections
![Page 75: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/75.jpg)
http://www.flickr.com/photos/mikebaird/2985066755/
![Page 76: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/76.jpg)
http://www.flickr.com/photos/david_jones/36379215/
![Page 77: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/77.jpg)
http://www.flickr.com/photos/dmatos/540688952/
![Page 78: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/78.jpg)
http://www.flickr.com/photos/mwichary/2188958154/
![Page 79: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/79.jpg)
http://www.flickr.com/photos/sylvar/1138341328/
![Page 80: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/80.jpg)
http://www.flickr.com/photos/fncll/145149313/
![Page 81: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/81.jpg)
http://www.flickr.com/photos/nedrichards/3234490934/
![Page 82: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/82.jpg)
http://www.flickr.com/photos/atbaker/1577665185/
Institution A
LMS 1 LMS 2
Institution B
LMS
Institution C
LMS
LMS Independent
Data
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
Useful Data/Informat
ion
T&L Practice Research
What
WhyHow
EnablingLittle
bit
Little bit
Little bit Not
much
![Page 83: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/83.jpg)
http://www.flickr.com/photos/fncll/145149313/
![Page 84: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/84.jpg)
http://www.flickr.com/photos/jamuraa/813966437/
http://tr.im/FvRQ
http://indicatorsproject.wordpress.com
![Page 85: Introducing the indicators project](https://reader036.vdocuments.site/reader036/viewer/2022062511/54c83f2e4a795961498b4640/html5/thumbnails/85.jpg)
Black, E., D. Beck, et al. (2007). "The other side of the LMS: Considering implementation and use in the adoption of an LMS in online and blended learning environments." Tech Trends 51(2): 35-39.
Coates, H., R. James, et al. (2005). "A Critical Examination of the Effects of Learning Management Systems on University Teaching and Learning." Tertiary Education and Management 11(1): 19-36.
Dawson, S. (2009). "'Seeing' the learning community: An exploration of the development of a resource for monitoring online student networking." British Journal of Educational Technology: in press.
Dawson, S., E. McWilliam, et al. (2008). Teaching smarter: How mining ICT data can inform and improve learning and teaching practice. Hello! Where are you in the landscape of educational technology? Proceedings ascilite Melbourne 2008. Melbourne: 221-230
Fresen, J. (2007). "A taxonomy of factors to promote quality web-supported learning." International Journal on E-Learning 6(3): 351-362.
Gonch, B. (2007). An inventory of Term 2 2006 online courses at CQU. Rockhampton, Central Queensland University: 18.
Jones, M. (1999). Information systems and the double mangle: Steering a course between the scylla of embedded structure and the charybdis of strong symmetry. Information Systems: Current Issues and Future Chalenges. T. Larsen, L. Levine and J. DeGross. Laxenburg, Austria, IFIP: 287-302.
Malikowski, S., M. Thompson, et al. (2007). "A model for research into course management systems: bridging technology and learning theory." Journal of Educational Computing Research 36(2): 149-173.
Morris, L., C. Finnega, et al. (2005). "Tracking student behavior, persistence, and achievement in online courses." Internet and Higher Education 8(3): 221-231.
Salmon, G. (2005). "Flying not flapping: a strategic framework for e-learning and pedagogical innovation in higher education institutions." ALT-J, Research in Learning Technology 13(3): 201-218.
Wiley, D. (2009). "The LHC and education." Retrieved 29 November, 2009, from http://opencontent.org/blog/archives/1098.