data2u: scalable real time student feedback in active learning environments

20
Imran Khan, Abelardo Pardo (@abelardopardo) Faculty of Engineering and IT slideshare.net/abelardo_pardo Kannan B flickr.com International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016 Data2U: Scalable Real time Student Feedback in Active Learning Environments

Upload: abelardo-pardo

Post on 12-Apr-2017

375 views

Category:

Education


3 download

TRANSCRIPT

Page 1: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Imran Khan, Abelardo Pardo (@abelardopardo)Faculty of Engineering and IT slideshare.net/abelardo_pardo

Kannan B flickr.comInternational Conference on Learning Analytics and Knowledge University of Edinburgh29 April 2016

Data2U: Scalable Real time Student Feedback in Active Learning

Environments

Page 2: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 2

Postmodern Sleaze flickr.com

Provide real-time meaningful feedback to students about their

engagement

The problem

Page 3: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 3

Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81-112. doi:10.3102/003465430298487

Faruk Ateş flickr.com

"information provided by an agent (teacher, peer, book, parent, self, experience) regarding aspects

of one’s performance or understanding”

Page 4: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 4

Black, P., & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74. doi:10.1080/0969595980050102

Gareth C

hristopher flickr.com

Innovations designed to strengthen the frequent feedback that students receive about their learning yield substantial learning gains

Page 5: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 5

Feedback is inherent in and a prime determiner of processes that constitute self regulated learning

Gal flickr.com

Butler, D. L., & Winne, P. H. (1995). Feedback and Self-Regulated Learning: A Theoretical Synthesis. Review of Educational Research, 65(3), 245-281

Page 6: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 6

Michael Levine-C

lark flickr.com

Krumm, A. E., Waddington, R. J., Teasley, S. D., & Lonn, S. (2014). A Learning Management System-Based Early Warning System for Academic Advising in Undergraduate Engineering. In J. A. Larusson & B. White (Eds.), Learning Analytics: From Research to Practice (pp. 103-119). New York, USA: Springer Science+Business Media

Information provided to an intermediary for further

processing

Information provided directly to the students for interpretation

Page 7: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 7

Active Learning Works

Page 8: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A.

The intermediary

Instructor may be thebottleneck for

basic real-time feedback8

Roel Wijnants flickr.com

Page 9: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 9

Corrin, L., & de Barba, P. (2014). Exploring students' interpretation of feedback delivered through learning analytics dashboards. Paper presented at the ASCILITE conference, Dunedin, New Zealand.

Dashboard provided directly to students

Students able to interpret the data

Increase motivation after seeing the data

Page 10: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 10

Pete flickr.comObjective: Feedback• Active learning scenarios • Automatic • Real time • Meaningful indicators • How do students use the dashboard?

Page 11: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 11

• First year engineering course

• Computer Systems • Flipped Blended

Learning • ~300 students

Preparation activities with formative and

summative assessment

John flickr.com

Page 12: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 12

2 Hours

2 Hours

3 Hours

Pardo, A. & Mirriahi N. (in press). Design, Deployment and Evaluation of a Flipped Learning First Year Engineering Course. In C. Reidsema, L. Kavanagh, R. Hadgraft & N. Smith (Eds.), Flipping the Classroom: Practice and Practices. Singapore: Springer.

Page 13: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 13

Page 14: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 13

Tracking

Page 15: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Abelardo Pardo Using technology to provide feedback on learning strategies 14

Weekly real time feedback

Page 16: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 15

Quinn D

ombrow

ski flickr.com

How many times is the dashboard accessed?

Most students access it once every six sessions

Page 17: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 16

Quinn D

ombrow

ski flickr.com

What type of interaction? W

indell Oskay flickr.com

Counted events before and after first access to dashboard

Page 18: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A.

Previous model used to predict type of interaction

17

How does interaction change over the semester?

Dashboard views do not correlate with academic performance

Page 19: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 18

Conclusions and Future Work• How students use a dashboard

with real time feedback. • Suitable for active learning

scenarios • Combine with qualitative analysis • Explore dashboard variations

Page 20: Data2U: Scalable Real time Student Feedback in Active Learning Environments

Imran Khan, Abelardo Pardo (@abelardopardo)Faculty of Engineering and IT slideshare.net/abelardo_pardo

Kannan B flickr.comInternational Conference on Learning Analytics and Knowledge University of Edinburgh29 April 2016

Data2U: Scalable Real time Student Feedback in Active Learning

Environments