Rapid Feedback for Oral Presentations

David Shallcross

and

Antonette Mendoza

Engineering Learning Unit Melbourne School of Engineering

University of Melbourne

Melbourne, Australia

Piper Alpha Disaster

iPad App for providing Rapid Feedback to students on their oral presentations. Select from over 170 comments. Score on six criteria. 3-page PDF and audio comments can be e-mailed to students immediately after presentation.

Rapid Feedback

Piper Alpha Disaster

For academics: • Does this tool allow instructors to provide tailored and

detailed feedback immediately?

• Is the instructor able to score the students’ presentation across a number of criteria that is tailored to the subject?

• Is using the iPad application an effective use of time for academics?

Objectives

Piper Alpha Disaster

For students: • Are students able to access their feedback in a timely

fashion, from anywhere?

• Do students feel that the feedback is personalized, precise and useful in improving their learning outcomes?

Objectives

Page Title / heading goes here Rapid Feedback – App Demonstration

Piper Alpha Disaster Feedback on the App

Testing for reliability and scalability: 1000 students (first year subject)

Formal evaluation:

Piper Alpha Disaster Feedback on the App

0 10 20 30 40 50

I like receiving feedback on my oral presentationvia email

Feedback is not useful unless it is received within aweek

I liked the personalized feedback I received on myoral presentation

I recommend that next time the subject is taughtthat feedback for oral presentation is provided in…

The feedback I received was not detailed enough

The feedback I received helped me to identify areasthat I could improve on for my next oral…

The timeliness of the feedback that I received wasvery good

The feedback was a waste of time

The feedback could have been more detailed insome areas

Number of Responses

CPA Oral Presentation Feedback Survey

No Reponse

Strongly Disagree

Disagree

Neither Agree norDisagree

Agree

Strongly Agree

82%

92%

85%

Piper Alpha Disaster

Feedback on the App

Some comments:

“The written comments were comprehensive. There are a large

number of comments to choose from” [academic]

“Well I think as an international student especially for student whose

first language is not English we find face to face much harder because

there’s language barrier so you might not clearly understand what

actually the lecturer is talking about. Instead using the written form for

feedback helps you will understand more clearly” [student]

“Let’s put it this way it’s far better than anything else I’ve received

during my time here” [student]

Piper Alpha Disaster

Feedback on the App

Some comments:

“The written comments were comprehensive. There are a large

number of comments to choose from” [academic]

“Well I think as an international student especially for student whose

first language is not English we find face to face much harder because

there’s language barrier so you might not clearly understand what

actually the lecturer is talking about. Instead using the written form for

feedback helps you will understand more clearly” [student]

“Let’s put it this way it’s far better than anything else I’ve received

during my time here” [student]

Piper Alpha Disaster In the Class room

• Does this tool allow instructors to provide tailored, consistent

and detailed feedback within a day of the presentation?

• During the presentation, is the instructor able to score a

student’s presentation across a number of criteria that is

tailored to the subject?

• Are academics able to identify key areas that students

struggle with in their oral presentations and teach them best practices of effective oral presentations?

Piper Alpha Disaster In the Class Room

Student Cohort:

2 subjects in Sem 2, 2015 at the University of Melbourne

• Subject 1 - 64 students (UG chemical engineering)

• Subject 2 - 120 students (UG general engineering subject.

Assessment across list of criteria • Subject 1 – individual assessment • Subject 2 – Group assessment

Piper Alpha Disaster - In the Class room – Sample feedback for students

Piper Alpha Disaster In the Class room – Analytics for individual

assessment

Piper Alpha Disaster In the Class room – Analytics for group

assessment

Piper Alpha Disaster In the Class room – Performance Pattern

Piper Alpha Disaster Conclusions

Instructors are able to provide students with:

• a rubric that explains the criteria they will be assessed for an oral

presentation

• best practice tips on how to present a topic

• something positive in the student’s presentation and begin and end

with positive statements

• feedback that is simple, specific and illustrates a point with examples

• feedback that must echo the grade given to the student.

Rapid Feedback App has in-built comments that encapsulate

all of the above best practices!!!!

Piper Alpha Disaster Concluding Remarks

Useful tool has been developed to provide timely, individual feedback to students. Tool has been used to deliver feedback at University of Melbourne to over 3000 students across the University. Use of the App has also been piloted at University of Sydney. The App has been re-written to provide feedback in optometry clinical examinations dental clinical examinations nursing clinical examinations reflective feedback

Piper Alpha Disaster Concluding Remarks

Useful tool has been developed to provide timely, individual feedback to students. Tool has been used to deliver feedback at University of Melbourne to over 3000 students across the University. Use of the App has also been piloted at University of Sydney. The App is currently being translated into Chinese.

© Copyright The University of Melbourne 2015