![Page 1: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/1.jpg)
eLearning and Evaluation Excellence in Healthcare
www.desouzainstitute.com@desouzainst
Mathew Gancarz – IT / Operations Manager
![Page 2: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/2.jpg)
![Page 3: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/3.jpg)
de Souza Institute is the leading innovative centre of continuing education dedicated to cancer care excellence.
![Page 4: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/4.jpg)
Small, but mighty Educated over 6300 nurses
Created more than 30 courses, each 10 hours long or longer
Developed a state-of-the-art integrated, innovative educational approach, expanded to be interprofessional
Almost 80% increase in the number of nurses in Ontario certified by the Canadian Nursing Association in oncology or palliative care
![Page 5: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/5.jpg)
EducatedSelf-directedMotivated
But… BUSY
Require flexibility
The course is not their #1 priority
![Page 6: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/6.jpg)
Learner Path - de Souza NurseDesignation
de Souza Nurse
de Souza Nurse Core Curriculum
Specialty Certification (CNA/CPHON)
de Souza Clinical Fellowship (75 hours)
![Page 7: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/7.jpg)
Our Approach to eLearning
![Page 8: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/8.jpg)
Engaging Interactions– Practice (but not on patients)!
• Activities
• Social Interactions Talk to someone in your field
• Assessment
![Page 9: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/9.jpg)
Sample Activity
![Page 10: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/10.jpg)
Discussion Forums
![Page 11: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/11.jpg)
Content Storyboard Production Launch
eLearning Production Process
Instructional Design is
![Page 12: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/12.jpg)
Regular Course UpdatesGot to keep up!
![Page 13: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/13.jpg)
eLearning / Moodle Demo
![Page 14: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/14.jpg)
![Page 15: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/15.jpg)
![Page 16: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/16.jpg)
![Page 17: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/17.jpg)
Sample Activity
![Page 18: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/18.jpg)
Sample Activity
![Page 19: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/19.jpg)
![Page 20: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/20.jpg)
![Page 21: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/21.jpg)
![Page 22: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/22.jpg)
![Page 23: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/23.jpg)
![Page 24: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/24.jpg)
![Page 25: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/25.jpg)
![Page 26: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/26.jpg)
Purpose of Evaluation
• Accountability to funders and learners– Does the program achieves its intended objectives?
• Quality and performance– Do de Souza courses change knowledge and confidence?
• Academic Excellence– Are we competitive against the best in Canada and in the
world?
![Page 27: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/27.jpg)
Evaluation at end.. What progress did we make?
Evaluation at the start..Establish baseline
![Page 28: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/28.jpg)
Moodle Questionnaire PluginThank you to Joseph Rezeau and Mike Churchward for building and maintaining
![Page 29: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/29.jpg)
Supporting Cancer Care Quality Improvement (Chemotherapy example)
2300 nurses completed de Souza chemotherapy course across ON
Annual chemotherapy maintenance course offered for all trained nurses
30 chemo-facilitators trained to provide mentorship in practice
Series10%
20%40%60%80%
100%
before the course after the course
Knowledge on chemotherapyEx
am s
core
![Page 30: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/30.jpg)
ESAS-R NCI Common toxicity criteria-grading
ECOG0
0.5
1
1.5
2
2.5
3
3.5
4
PRE vs POST Confidence Level-Validated Assessment Tools (N=131-135)
PREPOST
Mea
n (R
ated
1-4
)
![Page 31: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/31.jpg)
Instructi
ons
Navigation
Understanding of R
equirements
Ease of Acce
ss
Exam Navigation
Technica
l Support
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
Ratings of eLearning and Tools (N=143)
Mea
n (R
ated
1-5
)
![Page 32: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/32.jpg)
Mind Maps of EvaluationComments, Strengths and Weaknesses
![Page 33: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/33.jpg)
Extracting Questionnaire Data across multiple courses – Pentaho ETL
![Page 34: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/34.jpg)
Future Directions• Learner Analytics and EDM - look at analyzing
Moodle logs, evaluations across courses and time
• Empowering the learners, showing them their own improvement over time based on evaluation scores from courses.. What areas do they still need to develop?
![Page 35: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/35.jpg)
Questions – Comments
Thank you for your time, for more information:www.desouzainstitute.comTwitter: @desouzainstOr search for de Souza Institute on LinkedIn or Facebook
Find me at [email protected] or on LinkedIn – Mathew Gancarz
![Page 36: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/36.jpg)
Enrollment - ePortfolio• Course Calendar integrated with enrollment software
• Registration limited by health professions, per course
• Different course requirements• Prerequisites• Approvals• Disclosure agreements
• Payment via credit card• Bulk shopping cart
![Page 37: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/37.jpg)
Enrollment - Calendar
![Page 38: ELearning and Evaluation Excellence in Healthcare @desouzainst Mathew Gancarz – IT / Operations Manager](https://reader035.vdocuments.site/reader035/viewer/2022062804/5697bf9e1a28abf838c944be/html5/thumbnails/38.jpg)
Transcripts and Tracking