learning outcomes and core competencies lessons from...
TRANSCRIPT
![Page 1: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/1.jpg)
Fiona Deller
Higher Education Quality Council of Ontario (HEQCO)
November 19, 2014
Learning outcomes and core competencies – lessons from Ontario
Informing the Future of Higher Education
![Page 2: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/2.jpg)
What is HEQCO?
2
System design
How can Ontario provide a high-quality
postsecondary education in a period of continued growth and diminishing
resources?
Underrepresented groups
How can we improve access to higher
education for groups that are
underrepresented?
Learning outcomes
Are Ontario students graduating with the knowledge and skills they need to succeed
in life and work?
![Page 3: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/3.jpg)
Learning outcomes remarkably universal, despite geographical & discipline differences…
3
Informing the Future of Higher Education
![Page 4: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/4.jpg)
Four domain types:
• Team-work
• Grit
• Determination
• Communication
• Critical Thinking
• Numeracy
• Literacy
Disciplinary Content
Basic Cognitive
Skills
Higher-Order
Cognitive Skills
Transferable Skills
4
Informing the Future of Higher Education
![Page 5: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/5.jpg)
The four dimensions are the first steps in creating a common outcome language:
• We can classify and compare outcomes by dimension, even if institutions use different terms
• The four dimensions can guide and focus outcome mapping and assessment activities
![Page 6: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/6.jpg)
Basic cognitive outcomes
Laying foundations for successful transitions:
![Page 7: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/7.jpg)
PISA scores and PSE outcomes are related:
7
Sources: OECD (2010). PISA Pathways to Success: How Knowledge and Skills at Age 15 Shape Future Lives in Canada; Canadian Council on Learning (2006). Canadian Post-Secondary Education: A Positive Record – An Uncertain Future.
Higher numeracy and literacy scores
Completion of secondary school, PSE enrollment
Lower numeracy
scores
2x more likely to experience prolonged
unemployment vs. regular employment in
a given year
![Page 8: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/8.jpg)
Basic cognitive outcomes can be tapped to strengthen K-12-PSE alignment:
College Student Achievement Project
• Developing common math learning outcomes for pre-technology, pre-business, and business diploma programs at all 24 Ontario colleges
• Ensuring K-12-PSE alignment by using the same math terms and language as the provincial curriculum
• Improving the transferability of numeracy skills across institutions, creating a solid knowledge base
Byers, P. (2014). Bridging the Mathematics Gap through Learning Outcomes. College Student Achievement Project. Retrieved from http://csap.senecacollege.ca/en/publications.php8
![Page 9: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/9.jpg)
Average numeracy scores for university graduates (25-34)Average numeracy scores for college graduates, (25-34)
Source: Skills in Canada –First Results from the Programme for the International Assessment of Adult Competencies (2013)
Canada, 276OECD average, 285Canada, 299OECD average, 306
Canada falls below the OECD average for numeracy
![Page 10: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/10.jpg)
Canada falls below the OECD average for literacy
10
Informing the Future of Higher Education
Average literacy scores for college graduates, (25-34)
Canada, 284OECD average, 290
Average literacy scores for university graduates, (25-34)
Canada, 306OECD average, 309
Source: Skills in Canada –First Results from the Programme for the International Assessment of Adult Competencies (2013)
![Page 11: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/11.jpg)
Measuring Literacy in Canada
11
Informing the Future of Higher Education
![Page 12: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/12.jpg)
Do Ontario students have the literacy skills for PSE?
12
Informing the Future of Higher Education
![Page 13: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/13.jpg)
Transferrable outcomes
Creating lifelines across the educational continuum:
![Page 14: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/14.jpg)
We know that employers have signaled they value transferable skills over other skills. (This is not to suggest that technical skills are not important).
14
Informing the Future of Higher Education
Source: Canadian Council of Chief Executives. (2014). Preliminary Survey Report: the Skills Needs of Major Canadian Employers. Retrieved from http://www.ceocouncil.ca/skills
![Page 15: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/15.jpg)
Factors besides intelligence impact whether a student decides to stay or leave.
Source: Mischel, Ebbesen, & Zeiss, 1972; Mischel & Metzner, 1962
![Page 16: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/16.jpg)
One factor, grit, has been the source of great interest within the past few years.
16
Informing the Future of Higher Education
GRIT“perseverance and passion
for long-term goals”
Duckworth, A. L., Peterson, C., Matthews, M. D. & Kelly, D. R. (2007). Grit: Perseverance and Passion for Long-Term Goals. Journal of Personality and Social Psychology, 92 (6),1087-1101.
![Page 17: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/17.jpg)
We need to translate psychological research into educational strategies.
• Can grit be taught?
– Andrea Duckworth (UPenn) and the Grit Scale
• Can grit be measured?
– Paul Tough, How Children Succeed: Grit, Curiosity, and the Hidden Power of Character (2012)
17
Informing the Future of Higher Education
![Page 18: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/18.jpg)
We need to translate psychological research into educational strategies
• Can transferrable outcomes be taught and assessed in class?
• How do we account for developmental and environmental factors?
• Learning does not occur in a vacuum
18
![Page 19: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/19.jpg)
There are many measurements that work in clinical or counselling settings…
19
…but there are, at present, virtually no assessments designed with education in mind.
Duckworth’s Grit Scale
Wagnild & Young
Resilience Scale
Resilience Factor
Inventory
The Bar-On Emotional Quotient Inventory
Wagnild & Young: https://www.resiliencescale.com/ ; Bar-On: http://www.eiconsortium.org/measures/eqi.html ; Duckworth’s Grit Scale: https://sites.sas.upenn.edu/duckworth/pages/research ; Resilience Factor Inventory: http://www.adaptivlearning.com/assessment
![Page 20: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/20.jpg)
People for Education is developing measures and indicators for 5 different types of transferable outcomes in K-12, in partnership with HEQCO:
20
Health
Creativity
Social-emotional skills
Citizenship
Quality learning environments
People for Education. (2014). Broader measures of success: Measuring what matters in education. Measuring what Matters. Retrieved from http://www.peopleforeducation.ca/measuring-what-matters/the-domains/
![Page 21: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/21.jpg)
Learning outcomes can transform skills into educational lifelines.
21
• Striking the balance between psychological development and teaching & learning
• Creating an educational continuum through learning outcomes
• Articulating and building on demonstrable skills and outcomes
• Working across curricula and disciplines
![Page 22: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/22.jpg)
QUESTIONS:
1. What are the three big ideas that can be learned from the experiences of other jurisdictions regarding learning outcomes and alignment in K-12 and post-secondary?
2. What advantages do you see to aligning the goals of K-12 and post secondary education and what challenges, disadvantages or unintended consequences might arise?
22
Informing the Future of Higher Education
![Page 23: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/23.jpg)
Lessons learned and next steps
23
Informing the Future of Higher Education
![Page 24: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/24.jpg)
Lessons learned thus far…...
Assessment matters
Focus on students
Faculty Engagement
Learning Management Systems
Cross Discipline, cross sectorial , cross institutional
Language matters
24
![Page 25: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/25.jpg)
What’s Next for HEQCO.
Building Partnerships with k-12 sector
@Issue Paper on the Four Types of Learning Outcomes
Exploring the measurement of transferable skills
Learning Outcomes Assessment Consortium
Learning Outcomes Assessment Handbook
Online PIACC
25
![Page 26: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/26.jpg)
Bridging the gap between K-12 and PSE learning outcomes
“… a system in which the exit standards for
one sector align with the entrance
requirements of the next …one in which
students’ pathways are clearly defined and
reasonably straight…” –Jamie Merisotis,
President & CEO, Lumina Foundation
26
Informing the Future of Higher Education
![Page 27: Learning outcomes and core competencies lessons from Ontarioevents.ufv.ca/tlc/wp-content/uploads/sites/8/2015/01/Deller-UFV... · Learning outcomes and core competencies –lessons](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f98769e2c712d18f66c07a5/html5/thumbnails/27.jpg)
http://www.heqco.ca/en-CA/Research/LearningOutcomes/Pages/home.aspx
Thank you!
27
Informing the Future of Higher Education