![Page 1: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/1.jpg)
1
1
Pawan Adhikari and Changhua Rich
India-ATP PresentationNew Delhi, November 30, 2018
Applying ACT Holistic
Framework to Improving
Evaluation and Assessments
![Page 2: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/2.jpg)
2
India Higher Education and Skills Gap
• Rapid increase in college students enrollment in the past decades
• College graduates are not ready for employment
• Education system slow changing: knowledge, skills, curriculum, evaluation and assessment
• Technological advancement fast changing: big data, artificial intelligence, cloud computing, automation
• Jobs become redundant; skills become outdated
![Page 3: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/3.jpg)
3
Engage Employers: Google and InfoSys
• Google Study: How to revolutionize the university to prepare students for a world in flux
• India Minister of Skills Development, InfoSys CEO, and World Economic Forum to convene top 100 companies to develop action plans to close the skills gap
• What can we learn from existing thought leader about exam transformation research?
![Page 4: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/4.jpg)
4
The Common Model: ELA and MathIs this model still useful for preparing students for success?
![Page 5: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/5.jpg)
5
5
Success is Multidimensional
If success is
multidimensional,
shouldn’t
readiness for
school and work
focus on a
diverse set of
knowledge and
skills?
Course Grades
Enrollment
GPA
Retention
Satisfaction
Graduation
Education Success
Job Performance
Employment
Teamwork
Tenure
Job Satisfaction
Promotion
WorkSuccess
![Page 6: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/6.jpg)
6
Beyond Academics:
ACT’s Holistic Model of Education and Work Success
Behavioral Skills
Core Academic Skills
Cross-Cutting Capabilities
Education & Career Navigation
![Page 7: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/7.jpg)
7
GETTING
ALONG WELL
WITH OTHERS
STUDY SKILLS
MATH
ENVIRONMENTAL
FACTORS
Behavioral Skills
Core Academic Skills
Cross-Cutting Capabilities
Education & Career Navigation
ACT’s Holistic Framework
![Page 8: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/8.jpg)
8
MANAGING
CAREER &
EDUCATION
ACTIONS
SCIENCE
KEEPING AN
OPEN MIND
THINKING
SKILLS
Behavioral Skills
Core Academic Skills
Cross-Cutting Capabilities
Education & Career Navigation
ACT’s Holistic Framework
![Page 9: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/9.jpg)
9
MANAGING
CAREER &
EDUCATION
ACTIONS
SCIENCE
KEEPING AN
OPEN MIND
THINKING
SKILLS
ELA
SOCIALIZING
WITH OTHERS
INTEGRATION
COLLABORATIV
E PROBLEM
SOLVING
Behavioral Skills
Core Academic Skills
Cross-Cutting Capabilities
Education & Career Navigation
ACT’s Holistic Framework
![Page 10: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/10.jpg)
10
ACT’s Holistic Model of Education and Work Success
Behavioral Skills
Core Academic Skills
Cross-Cutting Capabilities
Education & Career Navigation
Education and
Work Success
![Page 11: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/11.jpg)
11
Advantages of ACT’s Holistic Framework
• Comprehensive – recognizes broad range of skills needed for
college and career readiness
• Integrative – has potential to organize personalized results and
insights for users in a coherent way
• Actionable – addresses the “so what?” (alignment to valued
outcomes) and “what’s next” (connecting current K&S to training)
• Developmental – outlines progressive learning across key
developmental and transition periods in K – career continuum
• Authoritative – includes authoritative and research-based content
![Page 12: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/12.jpg)
12
ACT’s Holistic Framework
Core Academic Skills:
knowledge and skills
necessary to perform
essential tasks in core
academic content.
Core Academic Skills
![Page 13: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/13.jpg)
13
ACT’s Holistic Framework
English Language Arts: Literacy skills related to comprehension
and capacity for use of written and oral language.
Mathematics: Relating and transforming numeric and symbolic
quantities, including applications to data sets, patterns, space, and
change.
Science: Gathering and interpreting observations, experimental
data, and disciplinary content knowledge in order to predict and
explain phenomena.
Core Academic Skills
![Page 14: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/14.jpg)
14
Research on Core Academic Skills
Percent of 2016 ACT-Tested High School Graduates Meeting ACT College Readiness Benchmarks by Subject
Core Academic Skills
![Page 15: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/15.jpg)
15
ACT’s Holistic Framework
Cross-Cutting Capabilities:
general knowledge and skills necessary to perform essential tasks acrossacademic content areas.
Cross-Cutting Capabilities
![Page 16: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/16.jpg)
16
ACT’s Holistic FrameworkCollaborative Problem Solving: The skills necessary to use problem solving and behavioral strategies to collaborate with a group to solve a problem
Learning Skills: Strategies and methods to effectively facilitate and manage learning.
Information and Communication Technology: Technology knowledge and skills necessary to effectively acquire and apply information.
Critical Thinking: Reasonably analyzing, interpreting, evaluating, synthesizing, or applying information, observations, communication, procedures, or argumentation for the purpose of reaching justified belief or action
Cross-Cutting Capabilities
![Page 17: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/17.jpg)
17
Research on Cross-Cutting
CapabilitiesCross-Cutting Capabilities
• In a survey of post secondary instructors, respondents were asked to
identify areas that, if weak, would be a barrier to success.
• Post secondary instructs rated the following skills above content knowledge
in terms of their impact on success:
• Learning Skills
• Critical Thinking
• Problem Solving
• Conscientiousness (Behavior)
• Creative Thinking (thinking and imagining)
![Page 18: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/18.jpg)
18
ACT’s Holistic Framework
Acting Honestly: valuing and adhering to ethical and moral standards of behavior, as well as personal level of humility.
Getting Along Well with Others:interacting positively and cooperating with others; generally kind, friendly, and tactful.
Keeping an Open Mind: open-mindedness and curiosity about a variety of ideas, beliefs, people, and experiences.
Behavioral Skills
Maintaining Composure: working on
staying calm, serene, and able to
manage emotions effectively.
Socializing with Others: preferred
level of social interaction, behavior in
interpersonal situations, and optimism.
Sustaining Effort: developing
diligence, effort, organization, self-
control, and compliance.
![Page 19: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/19.jpg)
19
ACT’s Holistic Framework
Self-knowledge: Perceptions of one’s own abilities, interests, skills, values, etc.
that contribute to understanding the self.
Environmental Factors: Information, conditions, and experiences related to
education and work acquired from external sources and surroundings.
Integration: Ongoing process of combining self-knowledge and environmental
factors to form personally-relevant knowledge to evaluate information and plan
courses of action.
Managing Career & Education Actions: Ongoing process of implementing plans
and enacting purposeful behaviors to facilitate education and occupation progress.
Education & Career Navigation
![Page 20: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/20.jpg)
20
Example: ACT’s Holistic Model of College Success
PersistenceGoal Striving
SociabilityOptimism
ELA Math
Science
Critical ThinkingTechnology and Info Literacy
Studying and Learning
Academic Self-EfficacyFit (Congruence)
SupportsGoals
College Graduation
![Page 21: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/21.jpg)
21
Current Applications of Holistic Framework
• Assessments
• Curriculum
• Interventions
• Serious educational games
Revamping Exam Standards!
© 2017 by ACT, Inc.
21
![Page 22: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/22.jpg)
22
![Page 23: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/23.jpg)
23
ACT Transformation
![Page 24: Applying ACT Holistic Framework to Improving Evaluation and Assessments adhikari_act.pdf · 2018. 12. 5. · Applying ACT Holistic Framework to Improving Evaluation and Assessments](https://reader036.vdocuments.site/reader036/viewer/2022071013/5fcbd8a07e2efa21ef1cb25f/html5/thumbnails/24.jpg)
24
Recap – Holistic Framework