1

Identifying Dimensions Identifying Dimensions of Student Intentionalityof Student Intentionality

Christine Brooks Cote and Elizabeth ReillyChristine Brooks Cote and Elizabeth ReillyBowdoin CollegeBowdoin College

Robert FrohRobert FrohNew England Association of Schools and New England Association of Schools and

CollegesColleges

2

If Intentionality is a Goal, If Intentionality is a Goal, Then...Then...

We need to understand intentionality.

We need to assess intentionality as a learning outcome.

We need to evaluate our efforts as educators to foster intentionality within our students.

3

The “Take Aways”The “Take Aways”

Process – listen to students to learn about their intentionality

Process – collaborative nature of project brought useful synergy

Process – able to involve faculty in meaningful ways

Product – sharpened definition of intentionality

Product – dimensions might be useful in assessment of intentionality

4

The Intentional Learner...is purposeful and self-directed. Purpose implies

clear goals, an understanding of process, and appropriate action. Further, purpose implies intention in one’s actions.

...possesses a self-awareness about the reason for study, the learning process itself, and how education is used.

...makes connections among seemingly disparate information and draws on a wide range of knowledge to make decisions or solve problems.

...connects study to personal life, formal educational to work, and knowledge to social responsibility.

-- Greater Expectations

5

The Intentional Learner - Operationalized

How do intentional (purposeful, self-directed) students behave?

What does an intentional learner do in the classroom?

How does an intentional learner make choices about courses or other academic options?

How do intentional students make the best use of advising?

How does an intentional student approach new subjects and different areas of the curriculum?

How do intentional students make sense of liberal learning as they think about their life and careers after college?

6

Four Parts of Today’s Four Parts of Today’s SessionSession

Description of Pilot Project Funded by Mellon Foundation Involving Several New England Liberal Arts Colleges

Dimensions of Intentionality That Came Out of the Project

Your FeedbackFourth Part (only if time remains):

– Description of Other Components of the Pilot Project

– Next Proposal

7

Mellon Pilot ProjectNEASC/CIHE Accreditation Context Articulate expectations and support for

Assessment and IE (throughout the accreditation cycle)

CIHE Policy on Institutional Effectiveness (IE) provides a framework

– Successive approximation (“The Science of Muddling Through” – Lindblom*

– Variation by type of institution Standards (2006) provide more clarity and

specificity

* Public Admin. Rev. 19:79-88, 1959; also Public Policy: The Essential Readings, Stella Theodoulou and Matthew Can, editors. Prentice Hall. 1995. p. 113-127

8

Mellon Pilot Project A collaboration of selective

liberal arts colleges conducting inquiry regarding:

– ‘what and how students learn’ – addressing ‘The Academic

Program’ (2006 Standards)

9

AssessmentAssessment“A Conflict in Models”*“A Conflict in Models”*

Skinner – Behaviorist Model– teaching and learning results from defining

terminal behaviors and reinforcement strategies Bruner – Scholarly Discipline Model

– “a teacher is a model, someone who understands and communicates a sense of intrinsic excitement about the discipline”

– “[a teacher] encourages intuitive leaps and leads students to the thrill of discovery”

* Paper by Bob Newton – Boston College (on the NEASC Assessment Web Site

10

Learning Understood Learning Understood ThroughThrough‘Critical Transition Points’‘Critical Transition Points’

First Year Experience

Selecting a Major

Study Abroad

Senior Thesis or Capstone Project

11

Research Questions Round One: After arriving on campus…

– What are your goals for your education? How did you decide upon these goals? What courses are you taking? How do you think these courses will help you achieve your educational goals? What knowledge and competencies or skills do you hope to acquire or develop during your first year in college?

Round Two: At the end of the first semester…– What have you learned about yourself and your academic

interests during the first semester? Have your educational goals changed in any way? How? Why? What courses do you plan to take in the spring semester? How do these match with the courses you earlier planned on taking in the spring? Have you done any thinking about a possible major? What are your thoughts?

12

DataStudent responses differed – some were

more sophisticated, more connected, more thoughtful, more eloquent than others

It appeared that some were more intentional and others were less intentional in their approach to college

Might some kind of developmental model help us in understanding the data?

Might we come up with some kind of “intentionality scale?”

13

Data AnalysisData Analysis

Read through students’ responses and recognized nine dimensions of student intentionality

Students were rated on each of the dimensions

Limitations and inter-rater reliability

14

Dimension One: Developing Dimension One: Developing SkillsSkills

Low Response– Students who were rated low spoke about

gaining proficiency in a “laundry list” of skills. High Response

– Students who were rated high in this dimension spoke about their interest and purpose in developing proficiency in a skill(s). They spoke of the long-term or personal benefits of acquiring proficiency in skills.

15

Dimension Two: Exploring the Dimension Two: Exploring the CurriculumCurriculum

Low Response– Students who were rated low spoke

generally about getting a “liberal arts education” or becoming “well-rounded”.

High Response– Students who were rated high wanted to

explore the curriculum and explained why. For instance, some students talked about finding a major, pursuing personal interests or gaining knowledge in unfamiliar academic fields.

16

Dimension Three: Pursuing Dimension Three: Pursuing KnowledgeKnowledge

Low Response– Students who received a low rating

spoke about the importance of grades or fulfilling course requirements.

High Response– Students who received high ratings

expressed a personal interest or purpose in learning that went beyond external factors.

17

Dimension Four: Declaring a Dimension Four: Declaring a MajorMajor

Low Response– Students were noncommittal and

spoke only about one or two possible majors.

High Response– Students spoke about narrowing their

choice of majors and why they wanted to pursue a particular academic field.

18

Dimension Five: Declaring a Dimension Five: Declaring a CareerCareer

Low Response– Students were ambiguous about future

career plans. High Response

– Students spoke of narrowing their choice of professions based on personal interest and pursuing experience and knowledge that would prepare them for their chosen profession.

19

Dimension Six: Making Dimension Six: Making ConnectionsConnections

Low Response– Students did not see a connection between

their learning inside and outside of the classroom.

High Response– Students were able to integrate their

experiences outside the classroom with the knowledge they have gained in the classroom. The students who were rated highest were able to demonstrate a greater appreciation for learning or self-understanding.

20

Dimension Seven: Planning Dimension Seven: Planning and Mapping the Futureand Mapping the Future

Low Response– Students who received a low rating responded by only

talking in the short-term about educational plans.High Response

– Students who had a long-term plan, such as taking courses to fulfill a major that would point them towards a desired profession(s). Students that consciously reflected on plans for attaining their goals were also rated highly.

Note– Only a small number of students addressed this dimension and a majority

did not rate as high as we would like to see.

21

Dimension Eight: Reflecting Dimension Eight: Reflecting on Own Ideas and Actionson Own Ideas and Actions

Low Response– Students spoke of only one or two

things that they had learned about themselves, usually pertaining to their interests or aptitude.

High Response– Students spoke about one or more

things they had learned about themselves that changed how they were thinking about their educational plans.

22

Dimension Nine: Owning the Dimension Nine: Owning the SelfSelf

Low Response– Students spoke about external factors

that had shaped their goals. High Response

– Students spoke about demonstrating a greater commitment and interest in pursuing their goals by realizing that they were responsible for their education and for making decisions about how to live their lives.

23

Important PointsImportant PointsDimensions were derived from the

data.

Low and high ratings were more an attempt to understand intentionality than an attempt to judge or evaluate students.

24

Conclusions Conclusions

A comparison of low rated responses to high rated responses shows the variability in student intentionality in each of the nine dimensions. Intentionality can be measured.

25

Conclusions Conclusions

The range of responses suggests that there are ways in which to develop or foster intentionality throughout a student’s education.

26

The “Take Aways”The “Take Aways”

Process – listen to students to learn about their intentionality

Process – collaborative nature of project brought useful synergy

Process – able to involve faculty in meaningful ways

Product – sharpened definition of intentionality

Product – dimensions might be useful in assessment of intentionality

27

Senior data that we later collected contained similar variation.

28

Links to PresentationLinks to Presentation

If you would like additional handouts, including quotes from students on each of the dimensions, or a copy of the PowerPoint presentation, please go to the following link:

http://academic.bowdoin.edu/ir/conferences/aacu2004.shtml

29

Your Feedback and Your Feedback and ParticipationParticipation

1. What methods have you used to research intentionality?

2. What might you contribute to an operational definition of an intentional learner?

3. What are you doing on your campus to assess intentionality as a learning outcome?

4. What are you doing on your campus to evaluate the effectiveness of programs designed to foster intentional learners?

30

Next ProposalNext Proposal

“Inquiry-Based Collaborative Assessment of Student Learning in Liberal Arts College”