Surveys of Student Engagement

Overview of Available NSSE, FSSE, and BCSSE Data

Background

10%

23%

28%

31%

9%

How effectively does your institution disseminate the findings of its as-

sessment efforts to faculty?

Not at all effectively234Very effectively

Objectives

You will be familiar with the five NSSE benchmarks and the survey items that make up each benchmark.

You will be familiar with the comparison groups for which we have NSSE data.

You will be familiar with the embedded data variables in the NSSE raw data.

You will be familiar with the historical NSSE data that is available for analysis.

You will be familiar with the content of the FSSE and the BCSSE and how these data can be combined with NSSE data.

You will be familiar with the new Qualtrics form that is available to request data from the NSSE, FSSE or BCSS to be used for program improvement.

National Survey of Student Engagement (NSSE)NSSE is administered to first-year students and seniors during the spring term.

The most recent data was collecting in spring 2009.

Previous administrations were in 2000, 2002, 2005 & 2006.

Response Rate

2006 FY- 37%SR- 31% 2009 FY- 40%SR- 38%

NSSE Benchmarks

Level of Academic Challenge (LAC) Active and Collaborative Learning (ACL) Student-Faculty Interaction (SFI) Enriching Educational Experiences

(EEE) Supportive Campus Environment (SCE)

Level of Academic Challenge (LAC)

Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance.

Level of Academic Challenge (LAC) Items

Preparing for class (studying, reading, writing, doing homework or lab work, etc. related to academic program)

Number of assigned textbooks, books, or book-length packs of course readings

Number of written papers or reports of 20 pages or more; between 5 and 19 pages; and fewer than 5 pages

Coursework emphasizes: Analysis of the basic elements of an idea, experience or theory

Coursework emphasizes: Synthesis and organizing of ideas, information, or experiences into new, more complex interpretations and relationships

Level of Academic Challenge (LAC) Items (cont.)

Coursework emphasizes: Making of judgments about the value of information, arguments, or methods

Coursework emphasizes: Applying theories or concepts to practical problems or in new situations

Working harder than you thought you could to meet an instructor's standards or expectations

Campus environment emphasizes: Spending significant amount of time studying and on academic work.

Active and Collaborative Learning (ACL)

Students learn more when they are intensely involved in their education and asked to think about what they are learning in different settings. Collaborating with others in solving problems or mastering difficult material prepares students for the messy, unscripted problems they will encounter daily during and after college

Active and Collaborative Learning (ACL) Items

Asked questions in class or contributed to class discussions

Made a class presentation

Worked with other students on projects during class

Worked with classmates outside of class to prepare class assignments

Active and Collaborative Learning (ACL) Items (cont.)

Tutored or taught other students (paid or voluntary)

Participated in a community-based project (e.g., service learning) as part of a regular course

Discussed ideas from your readings or classes with others outside of class (students, family members, co-workers, etc.)

Student-Faculty Interaction (SFI)

Students learn firsthand how experts think about and solve practical problems by interacting with faculty members inside and outside the classroom. As a result, their teachers become role models, mentors, and guides for continuous, life-long learning.

Student-Faculty Interaction (SFI) Items

Discussed grades or assignments with an instructor

Talked about career plans with a faculty member or advisor

Discussed ideas from your readings or classes with faculty members outside of class

Worked with faculty members on activities other than coursework (committees, orientation, student-life activities, etc.)

Received prompt written or oral feedback from faculty on your academic performance

Worked on a research project with a faculty member outside of course or program requirements

Enriching Educational Experiences (EEE)

Complementary learning opportunities enhance academic programs. Diversity experiences teach students valuable things about themselves and others. Technology facilitates collaboration between peers and instructors. Internships, community service, and senior capstone courses provide opportunities to integrate and apply knowledge.

Enriching Educational Experiences (EEE) Items

● Participating in co-curricular activities (organizations, campus publications, student government, social fraternity or sorority, etc.)

● Practicum, internship, field experience, co-op experience, or clinical assignment

● Community service or volunteer work

● Foreign language coursework / Study abroad

● Independent study or self-designed major

● Culminating senior experience (capstone course, senior project or thesis, comprehensive exam, etc.)

Enriching Educational Experiences (EEE) Items (cont.)

Serious conversations with students of different religious beliefs, political opinions, or personal values

Serious conversations with students of a different race or ethnicity than your own

Using electronic medium (e.g., listserv, chat group, Internet, instant messaging, etc.) to discuss or complete an assignment

Campus environment encouraging contact among students from different economic, social, and racial or ethnic backgrounds

Participate in a learning community or some other formal program where groups of students take two or more classes together

Supportive Campus Environment (SCE)

Students perform better and are more satisfied at colleges that are committed to their success and cultivate positive working and social relations among different groups on campus.

Supportive Campus Environment (SCE) Items

Students perform better and are more satisfied at colleges that are committed to their success and cultivate positive working and social relations among different groups on campus.

Supportive Campus Environment (SCE) Items

Campus environment provides the support you need to help you succeed academically

Campus environment helps you cope with your non-academic responsibilities (work, family, etc.)

Campus environment provides the support you need to thrive socially

Quality of relationships with other students

Quality of relationships with faculty members

Quality of relationships with administrative personnel and offices

Comparison Groups All NSSE participants Carnegie Peers Cross-Applicant Peers Aspirant Peers All NJ Schools NSSE Top 50% NSSE Top 10% Consortium for the Study of Writing in

College sub-group All schools who took the supplemental

assessment questions

Embedded Factors

Race Grades in WRI 101 & WRI 102 Admission category- Regular, Transfer,

EOF (non-transfer), General, Special SAT scores (Reading, Math, Writing,

Total) First major, second major Residence hall

Multi-year Comparisons

Multi-year Benchmark comparisons are readily available for the 2005, 2006 & 2009 web-based administrations

Other multi-year comparisons can be made manually from raw data from the 2000, 2002, 2005, 2006, and 2009 administrations

Longitudinal comparison of students who took NSSE as first-year students in 2005 and as seniors in 2009

Faculty Survey of Student Engagement (FSSE)The FSSE asks faculty about their perceptions of students’ engagement.

It was administered for the first time in spring 2009.

Response Rate

48%

FSSE Supplemental Assessment Questions

Asks faculty about assessment efforts on campus

Asks faculty about efforts to improve teaching and learning and about scholarship on teaching and learning

Beginning College Survey of Student Engagement (BCSSE)The BCSSE is given to incoming first-year students prior to the start of classes in the fall term.

It was administered for first time in fall 2008.

Multi-instrument Comparisons

FSSE-NSSE combined data BCSSE-NSSE combined data

FSSE-NSSE Combined DataExample: First-Year Students Seniors

Faculty perceptions of typical students and student responses:

FacultyPerception

StudentResponses   Faculty

PerceptionStudent

Responses

FSSE Item Response Options Col % Col %   Col % Col %

Asked questions in class or contributed to class discussions Never 0% 1% 0% 1%

Sometimes 39% 32% 19% 24%

Often 46% 37% 41% 27%

Very often 15% 30% 41% 48%

Total 100% 100%   100% 100%

FSSE-NSSE Combined DataImportance faculty place on campus-facilitated activities and student participation:

Faculty Responses Student Responses

Percentage of faculty who reported that it is important or very important that students at their institution do the following

Distribution of student responses to whether they had done or plan to do the following before graduating

FSSE ItemStudents Taught

Very Important or Important NSSE Item Class Done Plan to do

Do not plan to do

Have not decided

Practicum, internship, field experience, co-op experience, or clinical assignment

FY 88% Practicum, internship, field experience, co-op experience, or clinical assignment

FY 6% 83% 2% 9%

SR 88% SR 77% 8% 13% 3%

BCSSE-NSSE Cross-Sectional Results

How many hours in a typical 7-day week doing each of the following:

BCSSE NSSE

Preparing for class (studying, doing homework, rehearsing etc.)

High School Expected FY First YearCount % Count % Count %

None 13 1 0 0 2 01-10 589 57 128 13 110 2111-20 318 31 521 51 248 46More than 20

111 11 375 37 176 32

Total 1,031

100 1,024

100 536 100

BCSSE-NSSE Longitudinal Results

Level of Academic ChallengeBCSSE Scale Quartil

e Range

TCNJ All Other Masters

Statistical Comparisons

Perceived Academic Preparation

Mean SD N Mean SD N Diff. Sig. ES

Low 25 56.8 12.5 113 51.2 12.8 1644

5.57 *** .44

Mid 50 60.8 11.7 176 54.8 12.3 2274

6.08 *** .51

Top 25 62.5 11.1 90 58.6 13.4 882 3.88 ** .32

BCSSE Scales by NSSE Level of Academic Challenge (LAC)

Requesting NSSE, FSSE, BCSSE Data

Qualtrics Form on Office of Institutional Research and Assessment website