surveys of student engagement
DESCRIPTION
Surveys of Student Engagement. Overview of Available NSSE, FSSE, and BCSSE Data. Background. Objectives. National Survey of Student Engagement (NSSE). NSSE is administered to first-year students and seniors during the spring term. - PowerPoint PPT PresentationTRANSCRIPT
Surveys of Student Engagement
Overview of Available NSSE, FSSE, and BCSSE Data
Background
10%
23%
28%
31%
9%
How effectively does your institution disseminate the findings of its as-
sessment efforts to faculty?
Not at all effectively234Very effectively
Objectives
You will be familiar with the five NSSE benchmarks and the survey items that make up each benchmark.
You will be familiar with the comparison groups for which we have NSSE data.
You will be familiar with the embedded data variables in the NSSE raw data.
You will be familiar with the historical NSSE data that is available for analysis.
You will be familiar with the content of the FSSE and the BCSSE and how these data can be combined with NSSE data.
You will be familiar with the new Qualtrics form that is available to request data from the NSSE, FSSE or BCSS to be used for program improvement.
National Survey of Student Engagement (NSSE)NSSE is administered to first-year students and seniors during the spring term.
The most recent data was collecting in spring 2009.
Previous administrations were in 2000, 2002, 2005 & 2006.
Response Rate
2006 FY- 37%SR- 31% 2009 FY- 40%SR- 38%
NSSE Benchmarks
Level of Academic Challenge (LAC) Active and Collaborative Learning (ACL) Student-Faculty Interaction (SFI) Enriching Educational Experiences
(EEE) Supportive Campus Environment (SCE)
Level of Academic Challenge (LAC)
Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance.
Level of Academic Challenge (LAC) Items
Preparing for class (studying, reading, writing, doing homework or lab work, etc. related to academic program)
Number of assigned textbooks, books, or book-length packs of course readings
Number of written papers or reports of 20 pages or more; between 5 and 19 pages; and fewer than 5 pages
Coursework emphasizes: Analysis of the basic elements of an idea, experience or theory
Coursework emphasizes: Synthesis and organizing of ideas, information, or experiences into new, more complex interpretations and relationships
Level of Academic Challenge (LAC) Items (cont.)
Coursework emphasizes: Making of judgments about the value of information, arguments, or methods
Coursework emphasizes: Applying theories or concepts to practical problems or in new situations
Working harder than you thought you could to meet an instructor's standards or expectations
Campus environment emphasizes: Spending significant amount of time studying and on academic work.
Active and Collaborative Learning (ACL)
Students learn more when they are intensely involved in their education and asked to think about what they are learning in different settings. Collaborating with others in solving problems or mastering difficult material prepares students for the messy, unscripted problems they will encounter daily during and after college
Active and Collaborative Learning (ACL) Items
Asked questions in class or contributed to class discussions
Made a class presentation
Worked with other students on projects during class
Worked with classmates outside of class to prepare class assignments
Active and Collaborative Learning (ACL) Items (cont.)
Tutored or taught other students (paid or voluntary)
Participated in a community-based project (e.g., service learning) as part of a regular course
Discussed ideas from your readings or classes with others outside of class (students, family members, co-workers, etc.)
Student-Faculty Interaction (SFI)
Students learn firsthand how experts think about and solve practical problems by interacting with faculty members inside and outside the classroom. As a result, their teachers become role models, mentors, and guides for continuous, life-long learning.
Student-Faculty Interaction (SFI) Items
Discussed grades or assignments with an instructor
Talked about career plans with a faculty member or advisor
Discussed ideas from your readings or classes with faculty members outside of class
Worked with faculty members on activities other than coursework (committees, orientation, student-life activities, etc.)
Received prompt written or oral feedback from faculty on your academic performance
Worked on a research project with a faculty member outside of course or program requirements
Enriching Educational Experiences (EEE)
Complementary learning opportunities enhance academic programs. Diversity experiences teach students valuable things about themselves and others. Technology facilitates collaboration between peers and instructors. Internships, community service, and senior capstone courses provide opportunities to integrate and apply knowledge.
Enriching Educational Experiences (EEE) Items
● Participating in co-curricular activities (organizations, campus publications, student government, social fraternity or sorority, etc.)
● Practicum, internship, field experience, co-op experience, or clinical assignment
● Community service or volunteer work
● Foreign language coursework / Study abroad
● Independent study or self-designed major
● Culminating senior experience (capstone course, senior project or thesis, comprehensive exam, etc.)
Enriching Educational Experiences (EEE) Items (cont.)
Serious conversations with students of different religious beliefs, political opinions, or personal values
Serious conversations with students of a different race or ethnicity than your own
Using electronic medium (e.g., listserv, chat group, Internet, instant messaging, etc.) to discuss or complete an assignment
Campus environment encouraging contact among students from different economic, social, and racial or ethnic backgrounds
Participate in a learning community or some other formal program where groups of students take two or more classes together
Supportive Campus Environment (SCE)
Students perform better and are more satisfied at colleges that are committed to their success and cultivate positive working and social relations among different groups on campus.
Supportive Campus Environment (SCE) Items
Students perform better and are more satisfied at colleges that are committed to their success and cultivate positive working and social relations among different groups on campus.
Supportive Campus Environment (SCE) Items
Campus environment provides the support you need to help you succeed academically
Campus environment helps you cope with your non-academic responsibilities (work, family, etc.)
Campus environment provides the support you need to thrive socially
Quality of relationships with other students
Quality of relationships with faculty members
Quality of relationships with administrative personnel and offices
Comparison Groups All NSSE participants Carnegie Peers Cross-Applicant Peers Aspirant Peers All NJ Schools NSSE Top 50% NSSE Top 10% Consortium for the Study of Writing in
College sub-group All schools who took the supplemental
assessment questions
Embedded Factors
Race Grades in WRI 101 & WRI 102 Admission category- Regular, Transfer,
EOF (non-transfer), General, Special SAT scores (Reading, Math, Writing,
Total) First major, second major Residence hall
Multi-year Comparisons
Multi-year Benchmark comparisons are readily available for the 2005, 2006 & 2009 web-based administrations
Other multi-year comparisons can be made manually from raw data from the 2000, 2002, 2005, 2006, and 2009 administrations
Longitudinal comparison of students who took NSSE as first-year students in 2005 and as seniors in 2009
Faculty Survey of Student Engagement (FSSE)The FSSE asks faculty about their perceptions of students’ engagement.
It was administered for the first time in spring 2009.
Response Rate
48%
FSSE Supplemental Assessment Questions
Asks faculty about assessment efforts on campus
Asks faculty about efforts to improve teaching and learning and about scholarship on teaching and learning
Beginning College Survey of Student Engagement (BCSSE)The BCSSE is given to incoming first-year students prior to the start of classes in the fall term.
It was administered for first time in fall 2008.
Multi-instrument Comparisons
FSSE-NSSE combined data BCSSE-NSSE combined data
FSSE-NSSE Combined DataExample: First-Year Students Seniors
Faculty perceptions of typical students and student responses:
FacultyPerception
StudentResponses Faculty
PerceptionStudent
Responses
FSSE Item Response Options Col % Col % Col % Col %
Asked questions in class or contributed to class discussions Never 0% 1% 0% 1%
Sometimes 39% 32% 19% 24%
Often 46% 37% 41% 27%
Very often 15% 30% 41% 48%
Total 100% 100% 100% 100%
FSSE-NSSE Combined DataImportance faculty place on campus-facilitated activities and student participation:
Faculty Responses Student Responses
Percentage of faculty who reported that it is important or very important that students at their institution do the following
Distribution of student responses to whether they had done or plan to do the following before graduating
FSSE ItemStudents Taught
Very Important or Important NSSE Item Class Done Plan to do
Do not plan to do
Have not decided
Practicum, internship, field experience, co-op experience, or clinical assignment
FY 88% Practicum, internship, field experience, co-op experience, or clinical assignment
FY 6% 83% 2% 9%
SR 88% SR 77% 8% 13% 3%
BCSSE-NSSE Cross-Sectional Results
How many hours in a typical 7-day week doing each of the following:
BCSSE NSSE
Preparing for class (studying, doing homework, rehearsing etc.)
High School Expected FY First YearCount % Count % Count %
None 13 1 0 0 2 01-10 589 57 128 13 110 2111-20 318 31 521 51 248 46More than 20
111 11 375 37 176 32
Total 1,031
100 1,024
100 536 100
BCSSE-NSSE Longitudinal Results
Level of Academic ChallengeBCSSE Scale Quartil
e Range
TCNJ All Other Masters
Statistical Comparisons
Perceived Academic Preparation
Mean SD N Mean SD N Diff. Sig. ES
Low 25 56.8 12.5 113 51.2 12.8 1644
5.57 *** .44
Mid 50 60.8 11.7 176 54.8 12.3 2274
6.08 *** .51
Top 25 62.5 11.1 90 58.6 13.4 882 3.88 ** .32
BCSSE Scales by NSSE Level of Academic Challenge (LAC)
Requesting NSSE, FSSE, BCSSE Data
Qualtrics Form on Office of Institutional Research and Assessment website