ccsse 2015 report release · 2015-09-11 · overview page 7 cohort overview ... respondent profile...

27
Working With and Communicating About Your Survey Results September 10, 2015 CCSSE 2015 Report Release

Upload: others

Post on 08-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

Working With and Communicating About

Your Survey Results

September 10, 2015

CCSSE 2015 Report Release

Page 2: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT2

Welcome to Today’s Presentation

Evelyn WaiwaioleDirectorCenter for Community College Student Engagement

Page 3: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT3

If you have questions during the presentation, please

use the Q&A pod, and a Center staff member will

respond.

If we ask you to respond to a poll question, please use

the Chat pod.

Jeff CrumpleyAssociate Director

Page 4: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Working with Results

4

Page 5: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Report Release & Availability

Reporting for three most recent administration years available on site

• Contact your liaison for reporting prior to current cohort years

Results—including raw data file—available to anyone with members

only login credentials

• Raw data with student ID numbers must be requested by email

5

Page 6: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

CCSSE Reports: What is Available

6

Two main report types

• Standard Reports

• Custom Reports

Also available

• Appendices

• Raw data files

• Codebooks

• Information on methodology &

understanding survey results

• CCFSSE reports

Page 7: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Overview Page

7

Cohort overview

• Information about participant institutions

Respondent Profile

• Demographic information about cohort respondents

CCSSE Sampling

• Methodological information about survey sampling procedures

www.ccsse.org/members/reports/2015/overview.cfm

Page 8: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Understanding Survey Results Page

8

Provides methodological information on...

• Excluded respondents

• Respondents included in raw data file

• Standards for interpreting mean differences

• Weighting

• Student breakout criteria

www.ccsse.org/members/reports/2015/understanding.cfm

Page 9: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Standard Reports Page

9

Key Findings

Benchmark Reports

Frequency Reports

Means Reports

Standard Reports Breakout Options • Enrollment Status (full and less than full-time)

Standard Reports Comparison Options • Size Category

• National (3-year) Cohort

• Consortium comparison report also provided if college was part of consortium

www.ccsse.org/members/reports/2015/reports.cfm

Page 10: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Key Findings Report

10

Provides a tailored executive summary of institutional and cohort-level

results

Content includes

• Benchmark comparisons between your college and

2015 top-performing colleges

• Aspects of highest & lowest student engagement

• Special-Focus Items

• CCFSSE Results

Cohort-level results are included for institutions that did not

administer the faculty survey

www.ccsse.org/members/reports/2015/reports.cfm

Page 11: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Benchmark Report

11

Five groups of conceptually-related survey items in the following areas of student

engagement• Active & Collaborative Learning

• Student Effort

• Academic Challenge

• Student-Faculty Interaction

• Support for Learners

All student report & enrollment breakout report available

on Standard Reports page

More breakout options available on Custom Report Requests

page

Benchmarks are starting points for looking at your data

• Examine means and frequency scores for the individual items

included in benchmarks of interest

Item-level means and frequency data are included in the

benchmark report to facilitate this process

www.ccsse.org/members/reports/2015/reports.cfm

Page 12: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Means Report

12

Provides weighted item-level mean scores

Effect sizes meeting Center criteria for practical differences are flagged with a

double asterisk

• To be flagged, item must have a t-test value < .001 AND an effect size with an absolute value

> .2

All student report & enrollment breakout report available on Standard Reports page

• More breakout options available on Custom Report Requests page

Provides comparison to similarly-sized colleges and the national cohort

Consortium comparison report also provided if college was part of consortium

www.ccsse.org/members/reports/2015/reports.cfm

Page 13: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT13

Frequency Report

Provides weighted counts and percentages at the item level

All student report and enrollment breakout report available on Standard

Reports page

Provides comparison to similarly-sized colleges and the national cohort

Consortium comparison report also provided if college was part of

consortium

www.ccsse.org/members/reports/2015/reports.cfm

Page 14: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Appendices

• Table 1 Respondents to Underlying Population Comparisons

• Table 2 Percent of Target

• Table 3 Respondents and the Underlying Population Comparisons by

College Size

• Table 4 Underlying Population Percentages by Sex, Race/Ethnicity, and

Enrollment Status

• Table 5 Underlying Population Percentages by Age

• Table 6 Survey Completion Rates

Codebook

Also Available on the Standard Reports Page

14

Raw Data File

• Student Identifier file must be requested; it is

mailed on password-encrypted CD

Additional Items Frequency Reports

• Only available on reporting page corresponding to

administration year

www.ccsse.org/members/reports/2015/reports.cfm

Page 15: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT15

Allows institutions to compare...

• student groups within & across institutions

• results/breakout results with those of other

institutions

Custom Report Requests Page

Custom Breakout Options • Less Than Full-Time & Full-Time (Enrollment Status)

• Developmental & Non-Developmental

• Traditional & Nontraditional-Age Students

• First-Generation & Not First-Generation Students

• Male & Female Students (Sex)

• Race/Ethnicity

• Credit Hours Earned (0 to 29 & 30+)

Custom Comparison Options • Size Classification

• Private/Public Classification

• Location

• State

• Accreditation Region

• Consortia

• Custom Comparison Group

*Requested reports are displayed on the Completed

Report Requests page for 15 days. After this point,

users must re-enter site and request reports again.

www.ccsse.org/members/reports/2015/analysis.cfm

Page 16: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

For More Details

16

Center Tutorials

• Navigating the Online Reporting System (Overview)

• Interpreting Key Findings

• Standard Reports (Benchmarks, Means, Frequencies)

• Custom Report Requests

Located in the Tools section of the website at

http://www.ccsse.org/tools/tutorials/

Page 17: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Communicating About Your Results

17

Courtney AdkinsAssistant Director

Page 18: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Available Tools

18

www.ccsse.org/tools/sharingresults

Page 19: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Tools for Working with and Sharing Results

Drop-In Overview Templates

• Report

• Presentation

Predictions Exercises

• Faculty

• Student Services Staff

Data Narrative Exercise

College Connections Inventory

CCSSE and CCFSSE Results News Releases

Focus Group Guides

19

Page 20: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Drop-in Overview Report Template

20

Available on the Sharing Results page

CCSSE and CCFSSE versions available

www.ccsse.org/tools/sharingresults.cfm

Page 21: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Drop-in Overview Presentation Template

21

Available on the Sharing Results page

CCSSE and CCFSSE versions available

www.ccsse.org/tools/sharingresults.cfm

Page 22: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Predictions Exercises

22

Available on the Working with Results and Sharing Results

pages

Faculty and Student Services Staff versions available

www.ccsse.org/tools/sharingresults.cfm

Page 23: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Data Narrative Exercise

23

Available on the Working with Results and Sharing Results pages

www.ccsse.org/tools/workingresults.cfm

Page 24: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT24

College Connections Inventory

Available on the Sharing Results page

www.ccsse.org/tools/sharingresults.cfm

Page 25: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT25

Survey Results News Releases

Available on the Sharing Results page

www.ccsse.org/tools/sharingresults.cfm

Page 26: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Focus Group Guides

26

Contact [email protected]

for assistance with

focus group guides.

Page 27: CCSSE 2015 Report Release · 2015-09-11 · Overview Page 7 Cohort overview ... Respondent Profile ... Drop-In Overview Templates

THE CENTER FOR COMMUNITY COLLEGE STUDENT ENGAGEMENT

Center staff always welcomes questions at

[email protected]

[email protected]

Thank you for joining us!

27