assessment surveys july 22, 2004 chancellor’s meeting

Assessment Assessment SurveysSurveys

July 22, 2004July 22, 2004

Chancellor’s MeetingChancellor’s Meeting

Culture of Assessment Survey - SpringCulture of Assessment Survey - Spring– Professional staff and administrationProfessional staff and administration– DivisionalDivisional

ACT Faces of the Future Survey -SpringACT Faces of the Future Survey -Spring– PCCUA college studentsPCCUA college students

PCCUA Graduate Survey – SpringPCCUA Graduate Survey – Spring– Graduating studentsGraduating students

High School Survey – FallHigh School Survey – Fall– High school students in Phillips and High school students in Phillips and

Arkansas County’sArkansas County’s

Surveys 2003

Community Survey – SpringCommunity Survey – Spring– Phillips and Arkansas County’sPhillips and Arkansas County’s

Advising Survey – Spring Advising Survey – Spring – PCCUA AdvisorsPCCUA Advisors

ACT Survey of Academic Advising - ACT Survey of Academic Advising - SpringSpring– PCCUA College StudentsPCCUA College Students

PCCUA Graduate Survey PCCUA Graduate Survey (revised) - (revised) - SpringSpring– Graduating StudentsGraduating Students

Culture of Assessment Survey – SpringCulture of Assessment Survey – Spring– Professional Staff and AdministrationProfessional Staff and Administration

Surveys 2004

Culture of Assessment Culture of Assessment Survey Survey

Spring 2003 & Spring 2004Spring 2003 & Spring 2004

Culture of Assessment Culture of Assessment Survey Spring 2003 & Survey Spring 2003 &

Spring 2004Spring 2004 Survey to determine perceptions Survey to determine perceptions

regarding progress by College regarding progress by College toward Assessmenttoward Assessment

Faculty, administrators, and Faculty, administrators, and professional staff completed surveyprofessional staff completed survey– Institutional survey –spring 2003 & 2004Institutional survey –spring 2003 & 2004– Divisional survey – spring 2003Divisional survey – spring 2003

Used Dr. Cecelia Lopez’s Used Dr. Cecelia Lopez’s characteristics of assessment as modelcharacteristics of assessment as model– Collective ValuesCollective Values– MissionMission– Shared Faculty ResponsibilityShared Faculty Responsibility– Shared Administrative ResponsibilityShared Administrative Responsibility– Shared Student ResponsibilityShared Student Responsibility– Institutional Support ResourcesInstitutional Support Resources– EfficacyEfficacy

Model included: planning, emerging Model included: planning, emerging and maturing levelsand maturing levels


Spring 2004Spring 2004


Spring 2004Spring 2004 Established a point of reference to measure Established a point of reference to measure

progress of assessment implementation at progress of assessment implementation at PCCUAPCCUA

Long range goal is to improve culture of Long range goal is to improve culture of assessment at the Collegeassessment at the College

Survey confirmed that students have not been Survey confirmed that students have not been involved with the assessment processinvolved with the assessment process

Division survey demonstrated more progress Division survey demonstrated more progress initially within academic divisions than at initially within academic divisions than at institutional levelinstitutional level

– Collective Values & MissionCollective Values & Mission Commitment to studentsCommitment to students Commitment to excellence in educationCommitment to excellence in education Contribution to communityContribution to community Commitment to AccessCommitment to Access Commitment to faculty and staffCommitment to faculty and staff Quality campus lifeQuality campus life

– Shared Faculty ResponsibilityShared Faculty Responsibility Assessment has been faculty ledAssessment has been faculty led

– Shared Administrative ResponsibilityShared Administrative Responsibility Deans and administrators have contributed to Deans and administrators have contributed to

assessment effortsassessment efforts



– Shared Student ResponsibilityShared Student Responsibility Underutilize students in divisional and Underutilize students in divisional and

institutional assessmentinstitutional assessment

– Institutional Support ResourcesInstitutional Support Resources WebpageWebpage Plan of assessmentPlan of assessment

– EfficacyEfficacy Assess student learning evidenced by course Assess student learning evidenced by course

design and improvements in teachingdesign and improvements in teaching



How to use this dataHow to use this data Continue assessment activities, professional Continue assessment activities, professional

development, and divisional and institutional development, and divisional and institutional planningplanning

Increased mean score for each characteristic Increased mean score for each characteristic on survey indicates a measure of on survey indicates a measure of improvement of the culture of assessmentimprovement of the culture of assessment

Assessment will continue to expand as it Assessment will continue to expand as it becomes an effective and integrated process becomes an effective and integrated process used to improve student learning used to improve student learning

Based on outcome of survey it was decided Based on outcome of survey it was decided to add students to the Assessment to add students to the Assessment CommitteeCommittee

ACT Faces of the ACT Faces of the FutureFuture

ACT Faces of the ACT Faces of the FutureFuture Annual, nationwide survey of Annual, nationwide survey of

community colleges (ACT/AACC)community colleges (ACT/AACC) Identifies characteristics of studentsIdentifies characteristics of students Assesses student’s attitudes of school Assesses student’s attitudes of school

programs, services, and environmentprograms, services, and environment Identifies educational and career Identifies educational and career

intentions of studentsintentions of students Compares PCCUA students to national Compares PCCUA students to national

user groupuser group

ACT Faces of the ACT Faces of the FutureFuture Survey categories included Survey categories included

questions related to:questions related to:

– General background of studentGeneral background of student– Employment background of studentEmployment background of student– Educational background of studentEducational background of student– Current college experience of Current college experience of

studentstudent

ACT Faces of the ACT Faces of the FutureFuture Deans selected classes to surveyDeans selected classes to survey

Administered to 244 students across all Administered to 244 students across all campusescampuses

Mean scores based on 5-1 Likert scaleMean scores based on 5-1 Likert scale

ACT compiled data reportsACT compiled data reports

Reports will be linked to Assessment web page Reports will be linked to Assessment web page with Surveywith Survey

ACT Faces of the ACT Faces of the FutureFuture Student perceptions demonstrate Student perceptions demonstrate

PCCUA is committed and respect themPCCUA is committed and respect them

Students feel PCCUA provides quality Students feel PCCUA provides quality serviceservice

Students believe that PCCUA has Students believe that PCCUA has commitment to access and availabilitycommitment to access and availability

Students believe PCCUA reflects Students believe PCCUA reflects commitment to positive campus lifecommitment to positive campus life

How to use this dataHow to use this data

Provided student input for Provided student input for College’s self-studyCollege’s self-study

Opportunity to participate in this Opportunity to participate in this national survey annually each fall national survey annually each fall to assess student perceptions of to assess student perceptions of CollegeCollege

Graduate SurveyGraduate Survey

Graduate SurveyGraduate Survey

20032003– Administered each spring at Administered each spring at

graduationgraduation

2004 2004 – Assessment Committee revised Assessment Committee revised – Revisions correlate with college core Revisions correlate with college core

competenciescompetencies– Results are now maintained in Results are now maintained in

Assessment Office Assessment Office


Graduate data will be documented in the Graduate data will be documented in the Assessment of Student Learning report Assessment of Student Learning report annuallyannually

Graduate Follow-UpGraduate Follow-Up

Graduates perception of education Graduates perception of education receivedreceived

Alumni Surveys createdAlumni Surveys created

High School Survey High School Survey

High School Survey High School Survey

Determine students plans for Determine students plans for enrollment in higher educationenrollment in higher education

Gain enrollment information for PCCUAGain enrollment information for PCCUA

1010thth and 11 and 11thth grades target group grades target group

Administered to 1,078 studentsAdministered to 1,078 students Five Schools- Phillips County (443)Five Schools- Phillips County (443) Seven Schools – Arkansas County (635)Seven Schools – Arkansas County (635)

High School SurveyHigh School Survey

Survey questions related to:Survey questions related to:

EnrollmentEnrollment TechnologyTechnology Availability of services offeredAvailability of services offered Areas of study Areas of study Future plans of studentsFuture plans of students


Availability of services was most significant Availability of services was most significant area of responsearea of response

Students interested in enrolling at PCCUA if Students interested in enrolling at PCCUA if classes offered at their school during the dayclasses offered at their school during the day

Would enroll in ACT/SAT test preparation if Would enroll in ACT/SAT test preparation if offeredoffered

Areas of Study indicated by student based on Areas of Study indicated by student based on interest (students chose more than one area)interest (students chose more than one area)– Overall area of study responses = 2,062Overall area of study responses = 2,062

Top Five Areas of Top Five Areas of InterestInterest

NursingNursing Business ManagementBusiness Management Medical TechnologyMedical Technology CosmetologyCosmetology WeldingWelding


Students indicated they were Students indicated they were interested in AA Transfer degree interested in AA Transfer degree programs by taking courses at programs by taking courses at PCCUA through another college or PCCUA through another college or universityuniversity– Teachers, lawyers, pharmacy, Teachers, lawyers, pharmacy,

business-any professional study business-any professional study requiring a baccalaureate degreerequiring a baccalaureate degree

RecruitmentRecruitment College preparationCollege preparation Secondary Center (to be created)Secondary Center (to be created) Course paths for new Charter Course paths for new Charter

SchoolSchool



Information shared with marketing Information shared with marketing departmentdepartment– Packets of material have been prepared for Packets of material have been prepared for

each student who completed surveyeach student who completed survey– Packets include: fall schedule, brochures for Packets include: fall schedule, brochures for

area of interest, academic advisor list, area of interest, academic advisor list, application for enrollment, letter from college application for enrollment, letter from college relations office, cost comparison list and college relations office, cost comparison list and college catalog (catalog-if requested).catalog (catalog-if requested).

Information shared with each divisionInformation shared with each divisionExample: Graphic Communications – across both Example: Graphic Communications – across both

counties 68 students expressed an interest in counties 68 students expressed an interest in this program.this program.

Future Use of Future Use of High School SurveyHigh School Survey

Survey will continue to be utilized Survey will continue to be utilized because of the wealth of information it because of the wealth of information it providesprovides

Survey will rotate on a two-year cycle Survey will rotate on a two-year cycle and will be administered again in Fall and will be administered again in Fall 20062006

Survey tool has now been developed into Survey tool has now been developed into a web-based format and students will be a web-based format and students will be able to access on-line able to access on-line (Anthony Cunningham (Anthony Cunningham developed web access)developed web access)

Community SurveyCommunity Survey


Survey to determine Arkansas and Survey to determine Arkansas and Phillips County communities’ Phillips County communities’ perception of PCCUAperception of PCCUA

Survey categories included:Survey categories included:

MarketingMarketing College MissionCollege Mission Community PerceptionsCommunity Perceptions Institutional ServicesInstitutional Services


Type of SurveyType of Survey

Conducted convenience sample at various Conducted convenience sample at various locations in Phillips and Arkansas County’slocations in Phillips and Arkansas County’s

Used frequencies and percentages for Used frequencies and percentages for reporting data – easier for people to reporting data – easier for people to understandunderstand

Surveyed 327 individualsSurveyed 327 individuals

Overall report, the community has a positive Overall report, the community has a positive perception of the collegeperception of the college


Needed feedback from constituents in the Needed feedback from constituents in the communities about perception of the communities about perception of the college and last community survey was 15 college and last community survey was 15 years ago which only included Phillips years ago which only included Phillips CountyCounty

Contributes to future institutional planningContributes to future institutional planning

Survey provided data for the College’s self-Survey provided data for the College’s self-studystudy

Advising SurveyAdvising Survey

Advising SurveyAdvising Survey Survey completed by PCCUA advisors Survey completed by PCCUA advisors

to evaluate current advising processto evaluate current advising process

Initiative that began with Carl Perkins Initiative that began with Carl Perkins ProjectProject

Surveyed advisors perceptions of Surveyed advisors perceptions of current academic advising process and current academic advising process and the effectiveness of the proceduresthe effectiveness of the procedures

Survey emailed to all 35 advisors –all Survey emailed to all 35 advisors –all campusescampuses


Anonymous response from advisorsAnonymous response from advisors

Advisor response rate 57%Advisor response rate 57%

100% of advisors who responded stated 100% of advisors who responded stated willing to participate in advisor trainingwilling to participate in advisor training

80% are willing to serve on an advisor 80% are willing to serve on an advisor task force to evaluate current advising task force to evaluate current advising systemsystem


Advisors also responded to open-ended Advisors also responded to open-ended questions and provided suggestionsquestions and provided suggestions

Consensus of group seems to indicate Consensus of group seems to indicate need for more effective training, more need for more effective training, more information, and better communicationinformation, and better communication

Need effective training for new advisorsNeed effective training for new advisors

Advising system is effective to a degree Advising system is effective to a degree but improvements can be madebut improvements can be made


Develop advisor training beginning in the fall Develop advisor training beginning in the fall –conduct annually and as needed to update –conduct annually and as needed to update with new information/technologywith new information/technology

Create a task force – advisors indicated they Create a task force – advisors indicated they want to participatewant to participate

Develop annual evaluation process for Develop annual evaluation process for advisorsadvisors

Advising and Retention Resources purchased Advising and Retention Resources purchased and placed in Library and Professional and placed in Library and Professional Advisor’s offices at all campuses Advisor’s offices at all campuses

How to use this dataHow to use this data Utilize advising resources which Utilize advising resources which

include useful tips and training include useful tips and training sessions that can be adaptedsessions that can be adapted

Survey comments indicated Advisor Survey comments indicated Advisor Training in spring 2004 at NACADA Training in spring 2004 at NACADA Advising Conference was useful and Advising Conference was useful and informative (15 individuals attended)informative (15 individuals attended)

Continue to provide opportunities for Continue to provide opportunities for advisors to attend Advising advisors to attend Advising ConferencesConferences

ACT Survey of ACT Survey of Academic AdvisingAcademic Advising


Surveyed upper level studentsSurveyed upper level students

Deans selected classes to Deans selected classes to administer surveyadminister survey

Survey provides information of Survey provides information of students’ impressions of students’ impressions of institution’s academic advising institution’s academic advising servicesservices


Survey questions related to:Survey questions related to:

– Advising informationAdvising information– Academic advising needsAcademic advising needs– Impression of advisorImpression of advisor– Time spend with advisorTime spend with advisor


Provided students opportunity to Provided students opportunity to evaluate current advisor at PCCUAevaluate current advisor at PCCUA

ACT scores and returns report to ACT scores and returns report to PCCUAPCCUA

172 students responded to survey172 students responded to survey


Feedback from students regarding academic Feedback from students regarding academic advisingadvising

Indicates student perceptions of strengths Indicates student perceptions of strengths and weaknesses in advisingand weaknesses in advising

Evaluation tool to assess academic advisingEvaluation tool to assess academic advising

Individual advisor reports provided to advisors Individual advisor reports provided to advisors

Plan to continue the process of students Plan to continue the process of students evaluating advisors evaluating advisors

Assessment of Assessment of Student Learning Student Learning

Assessment of Assessment of Student Learning Student Learning

AKA - “The Assessment Plan”AKA - “The Assessment Plan”

Evolved into Assessment of Evolved into Assessment of Student Learning Process Student Learning Process

Goals and Expected Outcomes of Goals and Expected Outcomes of Student LearningStudent Learning

Assessment Web PageAssessment Web Page

www.pccua.edu/assessmentwww.pccua.edu/assessment

assessment surveys july 22, 2004 chancellor’s meeting

Documents