general education assessment challenge

19
GENERAL EDUCATION DEPARTMENT Assessment Results – Academic Year 2012 Prepared by: Maria Boada, Assistant Dean General Education and Foundations Departments

Upload: aipselfstudy

Post on 28-May-2015

526 views

Category:

Education


1 download

TRANSCRIPT

Page 1: General Education Assessment Challenge

GENERAL EDUCATION DEPARTMENTAssessment Results – Academic Year 2012

Prepared by: Maria Boada, Assistant DeanGeneral Education and Foundations Departments

Page 2: General Education Assessment Challenge

Mission and StructureGeneral Education Curriculum

Provides knowledge and skills required to become a well-rounded graduate and citizen.

Facilitates artistic and aesthetic appreciation, develop knowledge, and enhance the skills and critical thinking abilities needed for professional success.

Constitutes 30% of all degree programsIndividual Program's Curriculum

General Education Curricu-

lum

Page 3: General Education Assessment Challenge

General EducationStudent Learning Outcomes

Develop students

professionally and personally:

well rounded academic

experience

Written Communication

Oran Communication

Arts and Humanities

Behavioral and Social Sciences

Math and Natural Sciences

Information Fluency

Page 4: General Education Assessment Challenge

FY2012 Process and Faculty Engagement

• Means of assessment and criteria for success provided by Ai System Assessment Office

Assessment Model provided by Ai

System

• Faculty in each discipline review and plan implementation of assessment instrument(s) in their courses

• Data collection planned

Faculty Review and Planning

• Data collection takes place throughout the academic year

• Analysis of data takes place during in-service faculty meeting

Data Collection and Analysis

• Recommendations are implemented in curriculum and pedagogy

• Changes to assessment plan are recommended for next cycle

Use of Results and revision of future

plans

Page 5: General Education Assessment Challenge

Learning Outcomes:Written Communication

Written Communicatio

n Graduates will demonstrate

effective written communication by

providing their audience sufficient information on a

topic that is organized and employs the

generally accepted conventions of

English Language

Means of Assessment:

a. Writing Portfolio is evaluated

according to a set five point rubric

Means of Assessment:

b. ETS (Educational Testing Service)

Proficiency Profile

Success Criteria:a. 80% of students will

score a 3 or higherb. 75% of graduates

will score at or above the national ETS

average on the ETS writing component

Courses Assessed: ENG095 (Transitional

English), ENG1010 (English Composition

I) and ENG1020 (English Composition

II)

Page 6: General Education Assessment Challenge

Written Communication:FY12 Results

Assessment Cycle: ENG courses

Quarter of Data Collection

Artifact (s) Collected

Additional Data Collected

ENG095 FA2011 25% random sample of all Writing Portfolios

FY2012 cumulative passing rates. Passing rates in ENG1010

ENG1010 WI12 30% random sample of all writing portfolios. ETS Proficiency Profile Data

Qualitative focus on reflective essay

ENG1020 Collected during FY2011. Next data collection: WI2013

NA NA

Page 7: General Education Assessment Challenge

Written Communication..cont.

ENG095: Transitional EnglishCriteria: 80% of students will earn a 3

or higher (5 point rubric)

96% of students achieved an overall

score of 3.0 or better – Far exceeded set criteria

Criteria: 70% of students will earn a C

or better

74% of all student who took ENG095 in

SU11, FA11, WI12 and SP12 earned a C or better – Exceeded

set criteria

Additional Data will be presented in the Transitional Curriculum Assessment report

Page 8: General Education Assessment Challenge

Written Communication..cont.

Competency Average scoreWriting process—prewriting, drafting, revising, proofreading and editing 3.6

Structure 3.4Use of detail 3.8Use of standard rules of English grammar, mechanics and sentence construction

3.3

Understanding of reading and writing as interconnected processes

3.4

Use of critical thinking through argument or narrative 3.4

ENG095 Results: results by Competencies

•Results exceeded set criteria•Students did particularly well in the competency related to understanding the writing process.•Future assessment will focus on reading and writing as interconnected processes.

Page 9: General Education Assessment Challenge

Written Communication..cont.

ENG1010: Composition and Language

Criteria: 80% of students will earn a 3

or higher (5 point rubric)

70% of students earned a 3 or better – did not

meet criteria (see analysis)

Criteria: 75% of graduates will score at or above national

average in ETS Proficiency Profile writing component

Writing Level 1: 55% Proficient (National

Average is 69%)Writing Level 2: 15% Proficient (National

Average is 41 %)Writing Level 3: 6 % Proficient (National

Average is 8%)

Average Scores were below the

ETS National Averages for

College Seniors

Page 10: General Education Assessment Challenge

Written Communication..cont.

Writing process—prewriting, drafting, revising, proofreading and editing 3.0

Structure 3.4Use of detail 3.0Use of standard rules of English grammar, mechanics and sentence construction 3.5

Understanding of reading and writing as interconnected processes 3.1

Use of critical thinking through argument or narrative 3.4

ENG1010: Breakdown of Average Scores by Competency

Page 11: General Education Assessment Challenge

Written Communication..cont.

While the 80% criteria was not met, the total average scores was 3.25.= and no average for each competency was below 3.0. Further analysis showed two sections of ENG1010 with a high percentage of left-outliers.

The discussions centered on emphasizing data-generating exercises and a higher focus on intertextuality.

The ETS data showed writing proficiency levels below the national average. We recommend additional data collection and comparison with institutions that have programs similar to AiP.

Analysis and Use of Results

Page 12: General Education Assessment Challenge

Learning Outcomes:Oral Communication

Graduates will demonstrate effective oral

communication by providing their

audience sufficient information on a

topic that is organized and that

employed the generally accepted

conventions of English Language.

Means of Assessment: a. Capstone

assignment in COM3010: Analytical

oral presentation with visual aids.

Means of Assessment:

b. Graduate Surveys

Success Criteria:a. 80% of students will

score a 3 or higherb. 90% of students

agree that they have good communication

skills

Course evaluated:COM3010 Advanced

Communication

Page 13: General Education Assessment Challenge

Oral Communication:FY12 Results

Assessment Cycle: Communications

Quarter of Data Collection

Artifact (s) Collected

Additional Data Collected

COM3010Advanced Communications

FA2011, SP2012

A random 30% sample of all final oral presentations, centered around the SWOT analysis) were evaluated by a in-class panel of faculty

Results from graduate surveys related to communication skills

Page 14: General Education Assessment Challenge

Oral Communication…cont.

Criteria: 80% of students will earn

a score of 3 or higher in the oral presentation (5

point rubric)

90% of students scored a 3 or

higher in the oral presentation – Far

exceeded set criteria

Criteria: 90% of graduate students

agree/strongly agree that they

have good communication

skills

Data no yet received from

corporate office

COM3010 Advanced Communication - Results

Page 15: General Education Assessment Challenge

Oral Communication…cont.

Overall % of 3 and above

Average Score:Structure

Average Score:Non-verbal Skills

Average Score: Visual Aids

Average Score: Support

FA11 and SP122

90% FA11: 3.19

FA11: 3.54

SP12:2.59

FA11: 3.47

SP12: 2.35

Average Scores: Overall and breakdown by Competency

Page 16: General Education Assessment Challenge

Oral Communication…cont.

Analysis and Use of Results

The overall results met the stated criteria but some of the competencies highlighted areas of improvement.

Scores for the “Support” category were lower in SP12 than in the FA11 cycle. Oral communication instructors recommend a higher emphasis in research-based information and will collaborate with Writers’ Center to incorporate MLA workshops and other information literacy initiatives.

Average scores for the “Visual Aids” were also lower than expected. Added emphasis will be placed on visual aids requirements for final oral presentations.

Support and Visual Aids will be evaluated in the next assessment cycle.

Page 17: General Education Assessment Challenge

Learning Outcomes:Arts and Humanities

Graduates will demonstrate the

ability to interpret and analyze

artistic work, historical events, or philosophical

thought and describe the

relevance of the work to

themselves, society and

cultures.

Means of Assessment:

a. Comparative Analysis essay

holistically scored with a five-point

rubric

Means of Assessment:

b. ETS (Educational Testing Service)

Proficiency Profile

Success Criteria:a. 70% of students

will score a 3 or higher

b. 75% of graduates will score at or above

the national ETS average subscore for

humanities

Course Assessed: ART3010

American Art History

Page 18: General Education Assessment Challenge

Assessment: Sustainable and Uninterrupted

The results present a sample of the holistic assessment picture in our general education department

Additional results for all outcomes can be found in the FY12 Assessment Report

Assessment also takes place in the online modality and results are compared to the outcomes from campus students

Results from assessments continuously feed into curriculum modifications and improvements in pedagogy

Page 19: General Education Assessment Challenge

Questions or Comments?