what do our students know? a complete cycle of assessment: the common learning outcomes we hold for...

16
What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

Upload: shannon-stanley

Post on 21-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our students know?

A complete cycle of assessment: the common learning outcomes

we hold for our UG students: Round IV, 2012 - 2013

Page 2: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do we want our UG students to know?

Learning Outcome

Cycle #1

Assessed in . . .

Cycle #2

Assessed in . . .

Cycle #3

Assessed in . . .

Cycle #4

Assessed in . . .

Communication Skills

Oral 2004-2005 Fall 2008 Fall 2010 Due Fall 2012 - POSTPONED

Written 2005-2006 Spring 2009 Fall 2010 Fall 2012

Critical Thinking Skills 2006-2007 Fall 2009 Fall 2010 Fall 2012/

Spring 2013

Ethical Reasoning Skills

2007-2008 Spring 2010 Fall 2011 Spring 2013

Global Perspective NA – Outcome new in 2009

Spring 2010 Spring 2011 Spring/Fall 2012

Essential Business Knowledge

Annually Annually Annually Annually

Page 3: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our UG students know?

ORAL COMMUNICATION SKILLS This student learning outcome of the

Communication goal was postponed from the Fall 2012 time it was set to be assessed due to the AACSB Maintenance of Accreditation visit that occurred during that semester and an Undergraduate Curriculum Committee decision to review the measurement method.

Cycle #4 Assessment Time: FALL 2013

Page 4: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our UG students know?

WRITTEN COMMUNICATION SKILLS Assessed using the Writing Proficiency Assessment (WPA). WPA is assessed on a 12 point scale where 10-12 Exceeds

Expectations, 8-9 Meets Expectations, Below 8 falls Below Expectations; Scale equates to the CBA Written Communication Rubric.

Assessed on six criteria: Content Organization

Audience Style

Mechanics Referencing

Page 5: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

The student will use clear and concise communication in the written formBenchmark: 85% will meet or exceed, 50% will exceed

0%

10%

20%

30%

40%

50%

60%

Below Expectations Meets Expectations Above Expectations

31%

54%

15%

Page 6: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our UG students know?

CRITICAL THINKING SKILLS Assessed using essay questions from final exam in MGT 405, the

college-wide capstone course. Assessed using a 3 point rubric (Below Expectations, Meets

Expectations, Exceeds Expectations). “Approaches Expectations”, used in previous cycle was dropped in

Cycle #4. Assessed on 5 criteria that map to 2 SLOs:

Understands Question/IssueKnowledge of facts & use of data to illustrate positionUnderstands & applies concepts & frameworksThinks strategicallyArrives at logical conclusions

Page 7: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

Critical Thinking SkillsBenchmark: 85% will meet or exceed, 50% will exceed

0.0%20.0%40.0%60.0%80.0%

100.0%

Above Exp.

Meets Exp.

Below Exp.

Page 8: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our UG students know? ETHICAL REASONING SKILLS

Assessed using embedded questions on final in BA 300 – Ethical Decision Making in Business

SLO #1: Explain the various ethical dimensions of business decision making. (3 Qs)

SLO #2: Explain the role of various affected parties in business decision-making. (3 Qs)

SLO #3: Asses the ethics of decision alternatives using different ethical decision rules. (3 Qs)

SLO #4: apply ethical decision-making rules and concepts. (3 Qs)

Page 9: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

Ethical Reasoning Skills

0.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%

100.00%

SLO #1 SLO #2 SLO #3 SLO #4

% Correct, Benchmark: 70%

Page 10: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our UG students know?

GLOBAL PERSPECTIVE Assessed using responses to a final exam

essay question in MGT 405 (college-wide capstone course)

SLO #1: Identify and describe the impact of the global economy on business decisions.

WAS NOT ASSESSED IN THIS CYCLE SLO #2: Explain and apply a global

perspective in making business decisions.

Page 11: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

Global PerspectiveBenchmark: 70% will meet or exceed, 30% will exceed

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

Application of Global Perspective

Above Exp.

Meets Exp.

Below Exp.

Page 12: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our UG students know?

ESSENTIAL BUSINESS KNOWLEDGE Assessed via the Business Assessment Test (BAT)

– 80 Multiple Choice Qs Administered across the CSU system Given in MGT 405, the college-wide capstone course Traditionally Assesses: Accounting, Business Law,

Economics, Finance, Info Systems, Management, Marketing, Statistics

Substantially revised in 2010 Additional topics added: Ethics, Global, Operations

Page 13: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

SDSU Longitudinal Comparisons

50.6% 50.3% 50.1% 50.3% 54.9% 55.3% 56.4% 57.9% 58.9%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

2004 2005 2006 2007 2008 2009 2010 2011 2012

Overall Performance

2008 & after: scores used adjusted scoring that removed 22 items of questionable validity2011: substantial revision of test renders longitudinal comparison less valid

Page 14: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

SDSU Subject Area Results (2012) Percent of questions answered correctly within each subject area

All Majors

Accounting 52.00% 70.37%

Economics 47.46%

Ethics 94.06%

Finance 60.23% 71.37%

Information Systems 55.66% 75.50%

Global/International 42.92% 50.91%

Law 40.41%

Management 73.76% 75.82%

Marketing 64.16% 70.53%

Operations 58.42%

Statistics 58.74%

Page 15: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

SDSU Longitudinal Comparisons

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

2005 2006 2007 2008 2009 2010 2011 2012

CSU

SDSU

Page 16: What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV, 2012 - 2013

What do our students know? Summary

Communication Skills Most students are fair writers but a segment are weak

Critical Thinking Skills Our students are fair critical thinkers

Ethical Reasoning Skills Our students have good ethical reasoning skills

Global Perspective Our students can apply a global perspective

Essential Business Knowledge Our students vary by discipline on knowledge of essential

business principles but are stronger than the CSU average