FORMATIVE ASSESSMENTOF A COMPUTER-AIDED

ANALYSIS CENTER: PLAN DEVELOPMENT AND

PRELIMINARY RESULTS

Dr. Joan Burtner

Industrial Engineering

Project Evaluator

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 2

Advanced Engineering Analysis Center

Vision Energetic environment in which students and

faculty Discuss and analyze problems Share ideas Interact professionally

Funding W.M. Keck Foundation Three year implementation period

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 3

Design of Assessment Plan

Formative assessment period Phases I - V Scheduled for completion by May 1, 2005

Summative assessment period Phase VI Scheduled for completion by January 1, 2006

Includes quantitative and qualitative assessment methodologies

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 4

Phases I - II 1/1/03 - 8/15/03

Preparation of facility for use Design final layout Order furniture, hardware, and software Request electrical modifications (network drops)

Preliminary module development Course-based modules developed by project leaders

and used as a guide for other faculty Course-based modules and Unix tutorials developed by

affiliated faculty Development of assessment plan

Outline three year assessment plan Design survey instruments Obtain Institutional Review Board approval as needed

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 5

Phase III 8/15/03 - 5/1/04

Implementation and revision of Phase II modules

Implementation of controlled access (Bear Cards)

Initial monitoring of facility usage ISE 327 (Statistical Process Control) Faculty Usage Matrix Student Usage Matrix

Initial collection of student satisfaction data

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 6

Phase IV 5/1/04 - 8/15/04

Development of additional learning modules

Preparation for publication of Phase III modules

Preliminary analysis of assessment data Student Surveys Faculty Usage Matrix Student Usage Matrix Electronic Surveillance Reports

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 7

Phase V 8/15/04 - 5/1/05 Implementation/revision of Phase IV

modules Collection of educational assessment data

EGR 232 XXX 487/488

Continued monitoring of controlled access ISE 327 (Statistical Process Control) Faculty Usage Matrix Student Usage Matrix Electronic Surveillance Reports

Continued assessment of module efficacy

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 8

Phase VI 5/1/05-1/1/06 Final revision of all modules Web publication of modules Analysis of educational assessment data Analysis of student and faculty usage data Dissemination

Final Assessment Report to Keck Foundation Preparation of conference papers related to

module development and implementation Preparation of educational research journal

article related to EGR 232 study

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 9

Initial Assessment Observations 1

Module development can be very time consuming

Module refinement must occur during academic year

Faculty-delivered modules somewhat evenly spaced throughout the term

Typical faculty use Keck Analysis Center for required class activities 2-3 times during the term

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 10

Initial Assessment Observations 2

Student usage varies throughout term, with greater usage occurring during middle of term

Most student usage due to required course assignments

Use of Keck Analysis Center for senior design sporadic and heavily dependent on nature of design project

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 11

Select Student Survey Results

88/116 students gave the Center a rating of 4 or 5 with 5 being “essential to engineering education”

70/116 felt more class time should be spent in the Center

67/116 students expressed a strong interest in using the Center for projects outside of course requirements

79/116 students expressed a strong interest in learning more about the analysis capabilities of the Center software

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 12

Summary of Assessment Plan Components

Module development and implementation Biomedical Engineering Computer Engineering Mechanical Engineering Industrial Engineering

Student feedback Usage statistics Solicitation of Institutional Review Board approval Satisfaction surveys

Educational effectiveness Design of educational experiments Solicitation of Institutional Review Board approval Implementation in EGR 232 (Statics/Solid Mechanics)

Dissemination of assessment results

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 13

Acknowledgements

W. M. Keck Foundation Student Participants

James Sipe, System Administration

Rebecca Quesenberry, Website Design

ISE 327 Students (Keck Center Usage Sampling Project)

Faculty Participants Joan Burtner Donald Ekong Sinjae Hyun Hodge Jenkins Jack Mahaney Ramachandran

Radharamanan John Reece Renee Rogge Loren Sumner

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 14

Extra Slides

Keep in notebook to use if needed

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 15

Contact Information

ASSESSMENT Burtner_J@Mercer.edu Phone (478) 301- 4127 Fax (478) 301- 2331

LEARNING MODULES Sumner_LB@Mercer.edu Phone (478) 301- 5533 Fax (478) 301- 2331

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 16

Planned Module Implementation Biomedical Engineering

Biomechanics Biofluids Basic Biotransport

Phenomenon Computer Engineering

Digital Design with VHDL Computer Networks

Industrial Engineering Manufacturing Processes Computer Assisted

Manufacturing Systems

Mechanical Engineering Finite Elements Fluid Mechanics Visualization and Graphics Engineering Analysis Solid Mechanics II Statics/Mechanics of

Materials Machine Design

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 17

Hardware / Software Implementation 20 Sun Workstations , 1 PC, Projection Screen State-of-the-art engineering software

Networking Intranet Internet

Printers Black and white laser printer Color printer

CFX CATIA

ANSYS MathWorks

ProEngineer Process Engineer

OPNET QUEST

Cadence V5-Inspect

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 18

Module Development Matrix Format

Subject Area Designer PreliminaryModule

Developed

Module Presented

Module Refined

Module Finalized

ME – 1

ME – 2

ISE – 1

CPE – 1

CPE – 2

BME – 1

BME – 2

Others(as needed)

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 19

Fall 2003 Survey

Were you better motivated to work on course assignments that required use of the Keck Engineering Analysis Center facilities

compared to traditional textbook homework?

14

24

38

18

7

0

10

20

30

40

50

60

1 - much moremotivated

2 3 - equallymotivated

4 5 - much lessmotivated

Nu

mb

er o

f R

esp

on

ses

NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 20

Fall 2003 Survey

How valuable do you think the facilities of the Keck Engineering Analysis Center are in engineering education?

03

20

45 43

0

10

20

30

40

50

60

1 - not at allvaluable

2 3 4 5 - essential toengineeringeducation

Nu

mb

er

of

Resp

on

ses