SJSU Annual Program Assessment Form Academic Year 2016‐2017

Department: Aviation and Technology

Program: Bachelor of Science in Aviation

College: Engineering

Program Website: http://avtech.sjsu.edu

Link to Program Learning Outcomes (PLOs) on program website: http://avtech.sjsu.edu

Program Accreditation (if any): None

Contact Person and Email: Wenbin Wei, Wenbin.Wei@sjsu.edu

Date of Report: February 28, 2017

Part A 1. List of Program Learning Outcomes (PLOs) (PLOs should be appropriate to the degree and consider national disciplinary standards, if they exist. Each outcome should describe how students can demonstrate learning.)

All assessment measures were developed by the faculty working jointly with the program advisory board and regional aviation education partners. The measures are reflected in course level assessment tools that indicate mastery of learning objectives along with the means used to measure this learning. The Program Learning Outcomes (PLOs) for all Aviation and Technology Dept. programs are: a. Demonstrate strong communication, critical thinking, and interpersonal skills; b. Use skills in team development, dynamics, and management to work as team players; c. Demonstrate ethical behavior and concern for colleagues, society, and the environment; d. Demonstrate leadership skills for a technology professional.

The individual SLOs for each key course in the assessment program for the BS degree program in

Aviation are shown in section 2, Map of SLOs to ULGs. The manner in which learning of the

outcomes is attained (eg: exam, homework, project, paper, etc) is shown in the data collection

forms used by each instructor.

2. Map of PLOs to University Learning Goals (ULGs) (Please indicate how your PLOs map to the University Learning Goals below by listing the PLO under each relevant ULG, or including this map in table form (see examples here). Use the link above for a full description of each ULG.)

ULG 1 – Specialized Knowledge ULG 2 – Broad Integrative Knowledge ULG 3 – Intellectual Skills ULG 4 – Applied Knowledge ULG 5 – Social and Global Responsibilities

Table 1 below illustrates the relationship between the SLOs for each program concentration and the University Learning Goals. They demonstrate good overlap between the SLOs for each program and the ULGs. Table 1 shows the alignment of both overarching PLOs and program SLOs to the required courses for each program.

Table 1. Matrix of Aviation program Student Learning Outcomes to ULGs.

BS Aviation University Learning Goals

Matrix of Aviation program Student Learning Outcomes to ULGs

Specialized

K

no

wled

ge

Bro

ad In

tegrative

Kn

ow

ledge

Inte

llectual Skills

Ap

plied

Kn

ow

ledge

Social / G

lob

al R

esp

on

sibililities

Student Learning Outcomes

A1 Apply current knowledge and adapt to emerging applications in aviation

X X X

A2 Function effectively on teams X X X X

A3 Communicate effectively X X X X X

A4 Understand the role and processes in team development, dynamics and management

X X X

A5 Understand the attributes and behavior of an aviation professional, career planning, and certification

X X X

A6

Demonstrate an understanding of aircraft design, performance, operating characteristics, and maintenance as it relates to the student’s career goals

X X X

A7 Analyze the role and regulations regarding aviation safety

X X X

A8 Describe the legal and labor issues in national and international aviation

X X X X

A9 Describe meteorology and environmental issues as they relate to aviation

X X X

3. Alignment – Matrix of PLOs to Courses (Please show in which courses the PLOs are addressed and assessed. The curriculum map should show increasing levels of proficiency and

alignment of curriculum and PLOs. See examples here)

Table 2 Matrix of Program Learning Outcomes and Student Learning Outcomes to Aviation Courses

Bachelor of Science in Aviation

Course list

ULGs: Not yet available

A1 A2 A3 A4 A5 A6 A7 A8 A9

AVIA 002: Introduction to Aviation X X X X X X X X

AVIA 031: Aircraft Theory and Design X X X

AVIA 042: Aircraft Systems X X X

AVIA 043: Propulsion Theory X X X

AVIA 068: Avionics and Airborne Communication X X X

AVIA 073: Air Traffic Control X X X

AVIA 078: Introduction to Aviation Management X X X X X

AVIA 091: Aircraft Turbine Engines X X

AVIA 128: Aviation Safety and Security X X X X X X X

AVIA 141: Human Factors in Aviation Environment X X X X

AVIA 168: Avionics and Microwave Systems X X

AVIA 169: Avionic System Integration X X

AVIA 173: Aviation Law X X X X X

AVIA 176: Airline Operations and Management X X X X X X X X

AVIA 177: General Aviation Operations and Mgt. X X X X X X X

AVIA 178: Airport Planning and Management X X X X X X

AVIA 179: Advanced Airport Planning and Mgt. X X X X X

AVIA 190: Senior Capstone Seminar X X X X X X X X

AVIA 192: Instrument Flight Techniques X X X X

AVIA 193: Aerodynamics X X

AVIA 194: Pilot Avionics & Gen. Aviation Systems X X X X X X X

Key courses for assessment measures shaded key course taught in another department

4. Planning – Assessment Schedule

(Please provide a reasonable, multi‐year assessment plan that specifies when a PLO will be assessed (A), when you might plan to implement changes as a result of your assessment (I), and, if applicable, when you might reassess a given PLO (R) to gauge the impact of the change. All PLOs should be assessed at least once during each program planning cycle (usually 5 years). Add rows and columns as necessary.) The assessment schedule measures outcomes in each program, in key courses in the curriculum as shown below. This report is the third assessment report completed in the past. The first assessment report was completed in 2015, which is based on one course, Aviation 190. The second assessment report is completed in 2016 and based on the data from one course: Aviation 128. This third assessment is based on the data collected from three courses: Aviation 2, Aviation 31 and Aviation 190. The department needs to be more strict wit the requirement and make more effort to collect the data needed for the assessment plan.

Table 4. Five-year Course Level Assessment schedule for the BS Aviation program

AY 2014-15 AY 2015-16 AY 2016-17 AY 2017-18 AY 2018-19

Course # Title Course

Role Fall Spr Fall Spr Fall Spr Fall Spr Fall Spr

Avia 002 Introduction to Aviation Entry

M R I/M R I/M R

Avia 031 Aircraft Theory and Design CORE

M R I/M R I/M

Avia 128 Aviation Safety and Security CORE

M R I/M R I/M R I/M

Avia 190 Senior Capstone Seminar Capstone M R

M R I/M R I/M R

Tech 198 Technology and Civilization CORE/GE

M Collect data ('Measure')

R analyze and review

I Implement changes

I/M Implement and Measure

In addition to the course-level outcomes assessment, the Department will continue to gather outcomes information from graduates, as well as feedback from students in the program, every 2 to 3 years. The most recent surveys were conducted in Fall 2014, with previous surveys conducted in 2010 and 2012.

5. Student Experience a. How are your PLOs and the ULGs communicated to students, e.g. websites, syllabi,

promotional material, etc.? b. Do students have an opportunity to provide feedback regarding your PLOs and/or the

assessment process? If so, please briefly elaborate. The department lists all PLOs and SLOs on each course green sheet, and on the department website, linked to the pages for each program. At this time current students are not engaged directly in the creation of or review of the outcomes; however, there was a student representative on the Aviation Industry Advisory Board who provided student viewpoint for the Board. In addition the surveys of current students which are conducted every 2 to 3 years are part of our assessment process and will be used to shape and revise our PLOs. The faculty will discuss whether or not to involve the students directly in the creation or revision of program outcomes, and if so how to accomplish this purpose.

Part B 6. Assessment Data and Results

(Please briefly describe the data collected for this report (e.g., student papers, posters, presentations, portfolios, assignments, exams). The instruments used to evaluate student achievement (e.g., rubrics or other criteria) and actual data (e.g., assignment description or instructions) should be attached as appendices.)

Assessment in our programs takes place at several levels. First, PLOs are monitored for

relevance to the SJSU University Learning Goals. Second, learning of student outcomes takes place at key courses in both the core curriculum and the more specialized curricula for each concentration. Third, Surveys are collected every 2 to 3 years for feedback from current students and from program alumni. Finally, data from the course assessment and the surveys is provided to the faculty for review and recommendations. Examples of course level data collection are provided in Appendix 1. Prior surveys of students and alumni were conducted in 2010 and 2012. In this assessment report, the data for three courses (Aviation 2, Aviation 31, and Aviation 190) are collected. The detailed data are provided in Appendices 1A, 1B, and 1C of this report. The measures used to assess student learning and the methods to evaluate these measures in Aviation 2 are listed in the table below.

List measures used to assess learning: How Measured

A1: Apply current knowledge and adapt to emerging applications aviation

Weekly testing (quizzes) on the text and lecture materials

A7: Analyze the role and regulations regarding aviation safety.

Testing upon FAR's, and SOP's

The measures used to assess student learning and the methods to evaluate these measures in Aviation 31 are listed in the table below.

List measures used to assess learning: How Measured

A6: Demonstrate an understanding of aircraft design, performance, operating characteristics, and maintenance as it relates to the student’s career goals

This is the primary focus of the course. The lectures, homework and labs are based on the goal of conveying the understanding and mastery of the CLOs that support this. Solutions to homework and labs are provided in class, discussed and then posted on Canvas. The lecture slides are also

posted on Canvas. Mid-term exams are also reviewed to enhance understanding of the material. The students are also required to write a research paper relating to one or more of the CLOs and then present it to the class. All assignments are graded and feedback is noted on each. The research paper and the presentation of it are graded and written feedback is provided to the student on each. Two mid-term exams and the final exam are also used to evaluate the mastery of the course material.

A7: Analyze the role and regulations regarding aviation safety

FAA regulations are discussed as an integral part of the design, performance, maintenance and safety aspects of aircraft. The students are evaluated on the significant aspects of these areas on the exams, and some of the homework assignments.

The measures used to assess student learning and the methods to evaluate these measures in Aviation 190 are listed in the table below.

List measures used to assess learning: How Measured

A1: Apply current knowledge and adapt to emerging applications in aviation

Based on the completion of team project (maximum score is 50).

A2: Function effectively on teams Based on the completion of team project (maximum score is 50).

A3: Communicate effectively

Based on the project presentation (maximum score is 10), discussion and communications in class, and completion of the project.

A4: Understand the role and processes in team development, dynamics and management

Based on the completion of team project (maximum score is 50).

A5: Understand the attributes and behavior of an aviation professional, career planning, and certification

Based on the completion of resume (maximum score is 10) and the cover letter (maximum score is 10)

7. Analysis

(Please discuss the findings and evaluate the achievement of PLOs and/or progress on recommended actions.)

The outcomes of the assessment for each measure in Aviation 2 are listed in the table below.

Measures Total number of students

E = Exceeded

M = Met

N = not met at 70% mastery

A1 54 27 20 7

A7 54 24 19 11

It can be seen that more than 87% of students “exceeded” or “met” the criteria for “A1: Apply current knowledge and adapt to emerging applications aviation”, and about 80% of students “exceed” or “met” the criteria for “A7: Analyze the role and regulations regarding

aviation safety”. The outcomes of the assessment for each measure in Aviation 31 are listed in the table below.

Measures Total number of students

E = Exceeded

M = Met

N = not met at 70% mastery

A6 47 15 27 5

A7 47 15 27 5

It can be seen that more than 89% of students “exceeded” or “met” the criteria for “A6: Demonstrate an understanding of aircraft design, performance, operating characteristics,

and maintenance”, and more than 89% of students “exceed” or “met” the criteria for “A7: Analyze the role and regulations regarding aviation safety.” The outcomes of the assessment for each measure in Aviation 190 are listed in the table below.

Measures Total number of students

E = Exceeded

M = Met

N = not met at 70% mastery

A1 46 17 29 0

A2 46 17 29 0

A3 46 15 30 1

A4 46 17 29 0

A5 46 35 11 0

It can be seen that all the students “exceeded” or “met” the criteria for “A1: Apply current knowledge and adapt to emerging applications in aviation”, “A2: Function effectively on teams”, “A4: Understand the role and processes in team development, dynamics and management”, and “A5: Understand the attributes and behavior of an aviation professional, career planning, and certification”, and more than 99% of students “exceed” or “met” the criteria for “A3: Communicate effectively.”

8. Proposed changes and goals (if any)

(Given your findings, please list the proposed changes and goals for the next academic year and beyond – that is, how will you “close the loop”?)

This is the first time that the data of course Aviation 2 and Aviation 31 are collected for assessment purpose, we strongly recommend that the course instructors continue to collect assessment data in the future, make more efforts help those students who do not meet the specific learning criteria, and improve the course curriculum and teaching in general. More detailed recommendations for changes are expected in the future.

Part C (This table should be reviewed and updated each year, ultimately providing a cycle-long record of your efforts to improve student outcome as a result of your assessment efforts. Each row should represent a single proposed change or goal. Each proposed change should be reviewed and updated yearly so as to create a record of your department’s efforts. Please add rows to the table as needed.)

Proposed Changes and Goals Status Update

Data need to be collected from four courses, including Aviation 2, 31, 128 and 190.

The data from each of these 4 courses has been collected once. We will continue the process in the future.

Appendix 1A: Course Assessment form for Aviation 2, Fall 2016

Course number Title Semester

44111 Aviation 2 Fall 2016

Instructor Name Falcon SLOs measured

Student Name Grade SLO A1 SLO A7

1 D N N

2 C E M

3 F M N

4 A M E

5 B- E E

6 C N M

7 A E E

8 B E E

9 A M E

10 A M E

11 A M E

12 A M E

13 B E E

14 A- M E

15 A M E

16 C E M

17 C N M

18 B- N M

19 F E N

20 A E E

21 D E N

22 A E E

23 C E M

24 C M M

25 B M E

26 B+ M E

27 B+ E E

28 C+ N M

29 A E E

30 C E M

31 B E E

32 C E M

33 B- E M

34 F E N

35 B- E M

36 B+ N/A E

37 F E N

38 D E N

39 C M M

40 C M M

41 C- M M

42 A- E E

43 F E N

44 C- B N

45 B- M M

46 C M M

47 B E E

48 C M M

49 B E E

50 C M M

51 F N N

52 A E E

53 F N N

54 B E E

List measures used to assess learning: How Measured

Apply current knowledge and adapt to emerging applications aviation

Weekly testing (quizzes) on the text and lecture materials

Analyze the role and regulations regarding aviation safety.

Testing upon FAR's, and SOP's

Select outcomes to be measured for semester, and score each student for each outcome:

N = not met at 70% mastery M = Met E = Exceeded

Appendix 1B: Course Assessment form for Aviation 31, Spring 2016

Course number: Aviation 31 Title Semester

Instructor Name: Dennis Romano SLOs measured

Student Grade SLO A6 SLO A7

1 B M M

2 A- E E

3 A E E

4 A E E

5 D N N

6 B M M

7 A- E E

8 C+ M M

9 A E E

10 C M M

11 D N N

12 C M M

13 C+ M M

14 C+ M M

15 C- M M

16 D- N N

17 B- M M

18 C+ M M

19 B+ M M

20 A- E E

21 A- E E

22 A E E

23 A- E E

24 A+ E E

25 B+ M M

26 C+ M M

27 A- E E

28 C+ M M

29 B- M M

30 B M M

31 B M M

32 C+ M M

33 B- M M

34 A E E

35 C M M

36 C+ M M

37 B M M

38 B- M M

39 C+ M M

40 A- E E

41 B- M M

42 C M M

43 A E E

44 WU N N

45 D N N

46 A- E E

47 C- M M

List measures used to assess learning: How Measured

Demonstrate an understanding of aircraft design, performance, operating characteristics, and maintenance as it relates to the student’s career goals

This is the primary focus of the course. The lectures, homework and labs are based on the goal of conveying this

information and mastery of the CLOs that support this. Solutions are provided in class, discussed and then posted on Canvas. The lecture slides are also posted on Canvas. The students are also required to write a research paper

relating to one or more of the CLOs and then present it to the class. All assignments are graded and feedback is noted on each. The research paper and the presentation of it are graded and written feedback is provided to the student on

each. Two mid-term exams and the final exam are also used to evaluate the mastery of the course material.

Analyze the role and regulations regarding aviation safety

FAA regulations are discussed as an integral part of the design, performance, maintenance and safety aspects of aircraft. The students are evaluated on the significant aspects of these areas on the exams, and some of the homework assignments.

Select outcomes to be measured for semester, and score each student for each outcome:

N = not met at 70% mastery M = Met E = Exceeded

Appendix 1C: Course Assessment form for Aviation 190, Fall 2016 Course number: 49858 Title: Aviation 190: Senior Capstone Semester: Fall 2016 Instructor name: Wenbin Wei

SLOs Measured

Student Cover letter Resume Present Project Grade

SLO A1

SLO A1

SLO A1

SLO A1

SLO A1

1 8.5 8 8 40 B+ M M M M M

2 9 9 8 41 A- M M M M E

3 9 8.5 8 40 A- M M M M E

4 9 8.5 8 41 A- M M M M E

5 8.5 8 8 41 A- M M M M M

6 8 8 6 43 B+ E E N E M

7 9 8 8 43 A E E E E E

8 8.5 8.5 8 40 B+ M M M M E

9 9 9 8 43 A E E E E E

10 9 8.5 8 42 A- M M M M E

11 9 8 8 43 A E E E E E

12 9 8.5 8 43 A E E E E E

13 9 8 8 43 A E E E E E

14 9 8 8 42 A- M M M M E

15 8.5 8 8 40 B+ M M M M M

16 9 8 8 40 B+ M M M M E

17 9 8 8 40 B+ M M M M E

18 9 8.5 8 41 A- M M M M E

19 9 8 8 41 A- M M M M E

20 9 8 8 40 B+ M M M M E

21 8.5 8.5 8 40 B+ M M M M E

22 9 8.5 8 41 A- M M M M E

23 8.5 8 8 41 A- M M M M M

24 8.5 8.5 8 42 A- M M M M E

25 9 8.5 8 43 A E E E E E

26 9 8.5 8 41 A- M M M M E

27 8.5 8 8 41 A- M M M M M

28 9 8.5 8 41 A- M M M M E

29 9 8 8 41 A- M M M M E

30 9 8.5 8 43 A E E E E E

31 8.5 8 8 42 A- M M M M M

32 8.5 8.5 8 43 A E E E E M

33 8.5 8.5 8 40 B+ M M M M M

34 8.5 9 8 40 A- M M M M E

35 9 9 8 42 A M M E M E

36 9 8.5 8 43 A E E E E E

37 9 8.5 8 40 A- M M M M E

38 8.5 8 8 43 A- E E M E M

39 8.5 8.5 8 42 A- M M M M E

40 9 8.5 8 43 A E E E E E

41 8.5 8.5 8 40 B+ M M M M E

42 8.5 8 8 43 A- E E M E M

43 9 8.5 8 43 A E E E E E

44 9 8 8 43 A E E E E E

45 9 8 8 43 A E E E E E

46 9 8.5 8 43 A E E E E E

List measures used to assess

learning: How Measured

Apply current knowledge and adapt to emerging applications in aviation

Based on the completion of team project (maximum score is 50).

Function effectively on teams Based on the completion of team project (maximum score is 50).

Communicate effectively Based on the project presentation (maximum score is 10), discussion and communications in class, and completion of the project.

Understand the role and processes in team development, dynamics and management

Based on the completion of team project (maximum score is 50).

Understand the attributes and behavior of an aviation professional, career planning, and certification

Based on the completion of resume (maximum score is 10) and the cover letter (maximum score is 10)

Select outcomes to be measured for semester, and score each student for each outcome:

N = not met at 70% mastery M = Met E = Exceeded