Assessment and Evaluation

Assessment and Evaluation Assessment Evaluation

Measuring performance Measuring quality of performance

Non judgmental Judgment

Helpful to produce improvement Level of achievement

Is more limited process with more specific . It could be part of the evaluation

 is perhaps the most complex

Assessment versus evaluation

• The process of assessment is to gather, summarize, interpret, and use data to decide a direction for action.

• The process of evaluation is to gather, summarize, interpret, and use data to determine the extent to which an action was successful. (to judge the worth of…)

• The primary differences between the two

terms are those of

- Timing

- purpose

Informal Classroom assessment

• Instructors rely on answers to questions

• listen to student comments • Monitor body language and facial expressions

Classroom Assessment Techniques (CATs)

• Its typically, ungraded activities conducted in the classroom

setting.

• The Background Knowledge :

- Its a short, simple questionnaire given to students at the start

of a course, or before the introduction of a new unit, lesson

or topic. It is designed to uncover students’ pre-conceptions.

Classroom Assessment Techniques (CATs)

• Minute Paper: -Tests how students are gaining knowledge, or

not. - The instructor ends class by asking students

to write a brief response to the following questions: “What was the most important thing you learned during this class?” and “What important question remains unanswered

Classroom Assessment Techniques (CATs)

• The Muddiest Point : - Its to help assess where students are having

difficulties. - The technique consists of asking students to

jot down a quick response to one question: “What was the muddiest point in [the lecture, discussion, homework assignment, film, etc.]

Why Should I Use CATs?

1. It can be used to improve the teaching and learning that occurs in a class.

2. Provide just-in-time feedback about the teaching-learning process

3. Provide information about student learning with less work than

traditional assignments (tests, papers, etc.)

4. Help students become better monitors of their own learning

5. Provide concrete evidence that the instructor cares about learning

Question format

• Open ended questions vs. closed questions

- Advantages :(encourage the applicant to do

most of the talking).

- What did you do on you holidays?

- How do you keep focused on your work?

Question format

• Closed questions – refer to all formats in which the answers are provided in the form of options.

• do…, did…, can…, is…,are• Where do you live?• What time is it?

MCQ

MCQ

• Multiple choice items consist of a stem and a set of options.

• with the correct answer called the key• and the incorrect answers called distracters or

foil • The stem can include Such as case study, a

graph, a table, or a detailed description

MCQ

• Best answer

• Correct answer

MCQ

• Best answer: - format refers to a list of options that can all be

correct in the sense that each has an advantage, but one of them is the best.

• Correct answer: - format refers to one and only one right answer

RULES

• Stem directions should clearly indicate exactly what is being asked :

1. World War II was

A. The result of the failure of the League of Nations. B. Horrible. C. Fought in Europe, Asia, and Africa. D. Fought during the period of 1939-1945.

2. In which of these time periods was World War II fought? A. 1914-1917

B. 1929-1934 C. 1939-1945 D. 1951-1955

Rules • Keep options independent; options should not be overlapping: 1. During what age period is thumb-sucking likely to produce the greatest

psychological trauma? A. Infancy

B. Preschool period C. school periodD. During toddler E. After adolescence

2.During what age period is thumb-sucking likely to produce the greatest psychological trauma?

A. From birth to 2 years old B. From 2 years to 5 years old C. From 5 years to 12 years old D. From 12 years to 20 years old E. 20 years of age or older

MCQ RULES

Write the options so they are homogeneous in content:• Which of the following is the primary reason

people moved to California in 1849?A. ClimateB. ReligionC. Gold was discovered in central CaliforniaD. Farming

Rules • Avoid giving clues through the use of faulty grammatical construction.1. Who was Albert Einstein? A. An anthropologist.

B. An Astronomer. C. A chemist. D. A mathematician

1. Albert Eisenstein was a: A. Anthropologist.

B. Astronomer. C. Chemist. D. Mathematician

.

RULES

Complete statement

• The capital of California is in----------?

• In which of the following cities is the capital of California?

a. b.c.

Rules

• A question stem is preferable because it allows the student to focus on answering the question rather than holding the partial sentence. The cognitive load is increased when the stem is constructed with an initial or interior blank, so this construction should be avoided

Rules

• The greater the similarity among alternatives, the greater the difficulty:

• Who was the President of the U.S. during the War of 1812?

A. Grover Cleveland B. Abraham Lincoln C. James Madison D. Harry Truman E. George Washington

Example1.The primary prevention means ?a. Early detection b. Health promotion c. Self care d. Health protection

1. The early discovering of the disease ,called a. Primary preventionb. Secondary prevention c. Tertiary prevention d. Disease protection

MCQ

Emphasize Higher-Level Thinking

- The key to preparing memory-plus application questions ,that requires the student to first recall the facts and then apply or transfer the application of those facts into a situation.

Ability to Interpret Cause-and-Effect

- Why does headache occur with hypertension:A. B. C. D.

RULES

• Ability to Justify Methods and Procedures :• Why is adequate lighting necessary in a

balanced aquarium?a. Fish need light to see their food.b. Fish take in oxygen in the dark.c. Plants expel carbon dioxide in the dark.d. Plants grow too rapidly in the dark.

The alternatives should be presented in a logical order

• (e.g., alphabetical or numerical) to avoid a bias toward certain positions

a. Diabetics b.Encephalitis c. Fleabites d.Gastritis

Avoid complex multiple choice items

• In which some or all of the alternatives consist of different combinations of options.

a. Community healthb.Public helath c. Environmental healthd.A and B e.B and C

MCQRULES

Balance the Placement of the Correct Answer

• Correct answers are usually the second and third option

• More than five options does not help discriminate performance .

• Avoid specific determinates, such as never and always.

RULES

• Which of the following is not an IRAQI poet?• Which of the following is NOT an IRAQI poet?• Which of the following is an IRAQI poet?

• Avoid negative, or using negative words such as “except” or “not.” If you can’t avoid a negative, then bold, capitalize, or underline the negative word:

RULES

• Avoid, the phrase all of the above, none of the above IN OPTION

- Students may be able to find answer without knowing the correct answer

Be Grammatically Correct

• Use simple, precise and clear wording

• Don't Use difficult terminology for example : Awkward

MCQ

Advantages:• Easy to grade • Reliable • Its measuring different level of cognitive

Disadvantages :

• Its not measuring problem solving, higher order

reasoning

True and faluse

• Its test the factual knowledge ( cognitive ability ,recall )

• avoid absolute words ( Always , only ) its restrict possibilities

• Ask to correct the false • Its provide 50% of guessing

True and false

• Avoid semi-quantitative terminology. Words such as “often”. “seldom”, etc, are difficult to define.

• E.g. : In a certain percentage of patients with an acute pancreatitis the disease is often self-limiting

True and false

• Limitations:• Difficult to write questions.• False statements provide no evidence that the student

knows the correct answer.• Scores are more influenced by guessing than with any

other question type.• Cannot discriminate between students of varying

ability as well as other questions.• Requires that the answer to the question is absolutely

true or false.

Matching

- to identify relationship between a set of

similar items

- Its not only two table

- we can put the questions and put choices to

show which are more match with the

questions

Essay

• Its open ended questions • Its depend on evaluation, reasoning ,situation,

new concept • The question must not talk in lectures • E.g.: make SWAT analysis for medical

regulations

Essay

• Essay examinations are commonly given in

subjects as diverse as history, art, business,

engineering, psychology, and biology

Essay

• Strengths- Allows students to interpret and integrate their knowledge of

course content.-Easier and less time consuming to create than other question

types.- Allows students to express individuality and creativity in their

answers.- Reduces guessing.- Requires students to organize their own answers an to express

them in their own words.• Can efficiently measure higher order cognitive objectives

Short answer

- Measure high level of cognitive - It must be few words - must identify the length of answer ( its not like

comprehensive )- Ex: What structure in the blood carries oxygen

to the cells of the human body

Short answers

• More time consuming to score than multiple-choice or true-false questions.

• Blank spaces should usually occur at the end of the statement rather than the beginning or within.

• Avoid verbal clues and specific determiners (e.g., the, an, a).

Oral exam

• It must provide immediate feedback

OSCE

• O : Objective.- Every student gets the same patient • S :Structured. Several skills are tested at one time. Each skill is tested in a separate station. The examiner have a checklist for doing the

marking.

• C : clinical.- Testing the skills of students: • E : Examination.

OSCE

• No. of stations: 12-18

• The time per station should be uniform as possible. It ranges from 5-20 minutes

• Its depend on sheet ,and now they use it with technology

OSCE

OSCE

• There are instruction to read it before enter the station

• If examiner forget something ,they added to incomplete

• Its depend on checklist and grade on it • There are timer for each station • Every 2-3 station there are break

OSCE

• Marks candidates get marks for each step on the mark scheme that they perform correctly

• The examiner is usually asked to rate the candidate as pass/borderline/fail or.

• This is then used to determine the individual pass mark for the station

Marks

• Many centers allocate each station an individual pass mark.

• The sum of the pass marks of all the stations determines the overall pass mark for the OSCE.

• Many centers also impose a minimum number of stations required to pass.

• Expensive

• Takes long time to construct a case and a scoring checklist.

• Technical limitations

• OSCE stations can never be truly standardized and objective in the same way as a written exam

DISADVANTAGES

References

• CFT (center for Teaching Guides), Vanderbilt University.

• Nurse Educator (s):Marilyn H Oermann PhD RN FAAN ,2008 .

•