table of specifications (tos) and test construction review
TRANSCRIPT
![Page 1: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/1.jpg)
Table of Specification (TOS)
with an Overview on Test
Construction
Presented by:
Arnel O. Rivera Faculty Member
BNHS-Villa Maria
CAS, LPU-Cavite
Presented to the teachers of DepEd Bacoor City
June 6, 2016
http://www.slideshare.net/sirarnelPHhistory
![Page 2: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/2.jpg)
OUTLINE:
Reading Diet
Introduction
Table of Specification
Situational Judgment Tests (SJT)
Workshop
Wrap-up
![Page 3: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/3.jpg)
For every problem there is a solution. If you are not part of the solution then you are part of the PROBLEM.
Chinkee Tan
Chink Positive
![Page 4: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/4.jpg)
13% of students who got low grades in exams are caused by faulty test questions.
WORLDWATCH, The Philadelphia Trumpet (August 2005)
![Page 5: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/5.jpg)
Common observation of students on test questions
Hindi kasama sa lessons.
Masyadong mahaba ang question at mga pagpipilian.
Hindi maayos ang layout ng test, putol-putol ang mga sentence.
Nakakalito ang mga tanong. Minsan wala sa pagpipiliaan ang sagot.
![Page 6: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/6.jpg)
Possible reasons for faulty test questions:
Questions are copied verbatim from the book or other resources.
Not consulting the course outline.
Much consideration is given to reduce printing cost.
No TOS or TOS was made after making the test.
![Page 7: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/7.jpg)
Factors to consider in preparing test questions (Oriondo & Antonio, 1984)
Purpose of the test
Time available to prepare, administer and score the test.
Number of students to be tested.
Skill of the teacher in writing the test.
Facilities available in reproducing the test.
![Page 8: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/8.jpg)
“To be able to prepare a
GOOD TEST, one has to have
a mastery of the subject
matter, knowledge of the
pupils to be tested, skill in
verbal expression and the
use of the different test
format”
Evaluating Educational Outcomes
(Oriondo & Antonio,1984)
![Page 9: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/9.jpg)
Characteristics of Good Tests
Validity – the extent to which the
test measures what it intends to
measure
Reliability – the consistency with
which a test measures what it is
supposed to measure
Usability – the test can be
administered with ease, clarity
and uniformity
![Page 10: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/10.jpg)
Scorability – easy to score
Interpretability – test results can
be properly interpreted and is a
major basis in making sound
educational decisions
Economical – the test can be
reused without compromising the
validity and reliability
Other Things to Consider
![Page 11: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/11.jpg)
General Steps in Test Construction
DRAFT
ORDER
TEST ANALYZE
SUBMISSION
PRODUCE A
T.O.S.
![Page 12: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/12.jpg)
Table of Specifications (TOS)
A two way chart that relates the learning outcomes to the course content
It enables the teacher to prepare a test containing a representative sample of student knowledge in each of the areas tested.
![Page 13: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/13.jpg)
Sample TOS
![Page 14: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/14.jpg)
KPU Paradox
Knowledge (Remembering) – answers the question what, where and when? (ano, saan at kailan)
Process (Application & Analysis) – answers the question how? (paano)
Understanding (Analysis) – answers the question why ?(bakit)
![Page 15: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/15.jpg)
THE LEVELS OF COGNITIVE
DOMAIN
The levels are the guiding posts in constructing test items. Regardless of what type of teacher-made tests the teacher will prepare, the items must follow the pattern set for evaluation.
The following items are features of levels with regards to the objectives of the lessons.
![Page 16: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/16.jpg)
1. KNOWLEDGE (Remembering) – includes those objectives that deal with recall, recognize facts, terminology, etc.
Example: Sino ang kauna-unahang bayani ng Pilipinas na nakipaglaban sa mga Kastila?
![Page 17: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/17.jpg)
2. COMPREHENSION (Understanding) – includes some level of understanding. It requires the learners to change the form of communication to see the connection or relations among parts of a communication (interpretation) or draw a conclusion (inference).
Example: Bakit sa tabing dagat naninirahan ang mga sinaunang Pilipino?
![Page 18: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/18.jpg)
3. APPLICATION (Applying) – it requires the pupils to use previously acquired information in a setting other than the one in which it was learned.
Example:
Alin sa mga sumusunod ang uri ng pamumuhay noong panahon ng Martial Law?
![Page 19: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/19.jpg)
4. ANALYSIS (Analysing) – It requires the pupils to identify the logical errors (point out the prediction or erroneous inference), differentiate among facts, opinions, assumptions, hypothesis or conclusions, draw relationships among ideas or to compare and contrast.
Example: Alin sa mga sumusunod ang dapat ginawa ng mga Pilipino upang makamit ang inaasam na kalayaan laban sa mga Kastila?
![Page 20: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/20.jpg)
5. SYNTHESIS (Creating) – objectives at this level require the pupils to [produce something unique or original. Test questions at this level require the pupils to solve unfamiliar problems or combine parts to form a unique or novel whole.
Example: Bilang mag-aaral, paano ka makakatulong sa pagpapanatili ng kalinisan n gating kapaligiran?
![Page 21: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/21.jpg)
6. EVALUATION (Evaluating) – Under this objective, the learners are required to form judgments about the value of methods, ideas, people or products that have a specific purpose.
Example: Alin sa mga sumusunod ang higit na mabisang paraan ng pagsugpo sa ipinagbabawal na gamot?
![Page 22: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/22.jpg)
Tips in Preparing the Table of Specifications (TOS)
Don’t make it overly detailed.
It's best to identify major ideas and skills
rather than specific details.
Use a cognitive taxonomy that is most
appropriate to your discipline.
Weigh the appropriateness of the distribution
of checks against the students' level, the
importance of the test, the amount of time
available.
![Page 23: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/23.jpg)
General Rules in Writing Test
Questions
Number test questions continuously.
Keep your test question in each test group uniform.
Make your layout presentable.
Do not put too many test questions in one test group. T or F: 10 – 15 questions
Multiple Choice: max. of 30 questions
Matching type: 5 questions per test group
Others: 5 – 10 questions
![Page 24: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/24.jpg)
Some additional guidelines to consider when writing items are described below:
1. Avoid humorous items. Classroom testing is
very important and humorous items may
cause students to either not take the exam
seriously, become confused or anxious.
2. Items should measure one’s knowledge of the
item context not their level of interest.
3. Write items to measure what students know,
not what they do not know. (Cohen & Wallack)
![Page 25: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/25.jpg)
What is the effect of releasing a ball in
positive gravity?
a) It will fall “down.” correct
b) It will retain its mass. true but unrelated
c) It will rise. false but related
d) Its shape will change. false and unrelated
Anatomy of a Perfect
Multiple Choice Tests
![Page 26: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/26.jpg)
Multiple Choice Questions
1. Use negatively stated stems sparingly and
when using negatives such as NOT,
underline or bold the print.
2. Use none of the above and all of the above
sparingly, and when you do use them, don't
always make them the right answer.
3. Only one option should be correct or clearly
best.
![Page 27: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/27.jpg)
Multiple Choice Questions:
4. All options should be homogenous and
nearly equal in length.
5. The stem (question) should contain only
one main idea.
6. Keep all options either singular or plural.
7. Have four or five responses per stem
(question).
![Page 28: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/28.jpg)
Multiple Choice Questions:
7. When using incomplete statements place the blank space at the end.
8. When possible organize the responses.
9. Reduce wordiness.
10. When writing distracters, think of incorrect responses that students might make.
![Page 29: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/29.jpg)
Situational Judgment Tests (SJT)
![Page 30: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/30.jpg)
Situational Judgment Tests (SJT)
Is a type of test which presents realistic scenarios similar to those that would be encountered in real life. (http://blog.careerbuilder.co.uk/2015/06/11/what-you-need-to-know-about-situation-judgement-tests/)
![Page 31: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/31.jpg)
Situational judgment tests (SJT)
Situational judgment tests present the test-taker with realistic, hypothetical scenarios and ask the individual to identify the most appropriate response or to rank the responses in the order they feel is most effective. (https://en.wikipedia.org/wiki/Situational_judgement_test)
![Page 32: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/32.jpg)
Why use SJTs?
Situational judgment test’s are designed to clarify the difference between average from superior response. The most effective response will look at the situation from various angles, consider a wider range of action, and take account the long-term consequences of action. (Sharpley, 2010)
![Page 33: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/33.jpg)
Formats in SJT questions
Ranking questions ask you to rank in order your response to a situation. Multiple choice questions ask you to choose the most appropriate action or decision to take in a given situation. (http://www.foundationprogrammeguru.co.uk/the-situational-judgement-test.html)
![Page 34: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/34.jpg)
Things to remember in making SJT Questions
Since SJT questions require learners to identify the best or worst answer, the stem should be presented in a manner in which the test taker will choose the correct answer by eliminating the distractors.
![Page 35: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/35.jpg)
Things to remember in making SJT Questions
In making the choices, the correct answer should always be the one that actually solves the problem or answer the question. Logically, the “correct” answers need to be distinct from the other answer options. Hence if two answer options seem very similar, it would be very difficult to identify the “distractor”.
(http://www.foundationprogrammeguru.co.uk/the-situational-judgement-test.html)
![Page 36: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/36.jpg)
Conceptual Framework
Concept Ideas
Situational Judgemental
Test (SJT)
Answer
![Page 37: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/37.jpg)
Example:
Kalabisan (Surplus)
Ang kalabisan ay dahilan upang magkaroon ng pagbaba ng presyo upang makamit ang
presyong ekwilibriyo.
Answer: D
Sa presyong 1,000, ang demand para sa cellphone A ay 10,000. Ngunit ang naprodyus na cellphone A ay 14,000. Ano ang dapat gawin upang magkaroon ng ekwilibriyo?
A. Bawasan ang supply B. Bawasan ang demand C. Taasan ang presyo D. Ibaba ang presyo
![Page 38: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/38.jpg)
Knowledge:
Alin sa mga sumusunod ang nagpapahiwatig na may kakapusan sa bansa?
A. Kung mabilis ang paggawa ng produkto.
B. Kung sagana ang produkto sa pamilihan.
C. Kung may kaguluhan sa pulitika.
D. Kung limatado ang suplay ng kalakal sa bansa.
![Page 39: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/39.jpg)
Process: • Sa papaanong paraan mo maitataguyod ang karapatan sa
tamang impormasyon? A. Pag-aralan ang nakatatak sa etiketa ukol sa sangkap,
dami, at komposisyon ng produkto. B. Palaging pumunta sa timbangang-bayan upang matiyak
na husto ang biniling produkto. C. Pahalagahan ang kalidad at hindi ang tatak ng produkto
o serbisyong bibilhin. D. Palagiang gumamit ng recycled na produkto upang
mapangalagaan ang kapaligiran.
![Page 40: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/40.jpg)
Understanding: • Maituturing na kagustuhan ang isang bagay kapag higit ito sa
batayang pangangailangan. Kailan maituturing na batayang
pangangailangan ang isang produkto o serbisyo?
A. Magagamit mo ito upang maging madali ang mahirap na
gawain.
B. Nagbibigay ito ng kasiyahan at kaginhawaan.
C. Hindi mabubuhay ang tao kapag wala ang mga ito.
D. Makabibili ka ng maraming bagay sa pamamagitan nito.
![Page 41: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/41.jpg)
Understanding: Nagsimula sa maliit na puhunan ang negosyo ni Mang Cenon, hanggang ito ay lumaki at nagkaroon ng iba’t ibang sangay sa Bulacan. Alin ang HINDI dahilan ng kanyang pag-unlad?
A. Maayos ang kanyang pangangasiwa.
B. Marami siyang kabarkada at kaanak
C. Malawak ang kanyang kaalaman sa negosyo.
D. Mahusay siyang makitungo sa kanyang mga tauhan.
![Page 42: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/42.jpg)
Things to Remember: Making a good test takes time
Teachers have the obligation to provide their students with the best evaluation
Tests play an essential role in the life of the students, parents, teachers and other educators
Break any of the rules when you have a good reason for doing so! (emphasis mine)
(Mehrens, 1973)
![Page 43: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/43.jpg)
![Page 44: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/44.jpg)
POINTS TO PONDER…
A good lesson makes a good question
A good question makes a good content
A good content makes a good test
A good test makes a good grade
A good grade makes a good student
A good student makes a good COMMUNITY
Jesus Ochave Ph.D.
VP Research Planning & Development
Philippine Normal University
![Page 45: Table of Specifications (TOS) and Test Construction Review](https://reader036.vdocuments.site/reader036/viewer/2022081723/587360af1a28abe7648b5821/html5/thumbnails/45.jpg)
For questions , comments or if you want
to download this file, log-on to:
www.slideshare.net/sirarnelPHhistory