test development.pptx

7/27/2019 Test Development.pptx

1/17

Test Development


2/17

Test Development Process

Test Conceptualization

Test Construction

Test Tryout

Item Analysis

Revision


3/17

Test Conceptualization

An emerging social phenomenon or pattern of behavior might

serve as the stimulus for the development of a new test

The development of a new test maybe in response to a needto assess mastery in an emerging occupation or profession


4/17

Some Preliminary Questions

What is the test designed to measure?

What is the objective of the test?

Is there a need for this test?

Who will use this test? Who will take this test?

What content will the test cover?

How will the test be administered?

What is the ideal format of the test?

How will meaning be attributed to scores on this test?


5/17

Item Development Issues

Norm- Referenced versus Criterion-Referenced Tests


6/17

Pilot Work

Preliminary research surrounding the creation of a prototype

of the test

Test developer attempts to determine how best to measure atargeted construct

The process may entail the creation, revision and deletion of

many test items, experimentations and related activities


7/17

Test Construction

Scaling : It may be defined as the process of setting rules for

assigning numbers to measurement

Test taker is presumed to have more or less of thecharacteristic measured by a test as a function of the test

score


8/17

Summative Scale: Final test score obtained by summing the

ratings across all the items

Likert scale: Used to scale attitudes Each item has five alternative responses

Usually on an agree/disagree or approve/disapprove type of

continuum


9/17

Method of Paired Comparisons: Test takers presented with

pairs of stimuli which they are asked to compare

Comparative Scaling: Entails judgments of a stimulus incomparison with every other stimulus on the scale

Categorical Scaling: Stimuli are placed into one of two or

more alternative categories that differ quantitatively withrespect to some continuum


10/17

Writing Items

What range of contents should the items cover?

Which of the many different types of item formats should be

employed?

How many items should be written?


11/17

Item pool: It is the reservoir or well from which items will be

drawn or discarded for the final version of the test

Item Format: Variables such as the form, plan, structure,arrangement and layout of individual test items are

collectively referred to as item format. There are two types of

item format:

Selected - response format

Constructed - response format


12/17

Selected - Response Format

Multiple choice : It has three elements

A stem

A correct alternative

Distractors or foils

Matching : Two options are provided; premises on the left and

responses on the right

Binary choice item : true-false, yes-no, agree-disagree, right-

wrong, fact-opinion


13/17

Constructed - Response Format

Completion Item

Short answer

Essay


14/17

Item Analysis

Tools used by test developers to analyze and select items are:

An index ofitems difficulty

An index of items reliability

An index of items validity

An index of item discrimination


15/17

Qualitative Item Analysis

Qualitative methods are techniques of data generation and

analysis that rely on verbal rather than mathematical or

statistical procedures

It compares individual test items to each other and to the test

on the whole

It involves exploration of the issues through verbal means

such as interviews and group discussions conducted with test

takers

Think Aloud test administration: It sheds light on the test

taker's thought processes during the administration of the

test


16/17

Sensitivity Review

Study of test items typically conducted during the test

development process in which items are examined for fairness

to all prospective test takers and for the presence of offensive

language, stereotypes, or situations.


17/17

Test Revision

Test Revision as a stage in New Test Development

Test Revision in the Life Cycle of an Existing Test

test development.pptx

Documents