tsl3123 lecture4
DESCRIPTION
tsl3123TRANSCRIPT
![Page 1: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/1.jpg)
Language Assessment
TSL3123Lecture 4
![Page 2: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/2.jpg)
HHYeoh/TSL3123/Lecture 4
![Page 3: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/3.jpg)
Learning OutcomesDesigning Classroom Tests
•Identify the different stages of test construction •Decribe the features of a test specification •Draw up a test specification that reflect
both the purpose and the objectives of the test
![Page 4: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/4.jpg)
HHYeoh/TSL3123/Lecture 4
Stages of Test Construction
Assessing clear, unambiguous objectives
Drawing up Test specificationsItem writingItem moderationPre-testingAnalysisReporting
![Page 5: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/5.jpg)
HHYeoh/TSL3123/Lecture 4
Assessing clear, unambiguous objectives
• Know what you want to test• Examine the objectives for the unit
you are testing• Objectives – stated in terms of overt
performance• Determine appropriate objectives
![Page 6: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/6.jpg)
HHYeoh/TSL3123/Lecture 4
Can you ….
• Write an objective (in terms of performance) ?
• Linguistic domain – Speaking skills
![Page 7: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/7.jpg)
HHYeoh/TSL3123/Lecture 4
![Page 8: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/8.jpg)
HHYeoh/TSL3123/Lecture 4
Test Specifications
The writing of test items should be accompanied with a carefully prepared set of test specifications.
The function of the specifications is to describe the achievement domain being measured and to provide guidelines for obtaining a representative sample of test tasks.
![Page 9: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/9.jpg)
HHYeoh/TSL3123/Lecture 4
Drawing Up Test Specifications (Brown, 2004)
• TS for classroom use – simple and practical ouline of your tes
a) A broad outline of the testb) What skills you will testc) What the items will look like
![Page 10: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/10.jpg)
HHYeoh/TSL3123/Lecture 4
![Page 11: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/11.jpg)
HHYeoh/TSL3123/Lecture 4
![Page 12: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/12.jpg)
HHYeoh/TSL3123/Lecture 4
Test Specifications are:• The result of the design process (i.e. test content
and test method TEST SPECIFICATIONS• A set of instructions for creating the test• Function – to force explicitness about the design
decisions in the test and to allow new versions to be written in future.
Length and structure of the test The type of materials (e.g. authentic
materials) The response format The test rubric Scoring of responses
•
![Page 13: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/13.jpg)
HHYeoh/TSL3123/Lecture 4
Item Writing and Moderation (Hughes, 1989)
• Setting of items – extremely difficult; some items rejected, others reworked
• To be improved or abandoned- through teamwork• Critical questions that may be asked:
Is the task perfectly clear?Is there more than on possible correct response?Can candidates show the desired behaviour (or arrive at
the correct response) without having the skill supposedly being tested?
Do candidates have enough time to perform the task(s)?
![Page 14: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/14.jpg)
HHYeoh/TSL3123/Lecture 4
Guidelines in Writing Test Items
• Avoid wording that is ambiguous and confusing.
• Use appropriate vocabulary and sentence structure.
• Keep questions short and to the point.• Write items that have one correct answer.• Do not provide clues to the answer.
![Page 15: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/15.jpg)
HHYeoh/TSL3123/Lecture 4
Pre-testing
• Even after careful moderation, there are likely to be some problems with every test.
• Aim – administer it first to a group as similar as possible to the target group.
• Problems in administration and scoring are noted
• For a number of reasons – pretesting is not feasible. WHY?
![Page 16: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/16.jpg)
HHYeoh/TSL3123/Lecture 4
Analysis
Statistical analysis of test results mean standard deviation histograms
Item analysis involves the careful
analysis of score pattern on each of the test items
Tells us how well the item is working – the overall candidates’ ability emerging from the test
![Page 17: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/17.jpg)
HHYeoh/TSL3123/Lecture 4
Item analysis – 2 kinds of information
Item facility/ difficulty
• Helps us decide if test items are at the right level for the target group
Item discrimination• Allows us to see if
individual items are providing information on candidates’ abilities consistent with that provided by other items on the test.
![Page 18: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/18.jpg)
HHYeoh/TSL3123/Lecture 4
Reporting
DescriptionCommentDecisions
![Page 19: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/19.jpg)
HHYeoh/TSL3123/Lecture 4
Summary
• Stages of test construction?• Test specifications ?
![Page 20: TSL3123 Lecture4](https://reader035.vdocuments.site/reader035/viewer/2022062221/563db918550346aa9a99f0d1/html5/thumbnails/20.jpg)
HHYeoh/TSL3123/Lecture 4
Tutorial #4
• Pairwork: • Draw up a table of specifications that reflect
both the purpose and the objectives of the test
• Discuss the importance of test specifications for the purpose of assessment.