training seminar for chairpersons and paper setters december · pdf filetraining seminar for...

MATSEC Seminar 2010MATSEC Seminar 2010

Training SeminarTraining Seminar

for Chairpersons and Paper Settersfor Chairpersons and Paper Setters

December 2010December 2010

Setting high qualitySetting high qualityexaminationsexaminations

Basic PrinciplesBasic Principles

Quality examinations Quality examinations fit the purposefit the purpose for which for which they are set.they are set.

What is the purpose of MATSEC examinations?What is the purpose of MATSEC examinations? The purpose of the examination is to give an The purpose of the examination is to give an

opportunity to opportunity to allall candidates to demonstrate what candidates to demonstrate what they know, understand and can do in a particular they know, understand and can do in a particular subject. subject.

How can this purpose beHow can this purpose beachieved by means of theachieved by means of the

examination papers?examination papers?

By maximizing the validity of the examinationBy maximizing the validity of the examination Content validity (coverage of the 2011 syllabus Content validity (coverage of the 2011 syllabus

content and skills, range of difficulty especially in the content and skills, range of difficulty especially in the differentiated papers at SEC level)differentiated papers at SEC level)

Face validity (type of questions; language, symbols Face validity (type of questions; language, symbols and conventions used in questions)and conventions used in questions)

Consequential validity (high stakes exam for Consequential validity (high stakes exam for individuals; wash back effect on teaching and individuals; wash back effect on teaching and learning; credibility MATSEC examinations)learning; credibility MATSEC examinations)

Specification gridsSpecification grids are needed to check validityare needed to check validity

Reliability and ExaminationReliability and ExaminationPapersPapers

Freedom from bias Freedom from bias –– the context, the language, the examples the context, the language, the examples and illustrations used in questions may be sources of bias that and illustrations used in questions may be sources of bias that should be avoided.should be avoided.

Inclusiveness and equity Inclusiveness and equity –– all members of society should be all members of society should be treated with equal respect, irrespective of their gender, abilittreated with equal respect, irrespective of their gender, ability, y, cultural and religious backgrounds.cultural and religious backgrounds.

Differentiation and discrimination Differentiation and discrimination –– the examination should the examination should cater for the whole ability range yet it should also discriminatcater for the whole ability range yet it should also discriminate e between different achievement levels.between different achievement levels.

Options must be of comparable difficulty.Options must be of comparable difficulty.

Mark SchemesMark Schemes help in maximizing the reliability of help in maximizing the reliability of examinations.examinations.

Checking Examination PapersChecking Examination Papersand Mark Schemesand Mark Schemes

ChecklistsChecklists

Use the ChairpersonsUse the Chairpersons’’ Checklist before Checklist before sending the examination papers and mark sending the examination papers and mark scheme to the Reviser.scheme to the Reviser.

Make modifications agreed with the Make modifications agreed with the Reviser.Reviser.

MATSEC Support Unit staff will vet the MATSEC Support Unit staff will vet the papers and may suggest amendments.papers and may suggest amendments.

MEETINGS TO PREPARE PAPERS + MARK SCHEME

+ SPECIFICATION GRID(CHAIR + PAPER

SETTERS)

APPOINTMENT OF PAPER SETTERS’PANEL (CHAIR +

PAPER SETTERS + REVISER)

PAPERS + MARK SCHEME +

SPECIFICATION GRID SEEN, WORKED OUT,

CHECKED BY REVISER

CHAIR & PAPER SETTERS GO

THROUGH REVISER’S COMMENTS

PAPERS + MARK SCHEME + SPECIFICATION GRID

GIVEN TO PSAO AT MATSEC SUPPORT UNIT

PAPER VETTED BY PSAO

PRINTING OF PAPER

MEETING OF PSAO & CHAIR TO FINALISE

PAPER FOR PRINTING

Great Caution!!!

Exam takenConversion of Index Number

to Office Number

Preparation ofpapers in batches

for Markers

Moderation MeetingChair + Markers

Correction

Collection ofS B A marks

Grade boundariesmeeting: Chair &MATSEC staff

Publicationof results

Appointment ofMarkers Panel

Moderationof S B A

Fine tuning ofmarking scheme

ModerationBy Chair

Compilation ofresults by Chair

Oral exammarks

Examiners’Report


Reference is made to Reference is made to the the Guidelines for Guidelines for MATSEC Examination MATSEC Examination Panels, 2007Panels, 2007


SPECIFICATION GRIDS & MARKING SCHEMESSPECIFICATION GRIDS & MARKING SCHEMES

PurposePurpose –– Specification grids and marking Specification grids and marking schemes greatly increase the validity and reliability schemes greatly increase the validity and reliability of examinations.of examinations.

FormulationFormulation –– the preparing of specification the preparing of specification grids and marking schemes is a lengthy task that grids and marking schemes is a lengthy task that requires diligence, preparation and experience.requires diligence, preparation and experience.


MARKING SCHEMESMARKING SCHEMES

The Chairperson is required to ensure that the panel adopts The Chairperson is required to ensure that the panel adopts procedures in the marking schemes to ensure that:procedures in the marking schemes to ensure that: questions & marking schemes are written at the same questions & marking schemes are written at the same time; time; marks are given for attainment allowing credit for marks are given for attainment allowing credit for knowledgeknowledge, , understandingunderstanding & & skillsskills;; marks are commensurate with the demands of the marks are commensurate with the demands of the question;question; marking schemes are marking schemes are clearclear, , consistentconsistent, , questionquestion--specificspecific, , accept justifiable accept justifiable alternativesalternatives & awards & awards workingsworkings of of calculation.calculation.

Guidelines to be followed by the MATSEC Examination Panels, 2007Guidelines to be followed by the MATSEC Examination Panels, 2007


SPECIFICATION GRIDSSPECIFICATION GRIDS

The Panel is required to adopt specification grids to ensure The Panel is required to adopt specification grids to ensure that:that: the questions are the questions are within the syllabuswithin the syllabus & adequately cover & adequately cover the subject matter & the assessment objectives;the subject matter & the assessment objectives; standards are maintained & standards are maintained & questions are not repeatedquestions are not repeatedfrom one session to another;from one session to another; all all major topics in the syllabus are coveredmajor topics in the syllabus are covered..


•Assessment Objectives (SEC Physics 2011)

SPECIFICATION GRIDS

Question 10Question 10

1515151530304040Total MarksTotal Marks










Practical Practical AssessmentAssessment

Design & Design & planning of planning of experimentsexperiments

Problem Problem SolvingSolving

Knowledge and Knowledge and UnderstandingUnderstanding

Specification Grid – Examination Paper

Speaking and ListeningCandidates will be expected to:O1. communicate clearly, structuring and organising their talk and adapting it to different situationsO2. listen to and understand spoken EnglishO3. interact in discussions and play a number of roles.Candidates will be required to:O4. explain, describe, narrateO5. explore, imagine and possibly analyseO6. discuss, argue and/or persuade in a variety of formal and/or informal contexts.

ReadingCandidates will be expected to:O7. read and understand different text typesO8. evaluate information presented textually, visually or graphically, and select what is relevantO9. follow an argument or trend of thought, identifying implicationsO10. analyse the writer’s intentions and attitudes through the use of language.

WritingCandidates will be expected to:O11. select, order and present information, ideas and opinionsO12. express what is thought, felt or imaginedO13. write with a sense of audience and purpose showing an awareness of style in a variety of situations.

ASSESSMENT OBJECTIVES FOR A LANGUAGE EXAMINATION

O9O9

O8O8

O7O7

O6O6

O5O5

O3O3

O10O10

O4O4

O2O2

O1O1

Q 10Q 10

Q 9Q 9

Q 8Q 8

Q7Q7

Q6Q6

Q5Q5

Q4Q4

Q3Q3

Q2Q2

Q1Q1

O13O13O12O12O11O11

Specification Grid according to learning objectives

Topic 4Topic 4Topic 3Topic 3Topic 2Topic 2Topic 1Topic 1


Total MarksTotal Marks










Topic 8Topic 8Topic 7Topic 7Topic 6Topic 6Topic 5Topic 5

Specification Grid – According to topic


The Chairperson is expected to:The Chairperson is expected to:

organise the organise the standardization meetingstandardization meeting where a where a sample of scripts is marked by the markers & the sample of scripts is marked by the markers & the marking scheme is finalised;marking scheme is finalised; moderate a samplemoderate a sample of scripts to ensure that the of scripts to ensure that the marks are awarded consistently & according to the marks are awarded consistently & according to the marking scheme.marking scheme.


Objectives: To write in a style appropriate to a formal letter.

Marking : Marking should be in accordance with the writing assessment scale. (Content - 4, Fluency - 3, Accuracy - 3)

Under content, credit should be given for the candidate’s creativity in presenting his/her own ideas, However, some of the following points may be included. Maximum of one mark is to be deducted from total for improper layout.

Layout includes sender’s address, date, editor's address, subject, salutation and complimentary close

NOTE: Refer to the writing assessment scale.

Value Points:− What adult education means− Need for such an education− How to implement it− Involvement of youngsters− Precautions

Marking scheme – Letter to the editor

Conduction is the transfer of heat energy between neighbouring molecules in a substance from a hot region to a colder one.

1 MARK

In order to show that water is a poor conductor of heat a long test tube with ice cold water is taken. Some ice cubes are put in the test tube and kept at the bottom with the help of a wire gauze. The water in the upper part of the test tube is heated. It will be observed that water at the top end starts boiling, but the ice at the bottom does not melt completely 2 MARKS

Water is a poor conductor of heat.

1 MARK

10. What is conduction? Describe with a diagram, an experiment to show whether water is a good conductor of heat. State if it is considered as a good or bad conductor.

7 MARKS

LABELLED DIAGRAM

2 MARKS DIAGRAM

1 MARK LABELLING

Write a story that ends with the phrase Write a story that ends with the phrase ‘…‘…I was so I was so lucky!lucky!’’

(30 marks)(30 marks)

6 marks6 marks7 marks7 marks5 marks5 marks12 marks12 marks

Orthography Orthography Grammar, Grammar, syntax, syntax, vocabulary, vocabulary, idiomatic idiomatic expressionsexpressions

Style and Style and structure structure (punctuation, (punctuation, link of link of paragraphs, paragraphs, presentation)presentation)

Ideas related to Ideas related to the subject the subject --creativitycreativity

Marking Scheme Marking Scheme –– 30 marks30 marks

Taxonomy of EducationalTaxonomy of EducationalObjectivesObjectives

KnowledgeKnowledge

ComprehensionComprehension

ApplicationApplication

AnalysisAnalysis

SynthesisSynthesis

EvaluationEvaluation

KnowledgeKnowledge

KnowledgeKnowledge is the remembering of previously learnt is the remembering of previously learnt material: material:

Recall of things and materials even from specific facts.Recall of things and materials even from specific facts.

Recall of structures, methods or processes.Recall of structures, methods or processes.

Terms to elicit Knowledge and understanding

•State••NameName

•Match•List

•Outline•Select

•Identify•Describe

•Reproduce•Define

ComprehensionComprehensionComprehension Comprehension is the ability to grasp the meaning of is the ability to grasp the meaning of

material, by translating material from one from to another material, by translating material from one from to another (words to numbers); by interpreting material (explaining or (words to numbers); by interpreting material (explaining or summarizing); by estimating future trends (predicting summarizing); by estimating future trends (predicting consequences or effects) consequences or effects)

Terms to elicit Comprehension

•Summarise••ReRe--writewrite

•Paraphrase••EstimateEstimate

•Give examples••DistinguishDistinguish

•Generalise•Defend

•Predict••ExplainExplain

•Extend•Convert

ApplicationApplication

Application Application is the ability to use learned material in new is the ability to use learned material in new and concrete situations such as the application of rules, and concrete situations such as the application of rules, methods, concepts, principles, laws and theories. methods, concepts, principles, laws and theories.

Terms to elicit application

•Solve••UseUse

•Relate••DiscoverDiscover

•Produce••DemonstrateDemonstrate

•Prepare•Compute

•Show••ModifyModify

•Predict•Change

SynthesisSynthesisSynthesis Synthesis –– the ability to put parts together to form a new pattern or the ability to put parts together to form a new pattern or

structure.structure.

Production of a unique communication (theme or speech)Production of a unique communication (theme or speech) A plan of operations (research proposal) A plan of operations (research proposal) A set of abstract relations (scheme for classifying information)A set of abstract relations (scheme for classifying information)

Terms to elicit synthesis

••WriteWrite

•Tell••SummarizeSummarize

•Re-write••ReviseRevise

•Recognise••RelateRelate

•Reconstruct••RearrangeRearrange

•modify••GenerateGenerate

•Explain••DesignDesign

•Device••CreateCreate

•Compose•Compile

•Plan••OrganiseOrganise

•Combine•Categorise

AnalysisAnalysisAnalysis, Analysis, the ability to break down material into its component parts so the ability to break down material into its component parts so

that its organisational structure maybe understood. that its organisational structure maybe understood. Identification of partsIdentification of parts Relationship between partsRelationship between parts Recognition of the organisational principles involved in a struRecognition of the organisational principles involved in a structure of cture of

work (such as art, music or a piece of writing) work (such as art, music or a piece of writing)

Terms to elicit analysis

•Separate••IdentifyIdentify

•Select••DistinguishDistinguish

•Relate••DiscriminateDiscriminate

•Point out•Differentiate

•Subdivided••IllustrateIllustrate

•Outline•Breakdown

EvaluationEvaluation

This is concerned with the ability to judge the material for a This is concerned with the ability to judge the material for a given given purpose. The judgement is to be based on definite criteria purpose. The judgement is to be based on definite criteria determined by the student or teacher. determined by the student or teacher.

Terms to elicit evaluation

•Interpret••JustifyJustify

•Explain••DiscriminateDiscriminate

•Describe••CriticizeCriticize

•Contrast•Conclude

•Summarize••RelateRelate

••CompareCompare•Appraise


ComparabilityComparability


MATSEC Support UnitMATSEC Support Unit

December 2010December 2010

training seminar for chairpersons and paper setters december · pdf filetraining seminar for...

Documents