dr. chris davison & professor liz hamp-lyons faculty of education the university of hong kong...
Post on 11-Jan-2016
223 Views
Preview:
TRANSCRIPT
Dr. Chris Davison & Professor Liz Hamp-LyonsFaculty of Education
The University of Hong KongJuly 2, 2005
HkEd City HkEd City
2007 HKCE English Language School-2007 HKCE English Language School-based Assessment Componentbased Assessment Component
2
Introduction The aims of the School-based Assessment Component (SBA) in
the 2007 CE English Language Examination are to:
align the assessment more closely with the current English teaching syllabus and the proposed new Senior Secondary curriculum,
provide a more comprehensive appraisal of learners’ achievement,
enhance the capacity for student self-evaluation and life-long learning,
adopt a standards-referenced assessment system which maps the full range of educational achievement in HK schools.
3
Introduction For the School-based Assessment Component students have to: read/view four texts (print and video/film,
fiction and non-fiction material) over the course of two years (two texts each year)
keep a log book of brief comments/personal reflections,
take part in discussions with classmates on what they have read/viewed,
make individual presentations on what they have read/viewed, and
respond to questions from their teacher and/or peers.
4
Introduction
Note: The actual assessment is based
only on the students’ oral performance, i.e. the reading/viewing/writing is a pre-requisite.
The specific content of the text (ie. names and places, story lines, other factual information, etc) will not be directly assessed.
5
Introduction
The SBA is worth 15% of the total English mark for the HKCE.
Teachers will need to report the best mark for interaction (out of at least two
assessments) at the end of S.4 (total possible marks = 24, worth 5% of overall English mark)
the best mark for interaction and the best mark for individual presentation at the end of S.5 (total possible marks = 48, worth 10% of overall English mark)
(see Attachment 1 for a complete summary of the process)
6
Nature of oral text-types
Individual presentation: a single piece of oral text in which an
individual speaker presents some ideas or information over a sustained period (2-3 mins)
requires comparatively long turns generally needs more pre-planning and a
more explicit structure to ensure coherence.
may be followed by questions or comments
7
Nature of oral text-types
Oral interaction: an exchange of shorter turns or dialogue
with more than one speaker (not necessarily four) on a common topic
jointly constructed by two or more speakers
generally needs less explicit structuring but more attention to turn-taking skills
requires more planning of how to initiate, maintain and/or control the interaction by making suggestions, asking for clarification, agreeing, disagreeing, etc.
8
Nature of oral text-types
Note: If ideas more complex and
unfamiliar --> more false starts, hesitations and dysfluencies, more use of non-specific vocabulary and some grammatical mistakes.
9
Nature of assessment tasks
NO prescribed assessment tasks: Schools are free to develop and/or
adapt the kinds of assessment tasks which best suit their students’ level and interest, see Attachment 2 for an example of two possible tasks.
The ability of a student will be assessed by the quality and range of the oral language produced for assessment, including both fluency and accuracy.
10
Nature of assessment tasks
Assessment tasks can vary in length and complexity according to: communicative function (e.g. comparing,
describing, explaining…) number of people involved (e.g. pair,
small group, split or whole class, whole school…)
the position and status of the audience (e.g. fellow students, teachers, parents…)
the roles of the audience (e.g. asking questions, making comments…)
11
Mandatory assessment conditions
Certain mandatory conditions must be met to ensure students have the opportunity to do their best:
a. the type of task (ie. communicative function, grouping arrangement etc) must be familiar to students.
b. the task must not demand students take on a character or act out a role in a story or play, ie. drama skills are not assessed.
c. the students’ English teacher and at least one fellow student must be physically present.
12
Mandatory assessment conditions
d. tasks used to elicit an individual presentation must provide students with the opportunity to make an extended individual presentation (at least 2-3 minutes).
e. tasks used to elicit interaction must provide students with multiple opportunities to demonstrate appropriate interaction skills and make a balanced contribution.
13
Mandatory assessment conditionsf. students must not take notes during the
assessment activity, but may refer to brief notes or powerpoints in point form only.
g. there are no restrictions on the maximum number of tasks that can be used for assessment.
h. individual students are not permitted to repeat (ie. retake) the same assessment task without any change in input, nor engage in extensive rehearsal.
14
Mandatory assessment conditions
i. The teacher-assessor may interact individually with a student at any time by
asking specific question(s) (see Attachment 3 Guiding
Questions) to: clarify and/or encourage the student to extend
ideas. help prompt and/or scaffold the students’ oral
interaction. probe the range and depth of their oral
language skills. authenticate their work (ie. ensure it is their
own)
15
The assessment process
Two documents are essential to the teacher assessment process: the draft SBA Assessment Criteria
(see Attachment 4), and the Assessment Record (AR) (see
Attachment 5)
16
The assessment processThe draft SBA Assessment Criteria are: divided into seven levels. grouped into four different domains of
performance, with slight differences in criteria for interaction and the presentation pronunciation and delivery communication strategies vocabulary and language patterns ideas and organisation
expressed as “can do” statements.
17
The assessment process
The draft Assessment Record (AR) is used:
to record a specific level for each domain.
to calculate an overall mark for each assessment (out of 24 marks).
to help standardize the teacher’s assessment process.
to provide a record of the assessment task and its context for each student.
18
Standardization
After the assessments have been made, teachers need to meet to share their students’ work and to discuss why they made their particular assessment decisions, ie. quality control of teachers’ assessments by teachers.
19
Standardization
Such meetings are critical for developing: agreement about what a standard
means, ie. validity consistency in and between
teacher-assessors, ie. reliability public accountability professional collaboration/support
20
Standardization
Compulsory: One 3 hour meeting per year of all
English teachers at each form level in the same school, chaired by the SBA coordinator, to:
present the class records discuss a range of sample audio or
video-recordings and assessment records,
compare, then adjust or confirm each others’ results
21
Standardization
Strongly recommended: Informal meetings during the year with
one or more other English teachers to discuss assessment tasks, processes and marks.
One informal meeting of all SBA coordinators from about 15-25 schools once a year, chaired by an teacher trainer/assistant supervisor to share problems and issues and to provide collaborative support.
22
Statistical moderation
Statistical moderation by HKEAA … at the end of S5 the marks from each
school as a whole will be automatically compared with their results from the external examination
if a school’s pattern of SBA marks vary significantly from the school’s external examination marks, then adjustments will be made
23
Record-keepingAssessment
recordClass record Audio or video
recordings completed by class teachereach sheet must be signed by the teacher and endorsed by the student
list all the marks to be reported to the HKEAA for each class a statement of compliance with SBA assessment conditions signed by the class teacher, SBA coordinator, and the Principal
include a range of students’ oral performances, including the three*highest, lowest and mid-level assessments in each class, plus any contested or problematic ones, “home-made” quality
*In the first year of the SBA assessment, schools should try to make recordings of all students’ oral assessments. Individual records may be collated onto a CD-rom for storage purposes and reviewed by the HKEAA, if the need arises.
24
Implementation
The process of planning assessments should be undertaken collaboratively, taking into account students’ backgrounds, interest and skills as well as the school’s available resources
Planning needs to consider not only the selection of texts and assessment tasks but also the overall goals of the assessment program, the teaching and learning activities needed, the feedback processes to be implemented, the role of the students in the assessment process, etc.
25
ImplementationPlanning (and
reflecting)
Teaching
(and observing/monitoring)
Learning (and recording/self-evaluating)
Assessing
(and feedback/reporting)
26
ImplementationLook at an example of this process from Yuen Yuen No. 1 Institute school, a CMI band 3 school in Kwai Chung:
What does the teacher do to ensure students do well on the SBA?
How does the teacher integrate SBA activities into the normal teaching program?
27
ImplementationTrialling of assessment processes (not
teaching and learning): representative range of 24 schools, about
50 teachers full range of performance, criteria
generally worked well, student responses favourable
some clarification made to SBA guidelines, especially regarding role of recordings and nature of interaction
some concerns re strong influence of current oral exam
28
For more help…
For more general information and guidance on school-based assessment, especially setting up an extensive reading program and undertaking various assessment activities, visit HKU’s website on SBA:http://web.hku.hk/~sbapro
top related