aligning levels to the european framework the origó experience budapest, february 2006
TRANSCRIPT
![Page 1: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/1.jpg)
Aligning levels to the Aligning levels to the European FrameworkEuropean Framework
The Origó ExperienceThe Origó Experience
Budapest, February 2006Budapest, February 2006
![Page 2: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/2.jpg)
The number of ORIGÓ exams in 2005The number of ORIGÓ exams in 2005(oral and written):(oral and written):
108 401108 401
![Page 3: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/3.jpg)
ITK ORIGÓITK ORIGÓ
• The number of languagesThe number of languages:: 2929
• Arabic, Beás- Romani, Bulgarian, Chinese, Croatian, Czech, English, Danish, • Esperanto, Finnish, French, German, Hebrew, Hungarian, Italian, • Latin, Lovari-Romani, Modern-Greek, Old-Greek, Polish, Portugese, • Romanian, Russian, Serb, Spanish, Slovakian, Slovenian, Swedish, Turkish
• 2 testing systems2 testing systems:: Hungarian as a Foreign LanguageHungarian as a Foreign Language - - ALTE-membershipALTE-membership
![Page 4: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/4.jpg)
The ratio of languages (%) in 2005The ratio of languages (%) in 2005
English 53,0German 25,5Esperanto 6,4French 3,3Lovari 2,5Italian 2,5Spanish 1,7Russian 1,1Latin 1,4Croatian 0,4Romanian 0,3Serb 0,2Slovakian 0,3Other 2,0
![Page 5: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/5.jpg)
The number of exam centresThe number of exam centres::
70 - accredited/registered70 - accredited/registered
![Page 6: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/6.jpg)
Oral Written
69% 49%
Pass ratePass rate
20052005
![Page 7: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/7.jpg)
Population characteristics: age and sexPopulation characteristics: age and sex
female
male
64%
36%20052005
0
1000
2000
3000
4000
5000
6000
7000
8000
14 21 28 35 42 49 56
férfi
nő
![Page 8: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/8.jpg)
Distribution: age and sex, 2005Distribution: age and sex, 2005
0
1000
2000
3000
4000
5000
6000
14 16 18 20 22 24 26 28 30 32 34 36 38 40 42
![Page 9: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/9.jpg)
Candidates
• The oldest: 1935. 06. 23., female - Basic German, C, Pass
• The youngest: 1991.12. 14., female - Basic German, A, Passed
• Maximum performance (oral): 62 candidates 100%: English, Arabic, German, Esperanto, Latin, Hungarian, Russian,
Italian, Rumanian, Spanish, Serb, Slovakian, Modern-Greek, Hebrew - Basic-, Intermediate-, Advanced levels
• Maximum performance (written): 9 candidates 100%: Basic English- (5), Basic Hungarian-, Intermediate Italian-, Basic
Spanish-, Basic Modern-Greek
![Page 10: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/10.jpg)
The Framework levels and The Framework levels and Origó levels ???Origó levels ???
EuropeanCouncil
ITK ORIGÓ Accreditedlanguage
exams
Maturaexams
Cambridge Goethe
C2Mastery CPE
ZOP,KDS
C1Operationalproficiency
Proficiency/Advanced
Proficiency/Advanced
CAE ZMP
B2Vantage Intermediate Intermediate Advanced FCE
B1Threshold Basic Basic PET ZD
A2Waystage
Junior not accredited IntermediateKET
A1Breakthrough
notaccredited
not accredited
![Page 11: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/11.jpg)
The Hungarian context
• the law 1st September, 2006
• the Accreditation Board July, 2006
• the Matura - one-way equivalence
• international consensus?• levels?
![Page 12: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/12.jpg)
Schedule
• familiarization - scales• specification - documentation• standardization - scales, calibrated samples • empirical validation - calibrated samples,
level setting
![Page 13: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/13.jpg)
Origó - Previous experience
• level setting - empirical
alinging Rigó and international exams (ESU framework, Goethe)
• quality control procedures
• accreditation (1999)
![Page 14: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/14.jpg)
Origó - work accomplished
• schedule• familiarisation (exam developers)
• specification - modifications in Origó scales
suggestions for other modifications
• familiarisation - all oral examiners
![Page 15: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/15.jpg)
Origó - work to follow:
• familiarisation - item writers, markers (written exams)
• benchmarking - sample materials (exam developers)
• standardisation - all examiners
• empirical validation - major languages
![Page 16: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/16.jpg)
Origó - benefits
• positive working experience (CEFR)• useful guidelines (Manual)• useful discussions (awareness raising)• useful modifications
![Page 17: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/17.jpg)
Origó - problem areas
• terminology• translation problems • advanced (C1)/proficiency (C2) levels• availability of sample reference materials• mediation
![Page 18: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/18.jpg)
Terminology„claims”
• linking• relating• harmonizing• aligning• level setting
![Page 19: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/19.jpg)
Translation problems
• „claim”• „a degree of spontaneity and fluency”
![Page 20: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/20.jpg)
Levels
Proficiency (C2)
Advanced (C1)
![Page 21: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/21.jpg)
Difficulties with sample materials
videos in English (Eurocentre, Cambridge)
quality (copy of a copy)
accents (international)
levels
![Page 22: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/22.jpg)
Jihun B2 / intermediate
0
5
10
15
20
25
30
35
40
near pass at level good pass
![Page 23: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/23.jpg)
Estelle B2- / intermediate
0
5
10
15
20
25
30
35
good basic weak interm. interm.
![Page 24: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/24.jpg)
Origó 2004 / intermediate
0
10
20
30
B1 12 B2- 13
B1+ 19 B2 28
B2- 12 B2+ 5
Gábor, 30 Lilla, 35
![Page 25: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/25.jpg)
Renate - / B1
0
5
10
15
20
25
30
35
40
B1 B2
![Page 26: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/26.jpg)
Annemarie - / C1
0
5
10
15
20
25
30
B2 C1
![Page 27: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/27.jpg)
Evgeny C1 / Proficiency
0
5
10
15
20
25
good interm. weak prof. prof.
![Page 28: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/28.jpg)
Familiarization - scales
Pragmatic competence item 4 A1:2 A2:135 B1:6
item 3 B1:53 B2:83
Strategic competence item 1 A2:46 B1:78 B2:13
item 5 B2:26 C1:106
Language competence item 1 B2:3 C1:94
item 4 B1:34 B2:59
![Page 29: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/29.jpg)
Interpretation of data
IRT information - Eurocentre
- Dialang, Cambridge, Finnish Matriculation
not enough background info for reproduction
no measuring instruments attached
![Page 30: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/30.jpg)
Reference measures
Eurocentre Dialangreading
Cambridgereading
Finnishreading
C2 3.90 2.01 70-90 (80) 47-50
C1 2.80 1.23 61-81 (71) 40-46
B2 0.72 0.21 57-72 (62) 25-39
B1 -1.23 -.22 50-70 (56) 8-24
A2 -3.23 -.56 30-50 (41) 4-7
A1 -4.29 -.94 3
![Page 31: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/31.jpg)
Origó IRT measures (grammar)
Intermediate Proficiency
English 1.10 – 1.25 1.60 – 1.80
German 1.00 –1.20 1.30 – 1.70
French 1.20 – 1.40
Spanish 1.10 – 1.40
Italian 1.50 – 1.80
Russian 1.20 – 1.50
Esperanto 1.20 – 1.30
Lovari 1.20 – 1.30
Latin 1.60 – 1.90
![Page 32: Aligning levels to the European Framework The Origó Experience Budapest, February 2006](https://reader030.vdocuments.site/reader030/viewer/2022032804/56649e545503460f94b4af16/html5/thumbnails/32.jpg)
Origó - Mediation
• major difficulty: no CEFR scales• no Council of Europe sample materials• external validation? • accreditation?