Top 5 pitfalls to avoid in English CEFR assessment

Download Top 5 pitfalls to avoid in English CEFR assessment

Post on 30-Jul-2015

26 views

Category:

Education

0 download

TRANSCRIPT

1. Top 5 pitfalls to avoid in English CEFR progress assessment Brano Pokrivcak 2. About TrackTest.eu established in 2012 in Slovakia users from 140 countries customers in 60 countries companies, schools, individuals 3. TrackTest coverage 4. Do you like maths? Reliable language assessment 5. http://en.wikipedia.org/wiki/Glicko_rating_system 6. Top 5 pitfalls to avoid in English CEF progress assessment 7. 1. Choosing the right test format 8. One test vs. level tests ? One test: Pros: One test = one score Fast and comparable Must for placement tests. Cons: Assumes that your knowledge is linear Not wide enough Problem how to match to CEFR - Adaptive test 9. Single test vs. level tests ? Level test: Pros: Different skills can be tested (less multi-choice grammar questions, more reading comprehension in higher levels) Questions adequate to the level More detailed assessment of topics for the level Cons: Difficult to decide which level to start Progress between levels 10. Assessments systems CEFR Cambridge ESOL IELTS TOEFL TOEIC C2 Proficiency (CPE) 8 - 9 C1 Advanced (CAE), BEC Higher 7 110-120 880 B2 First Certificate (FCE), BEC Vantage 5 - 6 87-109 B1 Preliminary (PET), BEC Preliminary 4 57-86 550 A2 KEY (KET) Source: blog.tracktest.eu/2013/12/tracktest-cef-levels-compared-with.html 11. 2. How to measure progress between levels ? 12. 2. How to measure progress between CEF levels ? 13. 3. Reliability of test 14. Same difficulty for everybody (with one test or generated test) heavily organized assessments (e.g. maturita)- one set of questions Diversified environments (corporations and/or multiple locations) require more flexibility Challenge: Generated test needs to match the difficulty & topics coverage 15. What is cheating ? Copying answers from classmates ? Googling for the right answer ? Dictionary ? PC spellchecker ? 16. 4. Stress factor 17. 4. Stress factor - Time - Computer vs. pen&paper - Generation X vs Millenials 18. 5. Motivate 19. Motivate a) Feedback During the test- preliminary score (How am I doing) After the completion- analysis of mistakes (What should I improve) 20. 19 Topics Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 21. Slovakia Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 22. Slovakia Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 23. Slovakia Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 24. Slovakia Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 25. Vietnam Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 26. United Kingdom Adjectives/adv Articles Prepositions Comparatives Conjunctions Pronouns Quantifiers Modal verbs Infinitive/ing Past tenses Present tenses Future tenses Conditionals Questions Idioms Vocabulary Phrasal verbs Reading Listening 27. 5. Motivate a) Feedback b) Elements of gamification 28. Gamification in assessment Key elements of gamification (B-P-L): 1. Badges 2. Points 3. Leaderboards 29. Badges 30. Points 31. Leaderboards ? 32. 1. Choose the right format 2. Different test, same difficulty 3. Progress between levels 4. Avoid stress 5. and motivate ! Top 5 pitfalls to avoid in CEF English progress assessment