testing backto basics
TRANSCRIPT
June 09
Outline
1. Definition 2. Main principles 3. Test types 4. Test design procedure 5. Use of statistics 6. Technolgy and testing 7. Bibliography
June 09
I. Definition:
« a . . . . . . of measuring a person’s
ability, . . . . . . . . . . or . . . . . . . . . . .
in a given . . . . . . . . «
June 09
« a method of measuring a person’s ability,
knowledge or performance in a given
domain. »
D. Brown, 2004.
June 09
Terminolgy
-Performance vs knowledge
-Quiz vs test
-Testing vs assessment
-Assessment vs evaluation
June 09
II. Main principles
1. Usefulness
2. Practicality
3. Validity
4. Reliability
5. Authenticity
June 09
Main principles (cont’d)
6. Transparency
7. Washback
8. Security
9. Fairness
10. . . .
June 09
III. Taxonomies
a. Henning (1987):1. Diagnosis and feedback2. Screening and selection3. Placement4. Program evaluation5. Providing research criteria6. Assessment of attitudes and socio-
psychological differences
June 09
b. Alderson, Clapham and Wall (1995):
1. placement 2. progress 3. achievement 4. proficiency 5. diagnostic
June 09
c. objective vs. subjective tests
d. high- vs. low-stakes tests
e. formative vs summative
- . . . . .
June 09
h. Traditional vs. Alternative Assessment.
Refer to comparative chart
June 09
Types:
-self-assessment -portfolios -student-designed tests -projects -presentations - . . . .
June 09
IV. Test design procedure:
a. planning:
-decide on purpose
-check course content
-write specifications
June 09
b. development: -format -grading
-piloting
June 09
c. administration: -test conditions and procedures
-organize equipment needed
June 09
d. post-test -grading -statistics -item analysis -reporting
June 09
e. reflection:
-purpose
-validity and reliability
-future changes
June 09
V. Statistics:
a. what b. rationale: -information on students'
performance -test reliability -course content -teaching
June 09
c. how: -the mean -the pass/failure rate -histograms - . . . . .
June 09
VI. Technology and testing
a. history:
-1935: IBM model 805
-1970: Book on computerized testing (Holtzman)
- . . . ?
June 09
b. main uses: -CMT/CAT -CBT -CAT -Web/internet-based testing
June 09
VII. Bibliography:
-Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press.
-Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press.
-Brown, H.D. 2004. Language Assessment: Principles and classroom practices. New York: Pearson Longman.
-Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press.
June 09
-Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107.
-Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series.
-Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, 62 - 65. Last updated: 9th June 2008.Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top
June 09
-Fulcher, G. Resources in Language Testing (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.html)
-Heaton, J. B. 1988. Writing English Language Tests. Harlow, England:Longman Press.
-Hughes, Arthur. 2003. Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press.
June 09
Thank you for your patience!