testing backto basics

June 09

Testing: Back to Basics.

Abdellatif Zoubairzoubair2@hotmail.com

June 09

Outline

1. Definition 2. Main principles 3. Test types 4. Test design procedure 5. Use of statistics 6. Technolgy and testing 7. Bibliography

June 09

I. Definition:

« a . . . . . . of measuring a person’s

ability, . . . . . . . . . . or . . . . . . . . . . .

in a given . . . . . . . . «

June 09

« a method of measuring a person’s ability,

knowledge or performance in a given

domain. »

D. Brown, 2004.

June 09

Terminolgy

-Performance vs knowledge

-Quiz vs test

-Testing vs assessment

-Assessment vs evaluation

June 09

II. Main principles

1. Usefulness

2. Practicality

3. Validity

4. Reliability

5. Authenticity

June 09

Main principles (cont’d)

6. Transparency

7. Washback

8. Security

9. Fairness

10. . . .

June 09

III. Taxonomies

a. Henning (1987):1. Diagnosis and feedback2. Screening and selection3. Placement4. Program evaluation5. Providing research criteria6. Assessment of attitudes and socio-

psychological differences

June 09

b. Alderson, Clapham and Wall (1995):

1. placement 2. progress 3. achievement 4. proficiency 5. diagnostic

June 09

c. objective vs. subjective tests

d. high- vs. low-stakes tests

e. formative vs summative

- . . . . .

June 09

h. Traditional vs. Alternative Assessment.

Refer to comparative chart

June 09

Types:

-self-assessment -portfolios -student-designed tests -projects -presentations - . . . .

June 09

IV. Test design procedure:

a. planning:

-decide on purpose

-check course content

-write specifications

June 09

b. development: -format -grading

-piloting

June 09

c. administration: -test conditions and procedures

-organize equipment needed

June 09

d. post-test -grading -statistics -item analysis -reporting

June 09

e. reflection:

-purpose

-validity and reliability

-future changes

June 09

V. Statistics:

a. what b. rationale: -information on students'

performance -test reliability -course content -teaching

June 09

c. how: -the mean -the pass/failure rate -histograms - . . . . .

June 09

VI. Technology and testing

a. history:

-1935: IBM model 805

-1970: Book on computerized testing (Holtzman)

- . . . ?

June 09

b. main uses: -CMT/CAT -CBT -CAT -Web/internet-based testing

June 09

VII. Bibliography:

-Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press.

-Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press.

-Brown, H.D. 2004. Language Assessment: Principles and classroom practices. New York: Pearson Longman.

-Coombe, C., Folse, K., & Hubley, N. (2007).  A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press.

June 09

-Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107.

-Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series.

-Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, 62 - 65. Last updated: 9th June 2008.Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top

June 09

-Fulcher, G. Resources in Language Testing (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.html)

-Heaton, J. B. 1988. Writing English Language Tests. Harlow, England:Longman Press.

-Hughes, Arthur. 2003. Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press.

June 09

Thank you for your patience!