A History of Standardized A History of Standardized Testing Testing

Or “Alice Rivlin the Bane of Or “Alice Rivlin the Bane of Modern Educational Woes”Modern Educational Woes”

What is a Standardized Test?What is a Standardized Test?

It is used to refer to objective testsIt is used to refer to objective tests

(i) Fill in the blanks(i) Fill in the blanks

(ii) Multiple-choice(ii) Multiple-choice

It is used to refer to norm-referenced testsIt is used to refer to norm-referenced tests

(i) percentile rankings for a pool of test takers(i) percentile rankings for a pool of test takers

It is used to refer to criterion-referenced testsIt is used to refer to criterion-referenced tests

(i) which may be of any form and provide(i) which may be of any form and provide

absolute scoresabsolute scores

How it all StartedHow it all Started

• Standardized testing began in the Standardized testing began in the United States in the early 1900s to United States in the early 1900s to determine one's individual intelligence determine one's individual intelligence quotientquotient

• WWI the Army needed a method to WWI the Army needed a method to determine which soldiers were “Officer determine which soldiers were “Officer Material”Material”

• Eventually they would be used to test Eventually they would be used to test which students were “college worthy”which students were “college worthy”

How They Were Misused How They Were Misused

Cyril Burt fabricated data on identical twin Cyril Burt fabricated data on identical twin research to prove his hereditarian theory of research to prove his hereditarian theory of intelligence transfer in early 1900sintelligence transfer in early 1900s

This argument was then used to influence This argument was then used to influence the writing of the US Immigration Restriction the writing of the US Immigration Restriction Act of 1924Act of 1924

This gave rise to the debate surrounding the This gave rise to the debate surrounding the “true” definition of intelligence and the “true” definition of intelligence and the nature vs. nurture issuenature vs. nurture issue

The ETS

• Princeton’s Educational Testing Service• Henry Chauncey (Dean of Harvard) and

Devereux Colt Joseph (President of New York Life) founded ETS in 1947.

• Main mission was to provide tests for the govt. especially in times of national emergency

• Its tax exempt income ($94 Million in 1980) because of its non profit status kept it free from any form of accountability

ETS’s Major Testing ProgramsAP® - Advanced Placement Program®

CAPA - California Alternate Performance Assessment CAHSEE - California High School Exit Exam

CLEP® - College Level Examination Program® ETS®TOPE - ETS® Test of Professional English

GMAT® - Graduate Management Admission Test® GRE® - Graduate Record Examinations®

NJ ASK - New Jersey Assessment of Skills and Knowledge (NJ ASK) PRAXISTM - The Praxis Series: Professional Assessments for Beginning

Teachers® SAT® - SAT I: Reasoning Test and SAT II: Subject Tests

SLS - The School Leadership Series STAR - California Standardized Testing and Reporting TOEFL® - Test of English as a Foreign LanguageTM

Michael Sokol’s Michael Sokol’s Argument Argument

Against ETSAgainst ETSTesters are too close to their Testers are too close to their enterprise to filter out biasesenterprise to filter out biases

Tests reinforce class boundaries Tests reinforce class boundaries (Marxist)(Marxist)

Tests may be irrelevant or Tests may be irrelevant or insufficient for predicting insufficient for predicting performanceperformance

HELP!!!!!!!!!!!!!!

• New York's pioneering Truth-in-Testing Law (Chapter 672, L. 1979), this disclosure law has evolved to accommodate new issues as they arise in the testing industry. Test agencies are required to provide students who take postsecondary and professional school standardized admission examinations with the opportunity to get (at cost) a copy of the questions, their answers, the accepted answers, and the rules for computing their score.

Worshiping at the altar of the Worshiping at the altar of the expert America 1960-2004expert America 1960-2004

• Lyndon Baines Johnson (PPBS, 1965)• Senator Robert F. Kennedy misguided

attempt at accountability• William Gorham (gave birth to the

monster Alice Rivlin)• Elementary and Secondary Education

Act of 1965 (Title 1 emerged from this)

The Great Society InitiativeThe Great Society Initiative

He was a former school teacher of He was a former school teacher of poor immigrant children in Texas in poor immigrant children in Texas in the 1930sthe 1930s

Mid-1960s public sentiment Mid-1960s public sentiment supported social and educational supported social and educational reforms to fight poverty. reforms to fight poverty.

President Johnson allocates the then President Johnson allocates the then astronomical sum of $3 Billion dollars astronomical sum of $3 Billion dollars for educationfor education

The Road to Hell is Paved With The Road to Hell is Paved With Good IntentionsGood Intentions

Robert Kennedy demands a scientific Robert Kennedy demands a scientific system of reporting the effects of the system of reporting the effects of the new educational programs so as to new educational programs so as to be accountable to the poor blacks, be accountable to the poor blacks, and economically disadvantagedand economically disadvantaged

Johnson introduced the planning, Johnson introduced the planning, programming and budgeting system programming and budgeting system (PPBS) throughout the federal (PPBS) throughout the federal bureaucracybureaucracy

Countdown to Standardized TestingCountdown to Standardized Testing

10/1957 Russians launch Sputnik10/1957 Russians launch Sputnik 1958 National Defense Education Act (NDEA) 1958 National Defense Education Act (NDEA) 10/1963 President Kennedy is assassinated 10/1963 President Kennedy is assassinated

when he declares all troops will be home from when he declares all troops will be home from Viet Nam by Christmas.Viet Nam by Christmas.

10/1963 Lyndon Baines Johnson becomes 3610/1963 Lyndon Baines Johnson becomes 36 thth President of the United StatesPresident of the United States

1965 Congress passes the Elementary and 1965 Congress passes the Elementary and Secondary Education act (ESEA) as a “war on Secondary Education act (ESEA) as a “war on poverty” Billpoverty” Bill

8/1965 Johnson appoints William Gorham to head a new 8/1965 Johnson appoints William Gorham to head a new office in Health, Education and Welfare (HEW) to office in Health, Education and Welfare (HEW) to implement the PPBS. Gorham had done this at the implement the PPBS. Gorham had done this at the Department of DefenseDepartment of Defense> Gorham brings his team with him which includes Alice > Gorham brings his team with him which includes Alice Rivlin and Robert GrossRivlin and Robert Gross> Because Title I grew out of the ESEA Kennedy stressed > Because Title I grew out of the ESEA Kennedy stressed accountability for the monies but Gorham and his team saw accountability for the monies but Gorham and his team saw this as a “natural experiment” for identifying the most this as a “natural experiment” for identifying the most effective teaching methods.effective teaching methods.> Then the best methods would be passed on to teachers > Then the best methods would be passed on to teachers and administrators so that resources could be allocated and administrators so that resources could be allocated efficiently. efficiently. > Scientific research would remedy “teachers ignorance” > Scientific research would remedy “teachers ignorance” and would provide the positive knowledge needed to and would provide the positive knowledge needed to improve teachingimprove teaching

1967 Office was renamed the Office of the Assistant Secretary for Planning and Evaluation (ASPE)

June of 1968 Alice Rivlin replaces Gorham as the Assistant Secretary of the ASPE

1971 Rivlin publishes Systematic Thinking for Social Action

Alice is Still Alive and Well in Alice is Still Alive and Well in 20032003

““TheThe important goals of education are both easily important goals of education are both easily identified and can be measured.” (Alice Rivlin, 1971)identified and can be measured.” (Alice Rivlin, 1971)

““Standardized test scores accurately reflect reading Standardized test scores accurately reflect reading proficiency, mathematical competencies and acquired proficiency, mathematical competencies and acquired knowledge”…..so one should “focus on measurable knowledge”…..so one should “focus on measurable outcomes.” (Rivlin, 1971)outcomes.” (Rivlin, 1971)

““Stable relationships exist between outcomes and inputs Stable relationships exist between outcomes and inputs to the educational process.” (Rivlin 1971)to the educational process.” (Rivlin 1971)

““We want the biggest bang for our buck.” (Rivlin, 1971)We want the biggest bang for our buck.” (Rivlin, 1971)

And here in California?

Statewide tests used in California before 1990 were designed much like a poll, providing only sample scores for a school but no information to the parents regarding their child’s performance

In 1990, the state eliminated its old testing program. NAEP results were announced in 1994, California ranked near the

bottom on all measures 1995 The STAR (Standardized Testing And Reporting) program became

law California's education leaders selected the Stanford 9 (SAT-9) for its

statewide test and this new test was first given in CA in 1998. 2001:  California Standards Test completed, The part of STAR that was

custom developed to measure California standards was completed in 2001.  This fully-developed standards test is now called the California Standards Test (CST)

California here I come

The customized California Standards Test  is designed to measure student learning of the state's academic standards: English Language Arts, Mathematics, History, and Science. This portion of the STAR test has been developing over the last three years and now includes written essays at some grades in addition to multiple-choice questions.  The California Standards Test is now the most important test in California's program. 

STAR also includes a norm-referenced test, currently the Stanford-9 Achievement Test. This test is taken by students across the country and therefore provides a comparison of California students' achievement of basic skills with that of students nationwide.  Next year, California students will take the California Achievement Test, Version 6, to help compare their performance nationally.

Get behind Thee O’ California

Other important elements of the state's testing system are: The California English Language Development Test helps to monitor

progress toward English mastery of students whose first language is not English.

The Golden State Exams provide an opportunity for graduating students to earn a distinction of merit on their high school diploma.  To save testing time, these examinations will be combined with the high school California Standards Tests.

A California High School Exit Examination (2004) ensures graduating high school seniors can meet basic learning requirements in English and Math.

The California Alternate Performance Assessment will be an alternative to the STAR for children with disabilities who cannot take part in the general statewide assessment program. This assessment will meet the requirements of the Individuals with Disabilities Education Act (IDEA) and the No Child Left Behind Act (NCLB), to ensure that all California students are included in our statewide assessment and accountability system.     

Academic Point Index

• California's Academic Performance Index is an index that combines the results of the tests taken by all students in a school.  The API ranks schools and is the central measure in the state's accountability system to ensure that every school is getting better every year.  Results of the API rankings are released in California each October.