when johnny takes the test fields leslie hoge 2005 10pgs edu

10
7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 1/10 1 WHEN JOHNNY TAKE s THE TEST By Melanie K . Fields, Sarah H . Leslie, and Anita B . Hoge t i s c o m m o n l y k n o w n t h a t t h e C h i nese government keeps a "dangan o n i t s c i t i z e n s . As The Mew Yor Times INTERNATIONAL e x p l a i n s the dangan is a "f ile opened on eac u r b a n c i t i z e n w h e n h e o r s h e e n t e r s e l e m e n t a r y s c h o o l , a n d i t s h a d o w s t h e p e r s o n t h r o u g h o u t l i f e , m o v i n g o n t o h i g s c h o o l , c o l l e g e , e m p l o y e r . " I t i s f u r t h e x p l a i n e d t h a t " . . . t h e d a n g a n [ f i l e ] c o n t a i n s p o l i t i c a l e v a l u a t i o n s t h a t a f f e c t c a reer prospec ts and permission to leav the country . . . t h e f i l e i s k e p t b y o n e ' emp loyer . The dangan affects pr omo t i o n s a n d j o b o p p o r t u n i t i e s . . . a n y p r o spective employer is sup posed t examine an applicant's dangan befor m a k i n g h i r i n g d e c i s i o n s . " I C h i n a i s a c o m m u n i s t c o u n t r y , s o t h i c o m e s a s l i t t l e s u r p r i s e . C i t i z e n s l i v i n g i the Land of the Fr ee and the Home o t h e B r a v e a r e f r e e f r o m s u c h g o v e r n m e n i n t r u s i o n a n d c o n t r o l - a r e n ' t t h e y ? What right-th inking American woul dream that our government would actu a l l y c o l l e c t i n f o r m a t i o n o n a n y o n e ' s p r i v a t e a t t i t u d e s , v a l u e s a n d b e l i e f s , a n t h u s m i m i c t h e p r a c t i c e o f a t o t a l i t a r i a regime? I f y o u t h i n k t h i s i s i m p o s s i b l e , s i m p l a s k t o s e e a c o p y o f a n a t i o n a l t e s t y o u c h i l d w i l l t a k e i n s c h o o l . Y o u w i l l b e t o l t h e t e s t i s " s e c u r e , " t h a t t h e " i n t e g r i t y " o t h e t e s t c a n ' t b e c o m p r o m i s e d . T h a t b e c a u s e t h e t e s t w i l l b e u s e d i n t h e f u t u r e y o u , t h e p a r e n t , m a y n o t e v e n v i s i t t h s c h o o l t o r e a d i t . I n f a c t , t e s t s " a d m i n i s - t e r e d f o r e v a l u a t i o n o f s t u d e n t p e r f o r m - ance" are exempt from p arental access under the Freedom of Inform ation Act A n d i f y o u r e q u e s t t h a t t h e s c h o o l a l l o w y o u t o s e e a t e s t , y o u w i l l c o m e a w a y w i t t h e i m p r e s s i o n t h a t n a t i o n a l s e c u r i t y i s a t s t a k e . Why all the hoopla? Nine-year-olds t a k e t h e s e t e s t s ! A r e s c h o o l s s u g g e s t i n g t h a t y o u w i l l h e l p y o u r c h i l d r e n t o c h e a t ? I s t h a t w h y y o u c a n ' t s e e y o u r c h i l d ' s t e s t ? O r c o u l d t h e r e b e a n o t h e r r e a s o n ? I s t a l k of test "security" a smokescreen? We t h i n k s o , a n d t h e r e m a i n d e r o f t h i s a r t i c l e s e t s o u t t o s h o w y o u w h y .

Upload: opentosuggestions

Post on 14-Apr-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 1/10

1

WHEN JOHNNYTAKE s THETEST

B y M e l a n i e K . F i e l d s , S a r a h H . L e s l i e, a n d A n i t a B . H o g e

t i s c o m m o n l y k n o w n t h a t t h e C h i

n e s e g o v e r n m e n t k e e p s a " d a n g a n

o n i t s c i t i z e n s . A s The Mew Yor

T i m e s INTERNATIONAL e x p l a i n s

t h e d a n g a n i s a " f i l e o p e n e d o n e a c

u r b a n c i t i z e n w h e n h e o r s h e e n t e r s e l e

m e n t a r y s c h o o l , a n d i t s h a d o w s t h e p e r

s o n t h r o u g h o u t l i f e , m o v i n g o n t o h i g

s c h o o l , c o l l e g e , e m p l o y e r . " I t i s f u r t h

e x p l a i n e d t h a t " . . . t h e d a n g a n [ f i l e ] c o n

t a i n s p o l i t i c a l e v a l u a t i o n s t h a t a f f e c t c a

r e e r p r o s p e c t s a n d p e r m i s s i o n t o l ea v

t h e c o u n t r y . . . t h e f i l e i s k e p t b y o n e '

e m p l o y e r . T h e d a n g an a f f e c t s p r o m o

t i o n s a n d j o b o p p o r t u n i t i e s . . . a n y p r o

s p e c t i v e e m p l o y er i s s u p p o s e d t

e x a m i n e a n a p p l i c a n t ' s d a n g a n b e f o r

m a k i n g h i r i n g d e c i s i o n s . "I

C h i n a i s a c o m m u n i s t c o u n t r y , s o t h i

c o m e s a s l i t t l e s u r p r i s e . C i t i z e n s l i v i n g i

t h e L a n d o f t h e F r e e a nd t h e H o m e o

t h e B r a v e a r e f r e e f r o m s u c h g o v e r n m e n

i n t r u s i o n a n d c o n t r o l - a r e n ' t t h e y ?

W h a t r i g h t - t h i n k i ng A m e r i c a n w o u l

d r e a m t h a t o u r g o v e r n m e n t w o u l d a c t u

a l l y c o l l e c t i n f o r m a t i o n o n a n y o n e ' s p r i

v a t e a t t i t u d e s , v a l u e s a n d b e l i e f s , a n

t h u s m i m i c t h e p r a c t i c e o f a t o t a l i t a r i a

r e g i m e ?

I f y o u t h i n k t h i s i s i m p o s s i b l e , s i m p l

a s k t o s e e a c o p y o f a n a t i o n a l t e s t y o u

c h i l d w i l l t a k e i n s c h o o l . Y o u w i l l b e t o l

t h e t e s t i s " s e c u r e , " t h a t t h e " i n t e g r i t y " o

t h e t e s t c a n ' t b e c o m p r o m i s e d . T h a t b e

c a u s e t h e t e s t w i l l b e u s e d i n t h e f u t u r e

y o u , t h e p a r e n t , m a y n o t e v e n v i s i t t h

s c h o o l t o r e a d i t . I n f a c t , t e s t s " a d m i n i s -

t e r e d f o r e v a l u a t i o n o f s t u d e n t p e r f o r m -

a n c e " a r e e x e m p t f r o m p a r e n t al a c c e s s

u n d e r t h e F r e e d o m o f I n f o r m a t i o n A c t

A n d i f y o u r e q u e s t t h a t t h e s c h o o l a l l o w

y o u t o s e e a t e s t , y o u w i l l c o m e a w a y w i t

t h e i m p r e s s i o n t h a t n a t i o n a l s e c u r i t y i s a t

s t a k e .

W h y a l l t h e h o o p l a ? N i n e - y e a r - o l d s

t a k e t h e s e t e s t s ! A r e s c h o o l s s u g g e s t i n g

t h a t y o u w i l l h e l p y o u r c h i l d r e n t o c h e a t ?

I s t h a t w h y y o u c a n ' t s e e y o u r c h i l d ' s t e s t ?

O r c o u l d t h e r e b e a n o t h e r r e a s o n ? I s t a l k

o f t e s t " s e c u r i t y " a s m o k e s c r e e n ? W e

t h i n k s o , a n d t h e r e m a i n d e r o f t h i s a r t i c l e

s e t s o u t t o s h o w y o u w h y .

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 2/10

T h e N a t i o n a l A s s e s s m e n t o f

E d u c a t i o na l P r o gr e s s ( N A E P )

E a c h y e a r , c e r t a i n c h i l d r e n a r e s e l e c t e d

t o p a r t i c i p a t e i n t h e N a t i o n a l A s s e s s m e n t

o f E d u c a t i o n a l P r o g r e s s ( N A E P ) . I t i s a

n a t i o n a l t e s t m a n d a t e d b y C o n g r e s s ; h o w -

e v e r , p a r t i c i p a t i o n b y s t a t e s a c c o r d i n g t o

f e d e r a l l a w i s v o l u n t a r y . M a n y s t a t e s a r e

c o n s i d e r i n g u s i n g t h e NAEP a s t h e i r s t a t e

a s s e s s m e n t , s u p p l a n t i n g n o r m - r e f e r e n c e d

t e s t s a n d l o c a l l y o r s t a t e - d e v e l o p e d t e s t s . 3

The NAEP t e s t i s c a l l e d " T h e N a t i o n ' s

R e p o r t C a r d . " I t a s s e s s e s s u b j e c t s s u c h a s

r e a d i n g , w r i t i n g , m a t h e m a t i c s , a n d o t h e r

s u b j e c t s i n c l u d e d i n t h e N a t i o n a l E d u c a -

t i o n G o a l s , e i g h t n e w m a n d a t e s f o r e d u c a -

t i o n r e f o r m a s s o c i a t e d w i t h AMERICA

2 0 0 0 / G O A L S 2 0 0 0 . T h e N A E P i s c o n d u c t e d b y

t h e C o m m i s s i o n e r o f E d u c a t i o n S t a t i s t i c s

u n d e r t h e a u s p i c e s o f a N a t i o n a l A s s e s s -

m e n t G o v e r n i n g Bo a r d . T h e N a t i on al

C e n t e r f o r E d u c a t i o n S t a t i s t i c s ( N C E S ) ,

u n d e r t h e o v e r s i g h t o f t h e O f f i c e o f E d u -

c a t i o n al R e s e a r c h a n d I m p r o v e m e n t

( O E R I ) i n t h e U . S . D e p a r t m e n t o f E d u c a -

t i o n , o v e r s e e s t h e c o l l e c t i o n o f NAEP d a t a .

What Happens

When J ohnny Takes The Test?

I f y o u r c h i l d i s o n e o f t h e s t u d e n t s s e l e c t e d t o t a k e t h e t e s t ,

a l e t t e r f r o m s c h o o l i s l i k e l y t o c o m e h o m e w i t h y o u r c h i l d . I t

w i l l r e a d m u c h l i k e t h e o n e i n E x h i b i t 1 . E x h i b i t 1 c o m e s f r o m

p a g e 4 1 o f t h e NAEP M a n u a l f o r A s s e s s m e n t A d m i n i s t r a t o r s *

w h i c h i s t h e i n s t r u c t i o n b o o k f o r a d m i n i s t e r i n g t h e t e s t . Y o u w i l l

r e a d t h i s l e t t e r a n d p r o b a b l y t h i n k n o t h i n g o f i t . T h e r e i s n o t h i n g

i n i t t o s e t o f f a l a r m b e l l s -a t l e a s t n o t a t f i r s t g l a n c e . B u t r e a d

i t c a r e f u l l y s i n c e w e w i l l b e r e f e r r i n g t o i t f r e q u e n t l y .

J o h n n y w i l l g o t o s c h o o l a n d b e c a l l e d o u t o f h i s r e g u l a r c l a s s e s

f o r t h e t e s t . J o h n n y a n d t h e o t h e r s e l e c t e d c h i l d r e n w i l l b e

a s s e m b l e d i n t h e c a f e t e r i a , l i b r a r y o r s o m e p l a c e s p e c i a l w h e r e

h e w i l l b e t o l d h e i s t a k i n g a t e s t o n r e a d i n g s k i l l s o r m a t h . H e

w i l l b e a s k e d t o f o l l o w v e r y s p e c i f i c i n s t r u c t i o n s f r o m h i s p r i n c i -

p a l , w h o i s u s u a l l y t h e p e r s o n a d m i n i s t e r i n g t h e t e s t .

T h e p r i n c i p a l w i l l r e a d f r o m a p r e p a r e d s c r i p t , w h i c h i s a s e t

o f i n s t r u c t i o n s f o r t h e c h i l d r e n . T h i s i s s o a l l c h i l d r e n h e a r t h e

s a m e i n s t r u c t i o n s a c c o r d i n g t o t h e NAEP m a n u a l . J o h n n y w i l l

b e c a l l e d w h e n i t i s h i s t u r n t o w a l k u p t o t h e p r i n c i p a l t o g e t

h i s t e s t b o o k l e t a n d m a y b e a p e n c i l , a n d r e t u r n t o h i s s e a t ,

k e e p i n g h i s b o o k l e t f a c e d o w n . N o o n e h a s a c l u e u p t o t h i s p o i n t

t h a t s o m e t h i n g i s a m i s s - u n l e s s o n e h a p p e n s t o s e e t h e s c r i p t

f r o m w h i c h t h e p r i n c i p a l j u s t r e a d . J o h n n y w i l l c o m p l e t e t h e t e s t

b o o k l e t i n t h e a l l o t t e d t i m e , t h e b o o k s w i l l b e c o l l e c t e d , h e w i l l

PARENT INFORMATION LETTER

J a n u a r y , 1 9 9 2

D e a r P a r e n t :

Approximately 225 schools per stare including ( s c h o o l ) have been selected for

p a r t i c i p a t i o n i n t h e 1 9 9 2 N a t i o na l A s s e s s m e n t o f E d u c a t i o n a l P r o gr e s s , T r i a l S t a t e A s s e s s m e n t .

T h e N a t i o n a l A s s e s s m e n t i s a c o n t i n u i n g s u r v e y o f t h e k n o w l e d g e , s k i l l s , a n d a t t i t u d e s o f

y o u n g A m e r i c a n s a n d t h e s u b j e c t s t h e y a r e t a u g h t i n s c h o o l . T h i s a s s e s s m e n t w i l l f o c u s o n

m a t h e m a t i c s a t t h e e i gh t h - g r a d e l e v e l a n d o n r e ad i n g a nd m a t h e m a t i c s a t t h e f o u r t h - g r a d e

l e v e l .

A s a m p l e o f a b o u t 3 0 s t u d e n t s w a s randomly s e l e c t e d t o p a r t i c i p a t e i n e a c h a s s e s s m e n t

s e s s i o n i n o u r s c h o o l . T h e p a r e n t s o f e a c h s e l e c t e d s t u d e n t a r e r e c e i v i n g t h i s l e t t e r t o i n f o r m

t h e m a b o u t t h e s t u d y .

T h e a s s e s s m e n t t a k e s a b o u t 1 3 / 4 h o u r s o f a s t u d e n t ' s t i m e a n d i s c o n f i d e nt i a l . To

e n s u r e c o n f i d e n t i a li t y , N a t i o n a l A s s e s s m e n t r e s u l t s a r e n o t r e p o r t e d t o , o r a b o u t , i n d i v i d u a l

s t u d e n t s , s c h o o l s , o r d i s t r i c t s . S t u d e n t s ' n a m e s a r e n o t r e c o r d e d o n a n y o f t h e a s s e s s m e n t

m a t e r i a l s t a k e n f r o m t h e s c h o o l o r r e p o r t e d i n a n y w a y . P a r t i c i p a t i o n i n t h e p r o g r a m w i l l a m

a f f e c t y o u r c h i l d ' s g r a d e s o r p r o g r e s s i n s c h o o l .

T h e N a t i o n a l A s s e s s m e n t o f E d u c a t i o n a l P r o g r e s s i s a n i m p o r t a n t a c t i v i t y t o k e e p u s . a s

p a r e n t s a n d c i t i z e n s , i n f o r m e d a b o u t w h a t A m e r i c a n y o u t h a r e l e a r n i n g. We wanted to inform

y o u o f t h e s u r v e y a n d l e t y o u k n o w t h a t t h e p a r t i c i p a t i o n o f e v e r y s e l e c t e d c h i l d i s g r e a t l y

a p p r e c i a t e d .

C o r d i a l l y ,

E x h i b i t 1

In response to requests from some schools . NAEP has prepar ed a paren tal

i n f o r m a t i on l e t t e r ( s h o w n b e l o w ) w h i c h e x p l a i n s t h e a s s e s s m e n t a n d i t s i m p o r t a n c e . I f y o u r s c h o o l

r e q u i r e s p a r e n t a l n o t i f i c a t i o n , y o u m a y u s e o r m o d i f y t h e l e t t e r a s y o u s e e f i t .

g o b a c k t o c l a s s , a n d n o o n e w i l l b e t h e w i s e r .

W h a t I s A m i s s ?

T h e f i r s t o b v i o u s i n d i c a t i o n t h a t s o m e t h i n g i s n o t q u i t e r i g h

o c c u r s w h e n t h e c h i l d r e n a r e a s k e d t o f i l l o u t t h e q u e s t i o n n a i r

w h i c h a c c o m p a n ie s e a c h t e s t . T h e s e q u e s t i o n s a r e r e f e r r e d t

a s " b a c k g r o u n d q u e s t i o n s . " H o w e v e r , w h e n s h o w n t h e s e q u e

t i o n s , p a r e n t s w i l l f u r r o w t h e i r b r o w s a n d a s k w h a t t h e s e q u e s

t i o n s h a v e t o d o w i t h m a t h o r r e a d i n g ? T h i s p r o v e s t o b e a v e r

g o o d q u e s t i o n .

The NAEP A s s e s s m e n t A d m i n i s t r a t o r s T r a i n i n g E x a m p l e c o n

t a i n s e x p l a n a t i o n s o f t h e q u e s t i o n s a n d h o w t o a s s i s t t h e c h i l

d r e n i n r e s p o n d i n g s h o u l d t h e y h a v e a n y t r o u b l e . A s o n e c

s e e i n E x h i b i t 2 , t h e r e a r e t w e n t y " b a c k g r o u n d q u e s t i o n s " ( f r o

p p . READ 5 , 6 , a n d 7 ) . T h e y a c c o m p a n y ea c h NAEP t e s t , i n c l u

i n g t h e m a t h t e s t .

T h e N a t i o na l A s s e s s m e n t G o v e r n in g B o ar d j u s t i f i e s t h e s

n o s y q u e s t i o n s t h i s w a y , " T h e ' n o n - c o g n i t i v e i t e m s ' - o n f a m i l

b a c k g r o u n d , t e a c h e r s . . . f o r m t h e b a s i s . . . f o r N A E P ' s r e p o r t i

c a t e g o r i e s a n d a n a l y s e s . " I n f a c t , i n t h i s s a m e m e m o , i s s u e d i

J u l y o f 1 9 9 4 , NAEP i n d i c a t e s t h e y a r e c o n s i d e r i n g " a f i r s t t i m

p a r e n t q u e s t i o n n a i r e . . . . " [ e m p h a s i s a d d e d ]

A l t h o u g h t h e c o n t r o v e r s i al p a r e n t s u r v e y h a s b e e n a b a

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 3/10

3

SECTION 1

T h i s s e c t i o n h a s 2 0 q u m t i o m . M a r k y ou r a n s w e r s i n y o u r b o ok l e t . F i l l i n

o n l y o n e o v a l f o r e a c h q u e s t i o n .

1 . W h i c h b e s t d e s c r i b e s y o u r

O w h i t e l n o t H i s p a n i c )

CD B l a c k n o t H i s p a n i c !

C I D H i s p a n ic 1 - H is p an ic " m e a n s s o m e o n e

w h o i s M e x i c a n . M e x i c a n A m e r i c a n .

C h i c a n o.u e r t o R i c a n , C u b a n . o r f r o m

s o m e o t h e r S p a n i s h o r H i s p a n i c b a c k .

g r o u n d .)

i D A s i a n o r P a c i f i c I s l a n d e r r ' Asian a

p a g i n g I s l a n d e r ' m e a n s s o m e o n e w h o

is C hinese . J a p a n e s e . K o r a n . F i l i p i n o ,

V i e t n a m e s e . A s i a n A m e r i c a n , o r f r o m

s o m e o t h e r A s i a n a P a c i f i c I s l a n d b a c k .

pound .)m A m e r i c a n I n d i a n o r A l a s k a n N a t i v e

- A m e r c a n I n d i a n o r A l a s k a n

N a t i v e " m e a n s s o m e o n e w h o u f r o m

o n e o f t h e A m e r i c a n I n d i a n t r i b e s , o r

o n e o f t h e o r i g i n a l p e o p l e o f A l a s k a . )

C D O t h e r ( w h a t f ) W r i t e y o u r a n s w e r o n

t h e l i n e .en t2 . I f y o u a r e H i s p a n i c . w h a t i s y o u r H i s p a n i c

b a c k g r o u n d !

O I a m n o t H i s p a n i c .

i D M e a i c a n o . M e x i c a n A m e r i c a n , a

C h i c a n o ' .

( D P u e r t o R i c a n

O Cuba n

t D O t h e r S p an is h o r H i s p a n i c

b a c k g r o u n d f r i •uu

I S . W i t h i n t h e p a s t t w o y e a r s . h o w

m a n y t i m e s h a v e y o u c h a n c e d

s c h o o l s b e c a u s e y o u c h a n g e d

where you lived!

p None

p One

O Two

c D T h r e e or m o r e

o m .

want

READ-'

3 . W e r e y o u b o r n i n o n e o f t h e S O s t a t e s o f

t h e U n i t e d S t a t e s . i n t h e D i s t r i c t of

Colu mb ia, or in one of t he United Stat es

t e m t o n e s f

0 Yes

O No

4 . H o w o f t e n d o t h e p e o p l e i n y o u r h o m e

s peak a language ot her t han English !

I M N e v e r

m S o m e t i m e s

t D A l w a y s

S . H o w f a r i n s c h o o l d i d your m o t h e r g o ?

O S h e d i d n o t f i n i s h h i g h s c h o o l .

® S h e g r a d u a t e d f r o m h i g h s c h o o l .

t D S h e h a d s o m e e d u c a t i o n a f t e r h i g h

s c h o o l .

C S h e g r a d u a t e d f r o m c o l l e g e .

O I d o n ' t k n o w .

6 . H o w f a t i n s c h o o l d i d d y o u r f a t h e r g o ?

O H e d i d n o t f i n i s h h i g h s c h o o l .

C D H e g r a d u a t e d f r o m h i g h s c h o o l .

C D H e h a d s o m e e d u c a t i o n a f t e r h i g h

sc hool .

m H e g r a d u a t e d f r o m c o l l e g e .

t D I d o n ' t k n o w

I s . H o w o f t e n d o y o u u s e a c o m p u t e r

f o r s c h o o l w o r k !

O A l m o s t e v e r y d a y

i D O n c e o r t w i c e a w e e k

t D O n c e o r t w i c e a m o n t h

t D N e v e r o r h a r d l y e v er

Seen- I

E x h i b i t 21

s « t i e n I

7 . D o e s y o u r f a m i l y g e t a n e w s p a p e r

r e g u l a r l y ?

0 Yes

O No

© I d o n ' t k n o w

8 . I s t h e r e a n e n c y c l o p e d ia i n y o u r h o m e ?

O Yes

tD No

i D I d o n ' t k n o w n®ma

9 . A r e t h e r e m o r e t h a n 2 S b o o k s i n y o u r

home!

O Yes

O Nom I d o n ' t k n o w .

1 0 . D o e s y o u r f a m i l y g e t a n y m a g a z i n e s

r e g u l a r l y !

O Yes

(D No

(D I d o n ' t k n o w

A . G e n e r a l P r o e e d u e m

1 . U s i n g t h e S c r i p t

You will w e o n e o f t h e s c r i p t s i n A p p e n d i x B a t t h e e n d o f t h i s m a n u a l t o a d m i n i s t e r

eac h session . S i n c e t h e s c r i p t f o r t h e m a t h e m a t i c s s e s s i o n i s d i f f e r e n t f r o m t h e o n e ( o r t h e r e a d i n g

s e s s i o n , y o u m u s t b e s u r e t o u s e t h e c o r r e c t s c r i p t . T h e s c r i p t i n c l u d e s :

lama .

f s a r s a a

E x h i b i t 3

TASK3 ADMINISTER THE SESSION

T h e g e n e r a l p r o c e d u r e s f o r a d m i n i s t e r i ng t h e a s s e s s m e n t a r e t h e s a m e f o r t h e r e a d i n g

a n d m a t h e m a t i c a s e a i o n u a lt h o u g h t h e r e a r e a ( e w s p e c i f i c d i f f e r e n c e s . T h e g e n e r a l p r o c e d u r e ,

a r e d i s c u s s e d r u s t i n t h i s s e c t i o n . ( a l l o w e d b y s p e c l t c i n f o r m a t i o n f or e a c h p a r t i c u l a r s e s s i o n t y p e ,

1 1 . H o w m u c h t e l e v i s i o n d o y o u u s u a l l y

w a t c h e a c h d a y . '

0 None0 1 h o u r o r l e s s

© 2 h o u r s

O 3 h o u r s

O a h o u r s

O : h o u r sm 6 h o u r s o r m a t e

1 2 . H o w m u c h t i m e d o y o u u s u a l l y s p e n a a

h o m e w o r k e a c h d a y +

C I d o n ' t u s u a l l y h a v e h o m e w o r k

a s s i g n e d .

m I h a v e h o m e w o r k b u t I d o n ' t

u s u a l l y d o i t .

T ' i h o u r o r l e s s

C D I h o u r

C D M o r e t h a n I h o u r

1 3 . A b o u t h o w m a n y ; a c e s a d a y d o

you have to read in sc hool and for

homework!

O M o r e t h a n 2 0

T 16 . 2 0

X 11-13

Q 6-10

0 i o r f e w e r

T h e s c r i p t m u s t b e r e a d WORD FOR WORD ( b u t w i t h e x p r e s s i o n ) t o e n s u r e t h a t a d

sessions are administered uniformly . T h e o n l l i b e r t y y o u m a y t a k e w i t h t h e s c r i p t i s t h e very f a s t

l i n e w h i c h r e a d s ' H e l l o . M y n a m e i s _ ' U y o u f e e l m o r e c o m f o r t a b l e n o t i n t r o d u c i n g y o u r s e d

t o s t u d e n t s w h o m a y a l r e a d y k n o w y o µ y ou m a y o m i t t h i s l i n e . T h e r e m a i n d e r o f t h e s c r i p t m u s t

b e r e a d v e r b a t i m , w i t h o u t a d d i t i o n s o r d e l e t i o n s

N o t e t h a t i n t h e S c r i p t . i n s t r u c t i o n s t o y o u . t h e A s s e s s m e n t A d m i n i s t r a t o r . a r e i n b a l d .

c a p i t a l l e t t e r s D o n o t r e a d t h e s e t o t h e s t u d e n t s

»Y

1 4 . O i d y o u g o t o p r e s c h o o l . n u r s e r y

S c hool . a d a y c a r e b e f o r e

k i n d e r g a r t e n ?

1 7 . H o w o f t e n d o y o u d i s c u s s t h i n g s y o u h o s e

s t u d i e d i n s c h o o l w i t h s o m e o n e a s i o n

O A l m o s t e v e r y d a y

0 YesO O n c e o r t w i c e a w e e k

t s > N o m Once or twice a monthm I d o n ' t k n o w foray

O Never o r h a r d ly e v er

• An int rodu c t ion to t he asteatnent ;

1 6 . F r o m k i n d e r ga r t e n t h r o u g h f o u r t h g r a d e .

1 9 . D o e s e i t h e r y o u r m o t h e r o r y o u r

s t e p m o t h e r l i v e a t h o m e w i t h v o u ' . I n s t r u c t i o n s f o r d i s t r i b u t i n g b o o k l e t s ;

f o r h o w m a n y g r a d e s h a v e y o u g o n e t o

s c h o o l i n t h i s S t a g g ! O Yes . I n s t r u c t i o n s f o r r e s p o nd i n g t o e m en d e d o p e n < nd e d q u e s t i o n s

( D L e s s t h a n o n e g r a d e ( D No . I n s t r u c t i o n s f o r c o d i n g a s e c t i o n o f t h e b o o k l e t c o v e r ;

p 1 . 2 F a d e s • D i r e c t i o n s f r o m t h e b o o k l e t s t h a t a r e r e a d t o t h e s t u d e n t s ;

® 3 o r m o r e g r a d e s aawu2 0 . D o e s e i t h e r y o u r f a t h e r o r y o u r

s t e p f a t h e r l i v e a t h o m e w i t h y o u ? • T h e t i m i n g o f e a c h s e c t i o n ; a n d

O Yes • Direc tions for administ ering t he mat h estimation booklet ( m a t h s e s s i o n s o n l r l .

No

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 4/10

d o n e d ( f o r n o w ) , i t i s i m p o r t a n t t o u n d e r s t a n d w h a t

w a s p r o p o s e d . A m o n g o t h e r t h i n g s , NOES w a n t e d t o

know :

• H o w m a n y o f t h e f o l l o w i n g i t e m s a r e i n t h e

home : c o l o r t e l e v i s i o n , t e l e p h o n e , c a r t h a t

r u n s , r e f r i g e r a t o r , b i c y c l e , v a c u u m c l e a n e r , m i -

c r o w a v e o v e n , t e l e p h o n e a n s w e r i n g m a c h i n e ,

d i s h w a s h e r , v i d e o c a s s e t t e r e c o r d e r s , s t e r e o

s y s t e m , c a s s e t t e r e c o r d e r .

• W h e t h e r t h e f a m i l y r e c e i v e d i nc o m e f r o m

s t o c k s , m u t u a l f u n d s , r e n t a l p r o p e r t y , r o y a l t y ,

e s t a t e s , t r u s t s , S o c i a l S e c u r i t y , w e l f a r e , f o o d

s t a m p s o r a l im o n y .

•T h e f a m i l y ' s t o t a l c o m b i n e d i n c o m e .

•W h e t h e r t h e r e a r e c e r t a i n k i n d s o f t e l e v i s i o n

p r o g r a m s t h e c h i l d i s n o t a l l o w e d t o w a t c h .

• H o w m a n y b o o k s a r e i n t h e h o m e .

•H o w o f t e n t h e c h i l d s i n g s , d a n c e s , p l a y s m u s i c

o r p u t s o n a s h o w f o r a d u l t s i n t h e f a m i l y .

• H o w o f t e n t h e c h i l d s e e s a d u l t s i n t h e f a m i l y

w r i t i n g , u s i n g m a t h e m a t i c s o r r e a d i n g . l

T h e T r o u b l e W i t h C o n f i d en t i al it y

B y n o w s o m e a l a r m b e l l s s h o u l d b e g o i n g o f f . T h i s

i s a c o n g r e s s i o n a l l y - m a n d a t e d t e s t . T h i s t e s t i s g i v e n

b y a f e d e r a l a g e n c y . T h e f e d e r a l g ov e r n m e n t g e t s

t h e r e s u l t s o f t h e s e t e s t s . A n d w e c a n a s s u m e t h a t

t h e g o v e r n m e n t i s n ' t a s k i n g J o h n n y i f h e t a l k s t o y o u

a b o u t s c h o o l j u s t t o t a k e u p s p a c e i n t h e b o o k l e t .

B u t w a i t , y o u s a y , t h e l e t t e r a b o u t t h e t e s t t h a t

c a m e h o m e w i t h J o h n n y s a i d i t w a s " c o n f i d e n t i a l " .

W e l l , y e s , i t d i d s a y " c o n f i d e n t i a l . " A q u i c k r e a d

w o u l d l e a d t h e a v e r a g e r e a d e r t o b e l i e v e t h a t n o

c h i l d ' s i n f o r m a t i o n i s l i n k e d t o h i m p e r s o n a l l y i n a n y

w a y . T h i s , w e a s s e r t , i s t h e e x a c t i l l u s i o n NAEP

i n t e n d s t o c r e a t e .

L o o k a t t h e l e t t e r a g a i n . I t d o e s n o t s a y a n o n y -

m o u s . I t s a y s c o n f i d e n t i a l . T h e r e i s a s i g n i f i c a n t

d i f f e r e n c e b e t w e e n c o n f i d e n t i a l a n d a n o n y m o u s .

A n o n y m o u s m e a n s j u s t t h a t -n o w a y t o p e r s o n a l l y

l i n k t h e i n d i v i d u a l t o t h e i n f o r m a t i o n . C o n f i d e n t i a l

m e a n s t h a t p e r s o n a l i d e n t i t y i s l i n k e d t o t h e i n f o r -

m a t i o n , m u c h l i k e t h e i nf o r m a t i o n k e p t b y y ou r

d o c t o r . I t i s c o n f i d e n t i a l b e c a u s e o n l y a u t h o r i z e d p e r s o n s h a v e

a c c e s s t o i t . I n t h i s c a s e , t h e g o v e r n m e n t t h i n k s y o u s h o u l d t r u s t

t h e m t o h a v e a c c e s s t o p e r s o n a l i n f o r m a t i o n a n d t o a c t h o n o r -

a b l y w i t h i t .

N o t e a l s o i n t h e p a r e n t i n f o r m a t i o n l e t t e r t h e s t a t e m e n t : " T o

e n s u r e c o n f i d e n t i a l i t y , N a t i o n a l A s s e s s m e n t r e s u l t s a r e n o t

r e p o r t e d t o , o r a b o u t , i n d i v i d u a l s t u d e n t s , s c h o o l , o r d i s t r i c t s . "

T h e k e y w o r d h e r e i s " r e p o r t e d . " T h e r e i s a v a s t d i f f e r e n c e

[NOTE : INSTRUCTIONS TO THE ASSESSMENT ADMINISTRATOR ARE I N BOLCAPITAL LETTERS AND SHOULD NOT BE READ TO THE STUDENTS . )

INTRODUCTION

DISTRIBUTE

MATERIALS

CODING THEBOOKLET COVER

BOOKLETDIRECTIONS

E x h i b i t 4

4th GRADE

READING SESSION SCRIPT

( H e l l o . My n ame i s (YOUR NAME) . Today you will b

p a r t i c i p a t i n g i n a s p e c i a l s t u d y o n A m e r i c a n e d u c a t i o n . T h e s t u d y i

c a l l e d t h e N a t i o n a l A s s e s s m e n t o f E d u c a t i o n a l P r o g r e s s , a n d i

i n v o l v e s t h o u s a n d s o f s t u d e n t s y o u r a g e f r o m s c h o o l s a c r o s s t h

c o u n t r y . I w a n t t o b e g i n b y t e l l in g y ou t h e p u r p o s e o f t h i s s t u d y a n

e x p l a i ni n g h o w t h e r e s u l t s w i l l b e u s e d . T o m a k e s u r e t h a t a l

s t u d e n t s a r e t o l d t h e s a m e t h i n g , I w i l l b e r e a d i n g t o yo u f r o m t h i

s c r i p t .

T h e N a t i o n a l A s s e s s m e n t o f E d u c a t i o n al P r o g r e s s i s s p o n s o r ed b

t h e U . S . g o v e r n m e n t . I t s g o al i s t o f i n d o u t w h a t s t u d e n t s y o u r a g

k n o w a n d c a n d o i n d i f f e r e n t s c h o o l s u b j e c t s . I n t h e n e x t 9

m i n u t e s . y o u w i l l b e a s k e d t o s h o w h o w w e l l y o u c a n u n d e r s t a n d

w h a t y o u r e a d . Y o u w i l l a l s o b e a s k e d q u e s t io n s a b o u t y o u r s el f a n d

y o u r s c h o o l e x p e r i e n c e .

W h e n t h e s t u d y i s o v e r , y o u r a n s w e r s w i l l b e c o m b i n e d w i t h

i n f o r m a t i o n f r o m o t h e r s t u d e n t s a l l ov e r t h e c o u n t r y . T h e r e s u l t

w i l l h e l p g o v e r n m e n t l e ad e r s , s c h o o l a d m i n i s t r a t o r s , a n d t e a c h e r s t o

d e t e r m i n e w h a t s t u d e n t s a r e l e a r n i n g . B e c a u s e t h e s t u d y w i l l h a v

a n i m p a c t o n s c h o o l s a n d s t u d e n t s a l l o v e r t h e c o u n t r y , w e h o p e t h a t

y o u wi l l do t he b e s t t ha t y o u c a n .

N o w I w o u l d l i k e t o g i v e y o u t h e t h i n g s y o u w i l l b e u s i n g . B e f o r e

h a n d o u t y o u r m a t e r i a l s , p l e a s e c l e a r y o u r d e s k s . A s I c a l l y ou

n a m e , p l e a s e c o m e f o r w a r d t o g e t a b o o k l e t a n d p e n c i l . A f t e r y o

g e t y o u r b o o k l et , t u r n i t f a c e d o w n o n y o u r d e s k a n d d o n o t o p e n i

u n t i l I t e l l y o u t o . I f y o u n e e d a no t h e r p e n c i l a f t e r w e b e g i n, p l e a s e

r a i s e y o u r h a n d .

READ STUDENTS' NAMES FROM ADMINISTRATIONSCHEDULE. DISTRIBUTE BOOKLETS AND PENCILSRECORD A" . 1 " OR "A' IN PRESENT OR ABSENT COLUMN OF

THE ADMINISTRATION SCHEDULE . DOUBLE-CHECK THATTHE STUDENT'S NAME ON THE ADMINISTRATIONSCHEDULE MATCHES THE NAME ON THE POST-IT FOREACH STUDENT . REMOVE POST-IT BEFORE GIVING

MATERIALS TO STUDENT .

P l e a s e t u r n y o u r b o o k l e t o v e r . C o d e y o u r g r a d e , b i r t h d a t e , s e x , a n

z i p c o d e i n t h e b o x a t t h e t o p o f t h e b o o k l e t . W r i t e ' 4 ' i n t h e b o

l a b e le d ' G r a d e . T he n f i l l i n t he o va l n ex t to t h e n u m b e r i n t he g ri

b e l o w t h e b o x . I n t h e b o x l a b e l e d ' B ir t h d a y " , w r i t e t h e m o n t h a n

y e a r y o u we re b o rn a n d f i l l i n t he c o r r e c t o va l s . N e x t , w r i t e ' M ' f o

ma l e o r ' P f o r f e m a l e i n t he b o x l a b e l e d ' S e x ' a n d f i l l i n t he c o r re c

o v a l I n t h e b o x l a b e l e d z i p c o d e , w r i t e t h e z i p c o d e o f y ou r h o m

a d d r e s s . B e s u re t o f i l l i n t he o va ls c o m p l e te l y .

WRITE THE SCHOOL'S NAEP ID NUMBER ON THBLACKBOARD . N e x t , w r i t e t h i s n u m b e r (REPEAT NUMBER) i

t h e b o x e s l a b e l ed ' S c h o o l n u m b e r ' a n d f i l l in t h e c o r r e s p o n d i n

o v a l s b e l o w t h e b o x e s .

N o w t u r n y o u r b o o k o v e r a n d o p e n i t t o t h e D i r e c t i o n s o n t h e f i r s t

page. R e a d t h e m t o y o u r s e l f a s I r e a d t h e m o u t l o u d .

SHOW DIRECTIONS ON THE NEXT PACE OF THIS SCRIPT

READ ALL THE DIRECTIONS, EXAMPLES, AND ANSWER

VERBATIM AND SLOWLY .

DO NOT ADMIT ANY M ORE STUDENTS TO THE SESSION .

b e t w e e n r e p o r t i n g d a t a a n d c o l l e c t i n g d a t a . NAEP i s n o t s a y i

t h e y a r e n o t c o l l e c t i n g d a t a o n i n d i v i d u a l c h i l d r e n ; t h e y a

s a y i n g t h a t t h e y d o n o t r e p o r t t h e d a t a w i t h i n d i v i d u a l i d e n t i

a t t a c h e d . T e c h n i c a l l y , i n t e r m s o f t h e w o r d i n g o f t h e l e t t e r , t h

a r e n o t l y i n g . T h e y r e l y o n t h e h o p e t h a t t h e p a r e n t w i l l n

k n o w t h e t r u e m e a n in g of t h e w o r d s c h o s e n .

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 5/10

5

PIAEI' IV92 INIAI :i1AIL ASSESSMEIJI

1-0) . 1"I IWOL .1 .. 6/9!

Ru•/ERWcxy Cod.. :

W • WMI.-1INq.nkS • SI.. .61 NIq ..kN • Nlq.wk Nw11 .S.

A •A1./-IM I.N d..

1 A..IkM MOM/N.x .

o •OM .

Exhibit 5a

How Johnny Gets Bar-Coded

A t h i r d i t e m o f i n t e r e s t o n t h e p a r e n t l e t t e r i s t h e s e n t e n c e

"Students' names are not recorded on any of the assessment

m a t e r i a l s t a k e n f r o m t h e s c h o o l . " I t i s t r ue t h a t yo ur c h i l d 's n a m e

i s n o t r e c o r d e d o n t h e t e s t b o o k l e t . B u t , y o u r c h i l d ' s n a m e i s

recorded elsewhere .

H e r e i s t h e c l u e : r e m e m b e r t h e " s c r i p t " r e f e r r e d t o e a r l i e r ?

T h e s c r i p t i s s i m p l y a s e t o f i n s t r u c t i o n s f o r t a k i n g t h e t e s t a n d

it is to be read to all children taking the NAEP. The A d m i n i s t r a t o r s

Manual is v e r y e m p h a t i c t h a t t h i s b e d o n e t o t h e l e t t e r . W i t n e s s

p a g e 5 1 o f t h e A d m i n i s t r at o r s M a n u a l , w h e r e a d m i n i s t r a t o r s a r e

g i v e n t h e i r i n s t r u c t i o n s . T h e y a r e t o l d t o r e a d t h e s c r i p t

WORD FOR WORD (but with expression) to ensure

t h a t a l l s e s s i o n s a r e a d m i n i s t e r e d u n i f o r m l y . The only

l i b e r t y y o u m a y t a k e w i t h t h e s c r i p t i s t h e v e r y f i r s t l i n e

w h i c h r e a d s ' H e l l o . My name is ' . . . The remainder of

the script must be read verbatim, without additions or

d e l e t i o n s . ( E x h i b i t 3 )

The administrator is also warned : " N o t e t h a t i n t h e s c r i p t ,

i n s t r u c t i o n s t o y o u , t h e A s s e s s m e n t A d m i n i s t r a t o r , a r e i n b o l d ,

c a p i t a l l e t t e r s . D o n o t r e a d t h e s e t o t h e s t u d e n t s . " A l l o n e h a s

t o d o i s r e a d t h e b o l d c a p i t a l l e t t e r s t o k n o w w h y !

P l e a s e r e f e r t o E x h i b i t 4 . T h i s i s t h e a c t u a l s c r i p t t h e t e s t

a d m i n i s t r a t o r m u s t r e a d t o t h e s t u d e n t s f r o m p a g e s READ 1 and

A/eeA/F,e-FLA#ILFy0.8,

A1 , 0e--"Lgo/cam̂ 9„P2

A,J,en/S&Wn/SLt2

ADMINISTRATION SCIIEDIII.E-SCIwW is

1 / 14 I.I/I Q I . I ` ' • • •~̂wr~1~T/'ScIrWN.., . ~"(icratEA_C f̂&_THRr~ „q ._ :__S/

. O.y S..p1. 1m,• S Ppl. S ..ql ,

J•Op

. 1OfAL IN SAMPLe .3 /

WIMM... / ',

0 E..IM.N / J 6u1LAC1

• 11 1 a t ASSESSED

J

4NA/A/En/ - l2S~7.tAN41,-nEw, / - . - . 3

,5rgCy4/q~/O2E48

I'M,"D // F1ZQr'T s i ^ .IrsOw - a-81m

2 o f t h e A d m i n i s t r a -

tors Manual . Notice

the paragraph in

b o l d l e t t e r s r e m i n d -

i n g t h e a d m i n i s t r a-

tor to match the

" p o s t i t " o n t h e t e s t

booklet with . t h e

child's name on the

AdministrationSchedule . T h e " p o s t

i t " i s a s l i p o f p a p e r

on whic h the ad-

ministrator writes

the name of the

c h i l d b e f o r e a t t a c h -

i n g i t t o t h a t c h i l d 's

test booklet . Re-

member, the "post

i t " w i t h t h e c h i l d ' s

name must match

what is on the Ad-

m i n i s t r a t io n S c h e d -

u l e .

Now the mystery

b e g i n s t o u n f o l d a s

we get a fu rther

g l i m p s e i n t o t h e i n -

t e r n a l w o r k i n g s of t h e t e s t . F o l l o w a l o n g .

P l e a s e r e f e r t o E x h i b i t 5 A , w h i c h a p p e a r s o n p a g e 5 7 o f t h e

Training Example . Y o u w i l l see a sample Administration Sched-

u l e . T h i s i s t h e l i s t o f c h i l d r e n c h o s e n b y t h e g o v e r n m e n t t o t a k e

the NAEP test . T h i s l i s t i s s e n t t o t h e s c h o o l a n d e a c h s c h o o l i s

r e s p o n s i b l e f o r a s s u r i n g t h a t t h e c h i l d r e n o n t h e l i s t t a k e t h e

NAEPtest . N o t e t h a t f o r e a c h n a m e o n e a c h l i n e t h e r e i s a u n i q u e

number seven colu mns to the right . We draw your eye to

student 02, Casey Bailey . Her booklet number in the column

headed "Booklet or Exc. Student Quex . No." is 14-67210 . 3 . "

Also, notice that Casey is checked "present" in the eighth

c o l u m n , j u s t t o t h e r i g h t o f t h e b o o k l e t n u m b e r i n E x h i b i t 5 A .

T h i s w i l l b e i m p o r t a n t l a t e r .

Now, look at Exhibit 5B (from p . 6 0 ) . Y o u w i l l s e e a c op y o f

t h e c o v e r o f a NAEPt e s t b o o k l e t . What number do you see under

the bar code? 14-67210-3 . Y e s , i t i s t h e s a m e n u m b e r . T h e t e s t

booklet number matches the num ber next to Casey Bailey's

name on the Administration Schedule!

Tracking Johnny to the Data Bank

R e f e r b a c k t o E x h i b i t 1 , t h e s a m p l e l e t t e r t o p a r e n t s , t h a t

states that "Students names are not recorded on any of the

a s s e s s m e n t m a t e r i a l s t a k e n f r o m t h e s c h o o l . . . ." You now know

t h a t t h i s s t a t e m e n t i s n o t t r u e . Your child's name does not

a p p e a r o n t h e t e s t b o o k l e t i t s e l f . T h e " p o s t i t " i s u s e d f o r t h a t !

/

Ab. . .1

(MANEIN N . OR MORE ASSENI)

0 Ao ( O I I S I

• AenM0• VOIAL ASSESSED

5.ak1.1 .. S i t e d.Dun. No .

~:~oQaLIQ_

Y12433~ .

!4_ Loo ag_ 7

.2Q !4e3? .3.

.yl~//0003. . .3 "

ey• /oors~2S67A~/3

F-MI(/) or

AA. ( A )

A

r

III

1N

OS

IA I

01

IA

I0

nI,

17

INIyM.J wbw . . • L r J . J . , I . . •

E d 3

1 . . . 0 • . : i q / ) 1 / y

MN.y •. . I . . . . 1 1 . 4 , A W I .

D . y / 0 . 1 . :

S w ( ~c l / - - ~.

1 . . t . . , h. 1 4

1 '. . 1 .

w / r ? Y P I , ? r ,

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 6/10

B u t , a s t h e s c r i p t i n s t r u c t s , t h e " p o s t i t " i s

t a k e n o f f b e f o r e t h e b o o k l e t i s g i v e n t o y o u r

c h i l d .

The Administration Schedule, however,

d o e s c o n t a i n b o t h y o u r c h i l d ' s n a m e a n d t h e

number of the test booklet he/she used .

Examine Exhibit 6, especially the bottom

right comer . This is the NAEPp a c k i n g l i s t o f

m a t e r i a l s t o b e r e t u r n e d w i t h t e s t b o o k l e t s ,

f r o m p a g e 7 6 o f t h e Administrators Manual .

P l e a s e n o t e t h a t i t s a y s , " B a n d B o o k l e t s w i t h

Administration Schedule . " T o d o u b l y c o n -

f i r m t h a t t h i s i s t r u e , o n p a g e 6 0 w e r e a d

"Students' names must not be written on

t h e c o v e r o r i n s i d e o f a n y a s s e s s m e n t b o o k -

le t . A s t u d e n t ' s n a m e s h o u l d o n l y a p p e a r o n

the Administration Schedule . "

This Administration Schedule contains

both your child's name and the number o f

the test booklet he/she used . I t i s t h e n

shipped o f f t o NAEP, along with the test

b o o k l e t s , f o r s c o r i n g .

The Truth About Tracking

Refer again to the "background ques-

tions" Johnny is asked to answer (Exhibit

2 ) . Why does the government want this

information? Why is Johnny's name conclu-

s i v e l y l i n k e d t o t h a t i n f o r m a t i o n ? W h a t i s

t h e g o v e r n m e n t g o i n g t o d o w i t h t h i s i n f o r -

mation? What have they done with it in

y e a r s p a s t ? W h y a r e n ' t y o u t o l d y o u r c h i l d

w i l l b e a s k e d t o d i s c l o s e t h i s i n f o r m a t i o n ?

Why is it collected without permission in

t h e f i r s t p l a c e ?

It has been vehemently denied that the

f e d e r a l g o v e r n m e n t i s d o i n g a n y o f t h i s . I n f a c t , W i l l ia m R a nd a l l ,

chairman of NAEP's National Assessment Governing Board

p u b l i c l y s t a t e s :

No National Assessment data may be stored in a way

that permits personally identifiable information about

i n d i v i d u a l s t u d e n t s a n d t h e i r f a m i l i e s t o b e m a i n t a i n e d .

A s r e q u i r e d b y l a w , a l l i n f o r m at i o n a b o u t i n d i v i d u a l s t u -

d e n t s a n d t h e i r f a m i l i e s c o l l e c t e d b y t h e N a t i o n a l A s s e s s -

ment, shall remain c o n f i d e n t i a l . In fact, the names of

i n d i v i d u a l s t u d e n t s p a r t i c i p a t i n g i n t h e N a t i o n a l A s s e s s -

ment n e v e r l e a v e t h e s c h o o l w h e r e t h e s t u d e n t a t t e n d s -5

Y o u n o w k n o w t h a t t h e l a s t p a r t o f t h i s s t a t e m e n t i s n o t t r u e .

Your child's name and number do leave the school. But what

a b o u t t h e f i r s t p a r t o f t h i s s t a t e m e n t ?

The NAEP National Assessment Governing Board adopted

p o l i c i e s Ma y 1 3 , 1 9 9 5 t h a t s t a t e s t h a t t h e y w i l l a b i d e b y f e d e r a l

v

p/ I

Exhibit 5b

THE NATION'SREPORTCARDMMF

II

0 ACI 510r.0- six/0

91-92

Grade 4

Age 9

OCT 1 1 6 1 1 1 Mf •1 9 1 3 1 &,a

'0=0=o

CDo ~0 0W m CD

• w00• Wm m• Mmm®

xCDoo• X0•0® CD

kVVoXCm

r r t . I.EP

SECTION

I I R1

3 I Ml n

s N! •

5 1 NaI MB

I

BOOKM14RG

o =3E

0000000000000•00•00000000 0 m Q 0

a) a) 0 000000000000•000

T . . T . r . . e , 1 0 A S S

I

I I 9 1 , a l F / _ 1 _ 0 1 1 CCi N I•000 0•o M 0 0 0010 00000 m o 0 0010 o oCD mm mom 0 CD 010 CD000 000 0 moo 0 m000 000 0 000 0 0CD mm mmo © A- moo m 0000 moo moo 0 0oooiooo (~ ooo 0 00001000 , 0010 0~m•m0m0 I 0 0mlm C\~ OO NOT USE

1 1~1 I I 1 i000000 00000000000 00000000000 00000000000 00000000000 00000000000 00000000000 00000000000 00000000000 00000000000 00000

law : " a l l i n f o r m a t i o n c o l l e c t e d b y NAEP a b o u t i n d i v i d u a l s t

d e n t s a n d s c h o o l s s h a l l r e m a i n s t r i c t l y c o n f i d e n t i a l . NoNAEdata may be stored in a way which permits p e r s o n a l l y i d e n t i f

a b l e i n f o r m a t i o n a b o u t i n d i v i d u a l s t u d e n t s a n d t h e i r f a m i l i e s

be maintained . " [ e m p h a s i s a d d ed ] B u t , d o t h e y a b i d e b y t h e l a w

We have already come to realize the difference betwee

confidential and anonymous. B u t w h a t d o e s " p e r s o n a l ly i d e n t

fiable" mean? The commissioner of NCES, Emerson J . E l l i o t

e x p l a i n s i n a 7 / 1 1 / 9 4 l e t t e r t o r e s e a r c h e r A n i t a H o g e :

NCES d i s t i n g u i s h e s b e t w e e n i n d i v i d u a l l y i d e n t i f i e d and

i n d i v i d u a l l y i d e n t i f i a b l e data I n d i v i d u a l l y i d e n t i f ie d data

r e c o r d s c o n t a i n a c t u a l s t u d e n t i d e n t i f i e r s , s u c h a s n a m e

o r s o c i a l s e c u r i t y n u m b e r s . None of NAEP's s t u d e n t f i l e s

c o n t a i n i n d i v i d u a l l y i d e n t i f i e d d a t a . I n d i v i d u a l l y i d e n t i f i-

a b l e data records can be matched with other records or

f i l e s b y c r o s s - r e f e r e n c i n g i n d i v i d u a l s f o r a n a l y s i s o f d a t a . °

I

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 7/10

7

" I n d i v i d u a l l y i d e n t i f i a b l e " d a t a , t h e n , i s a b u r e a u c r a t i c d e f i -

nition that means that the data is able to be identified. To 1

c o n f i r m t h i s , w e f i n d a d e f i n i t i o n i n t h e LACES Field Restricted Use

D a t a P r o c e d u r e s M a n u a l ( 3 / 3 1 / 9 3 , B - 2 ) f o r t e s t d a t a :

Individually Identifiable Information-ny item,

c o l l e c t i on , o r g r o u p i n g o f i n f o r m a t i o n p e r t a i n i ng t o a n

individual and maintained by the National Center of

E d u c a t i o n S t a t i s t i c s o r o n e o f i t s c o n t r a c t o r s , i n c l u d i n g ,

b u t n o t l i m i t e d t o t h e i n d i v i d u a l ' s e d u c a t i o n , f i n a n c i a l

t r a n s a c t i o n s , m e d i c a l h i s t o r y a n d c r i m i n a l o r e m p l o y m e n t

h i s t o r y , a n d c o n t a i n i n g t h e n a m e , o r a n i d e n t i f y i n g n u m -

b e r , s y m b o l , o r o t h e r i d e n t i f y i n g p a r t i c u l a r a s s i g n e d t o t h e

i n d i v i d u a l , s u c h a s a f i n g e r p r i n t , v o i c e p r i n t , o r p h o t o -

graph .

D i d y o u r e l e c t e d o f f i c i a l s r e a l i z e t h a t t h e l a n g u a g e c o n t a i n e d

in the Federal Privacy Act (Sec . 5 5 2 a o f T i t l e 5 , U . S . Code)

w o u l d e n d u p m e a n i n g j u s t t h e o p p o s i t e ? W h a t i s t h e " p o s t i t "

i f n o t a p e r s o n a l i d e n t i f i e r ? A n d , w h a t i s t h e A d m i n i s t r a t i o n

Exhibit 6

Spoils., L um-W.:

Ma,, Sos's GY, 1 Ik,aNk.s

wd M29r 9Ak,s1150 1601

A.a" G.500 a OHAHIS(923 9251

C.sswk rape U29Iraw.

C+twalos - TI 106

CrtWiPosl..

Mala It".R.aO.qPm.e.Iaw RK-0Ns"I_ 11 . Yn.easneaus --

a

M.m.Neala . Saw.,Go ac S..O.S

R,.WSo,oWC.a.anes.es adPokws 0."_e ISCPo1

E.oNdd SWO . ..OeeMOn.wnT1-Os.nawesRas.N W Oo.vo.w.esAsses~ NWMCal0. L .ORP--0 kbm4IO,Lwl-Pd W Apoe.O..e..C-11(10)Pmt, .o.4Ream Pmlaq. Pad La0es

Su 511_ Mt S.oo .q F...bwC-a0eaa514.9 I.-To NoQ009 Sq6-d'. Sins

Pack all m aterials from the original session according to the instruc tions

in Task 4. Encl ose in this shipment: the used and unused (Le ., those not

needed for the make-up session) booklets, remaining calculators, rulers

and geometric shapes, the Roster of Questionnaires (or a copy if allquestionnaires have not been returned), all questionnaires, the owof

the Administration Schedule, and the spy of the Packing List.

Ship the box to NAEP within one day after the original session .

If the original session was attended by a NAEP representative, this

person will keep the materials needed for the make-up session (except

for the Administration Schedule with the students' names and Roster ofQu estionnaires if not all have been returned) and will ship the materials

from the original session .

Paeklng Ust

HASP. 1992

0 Wkensa P.C.d P.OP.dW-NASP aNAEP

3bPOdsi usd .,3D .aand 4

s wroasl wd~rsdda1

02

Is

Of

at

0,

01

6

-U-

S.dUss IIL

1MI0bMaNwq5

Shia M: AswsWw. AO.M.wMOr NameSEs.ao0 Ekawway Set W125 Man Sk.w1bp.,t0wn, WI WAS

HASP Scaeal* : SSA-114SMrweeO ekme,wary School

Snake, type: MALI SealR.1rq Seal

AS-Oat*: ~0~2M592~~

MaNew ww ~N* WwowsaaN." ..1-

Packing Diagram

Pac..q LM

Sr .a . 6 . . Ceaa-.qG,eMaCa-.s

awrap. R,cew-

fMw

ark. ScMakOEP S .. .-

P-0-u-, a--

S c h e d u l e w i t h y o u r c h i l d ' s n a m e a n d t e s t n u m b e r o n i t i f i t i s n '

p e r s o n a l l y i d e n t i f i a b l e ? NAEPc i r c u m v e n t s f e d e r a l l a w s w i t h i

"post it" note maneuverings and semantic gymnastics . T h i s

key to understanding the next thing that happens to Johnny'

test .

What Happens to Johnny's Test Data?

When Johnny's name, number and test are shipped back

who will have access to this data? The answer may shock yo

H e r e i s a l i s t o f 2 9 r e s e a r c h o r g a n i z a t i o n s , a c a d e m i c i n s t i t u t i o n s

c o m p a n i e s , a n d c o n t r a c t o r s w h i c h h a v e a c c e s s t o r e s t r i c t e d u

NAEPd a t a b a s e s t h a t c o n t a i n i n d i v i d u a l l y i d e n t i f i a b l e i n f o r m

t i o n :

AERA-Appalachia Education

Arizona Dept . Ed, Res & Dev

Boston Col - Center Study Testing

Bureau of Census . P o p u l a . D i v .

CTB/Macmil lan/McGraw-Hill

Dept. o f A g r i c u l t u r e , E c o . R e s . S e r .

EDOffice of Research

E c o n o m i c P o l i c y I n s t i t u t e

Educational Testing Service

LMP A s s o c i a t e s , I n c .

MPRA s s o c i a t es , I n c .

Montana State Attorney General

NCREL-North Central Reg. E d . L a b .

Penn State Univ . , V o c . a n d I n d . ED

RAND, Inc .

SERVE, SouthEstrn REG . V i s i o n , E d

Stanford U, Nat'l Bureau Econ .

Texas Education Agency

U Michigan, Sch Education

U New Mexico, Col . ED

U Southern Calif . , CF

U Tennessee, Sch. Education

U. S . N a t ' l E d G o a l P a ne l

U. S . Dod, Manpower Data Centr

UCLA, Center Evaluation Study

VA TECH, Res. E v a l . & P o l i c y

Westat

American Institute of Research

National Computer Systems 5

PLEASE RETURN ALL UNUSED MATERIALS

s.0 00001

Ma.asses

..ans M..Scw.a00 a-lea a S..n

Once Johnny's name, nu mber and te

d a t a e n d u p i n t h e n a t i o n a l d a t a b a n k , t

parent has no control over what happen

to that information next . P a r e n t s s h o u

k n o w t h a t t h e r e a r e t w o w a y s t h a t J o h n n y '

t e s t d a t a c a n b e a c c e s s e d b y s o u r c e s o u t s i

of NCES . A contractor (or subcontractor

c a n a c c e s s i t , o r a n o r g a n i z a t i o n c a n a p p l

f o r a l i c e n s e t o a c c e s s i t . Information m

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 8/10

be obtained by computer on-line :

NCES maintains data files on two mainframe systems .

The bulk of the data is maintained by Boeing Computer

S e r v i c e s . A d d i t i o n a l d a t a a r e m a i n t a i n e d o n a s y s t e m a t

the National Institutes of Health . While the data are

maintained for use by NCES a n a l y s t s , o t h e r r e s e a r c h er s

may access the data on the Boeing System . Those who

wish to use the NCES d a t a m u s t f i r s t r e c e i v e a p p r o v a l

through NCES . T h e n B o e i n g w i l l s et u p a u s e r I D f o r t h e

c l i e n t . T h e u s e r m u s t s i g n a c o n t r a c t w i t h B o e i ng i n o r d e r

t o b e c h a r g e d f o r t h e c o n n e c t t i m e w h i l e u t i l i z i n g NCES

data. A l l d a t a a v a i l a b l e f o r t a p e s a l e c a n b e a c c e s s e d o n

the Boeing System . B o e i n g m a i n t a i n s s a n i t i z e d v e r s i o n s o f

NCES d a t a f i l e s i n o r d e r t o s a t i s f y p r i v a c y r e q u i r e m e n t s . °

How could private testing data on an individual child be

used? Remember Johnny's attitudes have just been assessed .

Refer back to Exhibit 1, where the Parent -

Information Letter acknowledges that the

NAEPa s s e s s e s s t u d e n t " a t t i t u d e s . " H e h a s ju s t

been asked twenty personal background

questions . ( S e e E x h i b i t 2 ) H e w i l l b e a s s e ss e d

a g a i n i n f o u r y e a r s . A n d , y o u h a v e j u s t t e a m e d

that this information is not private, nor

anonymous . There are obvious Orwellian

s c e n a r i o s .

For example, the new trend in marketing

t e c h n i q u e s i s c a l l e d p s y c h o - g r a p h i c s . T h i s i s

p s y c h o - b e h a v i or a l m a r k e t i n g t h a t i s u s e d t o

p r e d i c t f u t u r e b e h a v i o r . M a r k e t i n g f i r m s a r eno-l.w

l o o k i n g a t s o m e t h i n g c a l l e d " e n e r g y l e v e l s " o f

people . E n e r g y i s d e f i n e d i n m a r k e t i n g a s w h a t

makes you the person that you are. What

motivates you? What are your values? Are

y o u a r i s k t a k e r ? D o y o u a c c e p t c h a n g e ? C o u -

pled with income data, demographic data,

a n d h e a l t h d a t a t h i s c o n s t i t u t e s a c o m p l e t e

p s y c h o l o g i c a l p r o f i l e . O n e s u c h s t u d y i s c a l l e d

VALS, t h e V a l u e s a n d L i f e s t y l e s S t u d y .

Is t h e NAEPdata valuable? Yes! The more

d e t a i l e d t h e d a t a c o l l e c t e d , t h e b e t t e r t h e

p r o f i t . D o e s t h i s a c c o u n t f o r t h e h i g h n u m b e r

o f i n t r u s i v e , c o n s u m e r - o r i e n t e d q u e s t i o n s o n

the proposed NAEP p a r e n t s u r v e y ?

What cou ld NAEPd a t a b e u s e d f o r ? I n f o r -

m a t i o n i s b i g b u s i n e s s . Companies would pay

enormous amou nts of money to know who

would be predisposed to buy their product .

What about someone running for president?

W h a t a b o u t i n f l u e n c i n g p u b l i c o p i n i o n ? I t i s

c o n c e i v a b l e t h a t c e r t a i n c o n t r a c t o r s o r s u b -

c o n t r a c t o r s c o u l d u t i l i z e e d u c a t i o n i n f o r m a -

Exhibit 7t i o n a n d s e l l i t f o r p u r p o s e s o f m a r k e t i n g a

a v e r s

p r o d u c t o r i n f l u e n c i n g p u b l i c o p i n i o n , o r w o r s e .

Now you know why this tangled web of bureaucratic amb

g u i t i e s a n d h a l f - t r u t h s s h o u l d b e o f c o n c e r n t o a l l A m e r i c

c i t i z e n s , n o t j u s t p a r e n t s o f s c h o o l - a g e c h i l d r e n .

How Johnny's Teacher I s Tracked

A s i f i t ' s n o t b a d e n o u g h t h a t J o h n n y ' s p r i v a c y i s v i o l a t e d , t

i n f o r m a t i o n g i v e n b y J o h n n y i s l i n k e d t o h i s t e a c h e r a n d h i s / h

teaching methods. Teachers are also given an assessment

s o r t s , b u t i t i s c a l l e d a q u e s t i o n n a i r e .

The Administrators Manual (page 27) describes the Teach

Q u e s t i o n n a i r e a s f o l l o w s : " . . . to survey teaching practices of

teachers o f t h e s t u d e n t s t o b e a s s e s s e d . . . " [ e m p h a s i s a d d e d ]

asks teachers about "background characteristics and educa

t i o n a l t r a i n i n g . . . . " Remember, children are also asked "bac

ground questions . " I t a l s o p r o b e s " t e a c h e r ' s i n s t r u c t i o n-1141441Y•OA1.er,nYU .. .

IIO*Tfll a ouu1,o , ,_... .orl•o,Y. .•e

as s_ nvooR•oa..w•.Ct-rr4I.I

I fI I

Grade 4 Questionnaire

Ms .

SMIkhI

9t-92 Teacher

0 0 0••0 C-FT-1b, 04

9 9: 9 9 2 99 0 0. 0 9 0 9999.099 Os

-•9m 9 9-9:a9•000 ̂oo

9 9 m, 9 m mmmmmmmaxm:

IN•••-t•O• ro •aw„y M.•1 I N S O w . S a f l . I . :

/• . M I l . Y • I I f l a , t • MY/KIY,I0 . ~0000000000000000000000000000000000000000000000000®0000000000000000mmommomm

WC7{/1

a I I I ,

Y O Oa Q . 0r a aY 0 ar 0 C« O 0r a 0« 0 aa 0 _

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 9/10

9

p r a c t i c e s . . . as they relate to the students selected for the

assessment . . . . "

H e r e i s h o w t e a c h e r s a r e t r a c k e d . A R o s t e r o f Q u e s t i o n n a i r e s

i s f i l l e d o u t w h i c h l i n k s t h e t e a c h e r t o t h e T e a c h e r Q u e s t i o n -

n a i r e i n t h e s a m e m a n n e r t h a t t h e t e s t b o o k l e t a n d t h e A d m i n i -

s t r a t i o n S c h e d u l e l i n k t h e c h i l d r e n . S e e E x h i b i t 7 f r o m p a g e 3 1

o f t h e Training Example .

Note the column next to the teacher's name . I t i s n u m b e r e d

" t e a c h e r 0 1 , 0 2 " a n d s o o n . N o w l o ok i n t h e s e c o n d t o t h e l a s t

column (Teacher #) of the Student Administration Schedule

Exhibit 8

(Exhibit 5A) . H e r e w e f i n d " 0 1 , 0 2 " a n d s o o n . T h i s m e a n s t h e

teacher's answers to the Teacher Questionnaire can be linked

t o t h e r e s u l t s o f t h e c h i l d ' s t e s t .

T h i s q u e s t i o n n a i r e p r o b e s i n t o t h e t e a c h i n g m e t h o d s o f e a c h

t e a c h e r . I t w o u l d s e e m l o g i c a l t h a t s i n c e NAEPi s c o l l e c t i n g d a t a

o n h o w t e a c h e r s t e a c h , a n d t h e n c o r r e l a t i n g i t t o w h a t s t u d e n t s

know, that the government would have ample explanation as

to what methods of teaching produce the best result . The

current debate over whole language vs . the phonics method of

t e a c h i n g r e a d i n g i s o n e e x a m p l e .

Numerous education reform plans and documents connect

s t u d e n t a s s e s s m e n t t e s t p e f o r m a n c e d i r e c t l y t o t e a c h e r i n c e n -

t i v e s , a s w e l l a s s c h o o l r e w a r d s a n d p e n a l t i e s . Teachers could

lose out on promotions and s chools could be shut down if

s t u d e n t t e s t r e s u l t s a r e n ' t u p t o p a r . We have just demonstrated

howNAEPs t u d e n t r e s u l t s a r e c o n n e c t e d w i t h t e a c h e r p e r f o r m -

ance . In the near future teachers who cannot produce the

d e s i r e d s t u d e n t o u t c o m e s o n a n a s s e s s m e n t t e s t w i l l b e c o n s i d -

s -

6-

A-

ADMINISTRATION CODES

The seven Adm inistration Codes are defined below . The most frequently used

code is '1',meaning that the st udent wa s in the session full time . Jf the student was absent,

enter the letter'A'in the box, code the last ova( and code t he reason for his/her absence in the

ABS box using the codes on the ne xt page, consu lting school records as necessary .

In s ession full-time . Student at least attempted to complete the booklet .

Most booklets will receive this code .

2 - In session full-time, but no response in booklet .

3- In s ession part-time . Student left a nd did or did not return . Specify the

reason on booklet cover (e.g . . student refusal after starting booklet) . Also .

note on booklet cover the section number when student left and the section

number when the stu dent returned, if s/he did return .

Session Incomplete. Specify the reason . Use this code when the sess ion was

interrupted and no st udent w as able to complete the booklet. Reasons may

include fire drills, equipment failures, et c

Stud ent Ineligible . Use this code when you are told or discover after the

session begins that the s tudent is not eligible for the ass essment . Explain fully

on the book let cover how you de termined the st udent w as ineligible.

Other, specify . Use this code for any situation which is not covered by the

other codes, s uch as th e discovery of a page missing from a booklet . Explain

the situation fully on the booklet cover .

Absent . Use ABS cod es in next column to explain why studen t was absent

from session . (See explanation of ABS codes on next page . )

e r e d i l l - s u i t e d t o t h e i r j o b . '

We must remind the reader that student test results und

various education reform measures and proposals are the co

troversial new "outcomes" of Outcome-Based Education (OB

t h a t m e a s u r e a c h i l d ' s f e e l i n g s , a t t i t u d e s , b e h a v i o r s , v a l u e s a

b e l i e f s . W i l l t e a c h e r s ( a n d s c h o o l s ) b e p e n a l i z e d i f t h e i r s t u d e n

d o n o t s c o r e t h e p r o p e r " a t t i t u d e " o n t h e NAEP'

Pulling Joh nn y Out

S o w h a t c a n p a r e n t s d o ? W e p r o p o s e t h e r e m o v a l o f c h i l d r

f r o m p a r t i c i p a t i o n i n t h e NAEPt e s t . H o w e v e r , t h e

is a hitch to this .

W h e n e v e r s c i e n t i f i c s t u d y i s d o n e , t h e r e s e a r c h

a t t e m p t s t o c o n t r o l , o r t o t a k e i n t o a c c o u n t a l l t

v a r i a b l e s . The NAEP i s a l o n g i t u d i n a l s t u d y , w h i

m e a n s t h a t i n o r d e r t o b e l o n g i t u d i n a l , i t m u s t m e

a t l e a s t t w o c r i t e r i a-n d i v i d u a l i d e n t i t y i s i n v o l v e

a n d t h e p a r t i c i p a n t s a r e r e - a s s e s s e d a t a l a t e r d a t e

Students who take the NAEP i n g r a d e f o u r w i l l

t h e v e r y s a m e s t u d e n t s w h o t a k e i t i n g r a d e e i g h t , a

so on . T h e n a t u r e o f l o n g i t u d i n a l s t u d i e s i s t o r e - e

a m i n e , o r r e - t e s t t h e s a m e s u b j e c t i n o r d e r t o m e a s u

c h a n g e s i n i n d i v i d u a l p r o g r e s s . T h a t i s w h y p e r s o n

i d e n t i t y m u s t b e a t t a c h e d t o t h e p a r t i c i p a n t s t a k i

t h e t e s t .

However, on the NAEP, o n e o f t h e v a r i a b l e s t a k

into account is the student who for one reason o

a n o t h e r d o e s n o t t a k e , o r d o e s n o t c o m p l e t e t h e t e s

T h e c o v e r o f t h e b o o k l e t s p r o v i d e s s p a c e s t o e n t

c o d e s f o r s o m e o f t h e s e " v a r i a b l e s ." On Exhibit

note the column on the test booklet cover mark

" A D " t o t h e r i g h t c e n t e r o f t h e p a g e . T h a t i s t h e c o

t o i n d i c a t e t h e ' o u t c o m e o f t h e s e s s i o n . " T h e s e c o d

include :

• I n s e s s i o n f u l l -t i m e . S t u d e n t a t l e a s t a t t e m p t e d

complete the booklet .

• Session incomplete. Specify the reason . Use this co

w h e n t h e s e s s i o n w a s i n t e r r u p t e d a n d n o s t u d e n t w a s a b

to complete the booklet . R e a s o n s m a y i n c l u d e f i r e d r i l l

e q u i p m e n t f a i l u r e s , e t c . ( pg . 6 5 )

P a r e n t s s h o u l d b e a l e r t e d t o E x h i b i t 5 B a n d t h e m e a n i n g

t h e l a s t b o x i n t h e c o l u m n , j u s t t o t h e r i g h t o f " A D : " an "ABS

I n E x h i b i t 8 w e l e a r n t h i s s t a n d s f o r " A b s e n t . Use ABS cod

i n n e x t c o l u m n t o e x p l a i n w h y s t u d e n t w a s a b s e n t f r o m s e s s i o n

[From page 65 of the Adm inistrators Matutal, emphasis ours . ]

T h e a d m i n i s t r a t o r i s t o i n d i c a t e w h y e a c h c h i l d i s a b s e n

T h e p o s s i b l e " w h y s " i n c l u d e " p a r e n t r e f u s a l . . . t o a l l o w s t u d e

t o p a r t i c i p a t e i n t h e a s s e s s m e n t , " R e a d c a r e f u l l y t h r o u g h t h e l i

of Absent Codes on page 66 of the Administrators Manu al

Exhibit 9 .

I t i s a p p a r e n t t h a t NAEPh a s a l l b a s e s c o v e r e d . If you refu

t o l e t y o u r c h i l d t a k e t h e t e s t . NAEP k n o w s , a n d i f y o u r c h i

7/27/2019 When Johnny Takes the Test Fields Leslie Hoge 2005 10pgs EDU

http://slidepdf.com/reader/full/when-johnny-takes-the-test-fields-leslie-hoge-2005-10pgs-edu 10/10

refuses, NAEP knows . No matter what you do, once your child

is selected, NAEP knows .

Many parents have pulled their children out of public and

e v e n p r i v a t e s c h o o l s t o a v o i d t h i s t y p e o f t e s t i n g a l t o g e t h e r . We

e n d o r s e t h i s c o u r s e o f a c t i o n . However, we caution those who

p r i v a t e l y e d u c a t e t h e i r c h i l d r e n t o u s e d i s c e r n m e n t r e g a r d i n g

any s t a n d a r d i z e d t e s t . T h e r e i s a m p l e e vi d e n c e t h a t i n t he f u t u r e

a ll c h i l d r e n m a y b e c o m p e l l e d t o t a k e t e s t s s u c h a s t h e NAEP

For those parents who must keep their children in the

c l a s s r o o m , t h e r e i s a w a y . T h i s w a y w o u l d r e q u i r e t h a t p a r e n t s

m a k e c h o i c e s t h a t c a t e g o r i z e t h e i r c h i l d r e n u n d e r t h e " T e m p o -

rary absence" code by ensuring that their children have un-

s c h e d u l e d a b s e n c e s f o r b o t h t h e o r i g i n a l t e s t i n g p e r i o d and the

make-up session .

N a t u r a l l y , NAEP w a n t s a s m a n y o f t h e s e l e c t e d s t u d e n t s a s

p o s s i b l e t o b e t e s t e d . And they have provided for this by

requiring a make up session : " I f f o u r o r m o r e s t u d e n t s w e r e

a b s e n t ( n o t c o u n t i n g s t u d e n t a n d p a r e n t r e f u s a l s ) , y o u m u s t

schedule a make-up session . . . . " (pg. 6 1 ) . " F o u r " a p p e a r s t o b e

the magic number for norming the test .

I t i s p o s s i b l e f o r t h e NAEPt o a d j u s t i t s t e s t f o r m i n g i f o n l y

a f e w p a r e n t s / s t u d e n t s r e f u s e t o t a k e t h e t e s t . H o w e v e r , i t i s

n o t a s e a s y t o a d j u s t test forming to temporary, unscheduled,

u n p r e d i c t a b l e absences . A great number of temporary absences

m i g h t c a u s e s o m e c h a o s i n t h e t e s t i n g p r o c e s s , i n c l u d i n g t h e

"make-up" sessions . N o t o n l y w i l l t h i s p r o t e c t many c h i l d r e n

f r o m i n t r u s i v e t e s t i n g , i t w i l l f o u l u p NAEP's c o l l e c t i o n a n d

n o r m i n g o f t h e d a t a . T h e m o r e t h e m e r r i e r !

Conclusion

F e d e r a l L a w a u t h o r i z i n g t h e NAEP(P.L . 1 0 0 - 2 9 7 ) s t a t e s : " I t

i s n o t t h e p u r p o s e o f t h i s A c t t o a u t h o r i z e t h e c o l l e c t i o n o r

r e p o r t i n g o f i n f o r m a t i o n o n s t u d e n t a t t i t u d e s o r b e l i e f s o r o n

other matters that are not germane to (relevant to) the

acquisition and analysis of information about academic

achievement . " B u t NAEP i s i n f a c t d o i n g j u s t t h a t .

S a d l y , t h i s r e s e a r c h i n d i c a t e s t h a t w e h a v e a g o v e r n m e n t

o u t o f c o n t r o l . I t i s i n v a d i n g y o u r p r i v a c y a n d t h e p r i v a c y o f

y o u r c h i l d r e n ' s l i v e s . Now that you have seen the documenta-

t i o n w i t h y o u r o w n e y e s , t a k e y o u r c h i l d r e n o u t o f t h e NAEPtest

a n d o t h e r a s s e s s m e n t t e s t s . E n c o u r a g e y o u r f r i e n d s , n e i g b o r s ,

and family members to do the same . S p r e a d t h e w o r d f a r a n d

wide .

P l e a s e , p r o t e c t y o u r c h i l d r e n a n d g r a n d c h i l d r e n !

How You Can Distribute This Article

Y o u c a n p h o t o c o p y t h i s a r t i c l e a n d d i s t r i b u t e i t w i d e l y a s l o n g

a s y o u p h o t o c o p y i t i n i t s e n t i r e t y w i t h o u t a n y o m i s s i o n s . T h i s

a r t i c l e i s c o p y r i g h t e d . I f y o u de s i r e t o r e - p u bl i s h t h i s a r t i c le i n

y o u r p u b l i c a t i o n y o u m u s t r e c e i v e p r i o r w r i t t e n p e r m i s s i o n f r o m

The C h r i s t i a n Conscience. T h i s a r t i c l e i s a v a i l a b l e o n 3 1 / 2 " f l o p p y

d i s k , t e x t f i l e f o r m a t , ( s c a n n e d g r a p h i c s o f e x h i b i t s ) f o r a c o n -

Exhibit 9

Endnotes :

1 Near York' times ivn :hx:\ i f ire VMonday, March 16.1992.

2. Quote is froxn Prince William Gtunty Public Schoxtls, Prince William V i r g i n i a . let

dated Oct ober 3. 1 9 9 4 .

3. F i l l i n g d u: (kqx, An ( tenuu of Data fm Education Grades K through 12 by Sharon

Babbitt, Pcay Quin an d Patricia Dobbs . NCES : Washington . D.C . , 1992 . p. 5 . #NC92.132 .

4. S o u r c e : National Assessment Gweming Board, as reported in 77 4 Waslurtgunt Tint

1 9 9 4 , " C r i t i c s s a y t e s t p r o b e o f p a r e n t s i s t o , ) n o s y . "

5 . NCES Field Restricted Use Dat a Pnwedures Ma nual . March 31 . 1 9 9 3 , p . C - 5 .

6. Emerson Elliott replies to questions front Anita Hoge's Dec . 17, 1993 nrent

attachment .

7 . The Iowa Hombeck r e p o r t s p e l l s o u t t h e rctimnplan for teachers and sc hv x , l s i a v i v

`Exhibits are trom me NAZI' Mv4nuwl for Asess nknt Adrncuatraun . Fourth Grade . 1 9

Trial State Assessment and the NAEI' Ase,sment Adnuruvtratnrs 7}dining Example, 1 9 9 2 T r i

State Assessment .

© 1995 by Melanie K F i e l d s , Sarah HL e s l i e andAnita B. Hoge . All righ

reserved. Prior pennissirnt mu st he obtained in w riting before re-publishing this

anoth er publicationn or electronically . Photoc opied reproductirnu may be madethis document in its entirety . Mass distribution( i s encouraged! i '

t r i b u t i o n o f $ 3 . 5 0 . D o c u m e n t a t i o n f r o m t h i s a r t i c l e a v a i l a b l e f

a c o n t r i b u t i o n o f $ 2 0 .00. O r d e r f r o m M e l a n i e F i e l d s , 6 $ P o

hontas Rd ., Front Royal, VA 22630 .

A g e n e r i c r e p r i n t o f t h i s a r t i c l e , i n c l u d i n g e x h i b i t s , w i

references to any publication removed, may be obtained

sending a self-addressed-stam ed envelope and $1 .00_ to,

Iowa Rese arch Group, Inc ., PO Box 449, Ravenna, OH 4 4266

M u l t i p l e r e p r i n t s a r e a v a i l a b l e f o r $ 1. 00 p er c o p y , p l u s S 3 .00

postage and handling .

For supplementary documentation and resource materia

order "Wo mb To Tomb" and/or "Talking Papers" by n

Hge .

This article was first published in The Christian Co

s c i e n c e , a magazine _ a b o u t _family.-education and cu-t ui s s u e s .

ABSENT CODES

1 - Temporary absence (less than 2 weeks ). Studen t is not in school temporaril

due to illness, disability, or excused absence .

2 - Long-term absence (more than 2 weeks) . Student has been absent from

school 2 weeks or more due to an illness or disability .

3 - Chronic truant. Student only attends school occasionally, if ever .

4 - Suspended o r expelled from school .

5 - Parent refus al. Parent officially notified school that he/she refuses to allo

student to participate in the assessmen t .

6 - Student refusal. Stude nt refused to participate in the assess ment before

being given an assess ment booklet .

7 - In school, did not attend session . Use if student was kno wn to be in school on

day of asses sment but, fo r example, was not released by teacher .

8 - In school. but not notified of assessment because of disruptive behavior .

9 - Other. Use this code for any absence no t covered by other codes . Specify the

reason completely on booklet cove r (e.g ., student came t o room after session

s t a r t e d ) .

1