a puzzle language & mind - linguistics at...

30
1 Language & Mind HONR 218L Development of Speech Perception A Puzzle Korean speakers use the sounds [r] and [l] e.g. Korea Seoul Korean babies hear the difference between [ra] and [la] … they don’t know Korean yet Korean adults know Korean … but they have difficulty hearing the [ra] vs. [la] contrast Speech Perception A speaker of a language is a prisoner of its ‘alphabet’ of sounds Cross-language Differences R L R L

Upload: hoangkhanh

Post on 06-Feb-2018

222 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

1

Language & MindHONR 218L

Development of Speech Perception

A Puzzle

• Korean speakers use the sounds [r] and [l]e.g. Korea

Seoul• Korean babies hear the difference between [ra]

and [la] … they don’t know Korean yet

• Korean adults know Korean … but they havedifficulty hearing the [ra] vs. [la] contrast

Speech Perception

A speaker of a language is aprisoner of its ‘alphabet’ ofsounds

Cross-language Differences

R L

R L

Page 2: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

2

Developmental Questions

• How does the native/non-native differenceemerge?

• What is the nature of the ‘learning’ that isinvolved?

• When does the native/non-native differenceemerge?

Developmental Questions

• How does the native/non-native differenceemerge?

• What is the nature of the ‘learning’ that isinvolved?

• When does the native/non-native differenceemerge?

Possibility #1: Adding Features

• Children learn the feature contrasts of theirlanguage

• Children learn gradually, adding featuresover the course of development

Roman Jakobson, 1896-1982

Possibility #1: Predictions

• Poor discriminators at birth• Better and better with age

Roman Jakobson, 1896-1982

Page 3: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

3

English VOT Perception

To Test Children

Not so easy!

High AmplitudeSucking

Reality Check for Possibility #1:

• Infants’ show Categorical Perception ofspeech sounds - at 2 months and earlier

• Discriminate a wide range of speechcontrasts

• Discriminate Non-Native speech contrastse.g., Japanese babies discriminate r-le.g., Canadian babies discriminate d-D

Universal Listeners

• Infants may be able to discriminate allspeech contrasts from the languages of theworld!

How can they do this?

• Innate speech-processing capacity?• General properties of auditory system?

Page 4: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

4

What About Non-Humans?

• Chinchillas show categorical perception ofvoicing contrasts!

Connecting Hearing & Speaking

Auditory [ba] + Visual [ga] = Perceptual [da]

McGurkEffect

Connecting Hearing & Speaking

Auditory [ba] + Visual [ga] = Perceptual [da]

Infants start to connect auditoryand visual information early

• Infants knowconnectionbetween visualand auditoryspeech stimuli

• Mix and match[a] vs. [i]

Page 5: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

5

Developmental Questions

• How does the native/non-native differenceemerge?

• What is the nature of the ‘learning’ that isinvolved?

• When does the native/non-native differenceemerge?

When does Change Occur?

• About 10 months

Janet Werker

U. of British Columbia

When does Change Occur?

• Hindi and Salishcontrasts testedon English kids

Janet Werker

U. of British Columbia Conditioned Headturn Procedure

Developmental Questions

• How does the native/non-native differenceemerge?

• What is the nature of the ‘learning’ that isinvolved?

• When does the native/non-native differenceemerge?

Page 6: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

6

Possibility #2: Maintenance & Loss

• Infants maintain features they hearbeing used in their language

• They lose all others

Patricia KuhlUniversity of Washington

Possibility #2: Maintenance & Loss

• Anotherschematic:

Possibility #2: Predictions

• Loss of discriminability should bepermanent and absolute

Possibility #2: Reality Check

• Loss of discriminability IS NEITHERpermanent NOR absolute

Page 7: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

7

Training improves adultperformance

Some non-native contrasts are easyfor adults to discriminate

Adults perform better at non-native contrasts if they think thesounds are not language sounds!

We seem to have different “ears” forlanguage sounds vs. other sounds

Page 8: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

8

Developmental Questions

• How does the native/non-native differenceemerge?

• What is the nature of the ‘learning’ that isinvolved?

• When does the native/non-native differenceemerge?

Possibility #3: FunctionalReorganization

• Changes in performance withdevelopment do not reflect changes inthe hard-wiring of the brain

• They reflect the operation ofpostperceptual processes that allow theinfant to attend to only phoneticinformation that distinguishes meaning

Janet WerkerUniversity of British Columbia

Possibility #3: FunctionalReorganization

• Schematically (from Phillips 2001)

What 1-year-olds can’t do

• Recognize minimal pairs while relatingthem to real words– “bear” versus “pair”– “Piglet” versus *“Biglet”

• More Werker experiments

Page 9: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

9

Word Learning

• Stager &Werker 1997

‘bih’ vs. ‘dih’and‘lif’ vs. ‘neem’

Word learning results

• Exp 2 vs 4

Why 1-year-olds Fail on MinimalPairs

• They fail specifically when the task requires word-learning

• They do know the sounds• But they fail to use the detail needed for minimal

pairs to store words in memory• What is going on?

Swingley & Aslin, 2002• 14-month olds did recognize mispronunciations of familiar

words

Page 10: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

10

Werker et al. 2002More…

• Word-learning is very hard for younger children,so detail is initially missed when they first learnwords

• Many exposures are needed to learn detailed wordforms at early stages of word-learning

• Success on the Werker/Stager task seems to berelated to the vocabulary spurt, rapid growth invocabulary after ~50 words

One-Year Olds Again

• One-year olds know the surface soundpatterns of the language

• One-year olds do not yet know whichsounds are used contrastively in thelanguage…

• …and which sounds simply reflect variationthat does not affect meaning

• One-year olds need to learn contrasts

We need another level!

Page 11: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

11

Same or different?

light liedtight tiedsite sighedlife liveknife knive(s)lice liesdice dies

Some people have this system:

light lajt lied lajd

tight tajt tied tajd

site sajt sighed sajd

life lajf live lajv

knife najf knive(s) najvz

lice lajs lies lajz

dice dajs dies dajz

Some people have this one:

light l√jt lied lajd

tight t√jt tied tajd

site s√jt sighed sajd

life l√jf live lajv

knife n√jf knive(s) najvz

lice l√js lies lajz

dice d√js dies dajz

What’s the pattern?

light l√jt lied lajd

tight t√jt tied tajd

site s√jt sighed sajd

life l√jf live lajv

knife n√jf knive(s) najvz

lice l√js lies lajz

dice d√js dies dajz

Page 12: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

12

What’s the pattern?

t d

t d

t d

f v

f v

s z

s z

voicelessalveolarstop

voicelesslabiodentalfricativevoicelessalveopalatalfricative

voicedalveolarstop

voicedlabiodentalfricativevoicedalveopalatalfricative

What’s the pattern?

t d

t d

t d

f v

f v

s z

s z

voicelessalveolarstop

voicelesslabiodentalfricativevoicelessalveopalatalfricative

voicedalveolarstop

voicedlabiodentalfricativevoicedalveopalatalfricative

So these speakers have a rule ...

Before a voiceless consonantaj _ √j

Isn’t it just two sets of words?

Page 13: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

13

l√js lajzd√js dajzl√jf lajzs√jt sajdl√jt lajd

Isn’t it just two sets of words?

l√js lajzd√js dajzl√jf lajzs√jt sajdl√jt lajd

Nope, it’s a rule ...

s t i gh t

s t i e d

[stajd]Nope, it’s a rule ...

[st√jt]

Two “levels” of speech sounds

The sounds you “store” in your head

Page 14: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

14

Two “levels” of speech sounds

The sounds you “store” in your head

/lajt/

/lajd/

Two “levels” of speech sounds

The sounds you actually produce

Two “levels” of speech sounds

The sounds you actually produce

[l√jt]

[lajd]

The sounds you “store” in your head

/lajt/

/lajd/

“phonemes”

TerminologyTerminology

Page 15: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

15

The sounds you actually produce

[l√jt]

[lajd]

TerminologyTerminology

“phones”[√j]

/aj/

[aj]We call the phonesWe call the phonesallophonesallophones of the of thephonemephoneme

1 phoneme; more than 1 phone

So:

• In some dialects of English, thephoneme /aj/ has two allophones: [aj]and [√j].

• The allophone [√j] occurs wheneverthe phoneme precedes a voicelesssound

Or, more succinctly:

aj

Page 16: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

16

Or, more succinctly:

aj

This phoneme

Or, more succinctly:

aj_

becomes

Or, more succinctly:

aj_√j

this sound(allophone)

Or, more succinctly:

aj_√j/

where?

Page 17: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

17

Or, more succinctly:

aj_√j/____

immediately before

Or, more succinctly:

aj_√j/____[-voice]

a voiceless sound

The whole rule:

aj_√j/____[-voice]

Another rule:

t_d/V____V

Page 18: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

18

• “sit” [sˆt]• “sitter” [sˆd\r]• “heat” [hit]• “heater” [hid\r]• “at” [æt]• “attic” [ædˆk]

Another rule:

• “attack”• “atone”• “determine”• “detect”

What about these?

[sˆd\r] [\tæk][hid\r] [\ton][ædˆk] [dit´kt]

Is there a pattern?

[sˆd\r] [\tæk][hid\r] [\ton][ædˆk] [dit´kt]

Is there a pattern?

Page 19: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

19

So we need a slight revision

t_d/V____V

1 phoneme

/t/

(sound storedin the brain)

[d]

1 phoneme 2 allophones

/t/

[t]sound(s) actually produced

/t,f,p.../What do you have

in your head?

sounds(phonemes)

Page 20: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

20

rules

/t,f,p.../What do you have

in your head?

rules

/t/

rules[d][t]

Points to note:

• Sequence becomes “easier to say”BUT• This process is a specific rule of a particular

dialect of English

In what sense a specific rule?

• doesn’t apply to all instances of “t” betweenvowels

• isn’t a part of the grammar of other dialectsof English

• is only one way to make sequences ofvowels and voiceless consonants easier tosay

Page 21: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

21

Moral:

The rules that we discover are often“natural” in that one can find an explanationfor many of them in terms of ease ofarticulation, but they are notinevitable/innate: they are specific rules ofparticular dialects or languages, and had tobe learned.

A way to think about phonemes

• You have a “mental dictionary” where youstore the words you have learned.

• What information does it have to contain foreach word?

• At least:• the meaning of the word• the sound of the word

A way to think about phonemes

• How much detail do you have to rememberabout the sound of each word?

If you can predict something by arule, you don’t have to remember

it

Just remember:

•• the the rulerule•• the things that the things that cancan’’tt be be

predictedpredicted

Page 22: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

22

/aj/

rules

[aj][√j]

Allophonic differences ignoredby hearers

/aj/

rules

[aj][√j]

Allophonic differences ignoredby hearers

/aj/

rules

[aj][√j]

rules

/aj/

Allophonic differences ignoredby hearers

• Voiceless stops /p, t, k/

• Aspirated at start of syllable; unaspirated after [s]• 6 month olds easily distinguish bottom 2 rows; 1 year olds

do not (adults aren’t great either)

pitspitspitbit

tackstackstackdack

Varying Pronunciations

Page 23: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

23

Languages can differ in whatis predictable

Korean has [l] & [r]

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

Korean has [l] & [r]

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

But [r] doesn’t show up everywhere ...

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

Page 24: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

24

But [r] doesn’t show up everywhere ...

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

[r] is alwaysin front of avowel

And nor does [l] ...

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

And nor does [l] ...

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

[l] is neverin front of avowel

/l/

rules

So: Korean has only 1 liquid phoneme

(Koreans don(Koreans don’’t have t have to remember if a wordto remember if a wordhas has [l][l] or or [r][r]))

Page 25: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

25

/l/

rules

[r][l]

... but that phoneme has 2 allophones

/l/

rules

[r][l]

rules

So in Korean, [l] and [r] are “the same”

/l/

So Korean works like this:

1 phoneme

/l/

(sound storedin the brain)

Page 26: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

26

[r]

1 phoneme 2 allophones

/l/

[l]sound(s) actually produced

While English works like this:

(sounds storedin the brain)

2 phonemes

/l//r/ [l]

2 phonemes 2 phones

[r]

/l//r/

sound(s) actually produced

Page 27: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

27

Even more schematically:Stored Produced

English/l//r/

[l]

Even more schematically:Stored Produced

English

Korean

/l//r/

[l]

/l/[r][l][r]

Minimal Pairs• In English, [r] and [l] can occur in the same position in a

wordrake lakeramp lamprim limbripper ripple

• In English, [r] and [l] can be used to mark a meaningcontrast

• In English, /r/ and /l/ are two phonemes

Minimal Pairs

• Korean works differently

Page 28: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

28

Korean has [l] & [r]

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

But [r] doesn’t show up everywhere ...

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

[r] is alwaysin front of avowel

And nor does [l] ...

[rupi] “ruby”[kiri] “road”[saram] “person”[ir}mi] “name”[ratio] “radio”[mul] “water”[pal] “big”[s\ul] “Seoul”[ilkop] “seven”[ipalsa] “barber”

[l] is neverin front of avowel

Minimal Pairs

• Korean works differently• [r] and [l] are two allophones of a single

phoneme in Korean• It’s impossible to create minimal pairs

which contrast r/l in Korean• [r] and [l] cannot be used contrastively in

Korean

Page 29: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

29

One-Year Olds Again

• One-year olds know the surface soundpatterns of the language

• One-year olds do not yet know whichsounds are used contrastively in thelanguage…

• …and which sounds simply reflectpronunciation rules

• One-year olds need to learn contrasts

Word Learning

• Stager &Werker 1997

‘bih’ vs. ‘dih’and‘lif’ vs. ‘neem’

Maybe not so bad after all...

• Children learn the feature contrasts of theirlanguage

• Children learn gradually, adding featuresover the course of development

Roman Jakobson, 1896-1982

Puzzle Solved!

• Korean speakers use the sounds [r] and [l]e.g. Korea

Seoul• Korean babies hear the difference between

[ra] and [la] … they don’t know Korean yet• Korean adults know Korean … but they

have difficulty hearing the [ra] vs. [la]contrast

Page 30: A Puzzle Language & Mind - Linguistics at Marylandling.umd.edu/~zukowski/courses/Spring2005/hon218L/class20.pdf · Language & Mind HONR 218L ... prisoner of its ‘alphabet’ of

30

Where’s Whorf?• We do “hear” language sounds differently

depending on what language we speak. But whenwe fail to hear a contrast that a speaker of anotherlanguage does hear, it isn’t because our physicalability to register that difference has disappeared.It’s because we have learned that that type ofcontrast is not a meaningful contrast for language.

• Our mental representations of the sounds of wordsare an abstraction from the physical signal.Allophones of /t/ are all the same sound in ourminds.