communication, language and foundations for …...implications for literacy foundations liberman,...

Communication, Language and Foundations

For Literacy: The Early Years

Usha Goswami

Centre for Neuroscience in Education

University of Cambridge

What is Language For?

- Social function – social interaction

- Communicative function – shared meaning

- Sociolinguistic function – language defines social

grouping

- Intra-psychological function – language is symbolic,

hence enables metacognition …

… and language is highly engaging for infants!

Social and Communicative Function

Language as a special “extra” capacity - ??

(Chomsky – LAD)

Goal is making shared meaning – so development likely

to involve similar abilities to psychological

development (“Theory of Mind”)

…perspective taking, joint visual attention,

understanding communicative intent ….

Studying Infant Abilities

Sucking paradigms

Head-turn/ looking paradigms

Brain imaging …

Electrodes10 electrodes

EEG studies

fMRI

fNIRS

Newborn Infants Recognise Mother’s Speech

De Casper & Fifer - neonates

Infant can hear mother’s voice during 3rd trimester

Sucking paradigm

Played them mother’s voice reading a story

Played strange female voice reading same story

Rewarded infants with mother’s voice whenever suck

rate was above (or below) baseline

De Casper & Fifer – Contingency Paradigm

Day 1: infants learned to suck at the rate appropriate

to hear the mother’s voice

Day 2: the experimenters reversed the contingency …

Role of Understanding Communicative Intent

Communication and meaning-making is not

always oral

- gesture

- sign language

And some animals can make some gestures

But a pre-requisite for using words, signs or

gestures linguistically is the understanding

that such actions have communicative intent

Csibra 2010: Specialized Ostensive Signals

Recognizing communicative intent is a key

source of the development of language skills:

1. Direct gaze generating eye contact

(confirms the other is “on line”)

2. The use of a special intonation pattern with

infants (‘Motherese’ or ‘Parentese’)

3. Contingent reactivity and turn-taking –

complementary matching of actions

(prototype = infant sucks, mother jiggles)

Csibra 2010: Specialized Ostensive Signals

Importance of infant’s own name – the earliest

recognized word (at around 4.5 months)

Caretakers utter the infant’s name:

- using Parentese

- when looking directly at the infant

- as part of contingent play

Hence pragmatically, name has a “special status”

as the strongest ostensive signal

Comprehension / Production: Bates et al.

Comprehension: can measure from 6 months

Production: onsets around 11 – 13 months

Universal sequence across languages

- but enormous individual differences

Median vocabulary size (production):

16 months 55 words

23 months 225 words

30 months 573 words …

6 years 6000 words

0

40

80

120

160

200

10 11 12 13 14 15 16

A

B

C

D

E

F

G

Age in months

Number of words Diary Studies: Comprehension

0

50

7 10 13 16 19 22 25

A

B

C

D

E

F

G

Age in months

Number of words Diary Studies: Production

Lexical Development

What do young children talk about?

- First words are highly relevant to day-to-

day life

Talk about salient objects (mummy, doggie),

about actions (up, gone), recurrence (more,

again) and social routines (night night)

Fast Mapping in Early Language

By the age of 2 years, children are acquiring 10 new

words per day

Often just hear a novel phonological string once, and

then learn it = “fast mapping”

Fast mapping supports the exponential increase

in vocabulary from 2 – 6 years

Quality (Parentese) and quantity of language heard

both related to individual differences

Language Input to Babies and Children

Hart & Risley, 1995; USA study

High SES families 487 utterances per hour

Lower SES families 178 utterances per hour

(on welfare)

By 4 years of age:

High SES families 44 million utterances

Lower SES families 12 million utterances

Grammatical Development

Examples of early grammatical and morphological

errors

1 y 10m “I noised” (playing with blocks)

2y 4m “I’m souping” (eating soup)

3y 1m “Yuck! It coughs me” (makes me c.)

2y 7m “It’s very nighty” (looking out at dark)

4y 6m “We saw a drummist and a flutist too”

- errors show that “rules” are being extracted

and applied creatively to produce new meanings

Who Teaches Children about Their Errors?

Perhaps surprisingly, parents rarely correct their

children directly

And when they do, children are fairly immune

“Want other one spoon daddy”

“You mean, you want the other spoon”

“Yes, I want other one spoon please daddy”

“Can you say ‘the other spoon’?”

“Other one spoon”

“Say ‘other’… Say ‘spoon’ … “Other spoon”.

“Other.. spoon. Now give me other one spoon?”

Learning Language: Role of Reformulation

Parents rarely correct misformed utterances

Instead, they reformulate them during conversation

“I want butter mine”

“Okay, give it here, I’ll put butter on it”

“I want butter on it”

“Muffy step on that”

“Who stepped on that?”

“Muffy”

“Muffy stepped on it”

- more conversationally natural

Reformulation Leads to Greater Learning

Nursery school study from USA

Day-care centre for children aged 2 – 3 years

G1 extensive and deliberate expansions

G2 natural conversation, reformulation

G3 control group

Language development by end of intervention:

G2 > G1 = G3

Whitehurst – Shared Picturebook Reading

Significant boost to children’s language skills:

- Acquire more complex syntax

- Greater gains in vocabulary

- Greater gains in narrative skills

The language in story books is different from

conversational speech

Language gains are greater when reading dialogic

“Parentese” and Learning Language

Found across languages, and whether mother

or father is the speaker

e.g., Fernald et al., 1989 – recorded naturalistic speech

All languages and both

genders showed:

-Higher pitch

-Greater prosodic contours

-Longer durations

-Longer pauses

Parentese and Language Acquisition

Brain

Language

Rhythm-driven

encoding

Infant-Directed Speech:

More stressed syllables

More slow modulations

Singing

Nursery Rhymes

Poetry

Rhythm

Prosody

Neural entrainment to slow modulations

in IDS may drive language acquisition

Babies begin with speech rhythm

-Auditory signal

-Visual dynamics

-Motor synchronisation

-Encoding via

oscillatory entrainment

The Brain and Phonological Development

Oscillatory Sensory Processing by the Brain:

Based on “sampling” energy in the environment.

Perception is not continuous, takes “snapshots” of the

signal. For auditory signals, the brain samples different

temporal rates concurrently: multi-time resolution.

Phonological

representations

“garden” “cat”

“banana”

Auditory

Visual

Motor

Language Encoding via Oscillations

Language

Representations

Neurons

Networks

Neuroscience:

MEG

EEGSimple neural coding

mechanisms, like neurons

oscillating at different

rhythmic rates, are key

delta: ~2 Hz

theta: ~5 Hz

beta: ~ 20 Hz

gamma: ~ 35 Hz

Nested – delta at top

Oscillatory Encoding by the Brain:

A Bit Like Fireflies Signalling

Brain Firing is Rhythmically Co-ordinated

Dots = Cells firing

LFP = summed activity

10 Hz Oscillation - From MMolano Word Press

Onset of speech signal:

Rise times cause phase reset (temporal

re-synchronisation)

+ Phase Locking of Oscillations Hierarchically Organised

F

R

E

Q

U

E

N

C

Y

Importance of Rhythm for Neural Encoding of Speech

Brain aligns neuronal

rhythms to rhythms in speech

…

Rhythm patterns in IDS and

in “nursery” rhymes optimal

All the different brain rhythms (delta ~2Hz, theta ~5Hz, gamma ~35)

must be in perfect time with each other for speech perception to be

accurate ( = perfect phase synchronisation or alignment)

From

Google

Images

IDS: Leong, Kalashnikova, Burnham & Goswami, 2017

Slowest brain rhythm is a 2 Hz oscillation

Modulation Peak in IDS ~ 2 Hz

Developmental Role for Slower Amplitude

Modulations

• Amplitude modulations (AMs) at 2 Hz salient

in infant-directed and child-directed speech

• Slower AMs < 10 Hz contribute rhythm and

prosody

Rhythm Individual words

Only < 2 Hz

AM

Only < 40

Hz AM

Only < 8 Hz

AM

The Speech Signal: High Complexity

Spectrogram: emphasises phonetic structure: b/d

Amplitude (energy) modulation: emphasises speech rhythm

Key source of individual differences in development

NINE SEVEN TWO THREE TWO

3D : Syllable Structure and AM Rise Time

[s]

[eh]

[vx]

[en]

juncture accented syllable

unaccented syllable

“Seven”

mean duration

Full-spectrumperspective

Greenberg 2002

[s] [eh] [vx] [en]

Rise times

Cues to rhythmic

energy patterns

Jack and Jill went up the hill

Amplitude Modulations in Child-Directed SpeechModelling nursery rhymes: strong AMs aid learning

Key AM patterns at different temporal rates are nested in

the speech signal: 2 Hz and 5 Hz modulations dominate

Different amplitude rise times cue the different temporal rates

Leong, Stone, Turner, Goswami, 2014

Ring a Ring o’ Roses

Phoneme

Onset –rime

Syllable

Stressed syllable GAR den

gar

g ar

den

d en

Amplitude Modulation Hierarchy

Related to Phonological Development

g ar d e n(taught via

reading)

Energy Patterns in Rhythmic Speech - Hierarchically Org.

"Ma -ry Ma -ry quite con tra -ry"

‘STRESS’ AM ~

delta (~2 Hz)

‘SYLLABLE AM’ ~ theta (~5

Hz)

‘ONSET/RIME’ AM ~

beta (~ 20 Hz)

Leong & Goswami, 2015

Onset -rime

Syllable

Stressed syllable

GAR den

gar

g ar

den

d en

Nested AM Hierarchy in Speech Signal:

Encoded Automatically by Neural Oscillations

~ 2 Hz

~ 5 Hz

~ 20 Hz

And these temporal hierarchies are perfectly aligned when singing!

Learning to read involves many skills …

Predicting Reading Across Languages:

Core Role of Linguistic Processing

Brain

Language

Reading

Phonology

sound

structure

of speech

Predicting Reading Across Languages:

Core Role of Linguistic Processing

Brain

Language

Reading

Phonology

sound

structure

of speech

“Phonological

representations”

for words = amalgam

of prosodic, syllabic,

phonetic learning.

Language: “Phonological Awareness”

Shows Language Universal Development

Preschool: large units

syllables

rhymes

With teaching: small units

phonemes

Ziegler & Goswami, 2005

Onset -rime

Syllable

Stressed syllable

GAR den

gar

g ar

den

d en

Language- Universal Phonological Impairments

in Developmental Dyslexia

Phonemes: Awareness develops via tuition in reading

Dyslexia:

Measuring the Neural Encoding of

Speech using EEG

Speech signal

Rapid modulations

Gamma networks

~30 – 50 Hz

Slow modulations

Theta networks

~4 – 8 Hz

Binding for

speech perception

Phase Locking to Slowest Modulations

Is Impaired in Developmental Dyslexia

Syllables (~ 5Hz)Phonemes(~35 Hz)

Slow modulations

Delta networks

~0.5 – 4 Hz

Stressed

syllables(~ 2 Hz)

Rhythm

Syllables

Meter

Phonetic

information

Goswami, 2011: Temporal Sampling Theory

Implications for Literacy Foundations

Liberman, 1975: All temporally-ordered human

behaviour is metrically organised

e.g. singing, movement, dancing, rhyming ….

- Spontaneous tap rate to music ~ 2 Hz (adults, children > 8yr)

- Singing lullabies to infants ~ 2 Hz (498 ms)

- Spontaneous adult applause (clapping) ~ 2 Hz (493 ms)

- Reading text aloud: inter-stress intervals multiples ~ 2 Hz

- Stressed syllables across languages ~ 2 Hz (493 ms)

-> Fun rhythmic activities that highlight 2 Hz rate

Training 1000 Olympic Drummers in 2012: “If you can say it, you can drum it…”

“Play the drum, so your Mum, can see you on TV”

From

Google

Images

Educational Neuroscience in the Classroom:

“Drum to say” helps children with dyslexia

“Entraining the oscillators” – use music + motor activities

to emphasise the rhythms and metrical structure of speech

- nursery rhymes

- poetry

- music and singing

- playground clapping games

Other rhythmic experiences:

- dancing

- marching

- playing instruments

to language rhythms

Matching speech and

motor rhythms

Enhanced phase alignment

of slow modulations

theta/delta networks

0.5 – 8 Hz

Enhanced

cross-modal

representations

of phonology

Rhythm and

syllable pattern

Motivation:

Language play based on

rhythm and metrical

patterning “entrains

the oscillators”

Educational Neuroscience: Training Rhythmic Timing

Bhide, Power & Goswami (2013)

Music+motor intervention for poor readers (10 weeks):

Drumming, singing, marching, poetry, hand-clap games…

Effect sizes:

Reading 0.73

NWR 0.95

Spelling 0.90

Rhyming 1.0

Conclusions

Learning language requires high quality input from

the learning environment: meaningful conversations

Other sources of individual differences include

differences in acoustic processing (e.g., dyslexia)

or in child’s ability to perceive communicative intent

Rhythmic games and language play focused on

speech rhythm patterns promote phonological

foundations for literacy

Singing involves perfect rhythmic synchronisation

GraphoGame Rime:

(Apple App, Google Play)