Download - Word Coach - Pitt Sept 08
![Page 1: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/1.jpg)
Tom CobbUniversité du Québec à Montréal
“Does My Word Coach
coach words?”
http://mywordcoach.us.ubi.com/
This PPT at http://www.lextutor.ca/cv/ppt/pittsburgh.ppt
![Page 2: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/2.jpg)
2
Video Game use – exponential increase
A great deal of some kind of learning no doubt happens
But can targeted learning be made to happen?
Can we exploit this trend rather than fight it?
![Page 3: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/3.jpg)
3
Many learning claims get made
![Page 4: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/4.jpg)
4
Few games have specific learning goals
Claims are about “new ways of learning,” not about any particular content
Few (any?) claims are based on empirical investigation
But more in glossy books than dull research papers
![Page 5: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/5.jpg)
5
To design a game with concrete learning goals
Based on learning principles
In one’s own research area And investigates its effects
empirically
An interesting opportunity therefore…
![Page 6: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/6.jpg)
6
![Page 7: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/7.jpg)
7
Game contains all the non-specialist words of English Sequenced by frequency/range in the BNC
Yes-no test determines start-point in sequence Words are introduced in six coordinated word games Games focus on
Form Meaning Verbal efficiency (speed of access)
Words are dropped only after six correct uses Principled recycling
Games are integrated within a tutor-model Choice of tutor Goal setting, record keeping, error review
Game incorporates a level-appropriate dictionary CALD
My Word Coach - description
![Page 8: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/8.jpg)
8
Belief: Discovery is not a sufficient strategy to grow an L2 lexicon
Some type of vocab focus is demonstrably necessary
Computer /video game is an ideal start to this job
Although maybe not finish
My Word Coach - philosophy
![Page 9: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/9.jpg)
9
Predecessors 1
![Page 10: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/10.jpg)
10
Predecessors 2
![Page 11: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/11.jpg)
11
Predecessors 3
![Page 12: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/12.jpg)
12
![Page 13: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/13.jpg)
13
Word Coach’s Pedagogy
![Page 14: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/14.jpg)
14
Behind-the-scenes pedagogy
![Page 15: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/15.jpg)
15
Word Coach’s Coaches
![Page 16: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/16.jpg)
16
Content – 3 strands
1. Form of words
![Page 17: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/17.jpg)
17
2. Meaning of words
![Page 18: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/18.jpg)
18
![Page 19: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/19.jpg)
19
3. Processing speed
![Page 20: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/20.jpg)
20
All packaged in a small box
… and announced to the world in a huge publicity campaign -
http://mywordcoach.us.ubi.com
![Page 21: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/21.jpg)
21
Are more word meanings known both immediately + after delay
Are more words used in oral production
Are words accessed more quickly?
Research Questions
Following substantial use of the game…
![Page 22: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/22.jpg)
22
Grade 6 primary school in suburban Montreal Feb-June 2007
Two intact classes, same teacher, n=50 Condition 1: both groups get to use game Condition 2: testing sessions not to exceed 1 hr
60%+ immigrant children, some quasi-bi/tri-lingual French, English, another
Instruction is in French, 2 hrs/wk ESL
Game is integrated into ESL classwork Parents solidly behind experiment
DS players + game disks from Ubisoft
Subjects and setting
![Page 23: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/23.jpg)
23
1. For meanings known Paul Nation’s BNC-based 14k
Levels test 10 levels used, then 5
2. For words used Boy, dog and frog story (Mercer) Analyzed with VP-kids
3. For word access UNESCO method
– Read words aloud from 60-word list in fixed time
Instruments
![Page 24: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/24.jpg)
24
1
![Page 25: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/25.jpg)
25
OLYMPUS DSS File
2
![Page 26: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/26.jpg)
26
![Page 27: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/27.jpg)
27
![Page 28: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/28.jpg)
28
![Page 29: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/29.jpg)
29
(60 words)
3
![Page 30: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/30.jpg)
30
Research Design
![Page 31: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/31.jpg)
31
Results
To note first:
Equal game use between groups
(despite considerable variance)
![Page 32: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/32.jpg)
32
Results 11a. Levels Test (pretest, both groups, no diffs)
Levels Test (10k) at Time 1
0.00
1.00
2.00
3.00
4.00
5.00
6.00
7.00
K-levels
Scor
es/1
0
601 (First game group) 6.33 5.03 4.13 4.90 4.87 2.73 2.93 2.80 1.70 1.47
602 (second game group) 6.07 4.76 4.20 4.87 4.84 2.73 2.83 2.74 1.64 1.45
1 2 3 4 5 6 7 8 9 10
About 2350 word meanings known from first 5000 families but only just over half at key 1k level (600 words, SD 150)
![Page 33: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/33.jpg)
33
Results1b. Levels post-test
Significant gains for first 5 k-levels combined at T3
601 - Levels Scores @ Times 1,2,3
0
1
2
3
4
5
6
7
8
1 2 3 4 5 6
K-levels (up to 6)
Sco
res/
10 Time 1
Time 2
Time 3
![Page 34: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/34.jpg)
34
Results
1c. Levels Test (3 times, both groups)
![Page 35: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/35.jpg)
35
Results – Levels Test - Summary
Initial state: No significant difference
Baseline (602, T1-T2): No significant difference
Following game use
601: 459 words average gain, **sig – but at T3, not T2
602: 178 words average gain, * sig
Note: These are average gainsIncorporating wide range of variance
![Page 36: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/36.jpg)
36
Results 2
2a. Frog stories – new words in use
![Page 37: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/37.jpg)
37
601 (first game group) VP-Kids at Times 1, 2, 3
0102030405060708090
1 2 3 4 5 6 7 8 9 10 11
250-word levels
Per
cen
t w
ord
s u
sed
Time 1
Time 2
Time 3
Results2b. Frog stories – where are these gains?
602 (second game group) VP-Kids at Times 1, 2, 3
0
10
20
30
40
50
60
70
80
90
1 2 3 4 5 6 7 8 9 10 11
250-word levels
Pe
rce
nt
wo
rds
us
ed
Time 1
Time 2
Time 3
![Page 38: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/38.jpg)
38
Results
2c. Frog stories – story size
![Page 39: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/39.jpg)
39
Results
2c. Frog stories – the main difference
![Page 40: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/40.jpg)
40
OLYMPUS DSS File
OLYMPUS DSS File
Listen & compare
Which Frog story is T1, and which is T3?
From same userJust above average use-record Francophone
but no code-switching issue
Press on to see VP-Kids profiles
![Page 41: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/41.jpg)
41
Results - 2e. Example
OLYMPUS DSS File
![Page 42: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/42.jpg)
42
Results – 2f. Example
OLYMPUS DSS File
![Page 43: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/43.jpg)
43
Results – Frog stories - Summary Initial state: No significant difference (n.s.d.)
- In # families used - In # tokens (=story size)
Baseline (602, T1-T2): n.s.d.
Following game use
Despite variance:- Average 3 new word families- Average 35 more word tokens- Average 45% reduction
in # of L1 words used
![Page 44: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/44.jpg)
44
Results 3
3. Access – number of words read in 1 min.
![Page 45: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/45.jpg)
45
Results3. Access – number of words read in 1 min.
![Page 46: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/46.jpg)
46
Results – Lexical access - Summary Initial state: No significant difference (n.s.d.)
Baseline (602, T1-T2): Small but sig gains *
Practice effect
Following game useDespite variance:
- Av. 23 more words read/minute- Statistically significant **
![Page 47: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/47.jpg)
47
Results 4– qualitative + post-hoc
4a. Beyond our means
![Page 48: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/48.jpg)
48
Results – qualitative + post-hoc
4b. Winning profiles
![Page 49: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/49.jpg)
49
Results – qualitative + post-hoc4b. Winning conditions
![Page 50: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/50.jpg)
50
Are more word meanings known both immediately + after delay
Are more words used in oral production
Are words accessed more quickly?
Research Questions
Following substantial use of the game…
![Page 51: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/51.jpg)
51
For this population, results are significantly and meaningfully positive on all three measures
Esp. compared to baselines e.g., Milton & Meara (1995): 550 wds/yr
in classroom on recognition measure
But paradoxical
Lexical development is at opposite ends of the spectrum Recognition – gains throughout first 5k Production – gains in first 250 words
Conclusions
![Page 52: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/52.jpg)
52
Source of productive gains unclear Learning or activation of existing knowledge?
Apparent confirmation that lexical access is trainable Small effect for practice with format; big effect for time-
pressure processing• As known since SkiJump days but never widely exploited
First successful use of Levels Test as pre-post measure
Unsurprising since game and test derive from same wordlists
Conclusions 2
![Page 53: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/53.jpg)
53
Significant prior vocab knowledge from somewhere 2350 known words at pretest
… but not in use
Frog stories of 100 toks / 40 fams• (cf. age 6 NS: 350 toks / 91 fams,)
… and distributed so that half the words are unknown at key 1k + 2k levels (# 32)
• Which explains weak reading levels• Which reflects neglect of lexis in MEQ curriculum
Conclusions 3 – Interesting portrait of Quebec ESL learner
![Page 54: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/54.jpg)
54
Can Word Coach compensate for any of this?
Effects of moderate-to-heavy users of the game
Word knowledge: 1k and 2k levels rise to equivalent age native speaker (NS) levels (80% plus)
Word use: Story size of 250 word, pushing age= NS average of 350
Access: 85 words read aloud/minute is approaching NS average of 110
A lot of compensation in a short time!
Conclusions 3 – Interesting portrait of Quebec ESL learner
![Page 55: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/55.jpg)
55
Two possible directions
1) More of the same
Game 2 which extends Word Coach approach into collocation, context, idioms, specialized domains
2) Integration of Word Coach principles (whole lexicon, sequence, recycle, review) into a full adventure narrative
“Look out ! They’re shooting from the balcony !!”
Next steps for Word Coach
![Page 56: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/56.jpg)
56“Look out – the other one’s in a garbage can!”
![Page 57: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/57.jpg)
57
Further reading 1 Frequency lists
– Leech et al, Word Frequencies in Written & Spoken English
Lemmatization procedures– Nation, unpublished
20k as size of adult educated lexicon– Goulding, Nation & Read (1990)
Yes-No Test– Buxton & Meara (1987)
Spaced recycling– Mondria & Mondria-Wit de Boer (1993)
Reaction-time & practice– Snellings, van Geldeen, & de Glopper (2002)
Easy and hard spelling– Connor (c.1986), N. Ellis (c.1996), Cognitive processes
in spelling
![Page 58: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/58.jpg)
58
Further reading 2 Baseline 550 words/year classroom
– Milton & Meara Pet-200 study
– Cobb, 1997 PET-2000 study
– Cobb, 1999a+b Francophones and cognates in Levels test
– Cobb 2000 Notion of a fixed order of lex growth
– Biemiller and Slonim, 200x Need for delayed post in vocab studies
– Cobb, 1999b
![Page 59: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/59.jpg)
59
Goulden, R., Nation, P., & Read, J.(1990). How large can a receptive vocabulary be? Applied Linguistics 11, 341-358.
Meara, P., & Buxton, B. (1987). An alternative to multiple choice vocabulary tests. Language Testing 4, 142-154.
Nation, P. (2007). How large a vocabulary is needed for reading and listening? Canadian Modern Language Review 63 (1), 1-12.
Mondria, J.-A. & Mondria-De Vries, S.(1993). Efficiently memorizing words with the help of word cards and 'hand computer': Theory and applications. System 22, 47-57.
Snellings, P., van Gelderen, A,, & de Glopper, K. (2002). Lexical retrieval: An aspect of fluent second language production that can be enhanced. Language Learning 52 (4), 723-754.
![Page 60: Word Coach - Pitt Sept 08](https://reader036.vdocuments.site/reader036/viewer/2022062319/557c21c6d8b42aa77f8b4664/html5/thumbnails/60.jpg)
60
Cobb, T. (2000). One size fits all? Francophone learners and English vocabulary tests. Canadian Modern Language Review, 57 (2), 295-324.
Cobb, T. (1999a). Applying constructivism: A test for the learner-as-scientist. Educational Technology Research & Development, 47 (3), 15-33
Cobb, T. (1999b). Breadth and depth of vocabulary acquisition with hands-on concordancing. Computer Assisted Language Learning 12, p. 345 - 360.
Cobb, T. (1997). Is there any measurable learning from hands-on concordancing? System 25 (3), 301-315.
This PPT at http://www.lextutor.ca/cv/ppt/pittsburgh.ppt