1

Computational Linguistics

Computational Linguistics

Ling 200Spring 2006

2

Speech and language processing

Speech and language processing

•Computational Linguistics use of computers to facilitate linguistic research

•Natural Language Processing computer-natural language interface applications

3

Combines disciplinesCombines disciplines

•Linguistics e.g. grammar engineering

•Electrical Engineering e.g. speech recognition

•Computer science e.g. machine translation

•Psychology e.g. cognitive modeling

4

2 Minute question (part 1)

2 Minute question (part 1)

List the specific language related skills HAL exhibits.

In other words, list the different abilities the computer (HAL) must have to display human-like language?

5

QuickTime™ and aH.263 decompressor

are needed to see this picture.

6

Today’s goalsToday’s goals

•Convey: some areas of research some of the difficulties involved some development strategies

•Provide examples of particular technologies as illustration

7

Computerized natural language

Computerized natural language

•speech recognition•language understanding•language generation•speech synthesis

8

Other areas of interest

Other areas of interest

• searching understanding search request finding relevant documents ordering by degree of relevance

• information extraction retrieving information from documents

• data mining discovering patterns and relationships in data

9

...and still more topics

...and still more topics

•machine translation http://babelfish.altavista.com http://www.google.com/translate

•summarization•grammar checking •spell checking

10

Commonly used toolsCommonly used tools

•formal rule systems•computational search algorithms•formal logic•probability theory•machine learning techniques

11

Speech Recognition Demo

Speech Recognition Demo

Software Used:iListen from MacSpeech

12

What is Speech Recognition?

What is Speech Recognition?

• Definition: Speech recognition turns acoustic input into strings of phonemes and then finds the best matching word in a database. Can be built for open domain use, theoretically recognizing all possible strings of words• e.g. dictation systems

Can also be built for a particular domain, recognizing small, finite sets of utterances • e.g. automated call-centers.

13

Speech RecognitionAcoustic Model

Speech RecognitionAcoustic Model

• First, the continuous speech signal is broken up into short segments.

• Segments are analyzed into features, which you can think of as quantitative versions of the phonetic features you learned in class.

• By comparing segments against internally stored phonological model, well matched phonemes are proposed for each segment

• End up with a list of most likely phoneme sequences.

14

Speech RecognitionLanguage Model

Speech RecognitionLanguage Model

• Sequences of phonemes are verified by comparing with a database of words and their likelihoods (in real time), and only actual words and phrases are accepted [rɛkənajspič]

• [rɛkənajspič]• ‘recognize speech’

[rɛkənajspiš] • [rɛkənajspiš]• ??‘recognize speesh’

*Fast speech: [z] -> [s] / _[s]

15

Problems Acoustic Model

Problems Acoustic Model

• Recognizing different voice qualities as the same basic sounds.

• You can think of this as choosing the correct phoneme. Phonemes sound different (allophones), depending on

their environments. • word position: /p/ --> [ph] / #_• assimilation: /z/ --> [s] / _C [-voice]• deletion: [s] --> ø / _[s]

“Three cats sit.”

• Speech signal is continuous and full of non-speech noise.

16

ProblemsAmbiguityProblemsAmbiguity

•Same or very similar sequence of phonemes can correspond to multiple words or phrases Homophones

•Words [dir] ‘deer’ ‘dear’

•Phrases (remember there is no pause to separate word boundaries)

[rɛkənajspič] ‘recognize speech’ [rɛkənajspič] ‘wreck a nice beach’

17

Potential FixLanguage ModelPotential FixLanguage Model

• Weight word/phrase interpretations (statistical language modeling)

• Lexical: Consider how often a word actually occurs. [dir] ‘deer’ (50) ‘dear’ (215)

• Choose most frequent, in this case ‘dear’

• Condition on context: Consider how often a word occurs within a particular context.

• I just shot a [dir]. (shot, a, dear) 1 (shot, a, deer) 10

• In this case, ‘deer’ occurs more frequently in this environment, so we choose ‘deer’ as our interpretation.

18

DemoTraining Data Matters

DemoTraining Data Matters

• Word and context frequencies are not just pulled from thin air.

• Frequencies are calculated (training) From some collection of text (a corpus).

• Speech recognizers often train on a user’s emails and documents, to better match the user’s lexical choice and phrase patterns.

• This training data helps decipher homophonous strings (strings that are acoustically ambiguous).

19

Demo 2Training Data Matters

Demo 2Training Data Matters

•I will attempt to utter the following phrase and iListen should transcribe my speech.

•It’s hard to… [rɛkənajspič] ‘recognize speech’ [rɛkənajspič] ‘wreck a nice beach’

20

Demo 3 LinguistDemo 3

Linguist• What if software is trained for a Computational Linguist? Trained on 3 Wikipedia articles about various topics in Computational Linguistics

Which interpretation should we expect, based on words and phrases likely to be present in computational linguistics documents?

Results:Is hard to recognize speech New set the state

but is so bad and found a 544 is no sound better, even so it is etc is not really that bad so at and his exist listening to 89, Nancy of

21

Demo 4 Beach BumDemo 4

Beach Bum• What if software is trained for a Beach Bum? Trained on 3 Wikipedia articles on beach topics.

Which interpretation should we expect, based on frequent words and phrases likely to be found in beach-related documents?

Results:It’s hard to wreck nice beach and

22

Language understandingLanguage understanding

•morphology•syntax•semantics•pragmatics•discourse

23

"I made her duck.”"I made her duck.”

•I cooked waterfowl for her•I cooked waterfowl belonging to her•I created the (plaster?) duck she owns

•I caused her to quickly lower her head or body

•I waved my magic wand and turned her into undifferentiated waterfowl

24

Language generationLanguage generation

“I'm sorry, Dave, I'm afraid I can't do that”

pragmatics:•politeness•indirect speech

morphology: •contractions

discourse: •reference (“that”)

25

Who/what is ELIZA?Who/what is ELIZA?

26

Dialogue systems - issues

Dialogue systems - issues

•HAL has complete understanding - How close are we to this?

•Eliza had no semantic understanding and only minimal syntactic knowledge

•dialogue systems: effective in limited domains like travel

27

Dialogue systems: demoDialogue systems: demo

[David]

•Chatbot website: http://daden.co.uk/chatbots/

28

2 minute question (part 2)

2 minute question (part 2)

•Do you think that HAL quality computer communication is a reasonable expectation?

•Why or why not?