finding entries in an on-line arabic dictionary
DESCRIPTION
Finding Entries in an On-line Arabic Dictionary. 27 May 2010 27 th Annual HCIL Symposium Sarah C. Wayland, C. Anton Rytting, David Zajic, Timothy Buckwalter, Jason White, Corey Miller, Jeffrey Carnes, Nathanael Lynn, Paul Rodrigues, Michael Maxwell, Evelyn Browne. Arabic is not English. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/1.jpg)
Finding Entries in an On-line Arabic Dictionary
27 May 2010
27th Annual HCIL Symposium
Sarah C. Wayland, C. Anton Rytting, David Zajic, Timothy Buckwalter, Jason White, Corey Miller, Jeffrey Carnes, Nathanael Lynn, Paul Rodrigues, Michael Maxwell, Evelyn Browne
![Page 2: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/2.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Arabic is not English
• Different sounds (e.g., voiceless uvular /q/, retroflex /l/, voiced velar fricative /gh/, glottal stop / ‘ /)
• Different letters (مباريات)
• Different morphology (templatic vs. affixative)
• Written form doesn’t reflect spoken dialect
• Keyboard has different layout/letters
2
![Page 3: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/3.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Many informal texts diverge from Modern Standard Arabic
Texts differ from classroom Arabic in orthography, morphology, and lexical content.
![Page 4: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/4.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Many informal texts diverge from Modern Standard Arabic
Texts differ from classroom Arabic in orthography, morphology, and lexical content.
Orthographic differences are based on dialect pronunciations, typographical errors, and ... “style.”
![Page 5: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/5.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Orthographic Differences
Dialect SATTS (no vowels)
Native (no vowels)
MSA (Modern Standard Arabic) KLB لبكIraqi (with Persian character)
#CLB
J-LB لبچ
Iraqi (with MSA character) JLB لبج
Some dialects use non-standard characters
![Page 6: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/6.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Many informal texts diverge from Modern Standard Arabic
Texts differ from classroom Arabic in orthography, morphology, and lexical content.
Orthographic differences are based on dialect pronunciations, typographical errors, and ... “style.”
![Page 7: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/7.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Many informal texts diverge from Modern Standard Arabic
Texts differ from classroom Arabic in orthography, morphology, and lexical content.
Orthographic differences are based on dialect pronunciations, typographical errors, and ... “style.”
![Page 8: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/8.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Many informal texts diverge from Modern Standard Arabic
Texts differ from classroom Arabic in orthography, morphology, and lexical content.
Orthographic differences are based on dialect pronunciations, typographical errors, and ... “style.”
![Page 9: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/9.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Phonetic Differences
ق Educated Urban (MSA) لبق
qlb /qalb/
گ Iraq لبگ
glb /gaLub/
غ Sudan لبغ
qhlb /ghaLib/
أ Cairo لبأ
’lb /’alb/
Consonants sometimes vary across dialects
![Page 10: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/10.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Morphologically Complex
qalub* قلب “heart”
قلبال Al-qalb “the-heart”
بوقل *quluwb “hearts”
وقلالب
Al-quluwb “the-hearts”
يقلب qalb-iy “my-heart”
نابوقل quluwb-naA “our-hearts”
كقلب qalb-ak “your-heart (to a man)”
كقلب qalb-ik “your-heart (to a woman)”
بيقل qulayb “little heart”
* (the only forms listed in the dictionary)
![Page 11: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/11.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
![Page 12: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/12.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
Adjacent letters are often visually similar
![Page 13: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/13.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
Adjacent letters are often visually similar
![Page 14: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/14.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
Adjacent letters are often visually similar
![Page 15: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/15.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
Adjacent letters also often sound similar (with contrasts not found in English)
![Page 16: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/16.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
Adjacent letters also often sound similar (with contrasts subject to place-assimilation)
![Page 17: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/17.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
The Arabic keyboard makes difficult-to-detect typos likely
Adjacent letters also often sound similar (particularly so in some dialect pronunciations)
![Page 18: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/18.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Putting DYM…? together• A query is checked by
composing a single-string finite state automaton (FSA) with: – weighted keyboard, visual,
and sound-based FSTs – a dictionary FSA (with
weights for dialect variants)
• The n-best paths yielding unique strings are calculated
• The corresponding strings are displayed to the user
Rر
Hح
Aا
Bب
sound-basedkeyboard
HARB, ?ARB, OARB, ....
visual
![Page 19: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/19.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION19
![Page 20: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/20.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION20
![Page 21: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/21.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION21
![Page 22: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/22.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION22
![Page 23: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/23.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION23
![Page 24: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/24.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION24
![Page 25: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/25.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION25
Show verbs Show non-verbs
![Page 26: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/26.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION26
Download Results
![Page 27: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/27.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION27
![Page 28: Finding Entries in an On-line Arabic Dictionary](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f55550346895daa16e1/html5/thumbnails/28.jpg)
LANGUAGE RESEARCH IN SERVICE TO THE NATION
Arabic is not English!
• One user interface for all languages will not work
• We must customize the user interface to take into account the unique structure of each language
28