Title
A Lexical Distance Study of Arabic Dialects.
Abstract
Diglossia is a very common phenomenon in Arabic-speaking communities, where the spoken language is different from both Classical Arabic (CA) and Modern Standard Arabic (MSA). The spoken language is characterised as a number of dialects used in everyday communication as well as informal writing. In this paper, we highlight the lexical relation between the MSA and Dialectal Arabic (DA) in more than one Arabic region. We conduct a computational cross dialectal lexical distance study to measure the similarities and differences between dialects and the MSA. We exploit several methods from Natural Language Processing (NLP) and Information Retrieval (IR) like Vector Space Model (VSM), Latent Semantic Indexing (LSI) and Hellinger Distance (HD), and apply them on different Arabic dialectal corpora. We measure the overlap among all the dialects and compute the frequencies of the most frequent words in every dialect. The results are informative and indicate that Levantine dialects are very similar to each other and furthermore, that Palestinian appears to be the closest to MSA.
Year
DOI
Venue
2018
10.1016/j.procs.2018.10.456
Procedia Computer Science
Keywords
Field
DocType
Diglossia,Lexical Distance,Vector Space Model,Latent Semantic Indexing,Hellinger Distance
Latent semantic indexing,Hellinger distance,Arabic,Classical Arabic,Computer science,Modern Standard Arabic,Diglossia,Artificial intelligence,Vector space model,Linguistics,Machine learning,Spoken language
Conference
Volume
ISSN
Citations 
142
1877-0509
1
PageRank 
References 
Authors
0.37
5
4
Name
Order
Citations
PageRank
Kathrein Abu Kwaik110.70
Motaz Saad2395.21
Stergios Chatzikyriakidis3329.87
Simon Dobnik4784.02