Paper Info
Title
Fine-Grained Analysis Of Language Varieties And Demographics
Abstract
The rise of social media empowers people to interact and communicate with anyone anywhere in the world. The possibility of being anonymous avoids censorship and enables freedom of expression. Nevertheless, this anonymity might lead to cybersecurity issues, such as opinion spam, sexual harassment, incitement to hatred or even terrorism propaganda. In such cases, there is a need to know more about the anonymous users and this could be useful in several domains beyond security and forensics such as marketing, for example. In this paper, we focus on a fine-grained analysis of language varieties while considering also the authors' demographics. We present a Low-Dimensionality Statistical Embedding method to represent text documents. We compared the performance of this method with the best performing teams in the Author Profiling task at PAN 2017. We obtained an average accuracy of 92.08% versus 91.84% for the best performing team at PAN 2017. We also analyse the relationship of the language variety identification with the authors' gender. Furthermore, we applied our proposed method to a more fine-grained annotated corpus of Arabic varieties covering 22 Arab countries and obtained an overall accuracy of 88.89%. We have also investigated the effect of the authors' age and gender on the identification of the different Arabic varieties, as well as the effect of the corpus size on the performance of our method.
Year
DOI
Venue
2020
10.1017/S1351324920000108
NATURAL LANGUAGE ENGINEERING
Keywords
DocType
Volume
Language variety identification, Demographics, Gender, Age, Author profiling, Cybersecurity, Arabic
Journal
26
Issue
ISSN
Citations 
6
1351-3249
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Francisco M. Rangel Pardo19716.73
paolo rosso21831188.74
Wajdi Zaghouani319721.27
Anis Charfi466348.32